Commit Graph

203 Commits

Author SHA1 Message Date
Ayaz Salikhov
30a1d17085 Add a way to easily test units 2021-06-26 18:40:50 +03:00
Ayaz Salikhov
b939948a62 Update packages 2021-06-13 00:22:22 +03:00
Ayaz Salikhov
b964b90a1c Merge branch 'master' into asalikhov/update 2021-06-07 23:04:34 +03:00
Ayaz Salikhov
14e2b08a48 Revert "Test commit to dismiss review"
This reverts commit ea1a3ea02b.
2021-06-06 23:45:15 +03:00
Ayaz Salikhov
ea1a3ea02b Test commit to dismiss review 2021-06-06 23:44:32 +03:00
Ayaz Salikhov
8cf181add0 Merge branch 'master' into asalikhov/update 2021-05-29 17:36:17 +03:00
Ayaz Salikhov
0999f1a36f Unify bash variables usage and add quotes where needed 2021-05-26 13:06:10 +03:00
Ayaz Salikhov
ccebe16e6e More installation updates 2021-05-25 14:34:02 +03:00
Ayaz Salikhov
e4f41dd4e9 Use mamba clean 2021-05-25 14:02:26 +03:00
Ayaz Salikhov
19cb1cf8de Merge branch 'master' into asalikhov/update 2021-05-23 22:55:05 +03:00
Ayaz Salikhov
bb5bd0123b Improve wording 2021-05-23 15:14:15 +03:00
Ayaz Salikhov
afa7daacdf Update docs to better reflect current state 2021-05-23 15:12:07 +03:00
Ayaz Salikhov
c281c03cf7 Merge branch 'master' into asalikhov/update 2021-05-22 15:23:28 +03:00
Ayaz Salikhov
fb06310754 Use altair and mamba instead of conda 2021-05-22 14:43:18 +03:00
Ayaz Salikhov
fbceaa9892 Fixes 2021-05-22 14:01:01 +03:00
Ayaz Salikhov
dc05be8ff5 Downgrade r-base 2021-05-22 13:27:19 +03:00
Ayaz Salikhov
7b14917cb0 Update packages 2021-05-22 00:11:22 +03:00
Ayaz Salikhov
66aaa99176 Update links 2021-05-21 14:17:18 +03:00
Erik Sundell
6d832135b6 Merge pull request #1293 from mathbunnyru/asalikhov/remove_unused_file
Remove unused all-spark-notebook/kernel.json
2021-05-19 03:44:52 +02:00
Ayaz Salikhov
0d08cc0efb Remove hooks from .dockerignore 2021-05-07 14:17:40 +03:00
Ayaz Salikhov
22c0a13e3d Remove unused all-spark-notebook/kernel.json 2021-05-07 00:49:48 +03:00
Ayaz Salikhov
16ec0852c5 Merge branch 'master' into asalikhov/fix_markdown 2021-05-04 01:08:53 +03:00
Ayaz Salikhov
c2031e2a4a Fix more errors 2021-05-01 13:07:40 +03:00
Ayaz Salikhov
bf5ec600d1 Use mdlint rules [WIP] 2021-05-01 12:52:41 +03:00
Ayaz Salikhov
833e235281 Implement SparkInfoManifest 2021-04-25 12:40:48 +03:00
Ayaz Salikhov
1839a4934d Implement RPackagesManifest 2021-04-25 12:28:29 +03:00
Ayaz Salikhov
2f8934e5ac Remove unused run_hook parts 2021-04-25 12:22:00 +03:00
Ayaz Salikhov
f52987a959 Delete run_hook parts already implemented in python 2021-04-25 11:54:46 +03:00
Ayaz Salikhov
9991d6438e Delete index update from run_hook 2021-04-24 20:38:44 +03:00
Ayaz Salikhov
74fe3361d7 Merge branch 'master' into asalikhov/python_tagging 2021-04-18 11:31:23 +03:00
Ayaz Salikhov
a8b7682fd6 Add newlines 2021-04-17 18:20:37 +03:00
Ayaz Salikhov
f8d21532ee Remove docker tag from run_hook 2021-03-22 13:36:32 +03:00
romainx
d0e066e116 Regular update 2021-03-17 2021-03-17 22:13:19 +01:00
Romain
d113a601db Merge pull request #1198 from romainx/fix_spark_java11
Fix spark installation for Java 11 and Arrow
2020-12-26 17:22:44 +01:00
romainx
daff4686e8 Fix .dockerignore by adding default hooks + test dirs 2020-12-20 05:47:12 +01:00
romainx
1dd95bad2c Fix spark installation for Java 11 and Arrow 2020-12-13 11:58:46 +01:00
romainx
86523f0619 Regular update + improvements 2020-12-01 22:05:21 +01:00
romainx
32090f6011 Update docker stack 2020-11-20
The following changes have been made.

- `base-notebook`
  - `Changed`: Bump Ubuntu
  - `Changed`: Bump conda
  - `Fixed`: Add missing `apt-get clean`
- `minimal-notebook`
  - `Removed`: `jed` editor see #1174 (partial)
  - `Deprecated`: `emacs` editor (in the documentation and in the image) see #1174 (partial)
- `scipy-notebook`
  - `Fixed`: Add missing `apt-get clean`
  - `Changed`: Bump `dask`
  - `Changed`: Bump `protobuf`
- `r-notebook`
  - `Changed`: Bump `r-base`
  - `Changed`: Bump `r-rmarkdown`
  - `Removed`: The description of `tidyverse` packages because it's not the place to do that and it will always be obsolete.
- `datascience-notebook`
  - `Changed`: Bump `r-base` to `4.0.x` see #1102 (partial)
  - `Removed`: `plyr` package because it's retired fixes #1103
  - `Removed`: `r-reshape2` package because it's retired fixes #1103
  - `Changed`: Bump `r-rmarkdown`
  - `Changed`: Bump Julia
- `tensorflow-notebook`
  - `Changed`: Bump `tensorflow`
- `pyspark-notebook`
  - `Fixed`: Add missing `apt-get clean`
  - `Changed`: Bump `pyarrow`
- `all-spark-notebook`
  - `Fixed`: Add missing `apt-get clean`
  - `Changed`: Bump `r-base` to `4.0.x` see #1102 (partial)
  - `Changed`: Bump `r-sparklyr`
2020-10-20 11:36:34 +02:00
Ayaz Salikhov
530e2b3834 Merge branch 'master' into asalikhov/py_codestyle 2020-08-16 20:02:40 +03:00
Peter Parente
1031477369 [ci skip] Update READMEs visible on Docker Hub 2020-08-08 15:09:02 -04:00
Peter Parente
5758b59314 Fix SOURCE_COMMIT -> GITHUB_SHA references 2020-08-01 00:12:07 -04:00
Peter Parente
d2cb805740 Clean up hook debugs, leftovers 2020-07-30 07:50:23 -04:00
Peter Parente
34e73d4f6b Refactor wiki hooks for Actions 2020-07-30 07:49:00 -04:00
Ayaz Salikhov
e28a197b41 Fix 2020-07-04 20:33:55 +02:00
Ayaz Salikhov
b1e4688d5c Add automatic checks 2020-07-04 19:06:21 +02:00
Darek
568708d279 Upgrading Spark to 3.0, removing Toree 2020-06-19 00:52:51 +00:00
Romain
5e6645d137 Ignore DL3006 and DL3008 by default 2020-06-01 06:23:44 +02:00
Romain
7b48e43b74 Fix hadolint deviations 2020-05-29 19:33:24 +02:00
Romain
c83024c950 Add spark notebook tests and change examples
* Test added for all kernels
* Same examples as provided in the documentation (`specifics.md`)
* Used the same use case for all examples: sum of the first 100 whole numbers

Note: I've not automatically tested `local_sparklyr.ipynb` since it creates by default the `metastore_db` dir and the `derby.log` file in the working directory. Since I mount it in `RO` it's not working. I'm struggling to set it elsewhere...
2020-05-29 06:54:46 +02:00
Peter Parente
ba6723edf1 Merge branch 'master' into remove-mesos 2020-05-27 16:05:31 -04:00