romainx
0f2a7473c4
Regular update
2020-11-05 20:55:18 +01:00
romainx
4271b09b33
rollback pyarrow update
2020-10-20 12:10:36 +02:00
romainx
32090f6011
Update docker stack 2020-11-20
...
The following changes have been made.
- `base-notebook`
- `Changed`: Bump Ubuntu
- `Changed`: Bump conda
- `Fixed`: Add missing `apt-get clean`
- `minimal-notebook`
- `Removed`: `jed` editor see #1174 (partial)
- `Deprecated`: `emacs` editor (in the documentation and in the image) see #1174 (partial)
- `scipy-notebook`
- `Fixed`: Add missing `apt-get clean`
- `Changed`: Bump `dask`
- `Changed`: Bump `protobuf`
- `r-notebook`
- `Changed`: Bump `r-base`
- `Changed`: Bump `r-rmarkdown`
- `Removed`: The description of `tidyverse` packages because it's not the place to do that and it will always be obsolete.
- `datascience-notebook`
- `Changed`: Bump `r-base` to `4.0.x` see #1102 (partial)
- `Removed`: `plyr` package because it's retired fixes #1103
- `Removed`: `r-reshape2` package because it's retired fixes #1103
- `Changed`: Bump `r-rmarkdown`
- `Changed`: Bump Julia
- `tensorflow-notebook`
- `Changed`: Bump `tensorflow`
- `pyspark-notebook`
- `Fixed`: Add missing `apt-get clean`
- `Changed`: Bump `pyarrow`
- `all-spark-notebook`
- `Fixed`: Add missing `apt-get clean`
- `Changed`: Bump `r-base` to `4.0.x` see #1102 (partial)
- `Changed`: Bump `r-sparklyr`
2020-10-20 11:36:34 +02:00
Ayaz Salikhov
e3085ca89e
Merge branch 'master' into asalikhov/py_codestyle
2020-09-28 06:37:23 +03:00
romainx
325dd5b3e2
Fix build (hope)
...
- miniconda versions and arguments
- remove useless hd5 install (dependency of h5py)
- pin the version of pyarrow
2020-09-19 17:27:47 +02:00
romainx
384acda330
Spark 3.0.1 -> fixes #1156
2020-09-10 15:25:00 +02:00
Ayaz Salikhov
530e2b3834
Merge branch 'master' into asalikhov/py_codestyle
2020-08-16 20:02:40 +03:00
romainx
c288e77acb
Fix debug line commented
2020-08-16 17:03:10 +02:00
romainx
8669d6e79b
Resolves #1131 : Allow alternative Spark version
...
Allow to build `pyspark-notebook` image with an alternative Spark version.
- Define arguments for Spark installation
- Add a note in "Image Specifics" explaining how to build an image with an alternative Spark version
- Remove Toree documentation from "Image Specifics" since its support has been droped in #1115
2020-08-15 20:19:35 +02:00
Peter Parente
1031477369
[ci skip] Update READMEs visible on Docker Hub
2020-08-08 15:09:02 -04:00
Peter Parente
5758b59314
Fix SOURCE_COMMIT -> GITHUB_SHA references
2020-08-01 00:12:07 -04:00
Peter Parente
34e73d4f6b
Refactor wiki hooks for Actions
2020-07-30 07:49:00 -04:00
Ayaz Salikhov
94cd03d6b9
Fix python codestyle
2020-07-04 18:30:53 +02:00
Darek
568708d279
Upgrading Spark to 3.0, removing Toree
2020-06-19 00:52:51 +00:00
Romain
5e6645d137
Ignore DL3006 and DL3008 by default
2020-06-01 06:23:44 +02:00
Romain
2ce0b49fb5
Final review
2020-05-30 05:44:53 +02:00
Romain
593698985f
Fixes
2020-05-29 21:27:18 +02:00
Romain
7b48e43b74
Fix hadolint deviations
2020-05-29 19:33:24 +02:00
Peter Parente
ba6723edf1
Merge branch 'master' into remove-mesos
2020-05-27 16:05:31 -04:00
Ayaz Salikhov
9096270368
Print image size in manifest
2020-05-26 15:07:25 +02:00
Peter Parente
bbbabd22a3
Update comments to remove mesos references
2020-05-25 12:25:47 -04:00
Peter Parente
3ccbfa0c7e
Remove mesos.key
2020-05-25 12:25:38 -04:00
Travis CI
44a7d70805
Remove mesos lib from pyspark-notebook
2020-05-24 14:18:47 -04:00
Peter Parente
18bb3a4b8b
Merge branch 'master' into fix-pyspark
2020-02-15 20:18:46 -05:00
Peter Parente
4a8b58a41b
Test payspark import
2020-02-15 19:08:40 -05:00
Peter Parente
3aa61f94c2
Split SPARK_HOME definition from other env vars
2020-02-15 18:53:51 -05:00
romainx
4333c7cc14
fix as_json param
2020-02-13 13:02:37 +01:00
romainx
7f7be5707c
spark mirror improvement
2020-02-13 12:00:41 +01:00
romainx
8b3ce5cfa6
Change spark mirror
2020-02-13 11:21:54 +01:00
romainx
45d51e3b42
Bump to spark 2.4.5 + minor improvements
2020-02-11 21:30:47 +01:00
Peter Parente
171ba82a30
Fix ssh key format
...
New Docker Hub UI loses newlines in the env
var settings. Loss of new lines leads ssh-add
to prompt and fail when loading the key.
Base64 encode and decode the key to workaround
the limitation.
2020-01-29 09:37:04 -05:00
Manny Cato
1089ae349c
Address updating spark version to fix wget error
2019-09-10 16:25:27 -07:00
Peter Parente
411ec857bb
Update to Spark 2.4.3
2019-05-11 19:27:53 -04:00
echowhisky
167c686011
Merge branch 'master' into issue-861
...
Resolved conflicts between local branch and updates to the upstream
master.
2019-05-06 18:46:51 +00:00
echowhisky
40c5c07b0a
added -f
flag to all conda clean
commands
...
This commit adds the additional `-f` force command to all uses of `conda
clean --all` through the repo. Size should be smaller, but still testing
if anything breaks. See issue #861 .
2019-05-04 19:11:32 +00:00
echowhisky
1f8311a7aa
changed -tipsy
to --all -y
across all files
...
The last commit was only for the base-notebook's Dockerfile. For this,
all the files in the repo were grepped through and changed.
2019-05-04 18:53:49 +00:00
Peter Parente
825166612c
Update to Spark 2.4.2
2019-04-25 10:06:50 -07:00
Peter Parente
32240517eb
Update checksum for spark 2.4.1
...
https://www.apache.org/dist/spark/spark-2.4.1/spark-2.4.1-bin-hadoop2.7.tgz.sha512
2019-04-10 09:30:59 -04:00
Peter Parente
8cea451451
Update to Spark 2.4.1
...
The mirror we prefer no longer has 2.4.0
2019-04-10 00:05:55 -04:00
Peter Parente
f3da6c276a
[ci skip] stderr when no tty
2019-03-18 22:32:25 -04:00
Peter Parente
657f8a095a
[ci skip] Prefer SPARK_HOME
2019-03-17 10:17:06 -04:00
Peter Parente
4abdeee523
[ci skip] Fix spark version check
...
Not in PATH
2019-03-17 10:05:48 -04:00
Peter Parente
76853d93ed
[ci skip] Escape those backticks
2019-03-16 22:38:40 -04:00
Peter Parente
4667cffc41
[ci skip] List full image name and tag
2019-03-16 22:31:10 -04:00
Peter Parente
3339b63abf
[ci skip] Add row to build index after every image push
2019-03-16 22:03:59 -04:00
Peter Parente
243da296a1
[ci skip] Add language versions, conda info, fix spark info
2019-03-16 22:03:54 -04:00
Peter Parente
10c58da405
[ci skip] Add package manifest support
...
Generates manifest pages and pushes them
to the docker-stacks GitHub wiki.
Does not update a global index of all builds yet.
2019-03-15 16:08:27 -04:00
Tim Ryan
3fc28b67e0
Remove apt-get clean command. Unecessary on official Ubuntu images.
2018-12-17 10:40:58 -05:00
borregore
f4f24a3e63
Update Dockerfile
2018-11-14 11:06:44 -07:00
borregore
46dbe75904
Update Dockerfile
2018-11-14 10:26:12 -07:00