Commit Graph

148 Commits

Author SHA1 Message Date
Peter Parente
ba6723edf1 Merge branch 'master' into remove-mesos 2020-05-27 16:05:31 -04:00
Ayaz Salikhov
9096270368 Print image size in manifest 2020-05-26 15:07:25 +02:00
Peter Parente
bbbabd22a3 Update comments to remove mesos references 2020-05-25 12:25:47 -04:00
Peter Parente
3ccbfa0c7e Remove mesos.key 2020-05-25 12:25:38 -04:00
Travis CI
44a7d70805 Remove mesos lib from pyspark-notebook 2020-05-24 14:18:47 -04:00
Peter Parente
18bb3a4b8b Merge branch 'master' into fix-pyspark 2020-02-15 20:18:46 -05:00
Peter Parente
4a8b58a41b Test payspark import 2020-02-15 19:08:40 -05:00
Peter Parente
3aa61f94c2 Split SPARK_HOME definition from other env vars 2020-02-15 18:53:51 -05:00
romainx
4333c7cc14 fix as_json param 2020-02-13 13:02:37 +01:00
romainx
7f7be5707c spark mirror improvement 2020-02-13 12:00:41 +01:00
romainx
8b3ce5cfa6 Change spark mirror 2020-02-13 11:21:54 +01:00
romainx
45d51e3b42 Bump to spark 2.4.5 + minor improvements 2020-02-11 21:30:47 +01:00
Peter Parente
171ba82a30 Fix ssh key format
New Docker Hub UI loses newlines in the env
var settings. Loss of new lines leads ssh-add
to prompt and fail when loading the key.

Base64 encode and decode the key to workaround
the limitation.
2020-01-29 09:37:04 -05:00
Manny Cato
1089ae349c Address updating spark version to fix wget error 2019-09-10 16:25:27 -07:00
Peter Parente
411ec857bb Update to Spark 2.4.3 2019-05-11 19:27:53 -04:00
echowhisky
167c686011 Merge branch 'master' into issue-861
Resolved conflicts between local branch and updates to the upstream
master.
2019-05-06 18:46:51 +00:00
echowhisky
40c5c07b0a added -f flag to all conda clean commands
This commit adds the additional `-f` force command to all uses of `conda
clean --all` through the repo. Size should be smaller, but still testing
if anything breaks. See issue #861.
2019-05-04 19:11:32 +00:00
echowhisky
1f8311a7aa changed -tipsy to --all -y across all files
The last commit was only for the base-notebook's Dockerfile. For this,
all the files in the repo were grepped through and changed.
2019-05-04 18:53:49 +00:00
Peter Parente
825166612c Update to Spark 2.4.2 2019-04-25 10:06:50 -07:00
Peter Parente
32240517eb Update checksum for spark 2.4.1
https://www.apache.org/dist/spark/spark-2.4.1/spark-2.4.1-bin-hadoop2.7.tgz.sha512
2019-04-10 09:30:59 -04:00
Peter Parente
8cea451451 Update to Spark 2.4.1
The mirror we prefer no longer has 2.4.0
2019-04-10 00:05:55 -04:00
Peter Parente
f3da6c276a [ci skip] stderr when no tty 2019-03-18 22:32:25 -04:00
Peter Parente
657f8a095a [ci skip] Prefer SPARK_HOME 2019-03-17 10:17:06 -04:00
Peter Parente
4abdeee523 [ci skip] Fix spark version check
Not in PATH
2019-03-17 10:05:48 -04:00
Peter Parente
76853d93ed [ci skip] Escape those backticks 2019-03-16 22:38:40 -04:00
Peter Parente
4667cffc41 [ci skip] List full image name and tag 2019-03-16 22:31:10 -04:00
Peter Parente
3339b63abf [ci skip] Add row to build index after every image push 2019-03-16 22:03:59 -04:00
Peter Parente
243da296a1 [ci skip] Add language versions, conda info, fix spark info 2019-03-16 22:03:54 -04:00
Peter Parente
10c58da405 [ci skip] Add package manifest support
Generates manifest pages and pushes them
to the docker-stacks GitHub wiki.
Does not update a global index of all builds yet.
2019-03-15 16:08:27 -04:00
Tim Ryan
3fc28b67e0 Remove apt-get clean command. Unecessary on official Ubuntu images. 2018-12-17 10:40:58 -05:00
borregore
f4f24a3e63 Update Dockerfile 2018-11-14 11:06:44 -07:00
borregore
46dbe75904 Update Dockerfile 2018-11-14 10:26:12 -07:00
Peter Parente
313453504d Keep py4j-0.10.7-src.zip 2018-11-09 23:43:03 -05:00
Javier Ivan Venegas Carrillo
777eec10c3 Update for test with py4j update for test 2018-11-08 17:29:03 -07:00
Javier Ivan Venegas Carrillo
dd3a198922 Update for test with py4j update 2018-11-08 17:04:10 -07:00
Javier Ivan Venegas Carrillo
5162984d02 Update for test 2018-11-08 16:41:04 -07:00
Javier Ivan Venegas Carrillo
c9bd0ff317 Bumped Spark to 2.4.0 adn py4j to 0.10.8.1 2018-11-08 16:29:41 -07:00
Peter Parente
f2889d7ae7 Merge pull request #731 from graemes/from-arg
Convert FROM specification to ARG (#727)
2018-10-23 22:01:53 -04:00
Michael Delgado
4462b5eb7b point readme badges to dockerhub in pyspark-notebook
* status, pulls badges now point to https://hub.docker.com/r/jupyter/pyspark-notebook/
* microbadger badges now have 'image metadata' alt text
2018-10-20 12:39:55 -07:00
graemes
1d763bbac5 Convert FROM specification to ARG (#727) 2018-10-19 18:52:27 +01:00
Stefan Proell
1584606a40 Adds config file initialization
Adds the initial creation of the configuration file
jupyter_notebook_config.json to the image. This file
was missing as reported in issue #639 and caused an
error when trying to set a new password via the Web
interface.

Bumps the version of Jupyter Notebook to 5.6

Updates Apache Mirror URL because the current causes build timeouts

The mirror used now (mirrors.ukfast.co.uk) is fast enough and does not
point to an ad site and is already used in a different Dockerfile within
this repository.
2018-07-19 10:17:50 +02:00
Darek
9f2072b8e6 Bumped Spark to 2.3.1 2018-06-13 14:39:25 +00:00
Braden Pellett
9a48f4cf65 Add Mesos GPG key
Add Mesos GPG key since accessing the keyserver seems to be flaky:
https://github.com/docker-library/official-images/issues/4252#issuecomment-381783035
2018-06-01 13:03:12 -07:00
Braden Pellett
ac04480084 Upgrade Ubuntu to latest LTS (Bionic 18.04)
Upgrade Ubuntu to latest LTS (Bionic 18.04), including:
- Change the IMAGE used for base-notebook;
- Keep Mesos install from Mesosphere's Xenial repository, since they
  don't yet have a Bionic repository;
- gnupg needs to be installed for apt-key to work;
- --force-yes option to apt-get has been removed;
- Package libav-tools is replaced by ffmpeg;
- Update Let's Encrypt example script to use 18.04.
2018-06-01 13:03:12 -07:00
Peter Parente
2b33e23bb7 Make RTD the doc source of truth 2018-05-20 16:15:06 -04:00
Jay Qi
7c6bf72ced Added conda clean. Addresses #627 2018-05-05 12:22:43 -05:00
Peter Parente
e2798680b0 Merge pull request #600 from taqtiqa-mark/patch-1
Keyserver pool
2018-04-15 22:21:03 -04:00
Peter Parente
22d38bad00 Fix pyarrow install
Need to install as NB_UID, not root, to keep all /opt/conda
folders writeable by the default user
2018-04-07 23:16:33 -04:00
Mark Van de Vyver
0344fd393d Keyserver used in Hashicorps Nomad files
Keyserver used in Hashicorps Nomad files
2018-04-04 21:40:08 +10:00
Min RK
8d9388cac5 Merge pull request #596 from clkao/start-notebook.d
Run additional scripts in /usr/local/bin/start-notebook.d/
2018-04-02 10:44:39 +02:00