Commit Graph

67 Commits

Author SHA1 Message Date
Tim Ryan
3fc28b67e0 Remove apt-get clean command. Unecessary on official Ubuntu images. 2018-12-17 10:40:58 -05:00
borregore
f4f24a3e63 Update Dockerfile 2018-11-14 11:06:44 -07:00
borregore
46dbe75904 Update Dockerfile 2018-11-14 10:26:12 -07:00
Peter Parente
313453504d Keep py4j-0.10.7-src.zip 2018-11-09 23:43:03 -05:00
Javier Ivan Venegas Carrillo
777eec10c3 Update for test with py4j update for test 2018-11-08 17:29:03 -07:00
Javier Ivan Venegas Carrillo
dd3a198922 Update for test with py4j update 2018-11-08 17:04:10 -07:00
Javier Ivan Venegas Carrillo
5162984d02 Update for test 2018-11-08 16:41:04 -07:00
Javier Ivan Venegas Carrillo
c9bd0ff317 Bumped Spark to 2.4.0 adn py4j to 0.10.8.1 2018-11-08 16:29:41 -07:00
graemes
1d763bbac5 Convert FROM specification to ARG (#727) 2018-10-19 18:52:27 +01:00
Stefan Proell
1584606a40 Adds config file initialization
Adds the initial creation of the configuration file
jupyter_notebook_config.json to the image. This file
was missing as reported in issue #639 and caused an
error when trying to set a new password via the Web
interface.

Bumps the version of Jupyter Notebook to 5.6

Updates Apache Mirror URL because the current causes build timeouts

The mirror used now (mirrors.ukfast.co.uk) is fast enough and does not
point to an ad site and is already used in a different Dockerfile within
this repository.
2018-07-19 10:17:50 +02:00
Darek
9f2072b8e6 Bumped Spark to 2.3.1 2018-06-13 14:39:25 +00:00
Braden Pellett
9a48f4cf65 Add Mesos GPG key
Add Mesos GPG key since accessing the keyserver seems to be flaky:
https://github.com/docker-library/official-images/issues/4252#issuecomment-381783035
2018-06-01 13:03:12 -07:00
Braden Pellett
ac04480084 Upgrade Ubuntu to latest LTS (Bionic 18.04)
Upgrade Ubuntu to latest LTS (Bionic 18.04), including:
- Change the IMAGE used for base-notebook;
- Keep Mesos install from Mesosphere's Xenial repository, since they
  don't yet have a Bionic repository;
- gnupg needs to be installed for apt-key to work;
- --force-yes option to apt-get has been removed;
- Package libav-tools is replaced by ffmpeg;
- Update Let's Encrypt example script to use 18.04.
2018-06-01 13:03:12 -07:00
Jay Qi
7c6bf72ced Added conda clean. Addresses #627 2018-05-05 12:22:43 -05:00
Peter Parente
e2798680b0 Merge pull request #600 from taqtiqa-mark/patch-1
Keyserver pool
2018-04-15 22:21:03 -04:00
Peter Parente
22d38bad00 Fix pyarrow install
Need to install as NB_UID, not root, to keep all /opt/conda
folders writeable by the default user
2018-04-07 23:16:33 -04:00
Mark Van de Vyver
0344fd393d Keyserver used in Hashicorps Nomad files
Keyserver used in Hashicorps Nomad files
2018-04-04 21:40:08 +10:00
Mark Van de Vyver
7b8fff73fc Keyserver pool
hkp://pool.sks-keyservers.net over keyserver.ubuntu.com see
https://sks-keyservers.net/overview-of-pools.php
2018-03-30 13:34:11 +11:00
Stijn De Haes
7e7041953e fixed tar --owner root to be correct 2018-03-26 09:05:16 +02:00
Stijn De Haes
a7eb9d6398 Make extracted files root id 2018-03-20 07:58:25 +01:00
Giovanni Lanzani
a58e6afb9b Add pyarrow installation
This way we can profit from pandas UDF
2018-03-14 13:50:52 +01:00
Darek
ef402bfe71 Fixing checksum error 2018-03-01 22:43:16 +00:00
Darek
29e1b43aa5 Changed Spark mirror server and upgraded py4j library to 0.10.6 2018-03-01 21:22:56 +00:00
Darek
f2e8096825 Upgrading Spark to 2.3 2018-03-01 20:54:06 +00:00
Graham Dumpleton
770007bb10 Use NB_UID for USER statement in Dockerfile so deployment platform can verify that image doesn't run as root. 2018-02-15 11:11:32 +11:00
cglewis
d91d4a8c48 MAINTAINER is deprecated, using LABEL now 2017-10-31 20:17:06 -07:00
Min RK
0351f0c3b7 base image on ubuntu:16.04 2017-08-09 11:07:29 +02:00
uodna
c740fbb1ca Upgrade Spark to 2.2.0 2017-07-18 23:50:18 +09:00
Pando85
93683ee25f [Update] Spark updated to 2.1.1 2017-06-24 14:12:21 +02:00
Vishu Dontham
c49a3cfdd7 changed the version of mesos to avoid backward compatibility issue 2017-04-30 02:58:53 +05:30
Rudolf Kral
1503e39c6f Bump Py4J to 0.10.4
Spark 2.1.0 requires Py4J 0.10.4, not 0.10.3.
2017-03-15 17:51:03 +01:00
Peter Parente
87ca3de02a Fix #345: Bump to Spark 2.1.0 2017-03-09 08:51:40 -05:00
Peter Parente
fde30f67fe Fix #340: Failing openjdk install 2017-02-07 22:56:31 -06:00
Peter Parente
52bce8f002 Use Apache Toree 0.2.0dev1 for Spark 2.0.2 2016-12-10 13:33:36 -05:00
Peter Parente
1339b518a9 Upgrade Spark to 2.0 2016-12-10 13:33:36 -05:00
Min RK
e89f0b278b inherit pyspark from scipy-notebook
removes duplicate installation of python 2 env and Python packages.

There are very few packages in scipy not in pyspark, so removing the duplicate seems valuable.
2016-06-29 09:45:12 +02:00
Sebastian Reuße
fdb247ec0c Make use of available environment variables
base-notebook defines environment variables for the Conda install path and the
notebook user. However, in some instances, these locations were still hardcoded.
Let’s use the variables instead.
2016-06-28 11:31:24 +02:00
John Kirkham
ac53e57ed9 pyspark-notebook: Use jq from conda-forge. 2016-06-09 19:26:45 -04:00
Peter Parente
e384a4512b Add pip2, pip3 symlinks for images with python2
Fixes #123

(c) Copyright IBM Corp. 2016
2016-05-29 23:09:48 -04:00
Peter Parente
401575ede9 Merge pull request #204 from lbustelo/UpgradeToree0.1.0.dev5
Bump Spark to 1.6.1, Toree to 0.1.0.dev7
2016-05-11 00:34:51 -04:00
Peter Parente
eb754a1a23 Bump Spark to 1.6.1
(c) Copyright IBM Corp. 2016
2016-05-10 09:06:09 -05:00
Peter Parente
e14e387d6c Require ipywidgets 5.1
5.0 had API compatibility problems
see ipython/ipywidgets#522

(c) Copyright IBM Corp. 2016
2016-04-29 07:40:48 -04:00
Peter Parente
39104f2432 Upgrade to notebook 4.2, ipywidgets 5.0 2016-04-26 08:55:18 -04:00
Peter Parente
42765a9617 Add numexpr to wherever pandas is
Fixes #173

(c) Copyright IBM Corp. 2016
2016-04-10 14:41:58 -04:00
Peter Parente
f5da6216ad Base all-spark-notebook on pyspark-notebook
To speed up build, reduce accidental disparity, ease maintenance

(c) Copyright IBM Corp. 2016
2016-03-18 08:16:39 -04:00
John Kirkham
630ceec257 Dockerfile: Clean apt-get lists. 2016-03-07 21:38:40 -05:00
John Kirkham
9f9ddd67a2 all-spark-notebook/Dockerfile: Clean after installing jq. 2016-03-06 23:58:35 -05:00
John Kirkham
a5cc245a7a docker: Make conda installs quieter. 2016-03-06 21:13:57 -05:00
John Kirkham
ca3f00a6c8 pyspark-notebook/Dockerfile: Note to get Mesos for jessie. 2016-03-05 15:12:24 -05:00
John Kirkham
4711a6ce75 pyspark-notebook/Dockerfile: Clean out conda. 2016-03-04 18:29:31 -05:00