Commit Graph

56 Commits

Author SHA1 Message Date
cglewis
d91d4a8c48 MAINTAINER is deprecated, using LABEL now 2017-10-31 20:17:06 -07:00
Min RK
c6c1ce4cb0 use groups for managing write-access to files
- any files the user should be able to write should have group `user-permissions` with `g+rwX`
- remove `chown` from start.sh because it is no longer needed
- add `fix-permissions` script for setting the user-writable permissions on a path
- user-permissions group as GID 10000 (is there a reason for it to have a different value?)
- containers can set group with `--group-add user-writable` if they want to run with a different uid/gid
  (without -u root -e NB_UID -e NB_GID, which make this unnecessary)
2017-08-26 09:50:56 -04:00
Peter Parente
d968de73b0 Add r-sparklyr 2017-06-26 23:59:35 -04:00
Peter Parente
b114a06f75 Use R packages from conda-forge 2017-06-26 23:57:47 -04:00
Peter Parente
64b05ca117 Update spylon-kernel to 0.4.x 2017-06-25 12:53:58 -04:00
Min RK
c6e5e289dd reduce files in home directory
- add a few missing `--system` flags to conda config
- install default notebook config to /etc/jupyter instead of ~/.jupyter
- add a few missing `conda clean`s
2017-05-02 13:26:35 +02:00
Peter Parente
6885115751 Bump spylon-kernel to 0.2.* 2017-03-08 22:40:34 -05:00
Peter Parente
fa77fe9957 Merge pull request #324 from parente/r-3.3.2
Upgrade to r-base 3.3.2
2017-01-12 13:13:51 -05:00
Marius van Niekerk
a58c3d7242 Version bump some more 2017-01-09 14:48:58 -05:00
Marius van Niekerk
21e8d8016a Version bump 2017-01-09 12:49:56 -05:00
Marius van Niekerk
8785f8b443 Pin spylon-kernel version 2017-01-09 11:44:18 -05:00
mariusvniekerk
e268ad01b3 Add spylon-kernel to all-spark 2017-01-06 16:42:42 -08:00
Peter Parente
012b408e73 Upgrade to r-base 3.3.2
Remove pinning for plotting fix and upgrade other R packages
2017-01-02 23:11:30 -05:00
Peter Parente
fff906003e Install Toree to conda env instead of user home 2016-12-31 15:24:30 -05:00
Peter Parente
52bce8f002 Use Apache Toree 0.2.0dev1 for Spark 2.0.2 2016-12-10 13:33:36 -05:00
Peter Parente
d762cb9790 Update to IRKernel 0.7
Version 0.6 does not work after all containers rebuild
2016-10-11 21:30:02 -05:00
Peter Parente
0d47f10af2 Workaround for R plotting regression
Pin r-base to 3.3.1-1 (3.3.1-3 breaks it)
2016-09-09 23:40:23 -04:00
Michael Poplavski
37bc11a05f Update R version to 3.3* 2016-07-13 11:36:54 -05:00
Sebastian Reuße
fdb247ec0c Make use of available environment variables
base-notebook defines environment variables for the Conda install path and the
notebook user. However, in some instances, these locations were still hardcoded.
Let’s use the variables instead.
2016-06-28 11:31:24 +02:00
Peter Parente
126009764f Disable pip cache during docker build
Ref #188

(c) Copyright IBM Corp. 2016
2016-05-29 23:09:48 -04:00
Gino Bustelo
b412388f12 Bump Toree to 0.1.0.dev7
(c) Copyright IBM Corp. 2016
2016-05-10 09:07:21 -05:00
Peter Parente
f5da6216ad Base all-spark-notebook on pyspark-notebook
To speed up build, reduce accidental disparity, ease maintenance

(c) Copyright IBM Corp. 2016
2016-03-18 08:16:39 -04:00
Marco Capuccini
8fd57ea27b upgrade mesos, switch to Jessie repository 2016-03-17 11:24:02 +01:00
John Kirkham
af11fbc3c4 docker: Add and install from the r channel with conda. 2016-03-08 16:59:45 -05:00
Gino Bustelo
f92bc91b78 Modified to install Apache Toree using pip
(c) Copyright IBM Corp. 2016
2016-03-08 09:17:18 -06:00
John Kirkham
630ceec257 Dockerfile: Clean apt-get lists. 2016-03-07 21:38:40 -05:00
John Kirkham
9f9ddd67a2 all-spark-notebook/Dockerfile: Clean after installing jq. 2016-03-06 23:58:35 -05:00
John Kirkham
a5cc245a7a docker: Make conda installs quieter. 2016-03-06 21:13:57 -05:00
John Kirkham
6e424ef4cd all-spark-notebook/Dockerfile: Note to get Mesos for jessie. 2016-03-05 15:11:58 -05:00
John Kirkham
4262e55628 all-spark-notebook/Dockerfile: Clean out conda. 2016-03-04 18:29:31 -05:00
John Kirkham
ff0f89c818 all-spark-notebook/Dockerfile: Tell conda yes. 2016-03-04 17:32:43 -05:00
Peter Parente
3fd3850bdc Bump python libs to match other images
(c) Copyright IBM Corp. 2016
2016-02-13 20:49:11 -05:00
Peter Parente
d25f33a5fb Fix py4j version and path
(c) Copyright IBM Corp. 2016
2016-02-04 21:29:36 -05:00
Peter Parente
154c4d64d2 Bump Spark dependencies
* Use Spark 1.6.0
* Use Apache Toree (new name/home of ibm-et/spark-kernel)
* Add missing pub key for binary
* Add SHA check for spark package download

(c) Copyright IBM Corp. 2016
2016-02-03 13:29:21 -05:00
Peter Parente
232d6fc465 Use jq instead of sed
(c) Copyright IBM Corp. 2016
2016-02-02 10:47:57 -05:00
Peter Parente
155fdea583 Set PYSPARK_HOME in python2 kernelspec
* Install python2 spec to CONDA_DIR instead of system prefix too

(c) Copyright IBM Corp. 2016
2016-02-02 09:03:30 -05:00
Peter Parente
9aae44ef66 Use updated LICENSE.md file
Also fix copyright headers on various files
2016-01-17 11:27:10 -05:00
Peter Parente
2988869079 Merge pull request #92 from parente/jovyan-by-default
Make jovyan the default user for the docker cmd
2016-01-04 20:53:47 -05:00
Peter Parente
b7aeac87f4 Install libxrender1 to appease matplotlib
Bite the bullet and preinstall it so that plotting libs that default
to using desktop rendering just work (matplotlib, ggplot, ...)
out of the box without having to get configuration right beforehand
(e.g., %matplotlib inline ahead of matplotlib import)

Only adds ~100k to the image size

(c) Copyright IBM Corp. 2015
2016-01-02 12:45:30 -05:00
Peter Parente
6d5cd67528 Make jovyan the default user for the docker cmd
* Switch to jovyan at the end of every Dockerfile
* Document --user root requirement for NB_UID and GRANT_SUDO flags

(c) Copyright IBM Corp. 2015
2015-12-27 21:05:48 -05:00
Peter Parente
d8c83ec385 Bump r-irkernel to 0.5 to fix zmq issue
Requires r-rmarkdown=0.8, r-devtools=1.9, r-tidyr=0.3 in r-notebook

(c) Copyright IBM Corp. 2015
2015-12-17 17:00:50 -05:00
Gino Bustelo
ff62ff0f8c Updating to reflect changes in how Spark Kernel is build and packaged
(c) Copyright IBM Corp. 2015
2015-12-09 14:45:08 -06:00
Justin Tyberg
e53b288e6e Bump to pandas 0.17.
(c) Copyright IBM Corp. 2015
2015-12-04 17:47:12 -05:00
Peter Parente
de9267afa9 Build spark kernel from specific SHA
Allows rebuilds against git SHAs in docker-stacks

(c) Copyright IBM Corp. 2015
2015-11-18 22:47:34 -05:00
Peter Parente
41222b047c Add system prereqs for R to all-spark-notebook
* Copy/paste from r-notebook
* Also add PORT option to make dev target for easy of testing

(c) Copyright IBM Corp. 2015
2015-10-22 21:30:19 -04:00
Peter Parente
76073ddf2d Temporary workaround for rzmq missing deps
(c) Copyright IBM Corp. 2015
2015-10-22 12:19:07 -04:00
Kai Wang
817550198f update for Spark 1.5.1 2015-10-21 15:22:57 +00:00
Peter Parente
678b64e9e4 Swap tini for supervisord
* Pass $@ args to start-notebook.sh
* Set tini as entrypoint, but keep start-notebook.sh as easily overridable CMD
* su to jovyan user within start-notebook.sh script

Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:18 -04:00
Peter Parente
69c5c35f7f Run pyspark, all-spark, scipy, r conda installs as jovyan
… but install kernel specs global to avoid problems when switching NB_UID

Contribution (c) Copyright IBM Corp. 2015
2015-09-11 00:36:40 -04:00
Peter Parente
701212dbf1 Explicitly set USER root in every Dockerfile
Contribution (c) Copyright IBM Corp. 2015
2015-08-29 21:50:04 -04:00