Commit Graph

17 Commits

Author SHA1 Message Date
Alexander Lewitt
2a6c7a59ed pyspark readme, spark ui support.
adding instructions for how to open an extra port in order to view spark ui monitoring status.
2015-11-10 09:55:12 -05:00
Peter Parente
744c903854 Merge pull request #50 from parente/doc-cmd-args
Remove trivial env vars, doc command line args
2015-10-24 22:36:03 -04:00
Kai Wang
817550198f update for Spark 1.5.1 2015-10-21 15:22:57 +00:00
Peter Parente
ad99f8c74f Remove trivial env vars, doc command line args
* Remove PORT and INTERFACE env vars which can conflict with other systems (e.g., Mesos)
* Document command line pass-through to start-notebook.sh

(c) Copyright IBM Corp. 2015
2015-10-19 09:36:28 -04:00
Peter Parente
488aa7ba64 Remove 3.x vs 4.x legacy info from README
Fixes #48

(c) Copyright IBM Corp. 2015
2015-10-19 09:05:10 -04:00
Peter Parente
43e1914065 Add doc about conda environments
Contribution (c) Copyright IBM Corp. 2015
2015-10-07 22:31:27 -04:00
Peter Parente
1f282e8a27 Document Mesos user flag requirements 2015-10-07 22:05:45 -04:00
Peter Parente
6e7c1574a6 Note tini is in 4.0 and up images 2015-09-23 20:17:33 -04:00
Peter Parente
d425a3a502 Mention tini and start-notebook.sh in READMEs
Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:42 -04:00
Peter Parente
678b64e9e4 Swap tini for supervisord
* Pass $@ args to start-notebook.sh
* Set tini as entrypoint, but keep start-notebook.sh as easily overridable CMD
* su to jovyan user within start-notebook.sh script

Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:18 -04:00
Peter Parente
d51afb34f7 Explicitly document jovyan user 2015-09-12 20:39:31 -04:00
Peter Parente
69c5c35f7f Run pyspark, all-spark, scipy, r conda installs as jovyan
… but install kernel specs global to avoid problems when switching NB_UID

Contribution (c) Copyright IBM Corp. 2015
2015-09-11 00:36:40 -04:00
Peter Parente
701212dbf1 Explicitly set USER root in every Dockerfile
Contribution (c) Copyright IBM Corp. 2015
2015-08-29 21:50:04 -04:00
Peter Parente
c4616560cf Make subimages compatible with late user creation
* Always remain as root during install
* Put kernel specs in system path, not user home
* Create user work directory at startup
* Note this is in 4.0 and up images, not 3.2

Contribution (c) Copyright IBM Corp. 2015
2015-08-28 23:43:57 -04:00
Peter Parente
16db7cfe55 Bump master to Jupyter Notebook 4.0
* Merge 4.0.x branch
* Rejigger Dockerfiles to build from minimal-notebook:latest
2015-08-25 20:45:04 -04:00
Peter Parente
e1c0c75c9c Upgrade to Jupyter Notebook
* Change minimal-notebook to install notebook=4.0*
* Change other Dockerfile to point to 4.0 Docker Hub tag (to be built)
* Change config and pem file paths for jupyter
* Install ipywidgets in all containers that have a Python stack
* Update all READMEs to describe v3.2 and v4.0 since Docker Hub only shows one README for all tags

Contribution (c) Copyright IBM Corp. 2015
2015-08-23 08:55:09 -04:00
Peter Parente
871c0edc16 Spark 1.4.1 and Mesos 0.22, for Python 2 and 3
Plus README explaining how to use pyspark in local mode and with a
Mesos cluster.

(c) Copyright IBM Corp. 2015
2015-08-12 12:10:09 -04:00