Commit Graph

222 Commits

Author SHA1 Message Date
Alexander Lewitt
53cc2f5d34 Update spark readme for spark ui instructions
Instructions to open an extra port to be able to see the spark ui for monitoring execution status.
2015-11-10 09:52:25 -05:00
Peter Parente
744c903854 Merge pull request #50 from parente/doc-cmd-args
Remove trivial env vars, doc command line args
2015-10-24 22:36:03 -04:00
Peter Parente
41222b047c Add system prereqs for R to all-spark-notebook
* Copy/paste from r-notebook
* Also add PORT option to make dev target for easy of testing

(c) Copyright IBM Corp. 2015
2015-10-22 21:30:19 -04:00
Peter Parente
76073ddf2d Temporary workaround for rzmq missing deps
(c) Copyright IBM Corp. 2015
2015-10-22 12:19:07 -04:00
Kai Wang
817550198f update for Spark 1.5.1 2015-10-21 15:22:57 +00:00
Peter Parente
ad99f8c74f Remove trivial env vars, doc command line args
* Remove PORT and INTERFACE env vars which can conflict with other systems (e.g., Mesos)
* Document command line pass-through to start-notebook.sh

(c) Copyright IBM Corp. 2015
2015-10-19 09:36:28 -04:00
Peter Parente
488aa7ba64 Remove 3.x vs 4.x legacy info from README
Fixes #48

(c) Copyright IBM Corp. 2015
2015-10-19 09:05:10 -04:00
Peter Parente
43e1914065 Add doc about conda environments
Contribution (c) Copyright IBM Corp. 2015
2015-10-07 22:31:27 -04:00
Peter Parente
1f282e8a27 Document Mesos user flag requirements 2015-10-07 22:05:45 -04:00
Peter Parente
6e7c1574a6 Note tini is in 4.0 and up images 2015-09-23 20:17:33 -04:00
Peter Parente
d425a3a502 Mention tini and start-notebook.sh in READMEs
Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:42 -04:00
Peter Parente
678b64e9e4 Swap tini for supervisord
* Pass $@ args to start-notebook.sh
* Set tini as entrypoint, but keep start-notebook.sh as easily overridable CMD
* su to jovyan user within start-notebook.sh script

Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:18 -04:00
Peter Parente
d51afb34f7 Explicitly document jovyan user 2015-09-12 20:39:31 -04:00
Peter Parente
69c5c35f7f Run pyspark, all-spark, scipy, r conda installs as jovyan
… but install kernel specs global to avoid problems when switching NB_UID

Contribution (c) Copyright IBM Corp. 2015
2015-09-11 00:36:40 -04:00
Peter Parente
701212dbf1 Explicitly set USER root in every Dockerfile
Contribution (c) Copyright IBM Corp. 2015
2015-08-29 21:50:04 -04:00
Peter Parente
c4616560cf Make subimages compatible with late user creation
* Always remain as root during install
* Put kernel specs in system path, not user home
* Create user work directory at startup
* Note this is in 4.0 and up images, not 3.2

Contribution (c) Copyright IBM Corp. 2015
2015-08-28 23:43:57 -04:00
Peter Parente
6c64040fd2 Fix README copy/paste image name errors 2015-08-28 13:17:00 -04:00
Peter Parente
748fc67301 Revert workaround for r-irkernel from downgrading to ipython 3.2.1 2015-08-27 20:54:10 -04:00
Peter Parente
822938d265 Prevent r-irkernel from downgrading to ipython 3.2.1
Force irkernel to install without deps, then install the irkernel deps

Contribution (c) IBM Corp. 2015
2015-08-26 21:40:51 -04:00
Peter Parente
16db7cfe55 Bump master to Jupyter Notebook 4.0
* Merge 4.0.x branch
* Rejigger Dockerfiles to build from minimal-notebook:latest
2015-08-25 20:45:04 -04:00
Peter Parente
e1c0c75c9c Upgrade to Jupyter Notebook
* Change minimal-notebook to install notebook=4.0*
* Change other Dockerfile to point to 4.0 Docker Hub tag (to be built)
* Change config and pem file paths for jupyter
* Install ipywidgets in all containers that have a Python stack
* Update all READMEs to describe v3.2 and v4.0 since Docker Hub only shows one README for all tags

Contribution (c) Copyright IBM Corp. 2015
2015-08-23 08:55:09 -04:00
Peter Parente
6cefadfad0 Notebook stack Scala, Python, and R w/ Spark on Mesos
(c) Copyright IBM Corp. 2015
2015-08-13 08:05:45 -04:00