Commit Graph

39 Commits

Author SHA1 Message Date
Peter Parente
3fd3850bdc Bump python libs to match other images
(c) Copyright IBM Corp. 2016
2016-02-13 20:49:11 -05:00
Peter Parente
d25f33a5fb Fix py4j version and path
(c) Copyright IBM Corp. 2016
2016-02-04 21:29:36 -05:00
Peter Parente
83f9f834bc Update README Spark version mentions
(c) Copyright IBM Corp. 2016
2016-02-03 13:29:21 -05:00
Peter Parente
154c4d64d2 Bump Spark dependencies
* Use Spark 1.6.0
* Use Apache Toree (new name/home of ibm-et/spark-kernel)
* Add missing pub key for binary
* Add SHA check for spark package download

(c) Copyright IBM Corp. 2016
2016-02-03 13:29:21 -05:00
Peter Parente
232d6fc465 Use jq instead of sed
(c) Copyright IBM Corp. 2016
2016-02-02 10:47:57 -05:00
Peter Parente
3e27c990e9 Remove os.environ step from spark READMEs
(c) Copyright IBM Corp. 2016
2016-02-02 09:06:54 -05:00
Peter Parente
155fdea583 Set PYSPARK_HOME in python2 kernelspec
* Install python2 spec to CONDA_DIR instead of system prefix too

(c) Copyright IBM Corp. 2016
2016-02-02 09:03:30 -05:00
Peter Parente
90a3d2ef7d Note bump to notebook 4.1.x
(c) Copyright IBM Corp. 2016
2016-01-17 11:27:34 -05:00
Peter Parente
9aae44ef66 Use updated LICENSE.md file
Also fix copyright headers on various files
2016-01-17 11:27:10 -05:00
Peter Parente
2988869079 Merge pull request #92 from parente/jovyan-by-default
Make jovyan the default user for the docker cmd
2016-01-04 20:53:47 -05:00
Peter Parente
b7aeac87f4 Install libxrender1 to appease matplotlib
Bite the bullet and preinstall it so that plotting libs that default
to using desktop rendering just work (matplotlib, ggplot, ...)
out of the box without having to get configuration right beforehand
(e.g., %matplotlib inline ahead of matplotlib import)

Only adds ~100k to the image size

(c) Copyright IBM Corp. 2015
2016-01-02 12:45:30 -05:00
Peter Parente
6d5cd67528 Make jovyan the default user for the docker cmd
* Switch to jovyan at the end of every Dockerfile
* Document --user root requirement for NB_UID and GRANT_SUDO flags

(c) Copyright IBM Corp. 2015
2015-12-27 21:05:48 -05:00
Peter Parente
d8c83ec385 Bump r-irkernel to 0.5 to fix zmq issue
Requires r-rmarkdown=0.8, r-devtools=1.9, r-tidyr=0.3 in r-notebook

(c) Copyright IBM Corp. 2015
2015-12-17 17:00:50 -05:00
Gino Bustelo
ff62ff0f8c Updating to reflect changes in how Spark Kernel is build and packaged
(c) Copyright IBM Corp. 2015
2015-12-09 14:45:08 -06:00
Justin Tyberg
e53b288e6e Bump to pandas 0.17.
(c) Copyright IBM Corp. 2015
2015-12-04 17:47:12 -05:00
Peter Parente
ebda307c7c Doc --net=host requirements for su
(c) Copyright IBM Corp. 2015
2015-11-20 20:09:40 -05:00
Peter Parente
de9267afa9 Build spark kernel from specific SHA
Allows rebuilds against git SHAs in docker-stacks

(c) Copyright IBM Corp. 2015
2015-11-18 22:47:34 -05:00
Alexander Lewitt
53cc2f5d34 Update spark readme for spark ui instructions
Instructions to open an extra port to be able to see the spark ui for monitoring execution status.
2015-11-10 09:52:25 -05:00
Peter Parente
744c903854 Merge pull request #50 from parente/doc-cmd-args
Remove trivial env vars, doc command line args
2015-10-24 22:36:03 -04:00
Peter Parente
41222b047c Add system prereqs for R to all-spark-notebook
* Copy/paste from r-notebook
* Also add PORT option to make dev target for easy of testing

(c) Copyright IBM Corp. 2015
2015-10-22 21:30:19 -04:00
Peter Parente
76073ddf2d Temporary workaround for rzmq missing deps
(c) Copyright IBM Corp. 2015
2015-10-22 12:19:07 -04:00
Kai Wang
817550198f update for Spark 1.5.1 2015-10-21 15:22:57 +00:00
Peter Parente
ad99f8c74f Remove trivial env vars, doc command line args
* Remove PORT and INTERFACE env vars which can conflict with other systems (e.g., Mesos)
* Document command line pass-through to start-notebook.sh

(c) Copyright IBM Corp. 2015
2015-10-19 09:36:28 -04:00
Peter Parente
488aa7ba64 Remove 3.x vs 4.x legacy info from README
Fixes #48

(c) Copyright IBM Corp. 2015
2015-10-19 09:05:10 -04:00
Peter Parente
43e1914065 Add doc about conda environments
Contribution (c) Copyright IBM Corp. 2015
2015-10-07 22:31:27 -04:00
Peter Parente
1f282e8a27 Document Mesos user flag requirements 2015-10-07 22:05:45 -04:00
Peter Parente
6e7c1574a6 Note tini is in 4.0 and up images 2015-09-23 20:17:33 -04:00
Peter Parente
d425a3a502 Mention tini and start-notebook.sh in READMEs
Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:42 -04:00
Peter Parente
678b64e9e4 Swap tini for supervisord
* Pass $@ args to start-notebook.sh
* Set tini as entrypoint, but keep start-notebook.sh as easily overridable CMD
* su to jovyan user within start-notebook.sh script

Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:18 -04:00
Peter Parente
d51afb34f7 Explicitly document jovyan user 2015-09-12 20:39:31 -04:00
Peter Parente
69c5c35f7f Run pyspark, all-spark, scipy, r conda installs as jovyan
… but install kernel specs global to avoid problems when switching NB_UID

Contribution (c) Copyright IBM Corp. 2015
2015-09-11 00:36:40 -04:00
Peter Parente
701212dbf1 Explicitly set USER root in every Dockerfile
Contribution (c) Copyright IBM Corp. 2015
2015-08-29 21:50:04 -04:00
Peter Parente
c4616560cf Make subimages compatible with late user creation
* Always remain as root during install
* Put kernel specs in system path, not user home
* Create user work directory at startup
* Note this is in 4.0 and up images, not 3.2

Contribution (c) Copyright IBM Corp. 2015
2015-08-28 23:43:57 -04:00
Peter Parente
6c64040fd2 Fix README copy/paste image name errors 2015-08-28 13:17:00 -04:00
Peter Parente
748fc67301 Revert workaround for r-irkernel from downgrading to ipython 3.2.1 2015-08-27 20:54:10 -04:00
Peter Parente
822938d265 Prevent r-irkernel from downgrading to ipython 3.2.1
Force irkernel to install without deps, then install the irkernel deps

Contribution (c) IBM Corp. 2015
2015-08-26 21:40:51 -04:00
Peter Parente
16db7cfe55 Bump master to Jupyter Notebook 4.0
* Merge 4.0.x branch
* Rejigger Dockerfiles to build from minimal-notebook:latest
2015-08-25 20:45:04 -04:00
Peter Parente
e1c0c75c9c Upgrade to Jupyter Notebook
* Change minimal-notebook to install notebook=4.0*
* Change other Dockerfile to point to 4.0 Docker Hub tag (to be built)
* Change config and pem file paths for jupyter
* Install ipywidgets in all containers that have a Python stack
* Update all READMEs to describe v3.2 and v4.0 since Docker Hub only shows one README for all tags

Contribution (c) Copyright IBM Corp. 2015
2015-08-23 08:55:09 -04:00
Peter Parente
6cefadfad0 Notebook stack Scala, Python, and R w/ Spark on Mesos
(c) Copyright IBM Corp. 2015
2015-08-13 08:05:45 -04:00