Commit Graph

235 Commits

Author SHA1 Message Date
Peter Parente
d58f481ac5 Pointer to recipes wiki page 2015-11-10 12:08:40 -05:00
Peter Parente
adbc703165 Merge pull request #61 from alewitt/master
Updating Readmes for Spark UI support
2015-11-10 10:34:36 -05:00
Alexander Lewitt
2a6c7a59ed pyspark readme, spark ui support.
adding instructions for how to open an extra port in order to view spark ui monitoring status.
2015-11-10 09:55:12 -05:00
Alexander Lewitt
53cc2f5d34 Update spark readme for spark ui instructions
Instructions to open an extra port to be able to see the spark ui for monitoring execution status.
2015-11-10 09:52:25 -05:00
Peter Parente
a388c4a66f Add temporary rzmq workaround to other R stacks
Required to rebuild now that a merge went in touching minimal

(c) Copyright IBM Corp. 2015
2015-10-24 22:40:59 -04:00
Peter Parente
744c903854 Merge pull request #50 from parente/doc-cmd-args
Remove trivial env vars, doc command line args
2015-10-24 22:36:03 -04:00
Peter Parente
1fb0494a3b Merge pull request #57 from parente/fix-r-deps-in-all-spark
Add system prereqs for R to all-spark-notebook
2015-10-23 19:38:11 -04:00
Peter Parente
41222b047c Add system prereqs for R to all-spark-notebook
* Copy/paste from r-notebook
* Also add PORT option to make dev target for easy of testing

(c) Copyright IBM Corp. 2015
2015-10-22 21:30:19 -04:00
Peter Parente
945db0f8fd Merge pull request #56 from parente/spark-1.5.1
Update to Spark 1.5.1
2015-10-22 12:27:50 -04:00
Peter Parente
76073ddf2d Temporary workaround for rzmq missing deps
(c) Copyright IBM Corp. 2015
2015-10-22 12:19:07 -04:00
Kai Wang
817550198f update for Spark 1.5.1 2015-10-21 15:22:57 +00:00
Peter Parente
f5bb3d4801 Remove need to quote >1 args to start-notebook
(c) Copyright IBM Corp. 2015
2015-10-20 22:43:32 -04:00
Peter Parente
3411997451 Retain current default port and interface IP
(c) Copyright IBM Corp. 2015
2015-10-20 22:43:12 -04:00
Min RK
2819b2b393 Merge pull request #49 from parente/readme-updates
Readme updates to remove legacy version info

closes #48
2015-10-20 15:21:58 +01:00
Peter Parente
ad99f8c74f Remove trivial env vars, doc command line args
* Remove PORT and INTERFACE env vars which can conflict with other systems (e.g., Mesos)
* Document command line pass-through to start-notebook.sh

(c) Copyright IBM Corp. 2015
2015-10-19 09:36:28 -04:00
Peter Parente
ab2414f0c5 Point to the folder READMEs from the top-level
(c) Copyright IBM Corp. 2015
2015-10-19 09:07:13 -04:00
Peter Parente
488aa7ba64 Remove 3.x vs 4.x legacy info from README
Fixes #48

(c) Copyright IBM Corp. 2015
2015-10-19 09:05:10 -04:00
Peter Parente
cc0ac6ce2a Update README with starting SHA for new versioning 2015-10-16 22:06:08 -04:00
Peter Parente
9bd33dcc86 Fix release-all build ordering
It was working, but it could end up using an old minimal notebook to rebuild other stacks before rebuilding minimal-notebook

(c) Copyright IBM Corp. 2015
2015-10-16 13:17:38 -04:00
Peter Parente
fbac8a1be7 Merge pull request #46 from parente/new-build
New versioning scheme
2015-10-16 13:03:35 -04:00
Peter Parente
8b20913b5e New versioning scheme
(c) Copyright IBM Corp. 2015
2015-10-15 12:20:06 -04:00
Peter Parente
43e1914065 Add doc about conda environments
Contribution (c) Copyright IBM Corp. 2015
2015-10-07 22:31:27 -04:00
Peter Parente
1f282e8a27 Document Mesos user flag requirements 2015-10-07 22:05:45 -04:00
Peter Parente
6e7c1574a6 Note tini is in 4.0 and up images 2015-09-23 20:17:33 -04:00
Kyle Kelley
dcd0a71876 Merge pull request #38 from parente/tini-init
Swap tini in for supervisord
2015-09-23 07:46:02 -05:00
Peter Parente
4c34446dc7 Fix jovyan hardcode in start-notebook.sh
Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:50 -04:00
Peter Parente
d425a3a502 Mention tini and start-notebook.sh in READMEs
Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:42 -04:00
Peter Parente
678b64e9e4 Swap tini for supervisord
* Pass $@ args to start-notebook.sh
* Set tini as entrypoint, but keep start-notebook.sh as easily overridable CMD
* su to jovyan user within start-notebook.sh script

Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:18 -04:00
Peter Parente
735c520486 Merge pull request #35 from jtyberg/pem_dir
Ensure PEM file directory exists before creating file.
2015-09-15 21:19:25 -04:00
Justin Tyberg
163867cb4d Set permissions on PEM_FILE, if generated. 2015-09-15 21:15:30 -04:00
Justin Tyberg
5956f1ae84 Ensure PEM file directory exists before creating file.
Fixes issue #34
2015-09-15 11:15:29 -04:00
Peter Parente
78df4dc0e7 Add maintainer workflows to README
Fixes issue #11
2015-09-12 21:41:20 -04:00
Peter Parente
e8df9912e2 Merge pull request #31 from parente/early-user-late-uid
Create jovyan in Dockerfile, reset UID at startup
2015-09-12 21:05:59 -04:00
Peter Parente
aec1c74825 Fix wrong user for apt-get in r-notebook 2015-09-12 20:39:55 -04:00
Peter Parente
d51afb34f7 Explicitly document jovyan user 2015-09-12 20:39:31 -04:00
Peter Parente
0c508efe4e Set group=users on home and conda dir 2015-09-12 20:37:53 -04:00
Peter Parente
69c5c35f7f Run pyspark, all-spark, scipy, r conda installs as jovyan
… but install kernel specs global to avoid problems when switching NB_UID

Contribution (c) Copyright IBM Corp. 2015
2015-09-11 00:36:40 -04:00
Peter Parente
b6ecf61df2 Fix for issue #30, missing ijulia
Contribution (c) Copyright IBM Corp. 2015
2015-09-11 00:31:40 -04:00
Peter Parente
dba9977525 Create jovyan in Dockerfile, reset UID at startup
* Create user jovyan with UID=1000 in the default users group in the Dockerfile
* Set group ownership of user home and conda to root to avoid 'users' group from host access when mounted
* Set stick bit on both paths so root owns subdirs too
* Change jovyan UID if NB_UID is specified and is not the default 1000

Contribution (c) Copyright IBM Corp. 2015
2015-09-10 23:46:31 -04:00
Peter Parente
7c9edef43d Fix missing install-self on py2 kernelspec 2015-08-30 21:56:48 -04:00
Peter Parente
7e5c7a77ac Merge pull request #21 from parente/costerwi-start-notebook
Add user in script + fixes
2015-08-30 19:33:21 -04:00
Peter Parente
5bc8eb1822 Make jovyan name / paths constant 2015-08-30 09:11:19 -04:00
Peter Parente
701212dbf1 Explicitly set USER root in every Dockerfile
Contribution (c) Copyright IBM Corp. 2015
2015-08-29 21:50:04 -04:00
Peter Parente
80c8475276 Improve start-notebook.sh checks
* Only create jovyan and set perms if user does not exist
* Allow docker host mount for NB_WORK: copy skel files if useradd fails because home dir already exists

Contribution (c) Copyright IBM Corp. 2015
2015-08-28 23:45:01 -04:00
Peter Parente
c4616560cf Make subimages compatible with late user creation
* Always remain as root during install
* Put kernel specs in system path, not user home
* Create user work directory at startup
* Note this is in 4.0 and up images, not 3.2

Contribution (c) Copyright IBM Corp. 2015
2015-08-28 23:43:57 -04:00
Carl Osterwisch
30932a3b12 Revert to using supervisord to launch notebook
Used to relaunch notebook and collect logging data.
2015-08-28 23:39:08 -04:00
Carl Osterwisch
f2b7f38df6 Added NB_UID to docs 2015-08-28 23:39:08 -04:00
Carl Osterwisch
7fad0c43f6 Move useradd, enable_sudo.sh, and server launch into start-notebook.sh
Provides ability to specify NB_USER and NB_UID at docker run time rather than build time.
2015-08-28 23:39:08 -04:00
Carl Osterwisch
c0dace3671 Expand $CONDA_DIR prior to writing /etc/profile.d/conda.sh 2015-08-28 23:39:08 -04:00
Peter Parente
6c64040fd2 Fix README copy/paste image name errors 2015-08-28 13:17:00 -04:00