Commit Graph

783 Commits

Author SHA1 Message Date
Alexander Lewitt
2a6c7a59ed pyspark readme, spark ui support.
adding instructions for how to open an extra port in order to view spark ui monitoring status.
2015-11-10 09:55:12 -05:00
Alexander Lewitt
53cc2f5d34 Update spark readme for spark ui instructions
Instructions to open an extra port to be able to see the spark ui for monitoring execution status.
2015-11-10 09:52:25 -05:00
Peter Parente
a388c4a66f Add temporary rzmq workaround to other R stacks
Required to rebuild now that a merge went in touching minimal

(c) Copyright IBM Corp. 2015
2015-10-24 22:40:59 -04:00
Peter Parente
744c903854 Merge pull request #50 from parente/doc-cmd-args
Remove trivial env vars, doc command line args
2015-10-24 22:36:03 -04:00
Peter Parente
1fb0494a3b Merge pull request #57 from parente/fix-r-deps-in-all-spark
Add system prereqs for R to all-spark-notebook
2015-10-23 19:38:11 -04:00
Peter Parente
41222b047c Add system prereqs for R to all-spark-notebook
* Copy/paste from r-notebook
* Also add PORT option to make dev target for easy of testing

(c) Copyright IBM Corp. 2015
2015-10-22 21:30:19 -04:00
Peter Parente
945db0f8fd Merge pull request #56 from parente/spark-1.5.1
Update to Spark 1.5.1
2015-10-22 12:27:50 -04:00
Peter Parente
76073ddf2d Temporary workaround for rzmq missing deps
(c) Copyright IBM Corp. 2015
2015-10-22 12:19:07 -04:00
Kai Wang
817550198f update for Spark 1.5.1 2015-10-21 15:22:57 +00:00
Peter Parente
f5bb3d4801 Remove need to quote >1 args to start-notebook
(c) Copyright IBM Corp. 2015
2015-10-20 22:43:32 -04:00
Peter Parente
3411997451 Retain current default port and interface IP
(c) Copyright IBM Corp. 2015
2015-10-20 22:43:12 -04:00
Min RK
2819b2b393 Merge pull request #49 from parente/readme-updates
Readme updates to remove legacy version info

closes #48
2015-10-20 15:21:58 +01:00
Peter Parente
ad99f8c74f Remove trivial env vars, doc command line args
* Remove PORT and INTERFACE env vars which can conflict with other systems (e.g., Mesos)
* Document command line pass-through to start-notebook.sh

(c) Copyright IBM Corp. 2015
2015-10-19 09:36:28 -04:00
Peter Parente
ab2414f0c5 Point to the folder READMEs from the top-level
(c) Copyright IBM Corp. 2015
2015-10-19 09:07:13 -04:00
Peter Parente
488aa7ba64 Remove 3.x vs 4.x legacy info from README
Fixes #48

(c) Copyright IBM Corp. 2015
2015-10-19 09:05:10 -04:00
Peter Parente
cc0ac6ce2a Update README with starting SHA for new versioning 2015-10-16 22:06:08 -04:00
Peter Parente
9bd33dcc86 Fix release-all build ordering
It was working, but it could end up using an old minimal notebook to rebuild other stacks before rebuilding minimal-notebook

(c) Copyright IBM Corp. 2015
2015-10-16 13:17:38 -04:00
Peter Parente
fbac8a1be7 Merge pull request #46 from parente/new-build
New versioning scheme
2015-10-16 13:03:35 -04:00
Peter Parente
8b20913b5e New versioning scheme
(c) Copyright IBM Corp. 2015
2015-10-15 12:20:06 -04:00
Peter Parente
43e1914065 Add doc about conda environments
Contribution (c) Copyright IBM Corp. 2015
2015-10-07 22:31:27 -04:00
Peter Parente
1f282e8a27 Document Mesos user flag requirements 2015-10-07 22:05:45 -04:00
Peter Parente
6e7c1574a6 Note tini is in 4.0 and up images 2015-09-23 20:17:33 -04:00
Kyle Kelley
dcd0a71876 Merge pull request #38 from parente/tini-init
Swap tini in for supervisord
2015-09-23 07:46:02 -05:00
Peter Parente
4c34446dc7 Fix jovyan hardcode in start-notebook.sh
Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:50 -04:00
Peter Parente
d425a3a502 Mention tini and start-notebook.sh in READMEs
Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:42 -04:00
Peter Parente
678b64e9e4 Swap tini for supervisord
* Pass $@ args to start-notebook.sh
* Set tini as entrypoint, but keep start-notebook.sh as easily overridable CMD
* su to jovyan user within start-notebook.sh script

Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:18 -04:00
Peter Parente
735c520486 Merge pull request #35 from jtyberg/pem_dir
Ensure PEM file directory exists before creating file.
2015-09-15 21:19:25 -04:00
Justin Tyberg
163867cb4d Set permissions on PEM_FILE, if generated. 2015-09-15 21:15:30 -04:00
Justin Tyberg
5956f1ae84 Ensure PEM file directory exists before creating file.
Fixes issue #34
2015-09-15 11:15:29 -04:00
Peter Parente
78df4dc0e7 Add maintainer workflows to README
Fixes issue #11
2015-09-12 21:41:20 -04:00
Peter Parente
e8df9912e2 Merge pull request #31 from parente/early-user-late-uid
Create jovyan in Dockerfile, reset UID at startup
2015-09-12 21:05:59 -04:00
Peter Parente
aec1c74825 Fix wrong user for apt-get in r-notebook 2015-09-12 20:39:55 -04:00
Peter Parente
d51afb34f7 Explicitly document jovyan user 2015-09-12 20:39:31 -04:00
Peter Parente
0c508efe4e Set group=users on home and conda dir 2015-09-12 20:37:53 -04:00
Peter Parente
69c5c35f7f Run pyspark, all-spark, scipy, r conda installs as jovyan
… but install kernel specs global to avoid problems when switching NB_UID

Contribution (c) Copyright IBM Corp. 2015
2015-09-11 00:36:40 -04:00
Peter Parente
b6ecf61df2 Fix for issue #30, missing ijulia
Contribution (c) Copyright IBM Corp. 2015
2015-09-11 00:31:40 -04:00
Peter Parente
dba9977525 Create jovyan in Dockerfile, reset UID at startup
* Create user jovyan with UID=1000 in the default users group in the Dockerfile
* Set group ownership of user home and conda to root to avoid 'users' group from host access when mounted
* Set stick bit on both paths so root owns subdirs too
* Change jovyan UID if NB_UID is specified and is not the default 1000

Contribution (c) Copyright IBM Corp. 2015
2015-09-10 23:46:31 -04:00
Peter Parente
7c9edef43d Fix missing install-self on py2 kernelspec 2015-08-30 21:56:48 -04:00
Peter Parente
7e5c7a77ac Merge pull request #21 from parente/costerwi-start-notebook
Add user in script + fixes
2015-08-30 19:33:21 -04:00
Peter Parente
5bc8eb1822 Make jovyan name / paths constant 2015-08-30 09:11:19 -04:00
Peter Parente
701212dbf1 Explicitly set USER root in every Dockerfile
Contribution (c) Copyright IBM Corp. 2015
2015-08-29 21:50:04 -04:00
Peter Parente
80c8475276 Improve start-notebook.sh checks
* Only create jovyan and set perms if user does not exist
* Allow docker host mount for NB_WORK: copy skel files if useradd fails because home dir already exists

Contribution (c) Copyright IBM Corp. 2015
2015-08-28 23:45:01 -04:00
Peter Parente
c4616560cf Make subimages compatible with late user creation
* Always remain as root during install
* Put kernel specs in system path, not user home
* Create user work directory at startup
* Note this is in 4.0 and up images, not 3.2

Contribution (c) Copyright IBM Corp. 2015
2015-08-28 23:43:57 -04:00
Carl Osterwisch
30932a3b12 Revert to using supervisord to launch notebook
Used to relaunch notebook and collect logging data.
2015-08-28 23:39:08 -04:00
Carl Osterwisch
f2b7f38df6 Added NB_UID to docs 2015-08-28 23:39:08 -04:00
Carl Osterwisch
7fad0c43f6 Move useradd, enable_sudo.sh, and server launch into start-notebook.sh
Provides ability to specify NB_USER and NB_UID at docker run time rather than build time.
2015-08-28 23:39:08 -04:00
Carl Osterwisch
c0dace3671 Expand $CONDA_DIR prior to writing /etc/profile.d/conda.sh 2015-08-28 23:39:08 -04:00
Peter Parente
6c64040fd2 Fix README copy/paste image name errors 2015-08-28 13:17:00 -04:00
Peter Parente
8cc825b744 Updated README with new stack, lastest/master ref 2015-08-28 08:08:14 -04:00
Peter Parente
dcf80142f5 Merge pull request #19 from parente/datascience-stack
Updates to nymoorland datascience-notebook stack
2015-08-27 22:11:19 -04:00