Alexander Lewitt
2a6c7a59ed
pyspark readme, spark ui support.
...
adding instructions for how to open an extra port in order to view spark ui monitoring status.
2015-11-10 09:55:12 -05:00
Alexander Lewitt
53cc2f5d34
Update spark readme for spark ui instructions
...
Instructions to open an extra port to be able to see the spark ui for monitoring execution status.
2015-11-10 09:52:25 -05:00
Peter Parente
a388c4a66f
Add temporary rzmq workaround to other R stacks
...
Required to rebuild now that a merge went in touching minimal
(c) Copyright IBM Corp. 2015
2015-10-24 22:40:59 -04:00
Peter Parente
744c903854
Merge pull request #50 from parente/doc-cmd-args
...
Remove trivial env vars, doc command line args
2015-10-24 22:36:03 -04:00
Peter Parente
1fb0494a3b
Merge pull request #57 from parente/fix-r-deps-in-all-spark
...
Add system prereqs for R to all-spark-notebook
2015-10-23 19:38:11 -04:00
Peter Parente
41222b047c
Add system prereqs for R to all-spark-notebook
...
* Copy/paste from r-notebook
* Also add PORT option to make dev target for easy of testing
(c) Copyright IBM Corp. 2015
2015-10-22 21:30:19 -04:00
Peter Parente
945db0f8fd
Merge pull request #56 from parente/spark-1.5.1
...
Update to Spark 1.5.1
2015-10-22 12:27:50 -04:00
Peter Parente
76073ddf2d
Temporary workaround for rzmq missing deps
...
(c) Copyright IBM Corp. 2015
2015-10-22 12:19:07 -04:00
Kai Wang
817550198f
update for Spark 1.5.1
2015-10-21 15:22:57 +00:00
Peter Parente
f5bb3d4801
Remove need to quote >1 args to start-notebook
...
(c) Copyright IBM Corp. 2015
2015-10-20 22:43:32 -04:00
Peter Parente
3411997451
Retain current default port and interface IP
...
(c) Copyright IBM Corp. 2015
2015-10-20 22:43:12 -04:00
Min RK
2819b2b393
Merge pull request #49 from parente/readme-updates
...
Readme updates to remove legacy version info
closes #48
2015-10-20 15:21:58 +01:00
Peter Parente
ad99f8c74f
Remove trivial env vars, doc command line args
...
* Remove PORT and INTERFACE env vars which can conflict with other systems (e.g., Mesos)
* Document command line pass-through to start-notebook.sh
(c) Copyright IBM Corp. 2015
2015-10-19 09:36:28 -04:00
Peter Parente
ab2414f0c5
Point to the folder READMEs from the top-level
...
(c) Copyright IBM Corp. 2015
2015-10-19 09:07:13 -04:00
Peter Parente
488aa7ba64
Remove 3.x vs 4.x legacy info from README
...
Fixes #48
(c) Copyright IBM Corp. 2015
2015-10-19 09:05:10 -04:00
Peter Parente
cc0ac6ce2a
Update README with starting SHA for new versioning
2015-10-16 22:06:08 -04:00
Peter Parente
9bd33dcc86
Fix release-all build ordering
...
It was working, but it could end up using an old minimal notebook to rebuild other stacks before rebuilding minimal-notebook
(c) Copyright IBM Corp. 2015
2015-10-16 13:17:38 -04:00
Peter Parente
fbac8a1be7
Merge pull request #46 from parente/new-build
...
New versioning scheme
2015-10-16 13:03:35 -04:00
Peter Parente
8b20913b5e
New versioning scheme
...
(c) Copyright IBM Corp. 2015
2015-10-15 12:20:06 -04:00
Peter Parente
43e1914065
Add doc about conda environments
...
Contribution (c) Copyright IBM Corp. 2015
2015-10-07 22:31:27 -04:00
Peter Parente
1f282e8a27
Document Mesos user flag requirements
2015-10-07 22:05:45 -04:00
Peter Parente
6e7c1574a6
Note tini is in 4.0 and up images
2015-09-23 20:17:33 -04:00
Kyle Kelley
dcd0a71876
Merge pull request #38 from parente/tini-init
...
Swap tini in for supervisord
2015-09-23 07:46:02 -05:00
Peter Parente
4c34446dc7
Fix jovyan hardcode in start-notebook.sh
...
Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:50 -04:00
Peter Parente
d425a3a502
Mention tini and start-notebook.sh in READMEs
...
Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:42 -04:00
Peter Parente
678b64e9e4
Swap tini for supervisord
...
* Pass $@ args to start-notebook.sh
* Set tini as entrypoint, but keep start-notebook.sh as easily overridable CMD
* su to jovyan user within start-notebook.sh script
Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:18 -04:00
Peter Parente
735c520486
Merge pull request #35 from jtyberg/pem_dir
...
Ensure PEM file directory exists before creating file.
2015-09-15 21:19:25 -04:00
Justin Tyberg
163867cb4d
Set permissions on PEM_FILE, if generated.
2015-09-15 21:15:30 -04:00
Justin Tyberg
5956f1ae84
Ensure PEM file directory exists before creating file.
...
Fixes issue #34
2015-09-15 11:15:29 -04:00
Peter Parente
78df4dc0e7
Add maintainer workflows to README
...
Fixes issue #11
2015-09-12 21:41:20 -04:00
Peter Parente
e8df9912e2
Merge pull request #31 from parente/early-user-late-uid
...
Create jovyan in Dockerfile, reset UID at startup
2015-09-12 21:05:59 -04:00
Peter Parente
aec1c74825
Fix wrong user for apt-get in r-notebook
2015-09-12 20:39:55 -04:00
Peter Parente
d51afb34f7
Explicitly document jovyan user
2015-09-12 20:39:31 -04:00
Peter Parente
0c508efe4e
Set group=users on home and conda dir
2015-09-12 20:37:53 -04:00
Peter Parente
69c5c35f7f
Run pyspark, all-spark, scipy, r conda installs as jovyan
...
… but install kernel specs global to avoid problems when switching NB_UID
Contribution (c) Copyright IBM Corp. 2015
2015-09-11 00:36:40 -04:00
Peter Parente
b6ecf61df2
Fix for issue #30 , missing ijulia
...
Contribution (c) Copyright IBM Corp. 2015
2015-09-11 00:31:40 -04:00
Peter Parente
dba9977525
Create jovyan in Dockerfile, reset UID at startup
...
* Create user jovyan with UID=1000 in the default users group in the Dockerfile
* Set group ownership of user home and conda to root to avoid 'users' group from host access when mounted
* Set stick bit on both paths so root owns subdirs too
* Change jovyan UID if NB_UID is specified and is not the default 1000
Contribution (c) Copyright IBM Corp. 2015
2015-09-10 23:46:31 -04:00
Peter Parente
7c9edef43d
Fix missing install-self on py2 kernelspec
2015-08-30 21:56:48 -04:00
Peter Parente
7e5c7a77ac
Merge pull request #21 from parente/costerwi-start-notebook
...
Add user in script + fixes
2015-08-30 19:33:21 -04:00
Peter Parente
5bc8eb1822
Make jovyan name / paths constant
2015-08-30 09:11:19 -04:00
Peter Parente
701212dbf1
Explicitly set USER root in every Dockerfile
...
Contribution (c) Copyright IBM Corp. 2015
2015-08-29 21:50:04 -04:00
Peter Parente
80c8475276
Improve start-notebook.sh checks
...
* Only create jovyan and set perms if user does not exist
* Allow docker host mount for NB_WORK: copy skel files if useradd fails because home dir already exists
Contribution (c) Copyright IBM Corp. 2015
2015-08-28 23:45:01 -04:00
Peter Parente
c4616560cf
Make subimages compatible with late user creation
...
* Always remain as root during install
* Put kernel specs in system path, not user home
* Create user work directory at startup
* Note this is in 4.0 and up images, not 3.2
Contribution (c) Copyright IBM Corp. 2015
2015-08-28 23:43:57 -04:00
Carl Osterwisch
30932a3b12
Revert to using supervisord to launch notebook
...
Used to relaunch notebook and collect logging data.
2015-08-28 23:39:08 -04:00
Carl Osterwisch
f2b7f38df6
Added NB_UID to docs
2015-08-28 23:39:08 -04:00
Carl Osterwisch
7fad0c43f6
Move useradd, enable_sudo.sh, and server launch into start-notebook.sh
...
Provides ability to specify NB_USER and NB_UID at docker run time rather than build time.
2015-08-28 23:39:08 -04:00
Carl Osterwisch
c0dace3671
Expand $CONDA_DIR prior to writing /etc/profile.d/conda.sh
2015-08-28 23:39:08 -04:00
Peter Parente
6c64040fd2
Fix README copy/paste image name errors
2015-08-28 13:17:00 -04:00
Peter Parente
8cc825b744
Updated README with new stack, lastest/master ref
2015-08-28 08:08:14 -04:00
Peter Parente
dcf80142f5
Merge pull request #19 from parente/datascience-stack
...
Updates to nymoorland datascience-notebook stack
2015-08-27 22:11:19 -04:00