Commit Graph

299 Commits

Author SHA1 Message Date
Peter Parente
3afdf219f0 Merge pull request #77 from lbustelo/master
Updating to reflect changes in how Spark Kernel is build and packaged
2015-12-09 17:01:52 -05:00
Gino Bustelo
ff62ff0f8c Updating to reflect changes in how Spark Kernel is build and packaged
(c) Copyright IBM Corp. 2015
2015-12-09 14:45:08 -06:00
Min RK
cbf05e05fc Merge pull request #74 from parente/add-rpy2
Add rpy2
2015-12-07 22:51:27 +01:00
Peter Parente
0a29b08d7c Add rpy2
Requires bump of devtools, tidyr, and rmarkdown too

(c) Copyright IBM Corp. 2015
2015-12-05 21:26:47 -05:00
Peter Parente
a5678f472c Merge pull request #72 from parente/fix-ds-bump
Fix datascience-notebook build after pandas bump
2015-12-04 22:39:56 -05:00
Peter Parente
8b0d810878 Fix datascience-notebook build after pandas bump
patsy, numba, bokeh all need upgrade to satisfy conda constraints

(c) Copyright IBM Corp. 2015
2015-12-04 22:36:51 -05:00
Peter Parente
beb29fb1cb Merge pull request #71 from parente/fix-scipy
Fix scipy-notebook build after pandas bump
2015-12-04 22:21:08 -05:00
Peter Parente
913c277297 Fix scipy-notebook build after pandas bump
patsy, numba, bokeh all need upgrade to satisfy conda constraints

(c) Copyright IBM Corp. 2015
2015-12-04 22:16:47 -05:00
Peter Parente
4ec01b31cb Merge pull request #70 from jtyberg/bump_pandas
Bump to pandas 0.17
2015-12-04 21:51:37 -05:00
Justin Tyberg
e53b288e6e Bump to pandas 0.17.
(c) Copyright IBM Corp. 2015
2015-12-04 17:47:12 -05:00
Peter Parente
46178069c9 Add tips and gotchas section
* Start with hint from issue #63

(c) Copyright IBM Corp. 2015
2015-11-20 22:27:38 -05:00
Peter Parente
ebda307c7c Doc --net=host requirements for su
(c) Copyright IBM Corp. 2015
2015-11-20 20:09:40 -05:00
Peter Parente
dbb9c7b505 Merge pull request #66 from parente/pin-spark-kernel
Build spark kernel from specific SHA
2015-11-19 07:34:59 -05:00
Peter Parente
de9267afa9 Build spark kernel from specific SHA
Allows rebuilds against git SHAs in docker-stacks

(c) Copyright IBM Corp. 2015
2015-11-18 22:47:34 -05:00
Peter Parente
d58f481ac5 Pointer to recipes wiki page 2015-11-10 12:08:40 -05:00
Peter Parente
adbc703165 Merge pull request #61 from alewitt/master
Updating Readmes for Spark UI support
2015-11-10 10:34:36 -05:00
Alexander Lewitt
2a6c7a59ed pyspark readme, spark ui support.
adding instructions for how to open an extra port in order to view spark ui monitoring status.
2015-11-10 09:55:12 -05:00
Alexander Lewitt
53cc2f5d34 Update spark readme for spark ui instructions
Instructions to open an extra port to be able to see the spark ui for monitoring execution status.
2015-11-10 09:52:25 -05:00
Peter Parente
a388c4a66f Add temporary rzmq workaround to other R stacks
Required to rebuild now that a merge went in touching minimal

(c) Copyright IBM Corp. 2015
2015-10-24 22:40:59 -04:00
Peter Parente
744c903854 Merge pull request #50 from parente/doc-cmd-args
Remove trivial env vars, doc command line args
2015-10-24 22:36:03 -04:00
Peter Parente
1fb0494a3b Merge pull request #57 from parente/fix-r-deps-in-all-spark
Add system prereqs for R to all-spark-notebook
2015-10-23 19:38:11 -04:00
Peter Parente
41222b047c Add system prereqs for R to all-spark-notebook
* Copy/paste from r-notebook
* Also add PORT option to make dev target for easy of testing

(c) Copyright IBM Corp. 2015
2015-10-22 21:30:19 -04:00
Peter Parente
945db0f8fd Merge pull request #56 from parente/spark-1.5.1
Update to Spark 1.5.1
2015-10-22 12:27:50 -04:00
Peter Parente
76073ddf2d Temporary workaround for rzmq missing deps
(c) Copyright IBM Corp. 2015
2015-10-22 12:19:07 -04:00
Kai Wang
817550198f update for Spark 1.5.1 2015-10-21 15:22:57 +00:00
Peter Parente
f5bb3d4801 Remove need to quote >1 args to start-notebook
(c) Copyright IBM Corp. 2015
2015-10-20 22:43:32 -04:00
Peter Parente
3411997451 Retain current default port and interface IP
(c) Copyright IBM Corp. 2015
2015-10-20 22:43:12 -04:00
Min RK
2819b2b393 Merge pull request #49 from parente/readme-updates
Readme updates to remove legacy version info

closes #48
2015-10-20 15:21:58 +01:00
Peter Parente
ad99f8c74f Remove trivial env vars, doc command line args
* Remove PORT and INTERFACE env vars which can conflict with other systems (e.g., Mesos)
* Document command line pass-through to start-notebook.sh

(c) Copyright IBM Corp. 2015
2015-10-19 09:36:28 -04:00
Peter Parente
ab2414f0c5 Point to the folder READMEs from the top-level
(c) Copyright IBM Corp. 2015
2015-10-19 09:07:13 -04:00
Peter Parente
488aa7ba64 Remove 3.x vs 4.x legacy info from README
Fixes #48

(c) Copyright IBM Corp. 2015
2015-10-19 09:05:10 -04:00
Peter Parente
cc0ac6ce2a Update README with starting SHA for new versioning 2015-10-16 22:06:08 -04:00
Peter Parente
9bd33dcc86 Fix release-all build ordering
It was working, but it could end up using an old minimal notebook to rebuild other stacks before rebuilding minimal-notebook

(c) Copyright IBM Corp. 2015
2015-10-16 13:17:38 -04:00
Peter Parente
fbac8a1be7 Merge pull request #46 from parente/new-build
New versioning scheme
2015-10-16 13:03:35 -04:00
Peter Parente
8b20913b5e New versioning scheme
(c) Copyright IBM Corp. 2015
2015-10-15 12:20:06 -04:00
Peter Parente
43e1914065 Add doc about conda environments
Contribution (c) Copyright IBM Corp. 2015
2015-10-07 22:31:27 -04:00
Peter Parente
1f282e8a27 Document Mesos user flag requirements 2015-10-07 22:05:45 -04:00
Peter Parente
6e7c1574a6 Note tini is in 4.0 and up images 2015-09-23 20:17:33 -04:00
Kyle Kelley
dcd0a71876 Merge pull request #38 from parente/tini-init
Swap tini in for supervisord
2015-09-23 07:46:02 -05:00
Peter Parente
4c34446dc7 Fix jovyan hardcode in start-notebook.sh
Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:50 -04:00
Peter Parente
d425a3a502 Mention tini and start-notebook.sh in READMEs
Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:42 -04:00
Peter Parente
678b64e9e4 Swap tini for supervisord
* Pass $@ args to start-notebook.sh
* Set tini as entrypoint, but keep start-notebook.sh as easily overridable CMD
* su to jovyan user within start-notebook.sh script

Contribution (c) Copyright IBM Corp. 2015
2015-09-22 20:51:18 -04:00
Peter Parente
735c520486 Merge pull request #35 from jtyberg/pem_dir
Ensure PEM file directory exists before creating file.
2015-09-15 21:19:25 -04:00
Justin Tyberg
163867cb4d Set permissions on PEM_FILE, if generated. 2015-09-15 21:15:30 -04:00
Justin Tyberg
5956f1ae84 Ensure PEM file directory exists before creating file.
Fixes issue #34
2015-09-15 11:15:29 -04:00
Peter Parente
78df4dc0e7 Add maintainer workflows to README
Fixes issue #11
2015-09-12 21:41:20 -04:00
Peter Parente
e8df9912e2 Merge pull request #31 from parente/early-user-late-uid
Create jovyan in Dockerfile, reset UID at startup
2015-09-12 21:05:59 -04:00
Peter Parente
aec1c74825 Fix wrong user for apt-get in r-notebook 2015-09-12 20:39:55 -04:00
Peter Parente
d51afb34f7 Explicitly document jovyan user 2015-09-12 20:39:31 -04:00
Peter Parente
0c508efe4e Set group=users on home and conda dir 2015-09-12 20:37:53 -04:00