hazza/docker-stacks
1
0
Fork 0
mirror of https://github.com/jupyter/docker-stacks.git synced 2025-10-08 02:24:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,692 Commits 4 Branches 0 Tags
288fb0e1cc17bffc5a6b1fe02cf9f55050e55762
Commit Graph

117 Commits

Author SHA1 Message Date
James Bourbeau
288fb0e1cc Update dask-labextension recipe for JupyterLab 3 2021-02-06 12:15:53 -06:00
Peter Parente
5cfa60996e Merge pull request #1192 from romainx/feat_spark_install 
Improve spark installation
 2020-11-29 14:01:02 -05:00
Peter Parente
8ea7abc5b7 Merge pull request #1188 from mathbunnyru/asalikhov/remove_emacs_jed 
Remove emacs and jed from the minimal image
 2020-11-29 10:41:40 -05:00
Peter Parente
d53a302fbc Merge pull request #1189 from romainx/feat_miniforge 
Switch from Miniconda to Miniforge
 2020-11-29 10:13:24 -05:00
romainx
1dca39182b Improve spark installation 
Spark installation improved by sourcing the `spark-config.sh` in the `before-notebook.d` hook that is run by `start.sh`. It permits to add automatically the right Py4J dependency version in the `PYTHONPATH`. So it is not needed anymore to set this variable at build time.

Documentation describing the installation of a custom Spark version modified to remove this step. Also updated to install the latest `2.x` Spark version.

`test_pyspark` fixed (was always OK before that).
 2020-11-24 20:40:06 +01:00
Matheus Canon
fd43b71a1a Add kotlin-notebook in selecting.md community stacks 2020-11-15 21:05:02 -03:00
romainx
c6764656cc typo 2020-11-14 12:03:13 +01:00
romainx
7d550a0a83 Document how to use defaults channels to install packages 2020-11-14 11:58:07 +01:00
romainx
8763e8c628 Doc update 2020-11-13 19:29:02 +01:00
Ayaz Salikhov
4eb8dac8de Remove emacs and jed from the minimal image 2020-11-12 15:35:24 +03:00
Romain
5ee27aa513 Merge pull request #1178 from das-g/copy-with-chown-in-recipes-dockerfiles 
recipes: use COPY with --chown for jovyan's files
 2020-10-24 22:17:03 +02:00
romainx
f055648e44 Rollback changes made on editors 2020-10-21 08:23:49 +02:00
romainx
32090f6011 Update docker stack 2020-11-20 
The following changes have been made.

- `base-notebook`
  - `Changed`: Bump Ubuntu
  - `Changed`: Bump conda
  - `Fixed`: Add missing `apt-get clean`
- `minimal-notebook`
  - `Removed`: `jed` editor see #1174 (partial)
  - `Deprecated`: `emacs` editor (in the documentation and in the image) see #1174 (partial)
- `scipy-notebook`
  - `Fixed`: Add missing `apt-get clean`
  - `Changed`: Bump `dask`
  - `Changed`: Bump `protobuf`
- `r-notebook`
  - `Changed`: Bump `r-base`
  - `Changed`: Bump `r-rmarkdown`
  - `Removed`: The description of `tidyverse` packages because it's not the place to do that and it will always be obsolete.
- `datascience-notebook`
  - `Changed`: Bump `r-base` to `4.0.x` see #1102 (partial)
  - `Removed`: `plyr` package because it's retired fixes #1103
  - `Removed`: `r-reshape2` package because it's retired fixes #1103
  - `Changed`: Bump `r-rmarkdown`
  - `Changed`: Bump Julia
- `tensorflow-notebook`
  - `Changed`: Bump `tensorflow`
- `pyspark-notebook`
  - `Fixed`: Add missing `apt-get clean`
  - `Changed`: Bump `pyarrow`
- `all-spark-notebook`
  - `Fixed`: Add missing `apt-get clean`
  - `Changed`: Bump `r-base` to `4.0.x` see #1102 (partial)
  - `Changed`: Bump `r-sparklyr`
 2020-10-20 11:36:34 +02:00
Raphael Das Gupta
d6da5aef56 recipes: use COPY with --chown for jovyan's files 
By default, Dockerfile's COPY creates files and directories with UID and
GID 0. (See https://docs.docker.com/engine/reference/builder/#copy)
When we put them in jovyan's $HOME or want jovyan to manipulate these
files, they should be owned by jovyan instead.

Specifically
https://jupyter-docker-stacks.readthedocs.io/en/latest/using/recipes.html#add-a-python-3-x-environment
failed with a "permission denied" error when the code for using an
environment.yml file was uncommented. I assume some of the other recipes
might have failed like that, too, but I didn't test them.
 2020-10-09 19:18:11 +02:00
romainx
8201c14ef4 nano -> nano-tiny 2020-09-30 06:45:26 +02:00
romainx
8cd98a1bff Fixes #1161 
Added a note in the documentation to indicate that the build will only work with Spark current versions.
 2020-09-17 04:50:11 +02:00
romainx
8669d6e79b Resolves #1131: Allow alternative Spark version 
Allow to build `pyspark-notebook` image with an alternative Spark version.

- Define arguments for Spark installation
- Add a note in "Image Specifics" explaining how to build an image with an alternative Spark version
- Remove Toree documentation from "Image Specifics" since its support has been droped in #1115
 2020-08-15 20:19:35 +02:00
Peter Parente
95f792c690 Travis -> GitHub Actions in doc 2020-08-07 22:52:12 -04:00
Tiffany A. Timbers
1fa0d4824c Merge branch 'master' into r4.0 2020-06-17 20:09:25 -07:00
ttimbers
a883ce1794 versions and tidymodels 
- added versions to ggplot2 and sparklyr for all-spark-notebook
- added tidymodels to r-notebook and docs

closes #1102
 2020-06-05 14:41:12 -07:00
ttimbers
13059e5f06 removed plyr and reshape2 
closes #1103
 2020-06-05 14:04:36 -07:00
Peter Parente
1c204509e1 Merge branch 'master' into asalikhov/ubuntu_focal 2020-05-29 09:12:34 -04:00
Peter Parente
40d2312b1e Merge branch 'master' into asalikhov/improve_docs 2020-05-29 09:10:49 -04:00
Romain
c83024c950 Add spark notebook tests and change examples 
* Test added for all kernels
* Same examples as provided in the documentation (`specifics.md`)
* Used the same use case for all examples: sum of the first 100 whole numbers

Note: I've not automatically tested `local_sparklyr.ipynb` since it creates by default the `metastore_db` dir and the `derby.log` file in the working directory. Since I mount it in `RO` it's not working. I'm struggling to set it elsewhere...
 2020-05-29 06:54:46 +02:00
Romain
36dc621f97 typo 2020-05-28 12:34:50 +02:00
Romain
3277f48c23 Follow-on PR #911: Spark documentation rework 
Some changes to the Spark documentation
for local and standalone use cases with the following drivers

* Simplify some of them (removing options, etc.)
* Use the same code as much as possible in each example to be consistent (only kept R different from the others)
* Add Sparklyr as an option for R
* Add some notes about prerequisites (same version of Python, R installed on workers)
 2020-05-28 12:26:09 +02:00
Ayaz Salikhov
b6d96d1ca2 Improve documentation 2020-05-28 11:47:48 +02:00
Ayaz Salikhov
a2086ce626 Start using Ubuntu 20.04 (focal) 2020-05-28 10:42:03 +02:00
Travis CI
44a7d70805 Remove mesos lib from pyspark-notebook 2020-05-24 14:18:47 -04:00
Peter Parente
11d87b2281 Merge branch 'master' into #1077 2020-05-20 23:23:44 -04:00
Ian Coffey
e243eeb0f6 add --no-cache-dir to autosklearn recipe 2020-05-15 18:03:18 -04:00
Ian Coffey
6f8ac879fe Merge branch 'master' into auto_sklearn 2020-05-14 10:28:57 -04:00
Ian Coffey
1a56c47dfe Improve formatting for autosklearn recipe 2020-05-14 10:25:18 -04:00
romainx
bcf1f53229 Fix #1077 
* Documentation `common.md` updated
* `test_nb_user_change` test written
 2020-05-02 17:25:14 +02:00
James Brock
6bf8482a68 ihaskell-notebook binder urlpath 
Change the Community Stacks ihaskell-notebook Binder urlpath to the revived IHaskell.ipynb notebook.
 2020-04-27 14:57:07 +09:00
Ian Coffey
5fc77daf33 Merge branch 'master' into auto_sklearn 2020-04-24 14:30:34 -04:00
Mark
7fef9cb754 Merge branch 'master' into add_pytables_bottleneck 2020-04-23 12:16:19 -04:00
Mark Dean
e0c13ceb51 update docs 2020-04-23 09:19:06 -04:00
romainx
c0ff7e08b3 Added dask to scipy-notebook doc 2020-04-23 09:08:17 +02:00
romainx
50ce2ec609 Selecting image doc minor fixes 
* Fix a sentence saying that `pandoc` is not installed on `base-notebook` #1013
* Precision on emacs installation (`emacs-nox`) #1059
 2020-04-23 08:30:57 +02:00
Ian Coffey
2dceea02d7 add a recipe around being able to install auto_sklearn 2020-04-22 09:55:14 -04:00
Peter Parente
57b78ba3b0 Merge branch 'master' into add-vim 2020-04-19 12:02:35 -04:00
romainx
2ebcdc5884 #1060 Fix conda command to create env 
`conda env create` is only to create environment from a `YAML` file.  Fixed the command in "Add a Python 3.x environment".

[Reference](https://conda.io/projects/conda/en/latest/user-guide/tasks/manage-environments.html)
 2020-04-10 22:15:19 +02:00
Peter Prescott
31262fe7ad do requested edit 2020-04-07 09:25:13 +01:00
Peter Prescott
8d918bd978 Fix tab typo 2020-04-06 21:21:31 +01:00
Peter Prescott
5765399ca4 add vim-tiny for now 2020-04-06 11:05:29 +01:00
Peter Prescott
75e586293f add mention of vim to docs 2020-04-06 08:32:34 +01:00
Ray Bell
c063aa650e Add an image tag 2020-03-16 23:22:26 -04:00
Ray Bell
323c3a0348 fix hyperlink 2020-03-16 23:16:43 -04:00
Ray Bell
fcafc155db Update docs/using/recipes.md 
Co-Authored-By: Peter Parente <parente@gmail.com>
 2020-03-16 23:07:07 -04:00