Commit Graph

143 Commits

Author SHA1 Message Date
Ayaz Salikhov
57c360e485 Merge branch 'master' into asalikhov/make_markdown_prettier 2021-05-19 12:42:44 +03:00
Erik Sundell
25a5c0639f Merge pull request #1302 from dimm0/master
Added Pacific Research Platform (PRP) managed images registry to community
2021-05-19 03:45:55 +02:00
Erik Sundell
b4f6714028 Merge pull request #1274 from mathbunnyru/asalikhov/rename_cloud_to_hub
Fix Docker Cloud -> Docker Hub and GitHub Actions related changes
2021-05-19 03:42:53 +02:00
Dmitry Mishin
b01cf84e98 Update docs/using/selecting.md
Co-authored-by: Erik Sundell <erik.i.sundell@gmail.com>
2021-05-15 09:39:39 -07:00
Dmitry Mishin
050df79c5f Added PRP managed images registry to community 2021-05-11 10:27:22 -07:00
Ayaz Salikhov
b748228e7e Fix dead links in docs 2021-05-07 13:46:59 +03:00
Ayaz Salikhov
becf59d83d Merge branch 'master' into asalikhov/rename_cloud_to_hub 2021-05-07 01:44:12 +03:00
Ayaz Salikhov
453556b2c4 Make markdown files look prettier using prettier :) 2021-05-07 00:53:06 +03:00
Ayaz Salikhov
a3d9bb8f61 Merge branch 'master' into asalikhov/fix_markdown 2021-05-06 19:59:49 +03:00
Romain
ef470a62da Update docs/using/specifics.md
Add explicit link to archive repo
2021-05-04 07:42:26 +02:00
Ayaz Salikhov
0fff54f3f2 Install spark from archive.apache.org to be able to use old versions 2021-05-02 23:28:32 +03:00
Ayaz Salikhov
c5aa354b09 Fix more errors 2021-05-01 13:29:58 +03:00
Ayaz Salikhov
09db3a4c16 Fix more errors 2021-05-01 13:09:26 +03:00
Ayaz Salikhov
c2031e2a4a Fix more errors 2021-05-01 13:07:40 +03:00
Ayaz Salikhov
14557c148a Rename Docker Cloud -> Docker Hub 2021-04-29 22:00:05 +03:00
Ayaz Salikhov
a8b7682fd6 Add newlines 2021-04-17 18:20:37 +03:00
Ayaz Salikhov
bf9660a054 Bunch of small refactorings and updates 2021-04-17 13:25:23 +03:00
romainx
2820438867 formatting 2021-04-01 07:00:00 +02:00
Antony Neu
ef46244450 Added whitespace 2021-03-27 10:30:43 +01:00
Antony Neu
1577d62798 Fixed issue with build arg 2021-03-27 10:20:56 +01:00
Tony
74fe49040b Add build arg for delta lake version
Co-authored-by: Romain <romainx@users.noreply.github.com>
2021-03-27 10:09:14 +01:00
Tony
fa8cea32f6 Add run of pyspark
Co-authored-by: Romain <romainx@users.noreply.github.com>
2021-03-27 10:08:54 +01:00
Tony
ed67f69ae2 Update docs/using/recipes.md
Co-authored-by: Romain <romainx@users.noreply.github.com>
2021-03-27 10:06:38 +01:00
Antony Neu
430b1cd57d Formatting 2021-03-21 16:04:47 +01:00
Antony Neu
646f9f4cd2 Added recipe for Delta lake 2021-03-21 16:01:38 +01:00
romainx
e8139fdf85 Mamba in base-notebook 2021-02-27 17:29:00 +01:00
James Bourbeau
288fb0e1cc Update dask-labextension recipe for JupyterLab 3 2021-02-06 12:15:53 -06:00
Peter Parente
5cfa60996e Merge pull request #1192 from romainx/feat_spark_install
Improve spark installation
2020-11-29 14:01:02 -05:00
Peter Parente
8ea7abc5b7 Merge pull request #1188 from mathbunnyru/asalikhov/remove_emacs_jed
Remove emacs and jed from the minimal image
2020-11-29 10:41:40 -05:00
Peter Parente
d53a302fbc Merge pull request #1189 from romainx/feat_miniforge
Switch from Miniconda to Miniforge
2020-11-29 10:13:24 -05:00
romainx
1dca39182b Improve spark installation
Spark installation improved by sourcing the `spark-config.sh` in the `before-notebook.d` hook that is run by `start.sh`. It permits to add automatically the right Py4J dependency version in the `PYTHONPATH`. So it is not needed anymore to set this variable at build time.

Documentation describing the installation of a custom Spark version modified to remove this step. Also updated to install the latest `2.x` Spark version.

`test_pyspark` fixed (was always OK before that).
2020-11-24 20:40:06 +01:00
Matheus Canon
fd43b71a1a Add kotlin-notebook in selecting.md community stacks 2020-11-15 21:05:02 -03:00
romainx
c6764656cc typo 2020-11-14 12:03:13 +01:00
romainx
7d550a0a83 Document how to use defaults channels to install packages 2020-11-14 11:58:07 +01:00
romainx
8763e8c628 Doc update 2020-11-13 19:29:02 +01:00
Ayaz Salikhov
4eb8dac8de Remove emacs and jed from the minimal image 2020-11-12 15:35:24 +03:00
Romain
5ee27aa513 Merge pull request #1178 from das-g/copy-with-chown-in-recipes-dockerfiles
recipes: use COPY with --chown for jovyan's files
2020-10-24 22:17:03 +02:00
romainx
f055648e44 Rollback changes made on editors 2020-10-21 08:23:49 +02:00
romainx
32090f6011 Update docker stack 2020-11-20
The following changes have been made.

- `base-notebook`
  - `Changed`: Bump Ubuntu
  - `Changed`: Bump conda
  - `Fixed`: Add missing `apt-get clean`
- `minimal-notebook`
  - `Removed`: `jed` editor see #1174 (partial)
  - `Deprecated`: `emacs` editor (in the documentation and in the image) see #1174 (partial)
- `scipy-notebook`
  - `Fixed`: Add missing `apt-get clean`
  - `Changed`: Bump `dask`
  - `Changed`: Bump `protobuf`
- `r-notebook`
  - `Changed`: Bump `r-base`
  - `Changed`: Bump `r-rmarkdown`
  - `Removed`: The description of `tidyverse` packages because it's not the place to do that and it will always be obsolete.
- `datascience-notebook`
  - `Changed`: Bump `r-base` to `4.0.x` see #1102 (partial)
  - `Removed`: `plyr` package because it's retired fixes #1103
  - `Removed`: `r-reshape2` package because it's retired fixes #1103
  - `Changed`: Bump `r-rmarkdown`
  - `Changed`: Bump Julia
- `tensorflow-notebook`
  - `Changed`: Bump `tensorflow`
- `pyspark-notebook`
  - `Fixed`: Add missing `apt-get clean`
  - `Changed`: Bump `pyarrow`
- `all-spark-notebook`
  - `Fixed`: Add missing `apt-get clean`
  - `Changed`: Bump `r-base` to `4.0.x` see #1102 (partial)
  - `Changed`: Bump `r-sparklyr`
2020-10-20 11:36:34 +02:00
Raphael Das Gupta
d6da5aef56 recipes: use COPY with --chown for jovyan's files
By default, Dockerfile's COPY creates files and directories with UID and
GID 0. (See https://docs.docker.com/engine/reference/builder/#copy)
When we put them in jovyan's $HOME or want jovyan to manipulate these
files, they should be owned by jovyan instead.

Specifically
https://jupyter-docker-stacks.readthedocs.io/en/latest/using/recipes.html#add-a-python-3-x-environment
failed with a "permission denied" error when the code for using an
environment.yml file was uncommented. I assume some of the other recipes
might have failed like that, too, but I didn't test them.
2020-10-09 19:18:11 +02:00
romainx
8201c14ef4 nano -> nano-tiny 2020-09-30 06:45:26 +02:00
romainx
8cd98a1bff Fixes #1161
Added a note in the documentation to indicate that the build will only work with Spark current versions.
2020-09-17 04:50:11 +02:00
romainx
8669d6e79b Resolves #1131: Allow alternative Spark version
Allow to build `pyspark-notebook` image with an alternative Spark version.

- Define arguments for Spark installation
- Add a note in "Image Specifics" explaining how to build an image with an alternative Spark version
- Remove Toree documentation from "Image Specifics" since its support has been droped in #1115
2020-08-15 20:19:35 +02:00
Peter Parente
95f792c690 Travis -> GitHub Actions in doc 2020-08-07 22:52:12 -04:00
Tiffany A. Timbers
1fa0d4824c Merge branch 'master' into r4.0 2020-06-17 20:09:25 -07:00
ttimbers
a883ce1794 versions and tidymodels
- added versions to ggplot2 and sparklyr for all-spark-notebook
- added tidymodels to r-notebook and docs

closes #1102
2020-06-05 14:41:12 -07:00
ttimbers
13059e5f06 removed plyr and reshape2
closes #1103
2020-06-05 14:04:36 -07:00
Peter Parente
1c204509e1 Merge branch 'master' into asalikhov/ubuntu_focal 2020-05-29 09:12:34 -04:00
Peter Parente
40d2312b1e Merge branch 'master' into asalikhov/improve_docs 2020-05-29 09:10:49 -04:00
Romain
c83024c950 Add spark notebook tests and change examples
* Test added for all kernels
* Same examples as provided in the documentation (`specifics.md`)
* Used the same use case for all examples: sum of the first 100 whole numbers

Note: I've not automatically tested `local_sparklyr.ipynb` since it creates by default the `metastore_db` dir and the `derby.log` file in the working directory. Since I mount it in `RO` it's not working. I'm struggling to set it elsewhere...
2020-05-29 06:54:46 +02:00