Commit Graph

211 Commits

Author SHA1 Message Date
romainx
c6764656cc typo 2020-11-14 12:03:13 +01:00
romainx
7d550a0a83 Document how to use defaults channels to install packages 2020-11-14 11:58:07 +01:00
romainx
8763e8c628 Doc update 2020-11-13 19:29:02 +01:00
GitHub Actions
32768af316 [ci skip] Automated publish for 5ee27aa513 2020-10-24 20:17:46 +00:00
Romain
5ee27aa513 Merge pull request #1178 from das-g/copy-with-chown-in-recipes-dockerfiles
recipes: use COPY with --chown for jovyan's files
2020-10-24 22:17:03 +02:00
GitHub Actions
d676cdf9b4 [ci skip] Automated publish for 45bfe5a474 2020-10-21 07:11:03 +00:00
romainx
f055648e44 Rollback changes made on editors 2020-10-21 08:23:49 +02:00
romainx
32090f6011 Update docker stack 2020-11-20
The following changes have been made.

- `base-notebook`
  - `Changed`: Bump Ubuntu
  - `Changed`: Bump conda
  - `Fixed`: Add missing `apt-get clean`
- `minimal-notebook`
  - `Removed`: `jed` editor see #1174 (partial)
  - `Deprecated`: `emacs` editor (in the documentation and in the image) see #1174 (partial)
- `scipy-notebook`
  - `Fixed`: Add missing `apt-get clean`
  - `Changed`: Bump `dask`
  - `Changed`: Bump `protobuf`
- `r-notebook`
  - `Changed`: Bump `r-base`
  - `Changed`: Bump `r-rmarkdown`
  - `Removed`: The description of `tidyverse` packages because it's not the place to do that and it will always be obsolete.
- `datascience-notebook`
  - `Changed`: Bump `r-base` to `4.0.x` see #1102 (partial)
  - `Removed`: `plyr` package because it's retired fixes #1103
  - `Removed`: `r-reshape2` package because it's retired fixes #1103
  - `Changed`: Bump `r-rmarkdown`
  - `Changed`: Bump Julia
- `tensorflow-notebook`
  - `Changed`: Bump `tensorflow`
- `pyspark-notebook`
  - `Fixed`: Add missing `apt-get clean`
  - `Changed`: Bump `pyarrow`
- `all-spark-notebook`
  - `Fixed`: Add missing `apt-get clean`
  - `Changed`: Bump `r-base` to `4.0.x` see #1102 (partial)
  - `Changed`: Bump `r-sparklyr`
2020-10-20 11:36:34 +02:00
GitHub Actions
1e2831c75a [ci skip] Automated publish for feacdbfc2e 2020-10-12 12:11:48 +00:00
Raphael Das Gupta
d6da5aef56 recipes: use COPY with --chown for jovyan's files
By default, Dockerfile's COPY creates files and directories with UID and
GID 0. (See https://docs.docker.com/engine/reference/builder/#copy)
When we put them in jovyan's $HOME or want jovyan to manipulate these
files, they should be owned by jovyan instead.

Specifically
https://jupyter-docker-stacks.readthedocs.io/en/latest/using/recipes.html#add-a-python-3-x-environment
failed with a "permission denied" error when the code for using an
environment.yml file was uncommented. I assume some of the other recipes
might have failed like that, too, but I didn't test them.
2020-10-09 19:18:11 +02:00
Ayaz Salikhov
668cc9311a Fix 2020-10-06 11:35:03 +03:00
GitHub Actions
c47a268cea [ci skip] Automated publish for 4a112c0f11 2020-10-05 04:37:17 +00:00
romainx
8201c14ef4 nano -> nano-tiny 2020-09-30 06:45:26 +02:00
Ayaz Salikhov
e3085ca89e Merge branch 'master' into asalikhov/py_codestyle 2020-09-28 06:37:23 +03:00
GitHub Actions
e16db0575b [ci skip] Automated publish for 4b26cce185 2020-09-18 19:01:26 +00:00
romainx
8cd98a1bff Fixes #1161
Added a note in the documentation to indicate that the build will only work with Spark current versions.
2020-09-17 04:50:11 +02:00
GitHub Actions
3cba2932e9 [ci skip] Automated publish for 13b866ff67 2020-08-17 03:45:10 +00:00
Ayaz Salikhov
530e2b3834 Merge branch 'master' into asalikhov/py_codestyle 2020-08-16 20:02:40 +03:00
romainx
8669d6e79b Resolves #1131: Allow alternative Spark version
Allow to build `pyspark-notebook` image with an alternative Spark version.

- Define arguments for Spark installation
- Add a note in "Image Specifics" explaining how to build an image with an alternative Spark version
- Remove Toree documentation from "Image Specifics" since its support has been droped in #1115
2020-08-15 20:19:35 +02:00
GitHub Actions
58a89177e4 [ci skip] Automated publish for 24da256d4e 2020-08-08 19:06:23 +00:00
Peter Parente
455e10b64f Merge branch 'master' into pre-commit 2020-08-08 14:23:34 -04:00
Peter Parente
95f792c690 Travis -> GitHub Actions in doc 2020-08-07 22:52:12 -04:00
Romain
bf39616d86 documentation 2020-07-24 05:16:12 +02:00
Ayaz Salikhov
94cd03d6b9 Fix python codestyle 2020-07-04 18:30:53 +02:00
Travis CI
54462805ef [ci skip] Update en source strings (build: 1850.1) 2020-06-25 12:26:52 +00:00
Tiffany A. Timbers
1fa0d4824c Merge branch 'master' into r4.0 2020-06-17 20:09:25 -07:00
Travis CI
04f7f60d34 [ci skip] Update en source strings (build: 1835.1) 2020-06-18 03:03:23 +00:00
ttimbers
3748d0f8a5 merging upstream changes 2020-06-15 22:58:06 -07:00
Peter Parente
d16063e623 Merge branch 'master' into asalikhov/ubuntu_focal 2020-06-13 13:26:20 -04:00
Travis CI
c094bb7219 [ci skip] Update en source strings (build: 1816.1) 2020-06-13 17:24:04 +00:00
ttimbers
a883ce1794 versions and tidymodels
- added versions to ggplot2 and sparklyr for all-spark-notebook
- added tidymodels to r-notebook and docs

closes #1102
2020-06-05 14:41:12 -07:00
ttimbers
13059e5f06 removed plyr and reshape2
closes #1103
2020-06-05 14:04:36 -07:00
Romain
5e6645d137 Ignore DL3006 and DL3008 by default 2020-06-01 06:23:44 +02:00
Ayaz Salikhov
ec68ceff31 Merge branch 'master' into asalikhov/ubuntu_focal 2020-05-31 18:58:37 +02:00
Romain
2ce0b49fb5 Final review 2020-05-30 05:44:53 +02:00
Romain
feb2e44022 Fix lint 2020-05-29 21:47:13 +02:00
Romain
64c143d3cd Merge branch 'master' into hadolint 2020-05-29 18:44:45 +02:00
Travis CI
76402a27fd [ci skip] Update en source strings (build: 1781.1) 2020-05-29 13:13:57 +00:00
Peter Parente
1c204509e1 Merge branch 'master' into asalikhov/ubuntu_focal 2020-05-29 09:12:34 -04:00
Peter Parente
8e8cbd0a0a Merge pull request #1097 from mathbunnyru/asalikhov/improve_docs
Improve documentation
2020-05-29 09:12:23 -04:00
Travis CI
8cddbac4b7 [ci skip] Update en source strings (build: 1779.1) 2020-05-29 13:11:13 +00:00
Peter Parente
40d2312b1e Merge branch 'master' into asalikhov/improve_docs 2020-05-29 09:10:49 -04:00
Romain
c83024c950 Add spark notebook tests and change examples
* Test added for all kernels
* Same examples as provided in the documentation (`specifics.md`)
* Used the same use case for all examples: sum of the first 100 whole numbers

Note: I've not automatically tested `local_sparklyr.ipynb` since it creates by default the `metastore_db` dir and the `derby.log` file in the working directory. Since I mount it in `RO` it's not working. I'm struggling to set it elsewhere...
2020-05-29 06:54:46 +02:00
Romain
36dc621f97 typo 2020-05-28 12:34:50 +02:00
Romain
3277f48c23 Follow-on PR #911: Spark documentation rework
Some changes to the Spark documentation
for local and standalone use cases with the following drivers

* Simplify some of them (removing options, etc.)
* Use the same code as much as possible in each example to be consistent (only kept R different from the others)
* Add Sparklyr as an option for R
* Add some notes about prerequisites (same version of Python, R installed on workers)
2020-05-28 12:26:09 +02:00
Ayaz Salikhov
b6d96d1ca2 Improve documentation 2020-05-28 11:47:48 +02:00
Ayaz Salikhov
a2086ce626 Start using Ubuntu 20.04 (focal) 2020-05-28 10:42:03 +02:00
Romain
e3558be988 First lint + fix implemented 2020-05-28 06:24:54 +02:00
Travis CI
2c0af4ab51 [ci skip] Update en source strings (build: 1770.1) 2020-05-28 00:44:58 +00:00
Peter Parente
48def68d94 Merge branch 'master' into patch-1 2020-05-27 20:43:18 -04:00