hazza/docker-stacks
1
0
Fork 0
mirror of https://github.com/jupyter/docker-stacks.git synced 2025-10-11 12:02:56 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,276 Commits 4 Branches 0 Tags
93a6865aa3540cd4df94aba312bbab5b9a9d147c
Commit Graph

209 Commits

Author SHA1 Message Date
Ayaz Salikhov
a6d0ed456e Merge branch 'master' into asalikhov/automatic_conda_versioning 2021-07-09 16:52:31 +03:00
Ayaz Salikhov
3c9e62efce Introduce owner to Dockerfiles to make it easy to test locally 2021-07-08 17:26:56 +03:00
Ayaz Salikhov
38fa41fb24 Merge branch 'master' into asalikhov/automatic_conda_versioning 2021-07-02 21:19:32 +03:00
Ayaz Salikhov
ace42f37d7 Remove microbadge usage 2021-06-29 12:50:35 +03:00
Ayaz Salikhov
3c5e7c9cb4 Merge branch 'master' into asalikhov/automatic_conda_versioning 2021-06-29 02:28:53 +03:00
Erik Sundell
411663b5d4 black style tweaks: add trailing commas 2021-06-28 22:07:26 +02:00
Erik Sundell
fe3968efe0 pre-commit: run black autoformatter on all files 2021-06-28 22:07:23 +02:00
Ayaz Salikhov
44979c015d Merge branch 'master' into asalikhov/automatic_conda_versioning 2021-06-27 14:25:23 +03:00
Ayaz Salikhov
5c860df8c4 Move assert after logs output to make debug easier 2021-06-27 13:19:05 +03:00
Ayaz Salikhov
30a1d17085 Add a way to easily test units 2021-06-26 18:40:50 +03:00
Ayaz Salikhov
bfb8cc7d50 Allow conda to automatically deduce package versions 2021-06-20 22:13:15 +03:00
Ayaz Salikhov
4befdd5948 Merge branch 'master' into asalikhov/use_mamba 2021-06-07 23:05:26 +03:00
Ayaz Salikhov
396024a4dd Merge pull request #1335 from mathbunnyru/asalikhov/unify_bash_variables 
Unify bash variables usage and add quotes where needed
 2021-06-07 23:00:11 +03:00
Darek
3b5b735bb6 Upgrading spark_version->3.1.2 2021-06-04 15:02:52 +00:00
Ayaz Salikhov
6ab40f0002 Use mamba instead of conda in spark images 2021-06-01 20:30:30 +03:00
Ayaz Salikhov
0999f1a36f Unify bash variables usage and add quotes where needed 2021-05-26 13:06:10 +03:00
Ayaz Salikhov
fbceaa9892 Fixes 2021-05-22 14:01:01 +03:00
Ayaz Salikhov
66aaa99176 Update links 2021-05-21 14:17:18 +03:00
Ayaz Salikhov
0d08cc0efb Remove hooks from .dockerignore 2021-05-07 14:17:40 +03:00
Ayaz Salikhov
a3d9bb8f61 Merge branch 'master' into asalikhov/fix_markdown 2021-05-06 19:59:49 +03:00
romainx
25d4876efe Regular update 2021-05-04 18:36:03 +02:00
Romain
f46d59f4b6 Merge pull request #1279 from mathbunnyru/asalikhov/archive_spark 
Install spark from archive.apache.org to be able to use old versions
 2021-05-04 08:28:08 +02:00
Ayaz Salikhov
16ec0852c5 Merge branch 'master' into asalikhov/fix_markdown 2021-05-04 01:08:53 +03:00
Ayaz Salikhov
b5d6f04e43 Delete unused hadolint ignore 2021-05-02 23:28:53 +03:00
Ayaz Salikhov
0fff54f3f2 Install spark from archive.apache.org to be able to use old versions 2021-05-02 23:28:32 +03:00
Ayaz Salikhov
c2031e2a4a Fix more errors 2021-05-01 13:07:40 +03:00
Ayaz Salikhov
bf5ec600d1 Use mdlint rules [WIP] 2021-05-01 12:52:41 +03:00
Ayaz Salikhov
833e235281 Implement SparkInfoManifest 2021-04-25 12:40:48 +03:00
Ayaz Salikhov
2f8934e5ac Remove unused run_hook parts 2021-04-25 12:22:00 +03:00
Ayaz Salikhov
f52987a959 Delete run_hook parts already implemented in python 2021-04-25 11:54:46 +03:00
Ayaz Salikhov
9991d6438e Delete index update from run_hook 2021-04-24 20:38:44 +03:00
Ayaz Salikhov
74fe3361d7 Merge branch 'master' into asalikhov/python_tagging 2021-04-18 11:31:23 +03:00
Ayaz Salikhov
a8b7682fd6 Add newlines 2021-04-17 18:20:37 +03:00
Ayaz Salikhov
725a94b87d Merge branch 'master' into asalikhov/python_tagging 2021-03-22 17:29:27 +03:00
Ayaz Salikhov
f8d21532ee Remove docker tag from run_hook 2021-03-22 13:36:32 +03:00
Antony Neu
5b0b25d158 Fix config formatting 2021-03-20 14:19:55 +01:00
Bjørn-Andre Skaar
0192175d05 Spark 3.1.1 upgrade 2021-03-04 08:27:14 +01:00
romainx
753abff645 Regular update 2021-02-28 06:56:36 +01:00
Aaron Cody
ffea0d5c94 bumped spark version to 3.0.2 as 3.0.1 is no longer available for download 2021-02-23 16:27:49 -08:00
Romain
d113a601db Merge pull request #1198 from romainx/fix_spark_java11 
Fix spark installation for Java 11 and Arrow
 2020-12-26 17:22:44 +01:00
romainx
daff4686e8 Fix .dockerignore by adding default hooks + test dirs 2020-12-20 05:47:12 +01:00
romainx
1dd95bad2c Fix spark installation for Java 11 and Arrow 2020-12-13 11:58:46 +01:00
romainx
1dca39182b Improve spark installation 
Spark installation improved by sourcing the `spark-config.sh` in the `before-notebook.d` hook that is run by `start.sh`. It permits to add automatically the right Py4J dependency version in the `PYTHONPATH`. So it is not needed anymore to set this variable at build time.

Documentation describing the installation of a custom Spark version modified to remove this step. Also updated to install the latest `2.x` Spark version.

`test_pyspark` fixed (was always OK before that).
 2020-11-24 20:40:06 +01:00
romainx
0f2a7473c4 Regular update 2020-11-05 20:55:18 +01:00
romainx
4271b09b33 rollback pyarrow update 2020-10-20 12:10:36 +02:00
romainx
32090f6011 Update docker stack 2020-11-20 
The following changes have been made.

- `base-notebook`
  - `Changed`: Bump Ubuntu
  - `Changed`: Bump conda
  - `Fixed`: Add missing `apt-get clean`
- `minimal-notebook`
  - `Removed`: `jed` editor see #1174 (partial)
  - `Deprecated`: `emacs` editor (in the documentation and in the image) see #1174 (partial)
- `scipy-notebook`
  - `Fixed`: Add missing `apt-get clean`
  - `Changed`: Bump `dask`
  - `Changed`: Bump `protobuf`
- `r-notebook`
  - `Changed`: Bump `r-base`
  - `Changed`: Bump `r-rmarkdown`
  - `Removed`: The description of `tidyverse` packages because it's not the place to do that and it will always be obsolete.
- `datascience-notebook`
  - `Changed`: Bump `r-base` to `4.0.x` see #1102 (partial)
  - `Removed`: `plyr` package because it's retired fixes #1103
  - `Removed`: `r-reshape2` package because it's retired fixes #1103
  - `Changed`: Bump `r-rmarkdown`
  - `Changed`: Bump Julia
- `tensorflow-notebook`
  - `Changed`: Bump `tensorflow`
- `pyspark-notebook`
  - `Fixed`: Add missing `apt-get clean`
  - `Changed`: Bump `pyarrow`
- `all-spark-notebook`
  - `Fixed`: Add missing `apt-get clean`
  - `Changed`: Bump `r-base` to `4.0.x` see #1102 (partial)
  - `Changed`: Bump `r-sparklyr`
 2020-10-20 11:36:34 +02:00
Ayaz Salikhov
e3085ca89e Merge branch 'master' into asalikhov/py_codestyle 2020-09-28 06:37:23 +03:00
romainx
325dd5b3e2 Fix build (hope) 
- miniconda versions and arguments
- remove useless hd5 install (dependency of h5py)
- pin the version of pyarrow
 2020-09-19 17:27:47 +02:00
romainx
384acda330 Spark 3.0.1 -> fixes #1156 2020-09-10 15:25:00 +02:00
Ayaz Salikhov
530e2b3834 Merge branch 'master' into asalikhov/py_codestyle 2020-08-16 20:02:40 +03:00