Commit Graph

84 Commits

Author SHA1 Message Date
Ayaz Salikhov
7bdb19cc1b Downgrade to Julia 1.11.1 (#2178) 2024-12-03 18:59:49 +00:00
Ayaz Salikhov
143db355da Install mamba 2.0 (#2147) 2024-12-03 01:31:56 +01:00
Erik Sundell
caf725210c base-notebook: stop installing nodejs from conda-forge (#2172)
* base-notebook: stop installing nodejs from conda-forge

nodejs was a conda dependency of jupyterhub, but by installing
jupyterhub-base we no longer need it and could opt to remove it.

By doing this, building base-notebook led to a reported size reduction
from 974MB to 828MB, which is a 146MB / 15% size reduction.

* Update CHANGELOG.md

* Update CHANGELOG.md

* Install jupyterhub-singleuser instead of jupyterhub-base

Note that jupyterhub-base is really whats the foundational need for this
image, where jupyterhub-singleuser the conda-forge package is building on
jupyterhub-base by also adding a depdendency on jupyterlab - but the
jupyterhub-singleuser command is provided by jupyterhub-base conda-forge
package.

* Update CHANGELOG.md

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2024-11-08 15:15:07 +00:00
Erik Sundell
28a0b25bce Install jupyterhub-base instead of jupyterhub (#2171)
* Install jupyterhub-base instead of jupyterhub

* Update images/base-notebook/Dockerfile

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2024-11-06 15:04:07 +00:00
Ayaz Salikhov
2c525aff70 Use pytorch with cuda12.4 (#2168) 2024-11-04 16:57:17 +00:00
Ayaz Salikhov
c2d9d1f06a Pin min notebook version (#2167)
* [TMP] Pin min notebook version

* Update Dockerfile
2024-11-04 14:55:35 +00:00
Ayaz Salikhov
03e5fe572d Fix docs: we're not installing stable version of spark anymore (#2165) 2024-10-29 10:11:31 +00:00
Ayaz Salikhov
f74a764584 Do not install tensorflow 2.18.0 as it gives an error 2024-10-28 14:06:50 +00:00
Max Muoto
a096c2b102 Upgrade to Python 3.12 (#2072) 2024-10-23 08:58:47 +01:00
Ayaz Salikhov
b744182207 Start using spark4-preview versions (#2159)
* Start using spark4-preview versions

* Allow to download preview versions

* Expect warnings in spark

* Disable local_sparklyr test for now
2024-10-22 11:47:45 +01:00
Ayaz Salikhov
c4cb04ec37 Make Spark scripts more robust: support preview versions and Spark 4 output 2024-10-19 19:08:04 +01:00
Ayaz Salikhov
5365b9f79f Rename: ROOT_CONTAINER->ROOT_IMAGE, BASE_CONTAINER->BASE_IMAGE (#2155)
* Rename: ROOT_CONTAINER->ROOT_IMAGE, BASE_CONTAINER->BASE_IMAGE

* Add changelog
2024-10-09 15:02:53 +01:00
Ayaz Salikhov
942ab96046 Use awk to pin python major.minor version (#2151) 2024-10-03 10:51:24 +01:00
Ayaz Salikhov
2f1a5615bb Do not install mamba 2.X 2024-10-02 11:36:27 +01:00
Ayaz Salikhov
5dd3a31645 Do not install mamba 2.0.0 2024-09-30 09:06:39 +02:00
John McGrath
e51895bcbd Upgrade to Ubuntu 24.04 Image base (#2131)
* fixed

* Update .github/workflows/docker-build-test-upload.yml

* Only remove user with uid 1000 if it exists

* Update Dockerfile

* Update Dockerfile

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2024-08-30 10:19:27 +01:00
Ayaz Salikhov
00987883e5 Improve comment for user creation in Dockerfile 2024-08-26 12:53:19 +01:00
Ayaz Salikhov
5ea1adbfd8 Improve Dockerfiles codestyle 2024-08-19 15:40:40 +01:00
Ayaz Salikhov
4d4ed0e0bf Unify ENV command in Dockerfiles (#2135) 2024-08-14 15:36:38 +01:00
Olivier Benz
6f74c72a92 [FAST_BUILD] No sudo when run with rootless triplet (#2132)
* No sudo when run with rootless triplet

-  rootless triplet: -e NB_USER=root -e NB_UID=0 -e NB_GID=0

* Add tests for rootless triplet

* Update tests for rootless triplet

* Fix tests for rootless triplet
2024-08-11 16:50:27 +01:00
Alex Hill
6ed34af77a Add netbase to docker-stacks-foundation image - fixes #2128 (#2129)
* Add netbase to docker-stacks-foundation image - fixes #2128

* Add a comment describing netbase
2024-08-04 20:11:50 +01:00
Thijs Walcarius
1ad688e421 Improve handling of tensorboard (#2126)
* Improve handling of tensorboard

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Improve style

* Move bash file to cuda-subdir

* Update tensorflow-notebook info

* Fix redirect link

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2024-08-01 09:43:35 +01:00
Erik Sundell
3fef15446f Put nvidia-smi on path for cuda image variants (#2124)
* Put nvidia-smi on path for cuda image variants

* Improve comments style

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2024-07-01 13:45:55 +01:00
Ayaz Salikhov
3be7274ee8 Fix typos 2024-05-05 11:31:56 +01:00
Olivier Benz
b2efa3cd8c Update JULIA_CPU_TARGET for precompiling packages (#2104)
* Update JULIA_CPU_TARGET for precompiling packages

* Update links

* Also update link for aarch64
2024-03-31 10:57:56 +02:00
ChristofKaufmann
b9553a8e5d Add cuda12 variant of tensorflow-notebook (#2100)
* Add cuda12 variant for tensorflow-notebook

* Reduce size of CPU version of tensorflow-notebook

* Try to fix tests

* Update docs/using/selecting.md

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>

* Update images/tensorflow-notebook/cuda12/Dockerfile

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>

* Update tests/docker-stacks-foundation/test_packages.py

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>

* Remove obsolete XLA_FLAGS env var

* Install CUDA and cuDNN using pip instead of mamba

* Fix pre-commit shell checks

* Change tensorflow variant name from cuda12 to cuda

* Update selecting.md

* Update selecting.md

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2024-03-26 01:12:59 +00:00
Johanna Reiml
eccda243c3 Add pytorch-notebook image variants with cuda 11 and 12 (x86_64 versions only) (#2091)
* feat: build cuda variants of pytorch

* feat: build with variant tag

* style: remove unused import

* refactor: rename get_prefix params

(cherry picked from commit 12b50af258c2f331d4100fb63fd41ad1a30acb1d)

* revert: drop ROOT_CONTAINER addition from Makefile

(cherry picked from commit f42314513df2855957a05c6ba0c748d2df26d7b0)

* style: use consistent three empty lines in Makefile

(cherry picked from commit 446b45aab37a37720462b5df305ce96b139cf67a)

* refactor: add default value for parent-image

(cherry picked from commit 32955cec99c7202f0ce50647dfc61ec98f57f741)

* revert: use original workflow structure

(cherry picked from commit 68c6744513636ec93d14f9bd0bbd123907efd13b)

* refactor: use single build image step

(cherry picked from commit 5f1ac0aeedcb5969a6d4b2a5bc939817378ab55d)

* fix: run merge tags regardless of repository owner

(cherry picked from commit 3fce366a98adc5db0d127f28ddf3157d13297a0f)

* refactor: build cuda12 instead of cuda tag

(cherry picked from commit 217144ecd322356376f04efb92792a20b4380177)

* docs: add note about CUDA tags to documentation

* refactor: add default value for variant in build-test-upload

* refactor: swap ordering of cuda11/cuda12 variants

* refactor: remove optional str type in arg parser

* fix: add proper env variables to CUDA Dockerfiles

* fix: remove CUDA build for aarch64

* fix: use latest NVIDIA documentation link

* fix: skip aarch64 tags file for CUDA variants

---------

Co-authored-by: zynaa <7562909-zynaa@users.noreply.gitlab.com>
2024-02-24 10:17:38 +00:00
Ben Mares
fe2195458f Don't default to US-specific locale settings (#2096) 2024-02-22 22:16:30 +00:00
Ayaz Salikhov
009821cdb3 Fix information about RESTARTABLE option 2024-01-23 00:08:56 +01:00
Ayaz Salikhov
7e240d59d3 Fix comment style in start-singleuser.py 2024-01-23 00:07:22 +01:00
Ayaz Salikhov
3dfe578caa Configure entrypoint after copying needed files to make it work 2024-01-23 00:06:56 +01:00
Simon Li
6e437aa489 Make start.sh the entrypoint (#2087) 2024-01-22 08:47:48 +04:00
Ayaz Salikhov
b71f4cb525 Unify access to env variables (#2086) 2024-01-21 17:32:14 +04:00
Ayaz Salikhov
a4ede5de2f Fix Python version pin (#2085) 2024-01-21 16:06:10 +04:00
Ayaz Salikhov
afe30f0c9a Use argparse to setup spark (#2082) 2024-01-17 15:07:15 +04:00
Ayaz Salikhov
bf33945b9e Do not bloat spark image with ENV variables (#2081)
* Do not bloat spark image with ENV variables

* Remove HadoopVersionTagger
2024-01-17 13:34:33 +04:00
Ayaz Salikhov
d57bf9590d Adjust sleep times (#2080)
* Adjust sleep times

* Update test_start_container.py

* Update test_healthcheck.py

* Update pluto_check.py
2024-01-17 02:11:44 +04:00
Ayaz Salikhov
86dc0f274f Fix comments codestyle in python 2024-01-16 16:56:36 +04:00
Ayaz Salikhov
14a29d12d8 Improve comments in images 2024-01-15 14:56:23 +04:00
Olivier Benz
37018f998c Add support for Docker/Podman in rootless mode (#2039)
- Fixes https://github.com/jupyter/docker-stacks/issues/2036

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2024-01-14 22:39:37 +04:00
Ayaz Salikhov
2a9c7dbc26 Update the way we install micromamba (#2077) 2024-01-07 18:33:54 +04:00
Ayaz Salikhov
6e80c1246f Fix comment about setup_julia.py file 2024-01-07 15:55:41 +04:00
Ayaz Salikhov
e84bfdf4ae Add logger to setup_julia and setup_spark 2024-01-07 15:55:41 +04:00
Ayaz Salikhov
c294e9e2d9 Automatically install latest spark version (#2075)
* Automatically install latest pyspark version

* Better text

* Do not use shutil to keep behaviour

* Make setup_script cwd independent

* Use _get_program_version to calculate spark version

* Update setup_spark.py reqs

* Update setup_spark.py

* Add info about HADOOP_VERSION

* Add customization back

* Better text

* Specify build args when they are actually needed

* Better text

* Better code

* Better code

* Better text

* Get rid of warning

* Improve code

* Remove information about checksum

* Better text
2024-01-07 10:01:23 +04:00
Hugo Hromic
2a6a115a7c [FAST_BUILD] Fix Docker healthcheck when using custom runtime dirs (#2074)
* Fix Docker healthcheck when using custom runtime dirs

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Use a writable directory for healthcheck test

* Allow missing import for `jupyter_core` in mypy

* Set HOME according to NB_USER in healthcheck script

* Add custom runtime dir an NB_USER case to healthcheck test

* Call `jupyter --runtime-dir` directly in healthcheck script

* Update docker_healthcheck.py

* Update docker_healthcheck.py

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2024-01-07 00:13:21 +04:00
Ayaz Salikhov
48b189e585 Add a comment for choosing latest_stable_version for Julia 2024-01-06 21:41:53 +04:00
John Muchovej
c515e883ea Fix max(stable_versions) on Julia version finding (#2076)
* Fix `max(stable_versions)`

Since the keys are semantic version strings, that means that `"1.9.4" > "1.10.0", which we know isn't true. 🙂

I just added some code to convert the string to tuples, find the max, then convert back to a string.

I first noticed this on the `2024-01-05` build of the `datascience-notebook`, since Julia 1.10.0 was released ~2 weeks ago: https://github.com/JuliaLang/julia/releases/tag/v1.10.0.

* Migrate to comparator on `max(stable_versions)`

* Update setup_julia.py

* Update setup_julia.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-01-06 21:09:30 +04:00
Ayaz Salikhov
06cdadd0bf Improve spark pandas version information 2024-01-05 15:06:26 +04:00
Ayaz Salikhov
ccbe678154 Fix typo 2023-12-14 17:52:22 +04:00
Ayaz Salikhov
55541bdc66 Remove jupyterlab and notebook pins in scipy-notebook (#2060) 2023-12-12 11:28:35 +04:00