Commit Graph

3802 Commits

Author SHA1 Message Date
Johanna Reiml
eccda243c3 Add pytorch-notebook image variants with cuda 11 and 12 (x86_64 versions only) (#2091)
* feat: build cuda variants of pytorch

* feat: build with variant tag

* style: remove unused import

* refactor: rename get_prefix params

(cherry picked from commit 12b50af258c2f331d4100fb63fd41ad1a30acb1d)

* revert: drop ROOT_CONTAINER addition from Makefile

(cherry picked from commit f42314513df2855957a05c6ba0c748d2df26d7b0)

* style: use consistent three empty lines in Makefile

(cherry picked from commit 446b45aab37a37720462b5df305ce96b139cf67a)

* refactor: add default value for parent-image

(cherry picked from commit 32955cec99c7202f0ce50647dfc61ec98f57f741)

* revert: use original workflow structure

(cherry picked from commit 68c6744513636ec93d14f9bd0bbd123907efd13b)

* refactor: use single build image step

(cherry picked from commit 5f1ac0aeedcb5969a6d4b2a5bc939817378ab55d)

* fix: run merge tags regardless of repository owner

(cherry picked from commit 3fce366a98adc5db0d127f28ddf3157d13297a0f)

* refactor: build cuda12 instead of cuda tag

(cherry picked from commit 217144ecd322356376f04efb92792a20b4380177)

* docs: add note about CUDA tags to documentation

* refactor: add default value for variant in build-test-upload

* refactor: swap ordering of cuda11/cuda12 variants

* refactor: remove optional str type in arg parser

* fix: add proper env variables to CUDA Dockerfiles

* fix: remove CUDA build for aarch64

* fix: use latest NVIDIA documentation link

* fix: skip aarch64 tags file for CUDA variants

---------

Co-authored-by: zynaa <7562909-zynaa@users.noreply.gitlab.com>
2024-02-24 10:17:38 +00:00
Ben Mares
fe2195458f Don't default to US-specific locale settings (#2096) 2024-02-22 22:16:30 +00:00
Ayaz Salikhov
c2159f4118 Update pre-commit hooks 2024-02-18 12:37:20 +04:00
Ayaz Salikhov
8da0523b50 Add ROOT_CONTAINER param to Makerfile 2024-02-12 13:00:22 +04:00
pre-commit-ci[bot]
949af9bbd5 [pre-commit.ci] pre-commit autoupdate (#2090) 2024-02-06 04:43:51 +04:00
Ayaz Salikhov
ce08d9e348 Update pre-commit hooks 2024-01-31 01:00:13 +01:00
Ayaz Salikhov
3692e3a84c Update pre-commit hooks 2024-01-28 22:16:57 +01:00
Ayaz Salikhov
6be9ae8ce6 Fix python in docs 2024-01-28 19:09:57 +01:00
Ayaz Salikhov
f5a7f1af1d Update docs copyright year 2024-01-28 18:07:33 +01:00
Ayaz Salikhov
7a5990be1f Do not rewrite variable with another value 2024-01-23 13:11:02 +01:00
Ayaz Salikhov
009821cdb3 Fix information about RESTARTABLE option 2024-01-23 00:08:56 +01:00
Ayaz Salikhov
7e240d59d3 Fix comment style in start-singleuser.py 2024-01-23 00:07:22 +01:00
Ayaz Salikhov
3dfe578caa Configure entrypoint after copying needed files to make it work 2024-01-23 00:06:56 +01:00
Simon Li
6e437aa489 Make start.sh the entrypoint (#2087) 2024-01-22 08:47:48 +04:00
Ayaz Salikhov
b71f4cb525 Unify access to env variables (#2086) 2024-01-21 17:32:14 +04:00
Ayaz Salikhov
a4ede5de2f Fix Python version pin (#2085) 2024-01-21 16:06:10 +04:00
Ayaz Salikhov
8d0ec50095 Improve wording 2024-01-21 15:29:27 +04:00
Ayaz Salikhov
8b8d1b7dcf Fix Docker broken links 2024-01-21 15:29:15 +04:00
Ayaz Salikhov
46d7265781 Rename test file test_python -> test_python_version 2024-01-21 14:37:52 +04:00
Ayaz Salikhov
aadf012336 Update pre-commit hooks 2024-01-18 11:56:15 +04:00
Ayaz Salikhov
5d68244bb2 Cleanup some commands in Makefile 2024-01-17 15:56:18 +04:00
Ayaz Salikhov
afe30f0c9a Use argparse to setup spark (#2082) 2024-01-17 15:07:15 +04:00
Ayaz Salikhov
bf33945b9e Do not bloat spark image with ENV variables (#2081)
* Do not bloat spark image with ENV variables

* Remove HadoopVersionTagger
2024-01-17 13:34:33 +04:00
Ayaz Salikhov
d57bf9590d Adjust sleep times (#2080)
* Adjust sleep times

* Update test_start_container.py

* Update test_healthcheck.py

* Update pluto_check.py
2024-01-17 02:11:44 +04:00
Ayaz Salikhov
86dc0f274f Fix comments codestyle in python 2024-01-16 16:56:36 +04:00
Ayaz Salikhov
d3e18d975c Fix some style issues in tests 2024-01-16 16:35:14 +04:00
Ayaz Salikhov
14a29d12d8 Improve comments in images 2024-01-15 14:56:23 +04:00
Ayaz Salikhov
0386b2a630 Remove some double spaces 2024-01-15 14:48:54 +04:00
Ayaz Salikhov
9fa124053b Update tag example 2024-01-15 13:27:44 +04:00
Ayaz Salikhov
6e01bbabec Improve wording in versioning via image tags 2024-01-15 13:26:33 +04:00
Ayaz Salikhov
a63a9a6fcb Document root homedir (#2079)
* Document root homedir

* Add link to issue
2024-01-14 22:56:24 +04:00
Olivier Benz
37018f998c Add support for Docker/Podman in rootless mode (#2039)
- Fixes https://github.com/jupyter/docker-stacks/issues/2036

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2024-01-14 22:39:37 +04:00
Ayaz Salikhov
eb04996c7d Use 1 fast 2CPU and 3 slow 1CPU aarch64 runners (#2040)
undefined
2024-01-14 17:59:42 +04:00
Ayaz Salikhov
d599a7aeca Improve get_manifest_timestamp function 2024-01-14 15:41:00 +04:00
Ayaz Salikhov
4d2c81cd88 Update update_wiki.py: fix for pattern download, build timestamps, additional checks 2024-01-14 14:27:33 +04:00
Ayaz Salikhov
c6c0a947ed Remove redundant step 2024-01-13 18:57:17 +04:00
Ayaz Salikhov
fccea73332 Get rid of separate download-manifests action 2024-01-13 18:57:17 +04:00
Ayaz Salikhov
cc3aa43c46 Update actions/download-artifact and actions/upload-artifact to v4 (#2061) 2024-01-13 18:57:17 +04:00
Ayaz Salikhov
e55bb93ff4 Update tag example 2024-01-08 11:03:49 +04:00
Ayaz Salikhov
d9f41655fe Simplify README.md 2024-01-08 10:58:58 +04:00
Ayaz Salikhov
2a9c7dbc26 Update the way we install micromamba (#2077) 2024-01-07 18:33:54 +04:00
Ayaz Salikhov
6e80c1246f Fix comment about setup_julia.py file 2024-01-07 15:55:41 +04:00
Ayaz Salikhov
e84bfdf4ae Add logger to setup_julia and setup_spark 2024-01-07 15:55:41 +04:00
Ayaz Salikhov
c294e9e2d9 Automatically install latest spark version (#2075)
* Automatically install latest pyspark version

* Better text

* Do not use shutil to keep behaviour

* Make setup_script cwd independent

* Use _get_program_version to calculate spark version

* Update setup_spark.py reqs

* Update setup_spark.py

* Add info about HADOOP_VERSION

* Add customization back

* Better text

* Specify build args when they are actually needed

* Better text

* Better code

* Better code

* Better text

* Get rid of warning

* Improve code

* Remove information about checksum

* Better text
2024-01-07 10:01:23 +04:00
Ayaz Salikhov
c1229303d0 Rename some tests in test_healthcheck.py 2024-01-07 00:15:38 +04:00
Hugo Hromic
2a6a115a7c [FAST_BUILD] Fix Docker healthcheck when using custom runtime dirs (#2074)
* Fix Docker healthcheck when using custom runtime dirs

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Use a writable directory for healthcheck test

* Allow missing import for `jupyter_core` in mypy

* Set HOME according to NB_USER in healthcheck script

* Add custom runtime dir an NB_USER case to healthcheck test

* Call `jupyter --runtime-dir` directly in healthcheck script

* Update docker_healthcheck.py

* Update docker_healthcheck.py

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2024-01-07 00:13:21 +04:00
Ayaz Salikhov
48b189e585 Add a comment for choosing latest_stable_version for Julia 2024-01-06 21:41:53 +04:00
John Muchovej
c515e883ea Fix max(stable_versions) on Julia version finding (#2076)
* Fix `max(stable_versions)`

Since the keys are semantic version strings, that means that `"1.9.4" > "1.10.0", which we know isn't true. 🙂

I just added some code to convert the string to tuples, find the max, then convert back to a string.

I first noticed this on the `2024-01-05` build of the `datascience-notebook`, since Julia 1.10.0 was released ~2 weeks ago: https://github.com/JuliaLang/julia/releases/tag/v1.10.0.

* Migrate to comparator on `max(stable_versions)`

* Update setup_julia.py

* Update setup_julia.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-01-06 21:09:30 +04:00
Ayaz Salikhov
06cdadd0bf Improve spark pandas version information 2024-01-05 15:06:26 +04:00
Ayaz Salikhov
dc6432a4eb Update .readthedocs.yaml 2024-01-04 23:47:17 +04:00