Commit Graph

34 Commits

Author SHA1 Message Date
Ayaz Salikhov
b2246417aa Do not use deprecated datetime.utcnow() 2025-02-18 15:27:07 +00:00
Ayaz Salikhov
c4cb04ec37 Make Spark scripts more robust: support preview versions and Spark 4 output 2024-10-19 19:08:04 +01:00
ChristofKaufmann
b9553a8e5d Add cuda12 variant of tensorflow-notebook (#2100)
* Add cuda12 variant for tensorflow-notebook

* Reduce size of CPU version of tensorflow-notebook

* Try to fix tests

* Update docs/using/selecting.md

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>

* Update images/tensorflow-notebook/cuda12/Dockerfile

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>

* Update tests/docker-stacks-foundation/test_packages.py

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>

* Remove obsolete XLA_FLAGS env var

* Install CUDA and cuDNN using pip instead of mamba

* Fix pre-commit shell checks

* Change tensorflow variant name from cuda12 to cuda

* Update selecting.md

* Update selecting.md

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2024-03-26 01:12:59 +00:00
Ayaz Salikhov
bf33945b9e Do not bloat spark image with ENV variables (#2081)
* Do not bloat spark image with ENV variables

* Remove HadoopVersionTagger
2024-01-17 13:34:33 +04:00
Ayaz Salikhov
c294e9e2d9 Automatically install latest spark version (#2075)
* Automatically install latest pyspark version

* Better text

* Do not use shutil to keep behaviour

* Make setup_script cwd independent

* Use _get_program_version to calculate spark version

* Update setup_spark.py reqs

* Update setup_spark.py

* Add info about HADOOP_VERSION

* Add customization back

* Better text

* Specify build args when they are actually needed

* Better text

* Better code

* Better code

* Better text

* Get rid of warning

* Improve code

* Remove information about checksum

* Better text
2024-01-07 10:01:23 +04:00
Thijs Walcarius
278dd76837 Add jupyter/pytorch-notebook (#1936)
* Add PyTorch image

* Fix linting errors

* Fix link to pytorch website

* Address review comments

* Fix PytorchVersionTagger

* Remove "+cpu" suffix from pytorch version tag

* Update selecting.md

* Rename pytorch-notebook/.dockerignore to images/pytorch-notebook/.dockerignore

* Rename pytorch-notebook/Dockerfile to images/pytorch-notebook/Dockerfile

* Rename pytorch-notebook/README.md to images/pytorch-notebook/README.md

* Add pytorch-notebook to registry-overviews

* Add registry to pytorch image

* Use Quay.io

* Remove incorrect link

* Update action.yml

* Update docker.yml

* Remove information about Docker Hub, because this image won't be uploaded to Docker Hub

* Update docker.yml

* Update action.yml

* Add pytorch-notebook to registry-move.yml

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
Co-authored-by: Ayaz Salikhov <mathbunnyru@gmail.com>
2023-11-22 11:56:45 +01:00
Ayaz Salikhov
5d535899a9 Add python major.minor version tag (#1791) 2022-09-29 12:09:20 +04:00
Ayaz Salikhov
0aa95c71ad Make tests a module and make imports absolute 2022-04-01 01:26:37 +01:00
Ayaz Salikhov
2da008cf5a Merge branch 'master' into asalikhov/pre_commit_isort_reqs 2022-03-16 17:18:38 +02:00
Ayaz Salikhov
5e5a9e29ab Revert 2022-03-16 17:08:14 +02:00
Ayaz Salikhov
812c713a64 Fix PyCharm issues 2022-03-16 16:47:30 +02:00
Ayaz Salikhov
2f201a4b81 Run pre-commit tools: isort, requirements-txt-fixer 2022-03-16 14:48:23 +02:00
Ayaz Salikhov
37c510fc8e Fix all typing issues 2022-01-23 12:44:16 +03:00
Ayaz Salikhov
2a1316c9ac Add some typing to tests 2022-01-18 19:13:17 +03:00
Erik Sundell
f2438d3039 Add DateTagger for tags like 2021-08-09 2021-08-09 14:42:57 +02:00
Ayaz Salikhov
054aff20ee Update tagging/taggers.py 2021-06-29 01:51:33 +03:00
Ayaz Salikhov
54d4c06c80 Update tagging/taggers.py 2021-06-29 01:51:16 +03:00
Erik Sundell
a582c24e19 black style tweaks: manually added commas etc to tweak formatting 2021-06-28 22:07:26 +02:00
Erik Sundell
fe3968efe0 pre-commit: run black autoformatter on all files 2021-06-28 22:07:23 +02:00
Ayaz Salikhov
2172a9ab16 Add some typing 2021-05-03 00:54:52 +03:00
Ayaz Salikhov
7d7bbba09f Make run_simple_command part of DockerRunner 2021-05-02 12:45:05 +03:00
Ayaz Salikhov
27f45c7f2c Use tagging as a module 2021-05-01 11:04:44 +03:00
Ayaz Salikhov
0b16bd5dc0 Implement manifest header and improve GitHelper 2021-04-25 12:19:10 +03:00
Ayaz Salikhov
1f7c6cc0aa [WIP] Implement draft version of manifests (build_history_line) 2021-04-24 20:21:05 +03:00
Ayaz Salikhov
260fb73523 Add ubuntu version tagger 2021-04-17 12:06:23 +03:00
Ayaz Salikhov
72d1b8847c Fix julia version tagger 2021-03-22 16:20:33 +03:00
Ayaz Salikhov
27fe8881a8 Fix tensorflow-version tagging 2021-03-22 16:14:53 +03:00
Ayaz Salikhov
355be0b500 Fix r-version tagging 2021-03-22 15:32:42 +03:00
Ayaz Salikhov
14dfb27d6b Improve logs 2021-03-22 15:00:13 +03:00
Ayaz Salikhov
20e12b93f2 Do not recreated container each time it is needed 2021-03-22 14:54:58 +03:00
Ayaz Salikhov
7f8368105d Fix spark, hadoop and java taggers 2021-03-22 14:34:43 +03:00
Ayaz Salikhov
0833514be2 Implement new taggers; add all the images; simplify code 2021-03-22 13:28:49 +03:00
Ayaz Salikhov
aa2b3645e2 Add docker_runner, new versioned tags, fix images order and actually apply tags 2021-03-22 00:42:00 +03:00
Ayaz Salikhov
ffbe758e54 Apply tags from the python 2021-03-20 21:02:21 +03:00