Commit Graph

747 Commits

Author SHA1 Message Date
Ayaz Salikhov
e55bb93ff4 Update tag example 2024-01-08 11:03:49 +04:00
Ayaz Salikhov
c294e9e2d9 Automatically install latest spark version (#2075)
* Automatically install latest pyspark version

* Better text

* Do not use shutil to keep behaviour

* Make setup_script cwd independent

* Use _get_program_version to calculate spark version

* Update setup_spark.py reqs

* Update setup_spark.py

* Add info about HADOOP_VERSION

* Add customization back

* Better text

* Specify build args when they are actually needed

* Better text

* Better code

* Better code

* Better text

* Get rid of warning

* Improve code

* Remove information about checksum

* Better text
2024-01-07 10:01:23 +04:00
Ayaz Salikhov
474312ac79 Update conf.py for new sphinx version 2023-12-20 13:36:31 +04:00
Ayaz Salikhov
027d3a1026 Fix cusotm env recipe 2023-12-08 05:47:10 +01:00
Ayaz Salikhov
2760b2e075 Use jupyter/minimal-notebook for custom env example 2023-12-08 05:44:20 +01:00
Ayaz Salikhov
c1d2127843 Use custom conda environment in Jupyter Notebook when user wants to use it (#2050)
* Modify the custom Python kernel

- to activate the custom environment
- for the respective Jupyter Notebook and Jupyter Console

Signed-off-by: Ayaz Salikhov <mathbunnyru@gmail.com>

* Add DL3059 to hadolint ignore list

Signed-off-by: Ayaz Salikhov <mathbunnyru@gmail.com>

* Move hadolint ignore to a single line

* Use python heredoc

* Remove unused print

* Fix style

* Do not hardcode CONDA_DIR

* Update custom_environment.dockerfile

* Use indent=1

* Implement activate_notebook_custom_env.py as a separate script

* Do not call Python manually

---------

Signed-off-by: Ayaz Salikhov <mathbunnyru@gmail.com>
Co-authored-by: Olivier Benz <olivier.benz@b-data.ch>
2023-12-08 03:03:32 +01:00
Ayaz Salikhov
3253fc39b5 Fix conda hook to work in both terminal and Jupyter Notebook (#2047)
* Fix conda hook to work in both terminal and Jupyter Notebook

* Fix hook for Jupyter Terminals

* Rename startup hook to have order of precedence

* Try to increase sleep

* Comment making env_name default in custom_environment
2023-12-04 21:09:23 +01:00
Ayaz Salikhov
406e397d43 Add info about robot permission when adding a new image 2023-11-22 14:17:42 +01:00
Thijs Walcarius
278dd76837 Add jupyter/pytorch-notebook (#1936)
* Add PyTorch image

* Fix linting errors

* Fix link to pytorch website

* Address review comments

* Fix PytorchVersionTagger

* Remove "+cpu" suffix from pytorch version tag

* Update selecting.md

* Rename pytorch-notebook/.dockerignore to images/pytorch-notebook/.dockerignore

* Rename pytorch-notebook/Dockerfile to images/pytorch-notebook/Dockerfile

* Rename pytorch-notebook/README.md to images/pytorch-notebook/README.md

* Add pytorch-notebook to registry-overviews

* Add registry to pytorch image

* Use Quay.io

* Remove incorrect link

* Update action.yml

* Update docker.yml

* Remove information about Docker Hub, because this image won't be uploaded to Docker Hub

* Update docker.yml

* Update action.yml

* Add pytorch-notebook to registry-move.yml

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
Co-authored-by: Ayaz Salikhov <mathbunnyru@gmail.com>
2023-11-22 11:56:45 +01:00
Ayaz Salikhov
0a75e3d3a6 Minor improvements 2023-11-21 13:17:33 +01:00
Ayaz Salikhov
d53e39763d Minor improvements 2023-11-21 02:40:50 +01:00
Ayaz Salikhov
d8c60bc42c Fix more grammar issues 2023-11-19 12:16:19 +01:00
Ayaz Salikhov
d03229331a Fix some grammar issues 2023-11-19 02:09:26 +01:00
Ayaz Salikhov
cc00341fcc Update troubleshooting.md 2023-11-18 12:28:25 +01:00
Ayaz Salikhov
db01bfbd23 Update specifics.md 2023-11-18 12:27:13 +01:00
Ayaz Salikhov
52e4cb96f2 Fix codestyle 2023-11-18 12:26:27 +01:00
Ayaz Salikhov
e79a501d7f Update selecting.md 2023-11-18 12:25:23 +01:00
Ayaz Salikhov
1ed3bb0093 Update running.md 2023-11-18 12:23:52 +01:00
Ayaz Salikhov
4df689f2f4 Update recipes.md 2023-11-18 12:23:14 +01:00
Ayaz Salikhov
a49920aac9 Update faq.md 2023-11-18 12:21:35 +01:00
Ayaz Salikhov
011a724ba5 Update common.md 2023-11-18 12:20:55 +01:00
Ayaz Salikhov
b0ef5b950d Update tasks.md 2023-11-18 12:19:42 +01:00
Ayaz Salikhov
f1b04258b6 Update new-images-and-packages-policy.md 2023-11-18 12:19:16 +01:00
Ayaz Salikhov
094078c1c9 Update tests.md 2023-11-18 12:18:35 +01:00
Ayaz Salikhov
f15ec03aa3 Update lint.md 2023-11-18 12:17:36 +01:00
Ayaz Salikhov
fd364af70f Update stacks.md 2023-11-18 12:15:27 +01:00
Ayaz Salikhov
bbd5211343 Update recipes.md 2023-11-18 12:14:33 +01:00
Ayaz Salikhov
7378b61ac7 Update packages.md 2023-11-18 12:14:19 +01:00
Ayaz Salikhov
dbaa43f898 Update tag example 2023-11-18 12:01:53 +01:00
Ayaz Salikhov
364b81a73b Revert "[TMP] Disable mybinder linkcheck"
This reverts commit 154343498e.
2023-11-06 21:34:20 +01:00
acjbrouwer
1f11f445ed Fix broken link to r-notebook tags on quay (#2021) 2023-11-03 14:27:15 +01:00
Ayaz Salikhov
154343498e [TMP] Disable mybinder linkcheck 2023-10-31 16:41:24 +01:00
Ayaz Salikhov
e9bb9c14b2 Update first example 2023-10-31 16:37:47 +01:00
Ayaz Salikhov
463ced7e4f Update tag example 2023-10-31 16:29:35 +01:00
xieshuaihu
66f7beff16 add grpcio grpcio-status to support spark connect (#2017)
* add grpcio grpcio_status to support spark connect

* Sort install list

* Fix package name

* Update pyspark docs with new deps grpcio and grpcio-status

* set grpcio and grpcio-status version as 1.56

* exclude grpcio and grpcio-status in test_packages.py

* Update selecting.md

* Update test_packages.py

* Update Dockerfile

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2023-10-30 12:11:32 +01:00
Ayaz Salikhov
2e35c52f83 Introduce policy for new images/packages (#2016)
* Introduce policy for new images/packages

* Fix GitHub links

* Upadte list
2023-10-27 13:00:22 +03:00
Ayaz Salikhov
df0464cf4e Add navigation_with_keys: False and sort options 2023-10-26 16:24:49 +03:00
Ayaz Salikhov
b331741540 Start new sentences on a new line in markdown 2023-10-21 20:11:49 +02:00
Ayaz Salikhov
ad28158ab1 Make troubleshooting.md source code more readable 2023-10-21 20:06:45 +02:00
Ayaz Salikhov
3aed21ef44 Improve wording in tasks.md 2023-10-21 19:59:00 +02:00
Ayaz Salikhov
02e7062250 Unify <somestack> usage 2023-10-21 19:49:29 +02:00
Ayaz Salikhov
e1ad1e302b Make features.md source code more readable 2023-10-21 19:44:15 +02:00
Ayaz Salikhov
5d62545ea2 Update issue links 2023-10-21 19:41:28 +02:00
Ayaz Salikhov
52f79605f3 Update example date 2023-10-21 02:10:53 +02:00
Ayaz Salikhov
119766df29 Use Docker Hub for an old image 2023-10-21 02:10:15 +02:00
Ayaz Salikhov
ee7b9133fb Use quay.io for cookiecutter 2023-10-21 02:09:59 +02:00
Ayaz Salikhov
00a6728161 Move from Docker Hub to quay.io (#2010)
* Move from Docker Hub to quay.io

* Fix http->https

* Update registry-overviews

* Remove Docker Hub name
2023-10-20 22:31:45 +02:00
Ayaz Salikhov
a55db53d96 Improve docs 2023-10-20 16:28:11 +02:00
Ayaz Salikhov
814219407b Remove some Docker Hub usage 2023-10-19 22:06:58 +02:00
Ayaz Salikhov
4adbb05073 Add docker.io to docker run commands 2023-10-19 21:26:48 +02:00