Ayaz Salikhov
c294e9e2d9
Automatically install latest spark version ( #2075 )
...
* Automatically install latest pyspark version
* Better text
* Do not use shutil to keep behaviour
* Make setup_script cwd independent
* Use _get_program_version to calculate spark version
* Update setup_spark.py reqs
* Update setup_spark.py
* Add info about HADOOP_VERSION
* Add customization back
* Better text
* Specify build args when they are actually needed
* Better text
* Better code
* Better code
* Better text
* Get rid of warning
* Improve code
* Remove information about checksum
* Better text
2024-01-07 10:01:23 +04:00
Ayaz Salikhov
474312ac79
Update conf.py for new sphinx version
2023-12-20 13:36:31 +04:00
Ayaz Salikhov
027d3a1026
Fix cusotm env recipe
2023-12-08 05:47:10 +01:00
Ayaz Salikhov
2760b2e075
Use jupyter/minimal-notebook for custom env example
2023-12-08 05:44:20 +01:00
Ayaz Salikhov
c1d2127843
Use custom conda environment in Jupyter Notebook when user wants to use it ( #2050 )
...
* Modify the custom Python kernel
- to activate the custom environment
- for the respective Jupyter Notebook and Jupyter Console
Signed-off-by: Ayaz Salikhov <mathbunnyru@gmail.com >
* Add DL3059 to hadolint ignore list
Signed-off-by: Ayaz Salikhov <mathbunnyru@gmail.com >
* Move hadolint ignore to a single line
* Use python heredoc
* Remove unused print
* Fix style
* Do not hardcode CONDA_DIR
* Update custom_environment.dockerfile
* Use indent=1
* Implement activate_notebook_custom_env.py as a separate script
* Do not call Python manually
---------
Signed-off-by: Ayaz Salikhov <mathbunnyru@gmail.com >
Co-authored-by: Olivier Benz <olivier.benz@b-data.ch >
2023-12-08 03:03:32 +01:00
Ayaz Salikhov
3253fc39b5
Fix conda hook to work in both terminal and Jupyter Notebook ( #2047 )
...
* Fix conda hook to work in both terminal and Jupyter Notebook
* Fix hook for Jupyter Terminals
* Rename startup hook to have order of precedence
* Try to increase sleep
* Comment making env_name default in custom_environment
2023-12-04 21:09:23 +01:00
Ayaz Salikhov
406e397d43
Add info about robot permission when adding a new image
2023-11-22 14:17:42 +01:00
Thijs Walcarius
278dd76837
Add jupyter/pytorch-notebook ( #1936 )
...
* Add PyTorch image
* Fix linting errors
* Fix link to pytorch website
* Address review comments
* Fix PytorchVersionTagger
* Remove "+cpu" suffix from pytorch version tag
* Update selecting.md
* Rename pytorch-notebook/.dockerignore to images/pytorch-notebook/.dockerignore
* Rename pytorch-notebook/Dockerfile to images/pytorch-notebook/Dockerfile
* Rename pytorch-notebook/README.md to images/pytorch-notebook/README.md
* Add pytorch-notebook to registry-overviews
* Add registry to pytorch image
* Use Quay.io
* Remove incorrect link
* Update action.yml
* Update docker.yml
* Remove information about Docker Hub, because this image won't be uploaded to Docker Hub
* Update docker.yml
* Update action.yml
* Add pytorch-notebook to registry-move.yml
---------
Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com >
Co-authored-by: Ayaz Salikhov <mathbunnyru@gmail.com >
2023-11-22 11:56:45 +01:00
Ayaz Salikhov
0a75e3d3a6
Minor improvements
2023-11-21 13:17:33 +01:00
Ayaz Salikhov
d53e39763d
Minor improvements
2023-11-21 02:40:50 +01:00
Ayaz Salikhov
d8c60bc42c
Fix more grammar issues
2023-11-19 12:16:19 +01:00
Ayaz Salikhov
d03229331a
Fix some grammar issues
2023-11-19 02:09:26 +01:00
Ayaz Salikhov
cc00341fcc
Update troubleshooting.md
2023-11-18 12:28:25 +01:00
Ayaz Salikhov
db01bfbd23
Update specifics.md
2023-11-18 12:27:13 +01:00
Ayaz Salikhov
52e4cb96f2
Fix codestyle
2023-11-18 12:26:27 +01:00
Ayaz Salikhov
e79a501d7f
Update selecting.md
2023-11-18 12:25:23 +01:00
Ayaz Salikhov
1ed3bb0093
Update running.md
2023-11-18 12:23:52 +01:00
Ayaz Salikhov
4df689f2f4
Update recipes.md
2023-11-18 12:23:14 +01:00
Ayaz Salikhov
a49920aac9
Update faq.md
2023-11-18 12:21:35 +01:00
Ayaz Salikhov
011a724ba5
Update common.md
2023-11-18 12:20:55 +01:00
Ayaz Salikhov
b0ef5b950d
Update tasks.md
2023-11-18 12:19:42 +01:00
Ayaz Salikhov
f1b04258b6
Update new-images-and-packages-policy.md
2023-11-18 12:19:16 +01:00
Ayaz Salikhov
094078c1c9
Update tests.md
2023-11-18 12:18:35 +01:00
Ayaz Salikhov
f15ec03aa3
Update lint.md
2023-11-18 12:17:36 +01:00
Ayaz Salikhov
fd364af70f
Update stacks.md
2023-11-18 12:15:27 +01:00
Ayaz Salikhov
bbd5211343
Update recipes.md
2023-11-18 12:14:33 +01:00
Ayaz Salikhov
7378b61ac7
Update packages.md
2023-11-18 12:14:19 +01:00
Ayaz Salikhov
dbaa43f898
Update tag example
2023-11-18 12:01:53 +01:00
Ayaz Salikhov
364b81a73b
Revert "[TMP] Disable mybinder linkcheck"
...
This reverts commit 154343498e
.
2023-11-06 21:34:20 +01:00
acjbrouwer
1f11f445ed
Fix broken link to r-notebook tags on quay ( #2021 )
2023-11-03 14:27:15 +01:00
Ayaz Salikhov
154343498e
[TMP] Disable mybinder linkcheck
2023-10-31 16:41:24 +01:00
Ayaz Salikhov
e9bb9c14b2
Update first example
2023-10-31 16:37:47 +01:00
Ayaz Salikhov
463ced7e4f
Update tag example
2023-10-31 16:29:35 +01:00
xieshuaihu
66f7beff16
add grpcio grpcio-status to support spark connect ( #2017 )
...
* add grpcio grpcio_status to support spark connect
* Sort install list
* Fix package name
* Update pyspark docs with new deps grpcio and grpcio-status
* set grpcio and grpcio-status version as 1.56
* exclude grpcio and grpcio-status in test_packages.py
* Update selecting.md
* Update test_packages.py
* Update Dockerfile
---------
Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com >
2023-10-30 12:11:32 +01:00
Ayaz Salikhov
2e35c52f83
Introduce policy for new images/packages ( #2016 )
...
* Introduce policy for new images/packages
* Fix GitHub links
* Upadte list
2023-10-27 13:00:22 +03:00
Ayaz Salikhov
df0464cf4e
Add navigation_with_keys: False and sort options
2023-10-26 16:24:49 +03:00
Ayaz Salikhov
b331741540
Start new sentences on a new line in markdown
2023-10-21 20:11:49 +02:00
Ayaz Salikhov
ad28158ab1
Make troubleshooting.md source code more readable
2023-10-21 20:06:45 +02:00
Ayaz Salikhov
3aed21ef44
Improve wording in tasks.md
2023-10-21 19:59:00 +02:00
Ayaz Salikhov
02e7062250
Unify <somestack> usage
2023-10-21 19:49:29 +02:00
Ayaz Salikhov
e1ad1e302b
Make features.md source code more readable
2023-10-21 19:44:15 +02:00
Ayaz Salikhov
5d62545ea2
Update issue links
2023-10-21 19:41:28 +02:00
Ayaz Salikhov
52f79605f3
Update example date
2023-10-21 02:10:53 +02:00
Ayaz Salikhov
119766df29
Use Docker Hub for an old image
2023-10-21 02:10:15 +02:00
Ayaz Salikhov
ee7b9133fb
Use quay.io for cookiecutter
2023-10-21 02:09:59 +02:00
Ayaz Salikhov
00a6728161
Move from Docker Hub to quay.io ( #2010 )
...
* Move from Docker Hub to quay.io
* Fix http->https
* Update registry-overviews
* Remove Docker Hub name
2023-10-20 22:31:45 +02:00
Ayaz Salikhov
a55db53d96
Improve docs
2023-10-20 16:28:11 +02:00
Ayaz Salikhov
814219407b
Remove some Docker Hub usage
2023-10-19 22:06:58 +02:00
Ayaz Salikhov
4adbb05073
Add docker.io to docker run commands
2023-10-19 21:26:48 +02:00
Ayaz Salikhov
f8cd90ade1
Add an ability to specify registry when using docker images ( #2008 )
...
* Add an ability to specify registry when using docker images
* Fix typo
* [TMP] Speedup workflow
* Revert "[TMP] Speedup workflow"
This reverts commit 3af0055ccf
.
2023-10-19 21:15:10 +02:00