Commit Graph

130 Commits

Author SHA1 Message Date
Ayaz Salikhov
87b37b4fd8 Specify protocol when using host.docker.internal proxy (#2181) 2024-12-09 11:30:06 +00:00
Ayaz Salikhov
143db355da Install mamba 2.0 (#2147) 2024-12-03 01:31:56 +01:00
Ayaz Salikhov
7060f20fb5 Remove pandas from EXCLUDED_PACKAGES (#2176) 2024-12-02 16:13:01 +00:00
Ayaz Salikhov
ac8453913c Use mamba env export with --json (#2162) 2024-11-25 16:23:38 +00:00
Erik Sundell
caf725210c base-notebook: stop installing nodejs from conda-forge (#2172)
* base-notebook: stop installing nodejs from conda-forge

nodejs was a conda dependency of jupyterhub, but by installing
jupyterhub-base we no longer need it and could opt to remove it.

By doing this, building base-notebook led to a reported size reduction
from 974MB to 828MB, which is a 146MB / 15% size reduction.

* Update CHANGELOG.md

* Update CHANGELOG.md

* Install jupyterhub-singleuser instead of jupyterhub-base

Note that jupyterhub-base is really whats the foundational need for this
image, where jupyterhub-singleuser the conda-forge package is building on
jupyterhub-base by also adding a depdendency on jupyterlab - but the
jupyterhub-singleuser command is provided by jupyterhub-base conda-forge
package.

* Update CHANGELOG.md

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2024-11-08 15:15:07 +00:00
Erik Sundell
28a0b25bce Install jupyterhub-base instead of jupyterhub (#2171)
* Install jupyterhub-base instead of jupyterhub

* Update images/base-notebook/Dockerfile

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2024-11-06 15:04:07 +00:00
Ayaz Salikhov
c2d9d1f06a Pin min notebook version (#2167)
* [TMP] Pin min notebook version

* Update Dockerfile
2024-11-04 14:55:35 +00:00
Ayaz Salikhov
f74a764584 Do not install tensorflow 2.18.0 as it gives an error 2024-10-28 14:06:50 +00:00
Ayaz Salikhov
a1265be650 Get rid of abseil warnings 2024-10-28 12:23:29 +00:00
Max Muoto
a096c2b102 Upgrade to Python 3.12 (#2072) 2024-10-23 08:58:47 +01:00
Ayaz Salikhov
b744182207 Start using spark4-preview versions (#2159)
* Start using spark4-preview versions

* Allow to download preview versions

* Expect warnings in spark

* Disable local_sparklyr test for now
2024-10-22 11:47:45 +01:00
Ayaz Salikhov
2f1cf2a2ef Expect warnings/errors when no_warnings/no_errors is False (#2160) 2024-10-20 16:38:40 +01:00
Ayaz Salikhov
41d0c3f5a4 Use mamba env export differently: --no-build(s) and no --json (#2150) 2024-10-02 17:40:30 +01:00
Ayaz Salikhov
640938bd1f Fix test 2024-10-02 11:42:39 +01:00
Ayaz Salikhov
55ea74f89f Exclude mamba package from tests 2024-09-30 09:13:25 +02:00
Olivier Benz
6f74c72a92 [FAST_BUILD] No sudo when run with rootless triplet (#2132)
* No sudo when run with rootless triplet

-  rootless triplet: -e NB_USER=root -e NB_UID=0 -e NB_GID=0

* Add tests for rootless triplet

* Update tests for rootless triplet

* Fix tests for rootless triplet
2024-08-11 16:50:27 +01:00
Ayaz Salikhov
615b8cc01b Ignore mypy in files with numpy 2024-07-02 10:37:46 +01:00
pre-commit-ci[bot]
949af9bbd5 [pre-commit.ci] pre-commit autoupdate (#2090) 2024-02-06 04:43:51 +04:00
Ayaz Salikhov
7a5990be1f Do not rewrite variable with another value 2024-01-23 13:11:02 +01:00
Simon Li
6e437aa489 Make start.sh the entrypoint (#2087) 2024-01-22 08:47:48 +04:00
Ayaz Salikhov
b71f4cb525 Unify access to env variables (#2086) 2024-01-21 17:32:14 +04:00
Ayaz Salikhov
a4ede5de2f Fix Python version pin (#2085) 2024-01-21 16:06:10 +04:00
Ayaz Salikhov
46d7265781 Rename test file test_python -> test_python_version 2024-01-21 14:37:52 +04:00
Ayaz Salikhov
d57bf9590d Adjust sleep times (#2080)
* Adjust sleep times

* Update test_start_container.py

* Update test_healthcheck.py

* Update pluto_check.py
2024-01-17 02:11:44 +04:00
Ayaz Salikhov
86dc0f274f Fix comments codestyle in python 2024-01-16 16:56:36 +04:00
Ayaz Salikhov
d3e18d975c Fix some style issues in tests 2024-01-16 16:35:14 +04:00
Ayaz Salikhov
c1229303d0 Rename some tests in test_healthcheck.py 2024-01-07 00:15:38 +04:00
Hugo Hromic
2a6a115a7c [FAST_BUILD] Fix Docker healthcheck when using custom runtime dirs (#2074)
* Fix Docker healthcheck when using custom runtime dirs

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Use a writable directory for healthcheck test

* Allow missing import for `jupyter_core` in mypy

* Set HOME according to NB_USER in healthcheck script

* Add custom runtime dir an NB_USER case to healthcheck test

* Call `jupyter --runtime-dir` directly in healthcheck script

* Update docker_healthcheck.py

* Update docker_healthcheck.py

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2024-01-07 00:13:21 +04:00
Ayaz Salikhov
3253fc39b5 Fix conda hook to work in both terminal and Jupyter Notebook (#2047)
* Fix conda hook to work in both terminal and Jupyter Notebook

* Fix hook for Jupyter Terminals

* Rename startup hook to have order of precedence

* Try to increase sleep

* Comment making env_name default in custom_environment
2023-12-04 21:09:23 +01:00
Thijs Walcarius
278dd76837 Add jupyter/pytorch-notebook (#1936)
* Add PyTorch image

* Fix linting errors

* Fix link to pytorch website

* Address review comments

* Fix PytorchVersionTagger

* Remove "+cpu" suffix from pytorch version tag

* Update selecting.md

* Rename pytorch-notebook/.dockerignore to images/pytorch-notebook/.dockerignore

* Rename pytorch-notebook/Dockerfile to images/pytorch-notebook/Dockerfile

* Rename pytorch-notebook/README.md to images/pytorch-notebook/README.md

* Add pytorch-notebook to registry-overviews

* Add registry to pytorch image

* Use Quay.io

* Remove incorrect link

* Update action.yml

* Update docker.yml

* Remove information about Docker Hub, because this image won't be uploaded to Docker Hub

* Update docker.yml

* Update action.yml

* Add pytorch-notebook to registry-move.yml

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
Co-authored-by: Ayaz Salikhov <mathbunnyru@gmail.com>
2023-11-22 11:56:45 +01:00
Ayaz Salikhov
0a75e3d3a6 Minor improvements 2023-11-21 13:17:33 +01:00
Ayaz Salikhov
d8c60bc42c Fix more grammar issues 2023-11-19 12:16:19 +01:00
Ayaz Salikhov
e6f89ded6e Mark test_nbconvert as a flaky test 2023-11-05 10:13:52 +01:00
Ayaz Salikhov
7866050baf Improve wording in test_extensions.py 2023-11-05 00:34:24 +01:00
Ayaz Salikhov
dc5ec3d08b Move test_packages.py to docker-stacks-foundation tests 2023-11-05 00:14:34 +01:00
Ayaz Salikhov
0a0e833fcb Fix quay.io naming 2023-11-05 00:03:23 +01:00
Ayaz Salikhov
8c874a1cb4 Rename run-hooks subdir to better show the test meaning 2023-11-04 11:44:52 +01:00
Ayaz Salikhov
0ad837af8f [FAST_BUILD] Test change variable value in run-hooks (#2023) 2023-11-04 11:41:59 +01:00
Ayaz Salikhov
29e6a45dd3 Introduce run_source_in_dir to make run-hooks tests easier to write 2023-11-04 11:36:19 +01:00
Ayaz Salikhov
d52ea4716e [FAST_BUILD] Test unset in run-hooks (#2022) 2023-11-04 11:34:33 +01:00
Ayaz Salikhov
64248b85c6 Increase timeout in test_spark_notebooks 2023-10-30 12:13:12 +01:00
xieshuaihu
66f7beff16 add grpcio grpcio-status to support spark connect (#2017)
* add grpcio grpcio_status to support spark connect

* Sort install list

* Fix package name

* Update pyspark docs with new deps grpcio and grpcio-status

* set grpcio and grpcio-status version as 1.56

* exclude grpcio and grpcio-status in test_packages.py

* Update selecting.md

* Update test_packages.py

* Update Dockerfile

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2023-10-30 12:11:32 +01:00
Ayaz Salikhov
02e7062250 Unify <somestack> usage 2023-10-21 19:49:29 +02:00
Ayaz Salikhov
f8cd90ade1 Add an ability to specify registry when using docker images (#2008)
* Add an ability to specify registry when using docker images

* Fix typo

* [TMP] Speedup workflow

* Revert "[TMP] Speedup workflow"

This reverts commit 3af0055ccf.
2023-10-19 21:15:10 +02:00
Yuvi Panda
bceaead5d2 Migrate start-notebook & start-singleuser to python (#2006)
* Migrate start-notebook.sh to bash

Based on

> Stop using bash, haha 👍

from https://github.com/jupyter/docker-stacks/issues/1532.

If there's more apetite for this, I'll try to migrate
`start.sh` and `start-singleuser.sh` as well - I think they should
all be merged together. We can remove the `.sh` suffixes for
accuracy, and keep symlinks in so old config still works. Since
the shebang is what is used to launch the correct interpreter,
the `.sh` doesn't matter.

Will help fix https://github.com/jupyter/docker-stacks/issues/1532,
as I believe all those things are going to be easier to do from
python than bash

* Rename start-notebook.sh to start-notebook

* Cleanup start-notebook a little

* Fix typo

* Migrate start-singleuser as well

* Remove unused import

* Run symlink commands as root

* Combine repetitive RUN commands

* Remove multiple args to env

-u can not be set by shebang, we must set the env var
instead

* Fix conditional inversion

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>

* Fix how start-singleuser is exec'd

* Actually call jupyterhub-singleuser in start-singleuser

* Pass through any additional args we get

* Put .py suffix on the start-* scripts

* Add .sh shims for the start-* scripts

* Document start-notebook.sh and start-singleuser.sh

* Partially test start-notebook.sh

* Reflow warning docs

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2023-10-17 14:46:43 +02:00
Bjørn Jørgensen
52a999a554 Upgrade Apache Spark to 3.5.0 (#1995)
* 1.

* add note for pandas version

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update images/pyspark-notebook/Dockerfile

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2023-09-16 20:56:10 +04:00
Ayaz Salikhov
3675f63d08 Test run_hooks when executables fail (#1987) 2023-09-04 19:50:30 +04:00
Ayaz Salikhov
0d8b4e4987 Replace os with pathlib where paths are used (#1984) 2023-08-26 17:41:40 +04:00
Ayaz Salikhov
6aded4bc1d Fix style 2023-08-26 01:39:26 +04:00
Ayaz Salikhov
7a4381ff2f Use only rv['StatusCode'] to simplify code (#1982) 2023-08-25 13:47:36 +04:00