Commit Graph

3837 Commits

Author SHA1 Message Date
Ayaz Salikhov
a4ede5de2f Fix Python version pin (#2085) 2024-01-21 16:06:10 +04:00
Ayaz Salikhov
8d0ec50095 Improve wording 2024-01-21 15:29:27 +04:00
Ayaz Salikhov
8b8d1b7dcf Fix Docker broken links 2024-01-21 15:29:15 +04:00
Ayaz Salikhov
46d7265781 Rename test file test_python -> test_python_version 2024-01-21 14:37:52 +04:00
Ayaz Salikhov
aadf012336 Update pre-commit hooks 2024-01-18 11:56:15 +04:00
Ayaz Salikhov
5d68244bb2 Cleanup some commands in Makefile 2024-01-17 15:56:18 +04:00
Ayaz Salikhov
afe30f0c9a Use argparse to setup spark (#2082) 2024-01-17 15:07:15 +04:00
Ayaz Salikhov
bf33945b9e Do not bloat spark image with ENV variables (#2081)
* Do not bloat spark image with ENV variables

* Remove HadoopVersionTagger
2024-01-17 13:34:33 +04:00
Ayaz Salikhov
d57bf9590d Adjust sleep times (#2080)
* Adjust sleep times

* Update test_start_container.py

* Update test_healthcheck.py

* Update pluto_check.py
2024-01-17 02:11:44 +04:00
Ayaz Salikhov
86dc0f274f Fix comments codestyle in python 2024-01-16 16:56:36 +04:00
Ayaz Salikhov
d3e18d975c Fix some style issues in tests 2024-01-16 16:35:14 +04:00
Ayaz Salikhov
14a29d12d8 Improve comments in images 2024-01-15 14:56:23 +04:00
Ayaz Salikhov
0386b2a630 Remove some double spaces 2024-01-15 14:48:54 +04:00
Ayaz Salikhov
9fa124053b Update tag example 2024-01-15 13:27:44 +04:00
Ayaz Salikhov
6e01bbabec Improve wording in versioning via image tags 2024-01-15 13:26:33 +04:00
Ayaz Salikhov
a63a9a6fcb Document root homedir (#2079)
* Document root homedir

* Add link to issue
2024-01-14 22:56:24 +04:00
Olivier Benz
37018f998c Add support for Docker/Podman in rootless mode (#2039)
- Fixes https://github.com/jupyter/docker-stacks/issues/2036

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2024-01-14 22:39:37 +04:00
Ayaz Salikhov
eb04996c7d Use 1 fast 2CPU and 3 slow 1CPU aarch64 runners (#2040)
undefined
2024-01-14 17:59:42 +04:00
Ayaz Salikhov
d599a7aeca Improve get_manifest_timestamp function 2024-01-14 15:41:00 +04:00
Ayaz Salikhov
4d2c81cd88 Update update_wiki.py: fix for pattern download, build timestamps, additional checks 2024-01-14 14:27:33 +04:00
Ayaz Salikhov
c6c0a947ed Remove redundant step 2024-01-13 18:57:17 +04:00
Ayaz Salikhov
fccea73332 Get rid of separate download-manifests action 2024-01-13 18:57:17 +04:00
Ayaz Salikhov
cc3aa43c46 Update actions/download-artifact and actions/upload-artifact to v4 (#2061) 2024-01-13 18:57:17 +04:00
Ayaz Salikhov
e55bb93ff4 Update tag example 2024-01-08 11:03:49 +04:00
Ayaz Salikhov
d9f41655fe Simplify README.md 2024-01-08 10:58:58 +04:00
Ayaz Salikhov
2a9c7dbc26 Update the way we install micromamba (#2077) 2024-01-07 18:33:54 +04:00
Ayaz Salikhov
6e80c1246f Fix comment about setup_julia.py file 2024-01-07 15:55:41 +04:00
Ayaz Salikhov
e84bfdf4ae Add logger to setup_julia and setup_spark 2024-01-07 15:55:41 +04:00
Ayaz Salikhov
c294e9e2d9 Automatically install latest spark version (#2075)
* Automatically install latest pyspark version

* Better text

* Do not use shutil to keep behaviour

* Make setup_script cwd independent

* Use _get_program_version to calculate spark version

* Update setup_spark.py reqs

* Update setup_spark.py

* Add info about HADOOP_VERSION

* Add customization back

* Better text

* Specify build args when they are actually needed

* Better text

* Better code

* Better code

* Better text

* Get rid of warning

* Improve code

* Remove information about checksum

* Better text
2024-01-07 10:01:23 +04:00
Ayaz Salikhov
c1229303d0 Rename some tests in test_healthcheck.py 2024-01-07 00:15:38 +04:00
Hugo Hromic
2a6a115a7c [FAST_BUILD] Fix Docker healthcheck when using custom runtime dirs (#2074)
* Fix Docker healthcheck when using custom runtime dirs

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Use a writable directory for healthcheck test

* Allow missing import for `jupyter_core` in mypy

* Set HOME according to NB_USER in healthcheck script

* Add custom runtime dir an NB_USER case to healthcheck test

* Call `jupyter --runtime-dir` directly in healthcheck script

* Update docker_healthcheck.py

* Update docker_healthcheck.py

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2024-01-07 00:13:21 +04:00
Ayaz Salikhov
48b189e585 Add a comment for choosing latest_stable_version for Julia 2024-01-06 21:41:53 +04:00
John Muchovej
c515e883ea Fix max(stable_versions) on Julia version finding (#2076)
* Fix `max(stable_versions)`

Since the keys are semantic version strings, that means that `"1.9.4" > "1.10.0", which we know isn't true. 🙂

I just added some code to convert the string to tuples, find the max, then convert back to a string.

I first noticed this on the `2024-01-05` build of the `datascience-notebook`, since Julia 1.10.0 was released ~2 weeks ago: https://github.com/JuliaLang/julia/releases/tag/v1.10.0.

* Migrate to comparator on `max(stable_versions)`

* Update setup_julia.py

* Update setup_julia.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-01-06 21:09:30 +04:00
Ayaz Salikhov
06cdadd0bf Improve spark pandas version information 2024-01-05 15:06:26 +04:00
Ayaz Salikhov
dc6432a4eb Update .readthedocs.yaml 2024-01-04 23:47:17 +04:00
pre-commit-ci[bot]
fcb20a914e [pre-commit.ci] pre-commit autoupdate (#2071)
updates:
- [github.com/PyCQA/isort: 5.12.0 → 5.13.2](https://github.com/PyCQA/isort/compare/5.12.0...5.13.2)
- [github.com/psf/black: 23.11.0 → 23.12.1](https://github.com/psf/black/compare/23.11.0...23.12.1)
- [github.com/pre-commit/mirrors-mypy: v1.7.1 → v1.8.0](https://github.com/pre-commit/mirrors-mypy/compare/v1.7.1...v1.8.0)
- [github.com/pre-commit/mirrors-prettier: v3.1.0 → v4.0.0-alpha.8](https://github.com/pre-commit/mirrors-prettier/compare/v3.1.0...v4.0.0-alpha.8)
- [github.com/igorshubovych/markdownlint-cli: v0.37.0 → v0.38.0](https://github.com/igorshubovych/markdownlint-cli/compare/v0.37.0...v0.38.0)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-01-02 01:04:24 +04:00
Yuvi Panda
1494233e27 Link to the rocker/binder image as an alternative (#2065)
* Link to the rocker/binder image as an alternative

* Unify style in README.md

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2023-12-21 20:42:49 +04:00
Ayaz Salikhov
474312ac79 Update conf.py for new sphinx version 2023-12-20 13:36:31 +04:00
Ayaz Salikhov
dc009c260c Revert "Update actions/download-artifact and actions/upload-artifact to v4 (#2061)"
This reverts commit 0736628649.
2023-12-20 13:36:01 +04:00
Ayaz Salikhov
0736628649 Update actions/download-artifact and actions/upload-artifact to v4 (#2061) 2023-12-15 01:06:20 +04:00
Ayaz Salikhov
ccbe678154 Fix typo 2023-12-14 17:52:22 +04:00
Ayaz Salikhov
55541bdc66 Remove jupyterlab and notebook pins in scipy-notebook (#2060) 2023-12-12 11:28:35 +04:00
Ayaz Salikhov
781a0f4d27 Mamba 1.5.5 is released, so remove fix for mamba clean 2023-12-12 04:27:13 +04:00
dependabot[bot]
5e20409c1e Bump actions/setup-python from 4 to 5 in /.github/actions/create-dev-env (#2058)
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 4 to 5.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](https://github.com/actions/setup-python/compare/v4...v5)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-12-11 13:39:19 +04:00
Ayaz Salikhov
6402f3dbfe Configure dependabot to update actions inside composite actions 2023-12-11 13:35:41 +04:00
dependabot[bot]
bf82b82d92 Bump actions/setup-python from 4 to 5 (#2057)
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 4 to 5.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](https://github.com/actions/setup-python/compare/v4...v5)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-12-11 13:25:24 +04:00
Ayaz Salikhov
42ff5aa638 Do not hardcode python3.11 in temporary fix 2023-12-08 12:37:12 +04:00
Ayaz Salikhov
027d3a1026 Fix cusotm env recipe 2023-12-08 05:47:10 +01:00
Ayaz Salikhov
2760b2e075 Use jupyter/minimal-notebook for custom env example 2023-12-08 05:44:20 +01:00
Ayaz Salikhov
c1d2127843 Use custom conda environment in Jupyter Notebook when user wants to use it (#2050)
* Modify the custom Python kernel

- to activate the custom environment
- for the respective Jupyter Notebook and Jupyter Console

Signed-off-by: Ayaz Salikhov <mathbunnyru@gmail.com>

* Add DL3059 to hadolint ignore list

Signed-off-by: Ayaz Salikhov <mathbunnyru@gmail.com>

* Move hadolint ignore to a single line

* Use python heredoc

* Remove unused print

* Fix style

* Do not hardcode CONDA_DIR

* Update custom_environment.dockerfile

* Use indent=1

* Implement activate_notebook_custom_env.py as a separate script

* Do not call Python manually

---------

Signed-off-by: Ayaz Salikhov <mathbunnyru@gmail.com>
Co-authored-by: Olivier Benz <olivier.benz@b-data.ch>
2023-12-08 03:03:32 +01:00