Commit Graph

3373 Commits

Author SHA1 Message Date
Ayaz Salikhov
d60cf610fd More clear docs 2023-07-11 14:24:41 +04:00
Ayaz Salikhov
a7781fb90a More clear docs on building pyspark-notebook with different spark version 2023-07-11 14:16:10 +04:00
Ayaz Salikhov
67029f17f0 Always pull ubuntu:22.04 (#1940) 2023-07-11 14:11:41 +04:00
Ayaz Salikhov
1b04ebe67d One more docs fix 2023-07-09 20:20:34 +04:00
Ayaz Salikhov
11071cb577 Fix docs 2023-07-09 19:57:34 +04:00
Ayaz Salikhov
29a1e3da6e Makefile cleanup and check-outdated fix 2023-07-09 16:50:39 +04:00
Ayaz Salikhov
8c74f0ba67 Update rtd config 2023-07-09 16:22:36 +04:00
Ayaz Salikhov
f0d0871bd3 Update prettier 2023-07-08 01:38:36 +04:00
Ayaz Salikhov
3d1dfb0453 Fix applying tags in local development (#1939) 2023-07-07 17:44:42 +04:00
Thijs Walcarius
4f92f2c651 Fix image tagging in hook/% (#1938) 2023-07-07 15:14:37 +04:00
Ayaz Salikhov
819aa10230 Add tensorflow-notebook artifacts download 2023-07-06 14:41:41 +04:00
Ayaz Salikhov
2edc0fe214 Put pluto test in one common file (#1934) 2023-07-05 22:07:43 +04:00
Yuvi Panda
39582f7099 Install Pluto.jl and jupyter-pluto-proxy (#1929)
* Install Pluto.jl and jupyter-pluto-proxy

[Pluto.jl](https://plutojl.org/) is an alternative reactive notebook
frontend focused specifically on Julia. I think shipping this
by default in the julia-enabled images helps serve the Julia
community better, particularly when used with JupyterHub.

For context, I am working with the Julia users of the
[Jupyter Meets the Earth](https://jupytearth.org/) project, and
trying to understand how to best serve their needs on a JupyterHub.
We currently maintain a massive image that 'has everything', but
I'm trying to instead work upstream wherever possible so everyone
working in these subfields can benefit. Meeting Julia users where
they are at seems a useful path forward here.

* Add note about Pluto.jl to selecting.md

* Default to replacing - with _ in package imports

* Add jupyter-pluto-proxy to package import mapping

* Add Pluto.jl to datascience-notebook image

* Add test for pluto proxy starting correctly

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update test_packages.py

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2023-07-05 18:48:36 +04:00
Ayaz Salikhov
127004aec4 Add an example of adding a new image 2023-07-04 20:27:31 +04:00
Ayaz Salikhov
51109c93aa Add newlines to Community Stacks to make images look better 2023-07-04 20:24:00 +04:00
Ayaz Salikhov
a10fc2bdd0 Update maintaining recipes 2023-07-04 20:11:56 +04:00
Ayaz Salikhov
b345aa508d Fix text 2023-07-04 18:37:17 +04:00
Ayaz Salikhov
042161a94f Put static files in correct folder 2023-07-04 18:33:14 +04:00
Ayaz Salikhov
e5879f20f1 Improve docs about VSCode jupyter settings 2023-07-04 18:27:42 +04:00
Ayaz Salikhov
0b8b444cf1 Change mypy website url 2023-07-04 18:10:12 +04:00
pre-commit-ci[bot]
d71917f3c0 [pre-commit.ci] pre-commit autoupdate (#1933)
updates:
- [github.com/asottile/pyupgrade: v3.6.0 → v3.8.0](https://github.com/asottile/pyupgrade/compare/v3.6.0...v3.8.0)
- [github.com/pre-commit/mirrors-mypy: v1.3.0 → v1.4.1](https://github.com/pre-commit/mirrors-mypy/compare/v1.3.0...v1.4.1)
- [github.com/igorshubovych/markdownlint-cli: v0.34.0 → v0.35.0](https://github.com/igorshubovych/markdownlint-cli/compare/v0.34.0...v0.35.0)
- [github.com/asottile/blacken-docs: 1.13.0 → 1.14.0](https://github.com/asottile/blacken-docs/compare/1.13.0...1.14.0)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-07-04 14:16:36 +04:00
Ayaz Salikhov
2df2eeca93 Compress images to improve download/upload speed (#1932) 2023-07-03 17:24:11 +04:00
Ayaz Salikhov
c44f6e9476 Remove extra line in some test files 2023-07-03 00:35:00 +04:00
Ayaz Salikhov
2343fdba34 Add run_command script in tests (#1931)
* Add run_command script in tests

* Fix

* Add timeout back
2023-07-03 00:34:06 +04:00
Ayaz Salikhov
28c5a1bf1d Refactor handling of artifacts (#1930) 2023-07-02 09:37:09 +04:00
Ayaz Salikhov
98d700d84d Unify julia scripts style 2023-07-01 11:45:39 +04:00
Ayaz Salikhov
095717cb57 Fix spelling 2023-06-29 12:52:21 +04:00
Yuvi Panda
b07eb7a640 Add a setup script to install Julia + IJulia (#1927) 2023-06-29 09:09:51 +04:00
Yuvi Panda
a489a0f259 Add jupyter/julia-notebook (#1926)
* Add jupyter/julia-notebook

There is a growing number of Julia users in the Jupyter
ecosystem who do not use R, and hence would <3 to have a
dedicated docker image that doesn't bring in all the R
stuff that datascience-notebook brings in! The built image
size is much smaller, and eventually paves the way to
better ecosystem support for Julia.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add a test for julia-notebook

* Tell tests what julia-notebook inherits from

* Sort lists with julia-notebook

* Fix README for julia-notebook

* Add julia-notebook to the makefile

* Move julia-notebook below r-notebook

* Use hard tabs in Makefile

* Do some more sorting

* Rename test_julia to avoid mypy issue

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Re-order julia/r-notebook

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>

* Move julia-notebook stanza under r-notebook

* Update inheritance diagram

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2023-06-28 14:41:45 +04:00
Bjørn Jørgensen
df5d516e34 Pin pandas to version 1.5.3 to all spark images (#1925)
* 1.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add note

* typo

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove test

* >=1.5.3 and <2.0.0

* update test

* Update pyspark-notebook/Dockerfile

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update pyspark-notebook/Dockerfile

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>

* move test to file

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add pandas to EXCLUDED_PACKAGES

* add 1.5.3,<2.0.0 and sort list

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add '

* "pandas[version='>"

* Rename test_pandas_version.py to unit_pandas_version.py

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2023-06-27 15:42:18 +04:00
Bjørn Jørgensen
846f4cd319 Upgrade Apache Spark to 3.4.1 (#1922)
* rc1

* 3.4.1
2023-06-23 20:40:28 +04:00
Ayaz Salikhov
799403c4c6 Do not use wget --quiet, as it makes debugging much harder 2023-06-19 17:57:19 +04:00
Ayaz Salikhov
4e57503a0b Use long options in code 2023-06-19 17:53:50 +04:00
Ayaz Salikhov
26e33462cd Kill containers and remove stopped ones on aarch64 runners (#1921)
* Kill containers and remove stopped ones on aarch64 runners

* Update docker-build-test-upload.yml

* Fix

* Fix
2023-06-19 17:29:41 +04:00
Ayaz Salikhov
1fa0829d9f Update julia version 2023-06-13 11:52:57 +04:00
Ayaz Salikhov
5203a374e8 Update pre-commit hooks 2023-06-13 00:22:02 +04:00
dependabot[bot]
e8b5a3cd15 Bump docker/login-action from 2.1.0 to 2.2.0 (#1920)
Bumps [docker/login-action](https://github.com/docker/login-action) from 2.1.0 to 2.2.0.
- [Release notes](https://github.com/docker/login-action/releases)
- [Commits](f4ef78c080...465a07811f)

---
updated-dependencies:
- dependency-name: docker/login-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-12 23:57:25 +04:00
Ayaz Salikhov
9e3ab9075a Add local_sparklyr test (#1916) 2023-06-06 18:59:35 +04:00
pre-commit-ci[bot]
e7bdf4f70e [pre-commit.ci] pre-commit autoupdate (#1918) 2023-06-06 11:30:02 +04:00
Yuvi Panda
63d4f3d1b7 Bump Julia version to 1.9 (#1917) 2023-06-06 00:45:18 +04:00
Ayaz Salikhov
5c660db02e Try to remove r-sparklyr fix (#1915) 2023-06-04 23:27:16 +04:00
Ayaz Salikhov
88392974b8 Remove nodejs exception in tests 2023-06-04 12:16:48 +04:00
Ayaz Salikhov
43519f20f4 Do not pin nodejs version (#1914) 2023-06-04 00:11:37 +04:00
Ayaz Salikhov
bd2e2cccd7 Update RTD config 2023-06-03 02:43:07 +04:00
Ayaz Salikhov
f07c8043d5 Update readthedocs config 2023-06-03 02:40:00 +04:00
Ayaz Salikhov
d2f5ae5d59 Update contributing guide 2023-06-03 02:35:19 +04:00
Ayaz Salikhov
beb4421edd Improve README.md 2023-06-02 19:38:45 +04:00
Ayaz Salikhov
0d7551c273 Update tag example to use python 3.11 2023-06-02 19:29:44 +04:00
Ayaz Salikhov
a01a701292 Build aarch64 tensorflow image (#1911) 2023-06-02 00:39:53 +04:00
Ayaz Salikhov
6932c83f93 Fix a link 2023-06-02 00:36:32 +04:00