Commit Graph

3555 Commits

Author SHA1 Message Date
Ayaz Salikhov
e5879f20f1 Improve docs about VSCode jupyter settings 2023-07-04 18:27:42 +04:00
Ayaz Salikhov
0b8b444cf1 Change mypy website url 2023-07-04 18:10:12 +04:00
pre-commit-ci[bot]
d71917f3c0 [pre-commit.ci] pre-commit autoupdate (#1933)
updates:
- [github.com/asottile/pyupgrade: v3.6.0 → v3.8.0](https://github.com/asottile/pyupgrade/compare/v3.6.0...v3.8.0)
- [github.com/pre-commit/mirrors-mypy: v1.3.0 → v1.4.1](https://github.com/pre-commit/mirrors-mypy/compare/v1.3.0...v1.4.1)
- [github.com/igorshubovych/markdownlint-cli: v0.34.0 → v0.35.0](https://github.com/igorshubovych/markdownlint-cli/compare/v0.34.0...v0.35.0)
- [github.com/asottile/blacken-docs: 1.13.0 → 1.14.0](https://github.com/asottile/blacken-docs/compare/1.13.0...1.14.0)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-07-04 14:16:36 +04:00
Ayaz Salikhov
2df2eeca93 Compress images to improve download/upload speed (#1932) 2023-07-03 17:24:11 +04:00
Ayaz Salikhov
c44f6e9476 Remove extra line in some test files 2023-07-03 00:35:00 +04:00
Ayaz Salikhov
2343fdba34 Add run_command script in tests (#1931)
* Add run_command script in tests

* Fix

* Add timeout back
2023-07-03 00:34:06 +04:00
Ayaz Salikhov
28c5a1bf1d Refactor handling of artifacts (#1930) 2023-07-02 09:37:09 +04:00
Ayaz Salikhov
98d700d84d Unify julia scripts style 2023-07-01 11:45:39 +04:00
Ayaz Salikhov
095717cb57 Fix spelling 2023-06-29 12:52:21 +04:00
Yuvi Panda
b07eb7a640 Add a setup script to install Julia + IJulia (#1927) 2023-06-29 09:09:51 +04:00
Yuvi Panda
a489a0f259 Add jupyter/julia-notebook (#1926)
* Add jupyter/julia-notebook

There is a growing number of Julia users in the Jupyter
ecosystem who do not use R, and hence would <3 to have a
dedicated docker image that doesn't bring in all the R
stuff that datascience-notebook brings in! The built image
size is much smaller, and eventually paves the way to
better ecosystem support for Julia.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add a test for julia-notebook

* Tell tests what julia-notebook inherits from

* Sort lists with julia-notebook

* Fix README for julia-notebook

* Add julia-notebook to the makefile

* Move julia-notebook below r-notebook

* Use hard tabs in Makefile

* Do some more sorting

* Rename test_julia to avoid mypy issue

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Re-order julia/r-notebook

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>

* Move julia-notebook stanza under r-notebook

* Update inheritance diagram

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2023-06-28 14:41:45 +04:00
Bjørn Jørgensen
df5d516e34 Pin pandas to version 1.5.3 to all spark images (#1925)
* 1.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add note

* typo

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove test

* >=1.5.3 and <2.0.0

* update test

* Update pyspark-notebook/Dockerfile

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update pyspark-notebook/Dockerfile

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>

* move test to file

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add pandas to EXCLUDED_PACKAGES

* add 1.5.3,<2.0.0 and sort list

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add '

* "pandas[version='>"

* Rename test_pandas_version.py to unit_pandas_version.py

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2023-06-27 15:42:18 +04:00
Bjørn Jørgensen
846f4cd319 Upgrade Apache Spark to 3.4.1 (#1922)
* rc1

* 3.4.1
2023-06-23 20:40:28 +04:00
Ayaz Salikhov
799403c4c6 Do not use wget --quiet, as it makes debugging much harder 2023-06-19 17:57:19 +04:00
Ayaz Salikhov
4e57503a0b Use long options in code 2023-06-19 17:53:50 +04:00
Ayaz Salikhov
26e33462cd Kill containers and remove stopped ones on aarch64 runners (#1921)
* Kill containers and remove stopped ones on aarch64 runners

* Update docker-build-test-upload.yml

* Fix

* Fix
2023-06-19 17:29:41 +04:00
Ayaz Salikhov
1fa0829d9f Update julia version 2023-06-13 11:52:57 +04:00
Ayaz Salikhov
5203a374e8 Update pre-commit hooks 2023-06-13 00:22:02 +04:00
dependabot[bot]
e8b5a3cd15 Bump docker/login-action from 2.1.0 to 2.2.0 (#1920)
Bumps [docker/login-action](https://github.com/docker/login-action) from 2.1.0 to 2.2.0.
- [Release notes](https://github.com/docker/login-action/releases)
- [Commits](f4ef78c080...465a07811f)

---
updated-dependencies:
- dependency-name: docker/login-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-12 23:57:25 +04:00
Ayaz Salikhov
9e3ab9075a Add local_sparklyr test (#1916) 2023-06-06 18:59:35 +04:00
pre-commit-ci[bot]
e7bdf4f70e [pre-commit.ci] pre-commit autoupdate (#1918) 2023-06-06 11:30:02 +04:00
Yuvi Panda
63d4f3d1b7 Bump Julia version to 1.9 (#1917) 2023-06-06 00:45:18 +04:00
Ayaz Salikhov
5c660db02e Try to remove r-sparklyr fix (#1915) 2023-06-04 23:27:16 +04:00
Ayaz Salikhov
88392974b8 Remove nodejs exception in tests 2023-06-04 12:16:48 +04:00
Ayaz Salikhov
43519f20f4 Do not pin nodejs version (#1914) 2023-06-04 00:11:37 +04:00
Ayaz Salikhov
bd2e2cccd7 Update RTD config 2023-06-03 02:43:07 +04:00
Ayaz Salikhov
f07c8043d5 Update readthedocs config 2023-06-03 02:40:00 +04:00
Ayaz Salikhov
d2f5ae5d59 Update contributing guide 2023-06-03 02:35:19 +04:00
Ayaz Salikhov
beb4421edd Improve README.md 2023-06-02 19:38:45 +04:00
Ayaz Salikhov
0d7551c273 Update tag example to use python 3.11 2023-06-02 19:29:44 +04:00
Ayaz Salikhov
a01a701292 Build aarch64 tensorflow image (#1911) 2023-06-02 00:39:53 +04:00
Ayaz Salikhov
6932c83f93 Fix a link 2023-06-02 00:36:32 +04:00
Darek
7805c32c42 Adding Scala kernel to Community Stacks docs (#1912)
Co-authored-by: Darek <dchrostowski@medallia.com>
2023-06-02 00:32:46 +04:00
Ayaz Salikhov
965f0ab08d Update information on old images 2023-06-01 16:54:47 +04:00
Ayaz Salikhov
347d4cd3be Fix pre-commit hooks 2023-06-01 15:28:22 +04:00
Bjørn Jørgensen
5bcf21052b Upgrade Python 3.11 (#1844)
* Update Dockerfile

* Update test_python.py

* [TMP] Do not install numba

* test with spark 3.4 rc2

* Update Dockerfile

* install tf with pip in conda

* remove mamba install pip

* Update Dockerfile

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@gmail.com>
Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2023-06-01 15:26:51 +04:00
Ayaz Salikhov
7d8861bf61 Increase recommended disk space for self-hosted runners 2023-05-31 17:34:33 +04:00
Ayaz Salikhov
4d70cf8da9 Revert "Temporarily pin flatbuffers version (#1907)"
This reverts commit 8027d13f82.
2023-05-30 14:43:46 +04:00
Ayaz Salikhov
8027d13f82 Temporarily pin flatbuffers version (#1907)
* Temporarily pin flatbuffers version

* Update Dockerfile
2023-05-28 11:39:46 +04:00
Ayaz Salikhov
4693a1d256 Update tag example once again 2023-05-27 11:47:18 +04:00
Ayaz Salikhov
7a3418ac4a Remove jupyter_server version fix (#1905) 2023-05-26 17:59:53 +04:00
Ayaz Salikhov
5800b8275c Pin nodejs version (#1906) 2023-05-26 15:01:54 +04:00
Kenta Murata
e98be3d3d0 Install nodejs >= 18.0 (#1902)
* Install nodejs >= 18.0

NodeJS >= 18.0 requires `jupyter lab build` command.

Fixes #1901.

* Update Dockerfile

* Update Dockerfile

* Update test_packages.py

---------

Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>
2023-05-26 11:29:13 +04:00
Ayaz Salikhov
a2f462b152 Update image example to use JupyterLab 4.0 2023-05-25 18:46:06 +04:00
Ayaz Salikhov
0294856e1e Better docs about self-hosted runners 2023-05-25 17:48:42 +04:00
Ayaz Salikhov
b54ec1b19a Fix listed packages in selecting.md (#1904)
* Fix listed packages in selecting.md

* Update selecting.md
2023-05-25 16:50:31 +04:00
Ayaz Salikhov
b9cea5b809 Add bold to make better docs 2023-05-25 16:14:50 +04:00
Ayaz Salikhov
a542afad1a Update aarch64-runner.md to support Google Cloud 2023-05-25 16:12:06 +04:00
Ayaz Salikhov
8e2603dd8c Use SUDO_USER to make script work when non-ubuntu user is default 2023-05-25 15:59:51 +04:00
Ayaz Salikhov
93146fdc6f Update pre-commit hooks 2023-05-24 11:30:26 +04:00