Commit Graph

182 Commits

Author SHA1 Message Date
Ayaz Salikhov
f9a75e58c5 Install Spark 4 release version (#2300) 2025-05-30 09:11:31 +01:00
Min RK
1eacd4ee78 log hook messages to stderr (#2293) 2025-04-30 08:59:49 +01:00
Ayaz Salikhov
1dbce17442 Improve pytorch unit test (#2290) 2025-04-25 01:39:47 +01:00
Ayaz Salikhov
90224a7a99 Install latest tensorflow using pip (#2263)
* Install latest tensorflow using pip

* Allow tensorflow test to warn

* Fix another way
2025-04-13 12:11:40 +01:00
Ayaz Salikhov
0ff54bbcb3 Use pytest-rerunfailures for flaky tests (#2279) 2025-04-04 02:31:14 +01:00
Ayaz Salikhov
258a47e789 Mark test_spark_r_nbconvert as flaky 2025-04-04 01:47:43 +01:00
Ayaz Salikhov
c81d61bbc1 Improve some tests (#2278)
* Improve some tests

* Fix
2025-04-04 01:44:03 +01:00
Ayaz Salikhov
f4b31dda77 Increase all run_and_wait timeouts to at least 10 seconds 2025-04-03 21:27:30 +01:00
Ayaz Salikhov
1473c9bbda Force using keyword-only arguments where types are the same (#2277)
* Force using keyword-only arguments where types are the same

* Fix
2025-04-03 21:27:24 +01:00
Ayaz Salikhov
fcff9a93bb Increase timeouts to make tests fail less 2025-04-03 15:34:12 +01:00
Ayaz Salikhov
ecaa90c704 Simplify code in CondaPackageHelper 2025-03-26 19:16:41 +00:00
Ayaz Salikhov
24d8f650af Cleanup EXCLUDED_PACKAGES list (#2269) 2025-03-26 15:28:52 +00:00
Ayaz Salikhov
8432e5741c Refactor CondaPackageHelper: cached_property, better typing, no state 2025-03-26 12:05:05 +00:00
Ayaz Salikhov
de8a1349ae Try to unmark tests as flaky (#2268) 2025-03-25 21:10:11 +00:00
Ayaz Salikhov
100187f79d Make free_host_port a fixture (#2267)
* Make free_host_port a fixture

* Remove redundant comment
2025-03-25 15:33:26 +00:00
Ayaz Salikhov
2ce2c06a22 Improve test_spark_r_nbconvert: add local_sparklyr back, test all output formats 2025-03-25 15:04:58 +00:00
Ayaz Salikhov
2766279baf Unify how we use volumes: mount files, use pathlib.Path without str 2025-03-25 14:49:50 +00:00
Ayaz Salikhov
1af2bfc070 Add check_nbconvert function and run tests for appropriate images (#2266) 2025-03-25 13:00:19 +00:00
Ayaz Salikhov
57ce6e3f05 Reduce indirection when running docker commands (#2265) 2025-03-25 09:40:27 +00:00
Ayaz Salikhov
834b6c7e03 Error logs on error/warn in logs 2025-03-25 09:39:02 +00:00
Ayaz Salikhov
de998c41eb Log errors on docker run/exec failure 2025-03-25 08:46:26 +00:00
Ayaz Salikhov
33d3b308c4 Use mamba to install jupyter-server-proxy (#2262)
* Use mamba to install jupyter-server-proxy

* Update changelog
2025-03-23 13:59:59 +00:00
Ayaz Salikhov
bc3baf8ad8 Improve logs around running docker (#2261) 2025-03-23 11:09:53 +00:00
Ayaz Salikhov
28070e6022 Remove example from test_packages as it is out-of-date 2025-03-22 17:49:19 +00:00
Ayaz Salikhov
23c6f42a6f Remove container directly in run_and_wait 2025-03-22 17:47:45 +00:00
Ayaz Salikhov
f47292edc0 Use tty for running docker commands by default (#2260)
* Use tty for running docker commands by default

* Add comment about using tty=False

* Remove unrelated part
2025-03-22 17:46:38 +00:00
Ayaz Salikhov
929ebdb758 Flush output in Python before running execvp (#2258) 2025-03-21 13:50:35 +00:00
Ayaz Salikhov
95aa99dd85 Do not allocate TTY in tests if not needed (#2257) 2025-03-21 12:15:16 +00:00
Ayaz Salikhov
f0ef7e30b2 Use simpler API to get health of container 2025-03-21 10:11:19 +00:00
Ayaz Salikhov
dcd1c457d3 Refactor TrackedContainer run_detached/exec_cmd functions (#2256)
* Refactor TrackedContainer run_detached/exec_cmd functions

* Add get_logs() method

* Small fixes

* Make get_health() a method

* Remove kwargs, always print output

* Small fixes
2025-03-21 10:05:00 +00:00
Ayaz Salikhov
b35f1554d6 Test server listening on IPv4/IPv6 (#2255)
* Test server listening on IPv4/IPv6

* Set up Docker in create-dev-env

* Show docker version

* Add info about docker client

* Check requests

* Show docker client version

* Try to pass docker sock

* Fix

* Break fast

* Revert

* Cleanup

* Better naming

* Always use docker.from_env

* Revert "Always use docker.from_env"

This reverts commit d03069ac28.

* Use custom docker client for only one test

* More logs

* Use cont_data_dir in test, so workdir doesn't matter

* Use common variable names

* Move patch to a separate function

* Try to use set-host option

* Use the same docker client in get_health

* Use .api

* Rewrite check_listening.py to use one function for both ipv4 and ipv6

* Add links to explain why we need to set up docker manually
2025-03-20 17:12:22 +00:00
Ayaz Salikhov
951dec9330 Refactor healthcheck tests to use one function (#2254) 2025-03-20 15:53:06 +00:00
Ayaz Salikhov
0510a43920 Refactor container.exec_run usages 2025-03-10 00:49:28 +00:00
Ayaz Salikhov
8f03304445 Add pre-commit hooks to check shebangs (#2247) 2025-03-03 17:30:57 +00:00
Ayaz Salikhov
cf453282a0 Use {} instead of dict() 2025-03-03 16:22:42 +00:00
Ayaz Salikhov
17442ed877 Fix typo 2025-03-03 16:22:03 +00:00
Ayaz Salikhov
8c22cc2892 Add by_image subdir for tests where needed 2025-02-26 17:43:09 +00:00
Ayaz Salikhov
5a556f5c8a Shorten test paths: rename image_specific_tests => by_image 2025-02-24 01:18:33 +00:00
Ayaz Salikhov
24fe890c21 Move get_test_dirs to a separate file 2025-02-23 20:57:41 +00:00
Ayaz Salikhov
4ee4f2b906 Remove explicit utf-8 from decode() as it's default (#2237) 2025-02-22 14:15:53 +00:00
Ayaz Salikhov
8fc97cb36b Add tagging config to pass params easier (#2234)
* Add tagging config to pass params easier

* Shorter function signatures
2025-02-22 01:05:54 +00:00
Ayaz Salikhov
18e09a7872 Clarify container.remove() behaviour (#2235) 2025-02-22 00:46:48 +00:00
Ayaz Salikhov
73628de2cd Fail if test dir doesn't exist (#2233) 2025-02-21 18:58:30 +00:00
Ayaz Salikhov
ba19c03837 Better logs for unit tests when dir doesn't exist 2025-02-21 17:59:07 +00:00
Ayaz Salikhov
2a6c640eb9 Put run-hooks test files in one data/run-hooks/ subdir 2025-02-21 17:52:32 +00:00
Ayaz Salikhov
165bbc1e71 Better tests directory structure (#2231) 2025-02-21 17:46:43 +00:00
Ayaz Salikhov
80b71625f0 Use Python 3.12 for internal code (#2222)
* Use Python 3.12 for internal code

* Add changelog entry
2025-02-18 15:26:06 +00:00
Ayaz Salikhov
e57047801c Improve handling common parser arguments (#2221) 2025-02-18 11:06:10 +00:00
Ayaz Salikhov
c5961fcc72 Revert "Pin some packages to fix r-notebook and datascience-notebook under aarch64 (#2215)" (#2220)
This reverts commit f3a92fadb7.
2025-02-18 00:42:41 +00:00
Ayaz Salikhov
66260f8d6f Simplify and improve test_packages.py (#2219) 2025-02-18 00:21:32 +00:00