4 Commits

Author	SHA1	Message	Date
Ayaz Salikhov	b744182207	Start using spark4-preview versions (#2159) ... * Start using spark4-preview versions * Allow to download preview versions * Expect warnings in spark * Disable local_sparklyr test for now	2024-10-22 11:47:45 +01:00
Bjørn Jørgensen	52a999a554	Upgrade Apache Spark to 3.5.0 (#1995) ... * 1. * add note for pandas version * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Update images/pyspark-notebook/Dockerfile Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com> --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>	2023-09-16 20:56:10 +04:00
Ayaz Salikhov	c44f6e9476	Remove extra line in some test files	2023-07-03 00:35:00 +04:00
Bjørn Jørgensen	df5d516e34	Pin pandas to version 1.5.3 to all spark images (#1925) ... * 1. * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * add note * typo * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * remove test * >=1.5.3 and <2.0.0 * update test * Update pyspark-notebook/Dockerfile Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Update pyspark-notebook/Dockerfile Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com> * move test to file * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * add pandas to EXCLUDED_PACKAGES * add 1.5.3,<2.0.0 and sort list * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * add ' * "pandas[version='>" * Rename test_pandas_version.py to unit_pandas_version.py --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Ayaz Salikhov <mathbunnyru@users.noreply.github.com>	2023-06-27 15:42:18 +04:00