9 Commits

Author SHA1 Message Date
Ayaz Salikhov
f9a75e58c5 Install Spark 4 release version (#2300) 2025-05-30 09:11:31 +01:00
Ayaz Salikhov
388066466d Only consider r'^spark-\d' as possible spark version 2025-05-12 09:14:29 +01:00
Ayaz Salikhov
1473c9bbda Force using keyword-only arguments where types are the same (#2277)
* Force using keyword-only arguments where types are the same

* Fix
2025-04-03 21:27:24 +01:00
Ayaz Salikhov
03e5fe572d Fix docs: we're not installing stable version of spark anymore (#2165) 2024-10-29 10:11:31 +00:00
Ayaz Salikhov
b744182207 Start using spark4-preview versions (#2159)
* Start using spark4-preview versions

* Allow to download preview versions

* Expect warnings in spark

* Disable local_sparklyr test for now
2024-10-22 11:47:45 +01:00
Ayaz Salikhov
c4cb04ec37 Make Spark scripts more robust: support preview versions and Spark 4 output 2024-10-19 19:08:04 +01:00
Ayaz Salikhov
afe30f0c9a Use argparse to setup spark (#2082) 2024-01-17 15:07:15 +04:00
Ayaz Salikhov
e84bfdf4ae Add logger to setup_julia and setup_spark 2024-01-07 15:55:41 +04:00
Ayaz Salikhov
c294e9e2d9 Automatically install latest spark version (#2075)
* Automatically install latest pyspark version

* Better text

* Do not use shutil to keep behaviour

* Make setup_script cwd independent

* Use _get_program_version to calculate spark version

* Update setup_spark.py reqs

* Update setup_spark.py

* Add info about HADOOP_VERSION

* Add customization back

* Better text

* Specify build args when they are actually needed

* Better text

* Better code

* Better code

* Better text

* Get rid of warning

* Improve code

* Remove information about checksum

* Better text
2024-01-07 10:01:23 +04:00