hazza/docker-stacks
1
0
Fork 0
mirror of https://github.com/jupyter/docker-stacks.git synced 2025-10-14 05:22:56 +00:00
Code Issues Packages Projects Releases Wiki Activity

Start using spark4-preview versions (#2159)

Browse Source 
* Start using spark4-preview versions

* Allow to download preview versions

* Expect warnings in spark

* Disable local_sparklyr test for now
This commit is contained in:
Ayaz Salikhov
2024-10-22 11:47:45 +01:00
committed by GitHub
parent 2f1cf2a2ef
commit b744182207
6 changed files with 27 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
images/pyspark-notebook/setup_spark.py
View File

@@ -36,7 +36,7 @@ def get_latest_spark_version() -> str:
stable_versions = [
ref.removeprefix("spark-").removesuffix("/")
for ref in all_refs
if ref.startswith("spark-") and "incubating" not in ref and "preview" not in ref
if ref.startswith("spark-") and "incubating" not in ref
]
# Compare versions semantically