hazza/docker-stacks
1
0
Fork 0
mirror of https://github.com/jupyter/docker-stacks.git synced 2025-10-17 15:02:57 +00:00
Code Issues Packages Projects Releases Wiki Activity

More clear docs on building pyspark-notebook with different spark version

Browse Source
This commit is contained in:
Ayaz Salikhov
2023-07-11 14:16:10 +04:00
parent 67029f17f0
commit a7781fb90a
1 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
docs/using/specifics.md
View File

@@ -39,7 +39,8 @@ ipython profile create
### Build an Image with a Different Version of Spark
You can build a `pyspark-notebook` image (and also the downstream `all-spark-notebook` image) with a different version of Spark by overriding the default value of the following arguments at build time.
You can build a `pyspark-notebook` image with a different version of Spark by overriding the default value of the following arguments at build time.
If you want to build `all-spark-notebook` with a different version, you have to build `pyspark-notebook` first with the version you want and then build `all-spark-notebook` (which is inherited from `pyspark-notebook`).
- Spark distribution is defined by the combination of Spark, Hadoop and Scala versions and verified by the package checksum,
see [Download Apache Spark](https://spark.apache.org/downloads.html) and the [archive repo](https://archive.apache.org/dist/spark/) for more information.