hazza/docker-stacks
1
0
Fork 0
mirror of https://github.com/jupyter/docker-stacks.git synced 2025-10-15 14:02:58 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add info about pyspark recipe

Browse Source
This commit is contained in:
Ayaz Salikhov
2023-08-27 23:04:56 +04:00
parent 0d8b4e4987
commit c7ce00b9fd
1 changed files with 5 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
docs/using/specifics.md
View File

@@ -57,11 +57,15 @@ You can build a `pyspark-notebook` image with a different `Spark` version by ove
For example, here is how to build a `pyspark-notebook` image with Spark `3.2.0`, Hadoop `3.2` and OpenJDK `11`. For example, here is how to build a `pyspark-notebook` image with Spark `3.2.0`, Hadoop `3.2` and OpenJDK `11`.
```{warning}
This recipe is not tested and might be broken.
```
```bash ```bash
# From the root of the project # From the root of the project
# Build the image with different arguments # Build the image with different arguments
docker build --rm --force-rm \ docker build --rm --force-rm \
-t jupyter/pyspark-notebook:spark-3.2.0 ./pyspark-notebook \ -t jupyter/pyspark-notebook:spark-3.2.0 ./images/pyspark-notebook \
--build-arg spark_version=3.2.0 \ --build-arg spark_version=3.2.0 \
--build-arg hadoop_version=3.2 \ --build-arg hadoop_version=3.2 \
--build-arg spark_checksum=707DDE035926A50B75E53FCA72CADA519F3239B14A96546911CB4916A58DCF69A1D2BFDD2C7DD5899324DBD82B6EEAB9797A7B4ABF86736FFCA4C26D0E0BF0EE \ --build-arg spark_checksum=707DDE035926A50B75E53FCA72CADA519F3239B14A96546911CB4916A58DCF69A1D2BFDD2C7DD5899324DBD82B6EEAB9797A7B4ABF86736FFCA4C26D0E0BF0EE \