Skip to content
GitLab
Menu
Projects
Groups
Snippets
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
zoe-apps
zapp-spark
Commits
26dabd03
Commit
26dabd03
authored
Feb 09, 2019
by
Daniele Venzano
🏇
Browse files
Update README.md
parent
32404f56
Pipeline
#11598
passed with stages
in 1 minute and 13 seconds
Changes
1
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
README.md
View file @
26dabd03
...
...
@@ -33,7 +33,7 @@ To run your own script (for example to install additional libraries on the worke
To start the worker correctly, you will need to use this command-line at the end of your script:
/opt/spark/bin/spark-class org.apache.spark.deploy.worker.Worker \
spark://${SPARK_MASTER
_IP
}:7077 --cores ${SPARK_WORKER_CORES} --memory ${SPARK_WORKER_RAM} \
spark://${SPARK_MASTER}:7077 --cores ${SPARK_WORKER_CORES} --memory ${SPARK_WORKER_RAM} \
-h ${SPARK_LOCAL_IP:-127.0.0.1}
### Master
...
...
@@ -42,7 +42,7 @@ To run your own script you can override the default command specified in the JSO
To start the master correctly, you will need to use this command-line at the end of your script:
${SPARK_HOME}/bin/spark-class org.apache.spark.deploy.master.Master --host ${SPARK_MASTER
_IP
} --port 7077 --webui-port 8080
${SPARK_HOME}/bin/spark-class org.apache.spark.deploy.master.Master --host ${SPARK_MASTER} --port 7077 --webui-port 8080
### Notebook and Spark submit
...
...
@@ -52,7 +52,7 @@ If you want to run the notebook, at the end of your script call `/opt/start_note
If you want to run spark-submit, you need to use:
/opt/spark/bin/spark-submit --master spark://${SPARK_MASTER
_IP
}:7077 <the rest of the options>
/opt/spark/bin/spark-submit --master spark://${SPARK_MASTER}:7077 <the rest of the options>
Where the rest of the options could be, for example:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment