Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Contribute to GitLab
Sign in / Register
Toggle navigation
zapp-spark
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
1
Merge Requests
1
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
zoe-apps
zapp-spark
Commits
26dabd03
Commit
26dabd03
authored
Feb 09, 2019
by
Daniele Venzano
🏇
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Update README.md
parent
32404f56
Pipeline
#11598
passed with stages
in 1 minute and 13 seconds
Changes
1
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
README.md
README.md
+3
-3
No files found.
README.md
View file @
26dabd03
...
...
@@ -33,7 +33,7 @@ To run your own script (for example to install additional libraries on the worke
To start the worker correctly, you will need to use this command-line at the end of your script:
/opt/spark/bin/spark-class org.apache.spark.deploy.worker.Worker \
spark://${SPARK_MASTER
_IP
}:7077 --cores ${SPARK_WORKER_CORES} --memory ${SPARK_WORKER_RAM} \
spark://${SPARK_MASTER}:7077 --cores ${SPARK_WORKER_CORES} --memory ${SPARK_WORKER_RAM} \
-h ${SPARK_LOCAL_IP:-127.0.0.1}
### Master
...
...
@@ -42,7 +42,7 @@ To run your own script you can override the default command specified in the JSO
To start the master correctly, you will need to use this command-line at the end of your script:
${SPARK_HOME}/bin/spark-class org.apache.spark.deploy.master.Master --host ${SPARK_MASTER
_IP
} --port 7077 --webui-port 8080
${SPARK_HOME}/bin/spark-class org.apache.spark.deploy.master.Master --host ${SPARK_MASTER} --port 7077 --webui-port 8080
### Notebook and Spark submit
...
...
@@ -52,7 +52,7 @@ If you want to run the notebook, at the end of your script call `/opt/start_note
If you want to run spark-submit, you need to use:
/opt/spark/bin/spark-submit --master spark://${SPARK_MASTER
_IP
}:7077 <the rest of the options>
/opt/spark/bin/spark-submit --master spark://${SPARK_MASTER}:7077 <the rest of the options>
Where the rest of the options could be, for example:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment