spark安装

./sbin/start-all.sh

http://localhost:8080/

./bin/spark-submit  --class org.apache.spark.examples.SparkPi --master local --num-executors 3 examples/jars/spark-examples_2.12-3.4.1.jar 10

./bin/spark-submit  --class org.apache.spark.examples.SparkPi --master yarn --num-executors 3 examples/jars/spark-examples_2.12-3.4.1.jar 10

Yarn UI: http://localhost:8088/cluster

注意参数--master

  --master MASTER_URL         spark://host:port, mesos://host:port, yarn,
                              k8s://https://host:port, or local (Default: local[*]).