Spark-submit测试任务提交

Spark-submit 测试任务提交

专业成都网站建设公司,做排名好的好网站,排在同行前面,为您带来客户和效益!成都创新互联公司为您提供成都网站建设,五站合一网站设计制作,服务好的网站设计公司,成都网站制作、做网站负责任的成都网站制作公司!

./spark-submit --keytab /usr/local/noah/basp-dataprocess-log/conf/noah.keytabs --principal noah@BJ.CTC --class org.apache.spark.examples.SparkPi --master local[*] ../lib/spark-examples-1.6.3.2.6.0.3-8-hadoop2.7.3.2.6.0.3-8.jar 100
./spark-submit --class org.apache.spark.examples.SparkPi --master local[*] /app/hdp/2.6.0.3-8/spark2/examples/jars/spark-examples_2.11-2.1.0.2.6.0.3-8.jar
 100
 /usr/hdp/2.6.0.3-8/spark2/bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn --deploy-mode cluster /app/hdp/2.6.0.3-8/spark2/examples/jars/spark-examples_2.11-2.1.0.2.6.0.3-8.jar 100
./spark-submit --class org.apache.spark.examples.SparkPi --master yarn-client /app/hdp/2.6.0.3-8/spark2/examples/jars/spark-examples_2.11-2.1.0.2.6.0.3-8.jar 100

本文标题:Spark-submit测试任务提交
分享地址:http://scyanting.com/article/ggiheo.html