/usr/local/spark/sbin/start-all.sh

By | 2019年5月16日

data2: failed to launch: nice -n 0 /usr/local/spark/bin/spark-class org.apache.spark.deploy.worker.Worker --webui-port 8081 spark://master:7077
hduser@master:/usr/local/spark/logs$ ls
spark-hduser-org.apache.spark.deploy.master.Master-1-master.out
spark-hduser-org.apache.spark.deploy.master.Master-1-master.out.1
spark-hduser-org.apache.spark.deploy.master.Master-1-master.out.2
spark-hduser-org.apache.spark.deploy.master.Master-1-master.out.3
spark-hduser-org.apache.spark.deploy.master.Master-1-master.out.4
spark-hduser-org.apache.spark.deploy.master.Master-1-master.out.5
hduser@master:/usr/local/spark/logs$ vim spark-hduser-org.apache.spark.deploy.master.Master-1-master.out
hduser@master:/usr/local/spark/logs$ cat spark-hduser-org.apache.spark.deploy.master.Master-1-master.out
Spark Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -cp /usr/local/spark/conf/:/usr/local/spark/jars/*:/usr/local/hadoop/etc/hadoop/ -Xmx1g org.apache.spark.deploy.master.Master --host master --port 7077 --webui-port 8080
========================================
18/06/26 09:09:31 WARN MasterArguments: SPARK_MASTER_IP is deprecated, please use SPARK_MASTER_HOST
18/06/26 09:09:44 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
hduser@master:/usr/local/spark/logs$ 
18/06/26 09:38:39 WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

发表评论