启动spark异常:failed to launch: nice -n 0 /usr/local/spark/bin/spark-class org.apache.spark.deploy.work

By | 2019年5月16日

第一次启动spark出现异常:failed to launch: nice -n 0 /usr/local/spark/bin/spark-class

日志:

starting org.apache.spark.deploy.master.Master, logging to
/usr/local/spark/logs/spark-master-org.apache.spark.deploy.master.Master-1-master.out
slave1: starting org.apache.spark.deploy.worker.Worker, logging to
/usr/local/spark/logs/spark-master-org.apache.spark.deploy.worker.Worker-1-slave1.out
slave2: starting org.apache.spark.deploy.worker.Worker, logging to
/usr/local/spark/logs/spark-master-org.apache.spark.deploy.worker.Worker-1-slave2.out
slave2: failed to launch: nice -n 0 /usr/local/spark/bin/spark-class
org.apache.spark.deploy.worker.Worker –webui-port 8081
spark://master:7077 slave2: full log in
/usr/local/spark/logs/spark-master-org.apache.spark.deploy.worker.Worker-1-slave2.out
slave1: failed to launch: nice -n 0 /usr/local/spark/bin/spark-class
org.apache.spark.deploy.worker.Worker –webui-port 8081
spark://master:7077 slave1: full log in
/usr/local/spark/logs/spark-master-org.apache.spark.deploy.worker.Worker-1-slave1.out

搜索了一下查找资料:
https://www.ibm.com/support/knowledgecenter/en/SSCTFE_1.1.0/com.ibm.azk.v1r1.azka100/topics/azkic_u_troubleshooting-spark.htm

An error occurs when starting the master, but the master starts correctly
Symptom

When starting the master, the following error occurs: bash-4.2$
$SPARK_HOME/sbin/start-master.sh starting
org.apache.spark.deploy.master.Master, logging to
/u/user/Billy/logs/spark–org.apache.spark.deploy.master.Master-1-ALPS.out
failed to launch org.apache.spark.deploy.master.Master: full log in
/u/user/Billy/logs/spark–org.apache.spark.deploy.master.Master-1-ALPS.out

Cause

Apache Spark polls for a number of seconds to repeatedly check to see
if the master started successfully. If your system is under heavy
load, this message might appear, but it generally means that the check
finished polling for success before the master startup completed.

Apache Spark轮询几秒钟,以反复检查主服务器是否成功启动。 如果您的系统负载很重,可能会显示此消息,但这通常意味着检查在主启动完成之前完成了轮询以确保成功。

Response

Check the master log, or issue the ps command and look for the master
process to definitively see whether or not the master started
successfully.

检查主日志,或发出ps命令并查找主进程以明确查看主服务器是否已成功启动。

发表评论