spark 启动worker时出错,求解答

FastBee 2016-04-13 04:33:36
lin@lin-Wenxiang-E520:/opt/data01/spark-1.3.0-bin-2.6.0-cdh5.4.0$ sbin/start-slave.sh
starting org.apache.spark.deploy.worker.Worker, logging to /opt/data01/spark-1.3.0-bin-2.6.0-cdh5.4.0/sbin/../logs/spark-lin-org.apache.spark.deploy.worker.Worker--lin-Wenxiang-E520.out
failed to launch org.apache.spark.deploy.worker.Worker:
--properties-file FILE Path to a custom Spark properties file.
Default is conf/spark-defaults.conf.
full log in /opt/data01/spark-1.3.0-bin-2.6.0-cdh5.4.0/sbin/../logs/spark-lin-org.apache.spark.deploy.worker.Worker--lin-Wenxiang-E520.out

log日志里面的内容为:
16/04/13 16:40:17 INFO worker.Worker: Registered signal handlers for [TERM, HUP, INT]
16/04/13 16:40:17 WARN util.Utils: Your hostname, lin-Wenxiang-E520 resolves to a loopback address: 127.0.1.1; using 10.170.33.22 instead (on interface eth0)
16/04/13 16:40:17 WARN util.Utils: Set SPARK_LOCAL_IP if you need to bind to another address
Usage: Worker [options] <master>

Master must be a URL of the form spark://hostname:port

Options:
-c CORES, --cores CORES Number of cores to use
-m MEM, --memory MEM Amount of memory to use (e.g. 1000M, 2G)
-d DIR, --work-dir DIR Directory to run apps in (default: SPARK_HOME/work)
-i HOST, --ip IP Hostname to listen on (deprecated, please use --host or -h)
-h HOST, --host HOST Hostname to listen on
-p PORT, --port PORT Port to listen on (default: random)
--webui-port PORT Port for web UI (default: 8081)
--properties-file FILE Path to a custom Spark properties file.
Default is conf/spark-defaults.conf.
...全文
1459 1 打赏 收藏 转发到动态 举报
写回复
用AI写文章
1 条回复
切换为时间正序
请发表友善的回复…
发表回复
晚秋_梦依在 2016-04-15
  • 打赏
  • 举报
回复
好像没有启动Worker一说,一般情况下,执行sbin/start-all.sh,Master节点自动加载Maste进程,Worker节点自动加载Worker进程

1,261

社区成员

发帖
与我相关
我的任务
社区描述
Spark由Scala写成,是UC Berkeley AMP lab所开源的类Hadoop MapReduce的通用的并行计算框架,Spark基于MapReduce算法实现的分布式计算。
社区管理员
  • Spark
  • shiter
加入社区
  • 近7日
  • 近30日
  • 至今
社区公告
暂无公告

试试用AI创作助手写篇文章吧