Can't fetch history log; missing job ID Can't fetch task logs; missing applicati

wqq奋斗的小鸟 2018-06-04 10:06:59

python /home/hduser/Workspace/Ch5_Py_mrjob_PegasosSVM/mrSVM.py -r hadoop < Workspace/Ch5_Py_mrjob_PegasosSVM/kickStart.txt


之前顺利执行过一次,也尝试过格式话namenode;重新删除建立data文件夹,问题仍然存在:
报错:
No handlers could be found for logger “mrjob.launch”
No configs found; falling back on auto-configuration
No configs specified for hadoop runner
Looking for hadoop binary in /usr/local/hadoop/bin…
Found hadoop binary: /usr/local/hadoop/bin/hadoop
Using Hadoop version 2.7.5
Looking for Hadoop streaming jar in /usr/local/hadoop…
Found Hadoop streaming jar: /usr/local/hadoop/share/hadoop/tools/lib/hadoop-streaming-2.7.5.jar
Creating temp directory /tmp/mrSVM.hduser.20180604.015226.736070
reading from STDIN
Copying local files to hdfs:///user/hduser/tmp/mrjob/mrSVM.hduser.20180604.015226.736070/files/…
Running step 1 of 2…
session.id is deprecated. Instead, use dfs.metrics.session-id
Initializing JVM Metrics with processName=JobTracker, sessionId=
Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
Cleaning up the staging area file:/usr/local/hadoop/hadoop_data/mapred/staging/hduser854512016/.staging/job_local854512016_0001
Error launching job , bad input path : File does not exist: /usr/local/hadoop/hadoop_data/mapred/staging/hduser854512016/.staging/job_local854512016_0001/files/mrSVM.py#mrSVM.py
Streaming Command Failed!
Attempting to fetch counters from logs…
Can’t fetch history log; missing job ID
No counters found
Scanning logs for probable cause of failure…
Can’t fetch history log; missing job ID
Can’t fetch task logs; missing application ID
Step 1 of 2 failed: Command ‘[‘/usr/local/hadoop/bin/hadoop’, ‘jar’, ‘/usr/local/hadoop/share/hadoop/tools/lib/hadoop-streaming-2.7.5.jar’, ‘-files’, ‘hdfs:///user/hduser/tmp/mrjob/mrSVM.hduser.20180604.015226.736070/files/mrSVM.py#mrSVM.py,hdfs:///user/hduser/tmp/mrjob/mrSVM.hduser.20180604.015226.736070/files/mrjob.zip#mrjob.zip,hdfs:///user/hduser/tmp/mrjob/mrSVM.hduser.20180604.015226.736070/files/setup-wrapper.sh#setup-wrapper.sh’, ‘-input’, ‘hdfs:///user/hduser/tmp/mrjob/mrSVM.hduser.20180604.015226.736070/files/STDIN’, ‘-output’, ‘hdfs:///user/hduser/tmp/mrjob/mrSVM.hduser.20180604.015226.736070/step-output/0000’, ‘-mapper’, ‘sh -ex setup-wrapper.sh python mrSVM.py –step-num=0 –mapper’, ‘-reducer’, ‘sh -ex setup-wrapper.sh python mrSVM.py –step-num=0 –reducer’]’ returned non-zero exit status 512
各位大神,求指教~
...全文
642 1 打赏 收藏 转发到动态 举报
写回复
用AI写文章
1 条回复
切换为时间正序
请发表友善的回复…
发表回复
G_L_QQ 2018-06-05
  • 打赏
  • 举报
回复
参考一下github上这个回答,https://github.com/Yelp/mrjob/issues/940

20,808

社区成员

发帖
与我相关
我的任务
社区描述
Hadoop生态大数据交流社区,致力于有Hadoop,hive,Spark,Hbase,Flink,ClickHouse,Kafka,数据仓库,大数据集群运维技术分享和交流等。致力于收集优质的博客
社区管理员
  • 分布式计算/Hadoop社区
  • 涤生大数据
加入社区
  • 近7日
  • 近30日
  • 至今
社区公告
暂无公告

试试用AI创作助手写篇文章吧