Hadoop2.7.3运行wordcount只有map 0% reduce 0%然后报错 Hadoop初学者

royroy_l 2017-11-29 09:08:16
Hadoop2.7.3运行wordcount只有map 0% reduce 0%然后报错
17/11/29 21:01:04 WARN conf.Configuration: bad conf file: element not <property>
17/11/29 21:01:04 WARN conf.Configuration: bad conf file: element not <property>
17/11/29 21:01:04 WARN conf.Configuration: bad conf file: element not <property>
17/11/29 21:01:04 WARN conf.Configuration: bad conf file: element not <property>
17/11/29 21:01:04 WARN conf.Configuration: bad conf file: element not <property>
17/11/29 21:01:04 WARN conf.Configuration: bad conf file: element not <property>
17/11/29 21:01:04 WARN conf.Configuration: bad conf file: element not <property>
17/11/29 21:01:04 WARN conf.Configuration: bad conf file: element not <property>
17/11/29 21:01:05 WARN conf.Configuration: bad conf file: element not <property>
17/11/29 21:01:05 WARN conf.Configuration: bad conf file: element not <property>
17/11/29 21:01:05 INFO client.RMProxy: Connecting to ResourceManager at hadoop021/192.168.1.175:8032
17/11/29 21:01:06 WARN conf.Configuration: bad conf file: element not <property>
17/11/29 21:01:06 WARN conf.Configuration: bad conf file: element not <property>
17/11/29 21:01:06 WARN conf.Configuration: bad conf file: element not <property>
17/11/29 21:01:06 WARN conf.Configuration: bad conf file: element not <property>
17/11/29 21:01:06 WARN conf.Configuration: bad conf file: element not <property>
17/11/29 21:01:06 WARN conf.Configuration: bad conf file: element not <property>
17/11/29 21:01:07 INFO input.FileInputFormat: Total input paths to process : 1
17/11/29 21:01:07 INFO mapreduce.JobSubmitter: number of splits:1
17/11/29 21:01:07 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1511829915922_0054
17/11/29 21:01:07 INFO impl.YarnClientImpl: Submitted application application_1511829915922_0054
17/11/29 21:01:07 INFO mapreduce.Job: The url to track the job: http://hadoop021:8088/proxy/application_1511829915922_0054/
17/11/29 21:01:07 INFO mapreduce.Job: Running job: job_1511829915922_0054
17/11/29 21:01:33 INFO mapreduce.Job: Job job_1511829915922_0054 running in uber mode : false
17/11/29 21:01:33 INFO mapreduce.Job: map 0% reduce 0%
17/11/29 21:01:33 INFO mapreduce.Job: Job job_1511829915922_0054 failed with state FAILED due to: Application application_1511829915922_0054 failed 2 times due to AM Container for appattempt_1511829915922_0054_000002 exited with exitCode: -1
For more detailed output, check application tracking page:http://hadoop021:8088/cluster/app/application_1511829915922_0054Then, click on links to logs of each attempt.
Diagnostics: File /home/hadoop021/hadoop_tmp/nm-local-dir/usercache/root/appcache/application_1511829915922_0054/container_1511829915922_0054_02_000001 does not exist
Failing this attempt. Failing the application.
17/11/29 21:01:33 INFO mapreduce.Job: Counters: 0
这句报错:
Diagnostics: File /home/hadoop021/hadoop_tmp/nm-local-dir/usercache/root/appcache/application_1511829915922_0054/container_1511829915922_0054_02_000001 does not exist
是不是core-site.xml的问题?之前有在core-site.xml里设置过一个hadoop_tmp的临时文件,后来再core-site.xml配置里删掉了为什么报错还有hadoop_tmp这个东西?
...全文
251 2 打赏 收藏 转发到动态 举报
写回复
用AI写文章
2 条回复
切换为时间正序
请发表友善的回复…
发表回复
曹宇飞丶 2017-12-01
  • 打赏
  • 举报
回复
For more detailed output, check application tracking page:http://hadoop021:8088/cluster/app/application_1511829915922_0054Then, click on links to logs of each attempt. 应该去这里看日志,container_1511829915922_0054_02_000001 does not exist是因为 Application application_1511829915922_0054 failed 2 times due to AM Container for appattempt_1511829915922_0054_000002 exited with exitCode: -1
weixin_41220355 2017-11-30
  • 打赏
  • 举报
回复
我的情况是就停留在map 0% reduce 0% 一直不动

20,808

社区成员

发帖
与我相关
我的任务
社区描述
Hadoop生态大数据交流社区,致力于有Hadoop,hive,Spark,Hbase,Flink,ClickHouse,Kafka,数据仓库,大数据集群运维技术分享和交流等。致力于收集优质的博客
社区管理员
  • 分布式计算/Hadoop社区
  • 涤生大数据
加入社区
  • 近7日
  • 近30日
  • 至今
社区公告
暂无公告

试试用AI创作助手写篇文章吧