YARN执行 mapreduce出错,不知道咋办了

wzwdev1980 2018-07-12 01:43:17
2018-07-12 11:52:35,961 INFO mapreduce.Job: Job job_1531367090244_0001 running in uber mode : false
2018-07-12 11:52:35,962 INFO mapreduce.Job: map 0% reduce 0%
2018-07-12 11:52:35,994 INFO mapreduce.Job: Job job_1531367090244_0001 failed with state FAILED due to: Application application_1531367090244_0001 failed 2 times due to AM Container for appattempt_1531367090244_0001_000002 exited with exitCode: 1
Failing this attempt.Diagnostics: [2018-07-12 11:52:34.865]Exception from container-launch.
Container id: container_e66_1531367090244_0001_02_000001
Exit code: 1

[2018-07-12 11:52:34.891]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.


[2018-07-12 11:52:34.892]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.


For more detailed output, check the application tracking page: http://hd6.wzw.com:8088/cluster/app/application_1531367090244_0001 Then click on links to logs of each attempt.
. Failing the application.
2018-07-12 11:52:36,020 INFO mapreduce.Job: Counters: 0
...全文
540 1 打赏 收藏 转发到动态 举报
写回复
用AI写文章
1 条回复
切换为时间正序
请发表友善的回复…
发表回复
wzwdev1980 2018-07-12
  • 打赏
  • 举报
回复
深入挖掘错误 :

Exception Details:
Location:
org/apache/hadoop/mapreduce/v2/proto/MRProtos$JobIdProto$Builder.setAppId(Lorg/apache/hadoop/yarn/proto/YarnProtos$ApplicationIdProto;)Lorg/apache/hadoop/mapreduce/v2/proto/MRProtos$JobIdProto$Builder; @36: invokevirtual
Reason:
Type 'org/apache/hadoop/yarn/proto/YarnProtos$ApplicationIdProto' (current frame, stack[1]) is not assignable to 'org/apache/hadoop/shaded/com/google/protobuf/GeneratedMessage'
Current Frame:
bci: @36
flags: { }
locals: { 'org/apache/hadoop/mapreduce/v2/proto/MRProtos$JobIdProto$Builder', 'org/apache/hadoop/yarn/proto/YarnProtos$ApplicationIdProto' }
stack: { 'org/apache/hadoop/shaded/com/google/protobuf/SingleFieldBuilder', 'org/apache/hadoop/yarn/proto/YarnProtos$ApplicationIdProto' }
Bytecode:
0x0000000: 2ab4 0073 c700 1b2b c700 0bbb 00f3 59b7
0x0000010: 00f4 bf2a 2bb5 005a 2ab6 00f7 a700 0c2a
0x0000020: b400 732b b600 fb57 2a59 b400 7904 80b5
0x0000030: 0079 2ab0
Stackmap Table:
same_frame(@19)
same_frame(@31)
same_frame(@40)


用的是hadoop3.0.0的版本,使用的是protobuf2.5.0版本

1,258

社区成员

发帖
与我相关
我的任务
社区描述
Spark由Scala写成,是UC Berkeley AMP lab所开源的类Hadoop MapReduce的通用的并行计算框架,Spark基于MapReduce算法实现的分布式计算。
社区管理员
  • Spark
  • shiter
加入社区
  • 近7日
  • 近30日
  • 至今
社区公告
暂无公告

试试用AI创作助手写篇文章吧