求助,Hadoop运行实例时,INFO mapreduce.Job: Running job: job_1458965576605_0001卡死

sinat_26742267 2016-03-25 10:32:32
2016-03-25 21:17:15,223 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_1458965576605_0001_01_000001, NodeId: Slave1:42568, NodeHttpAddress: Slave1:8042, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 192.168.247.3:42568 }, ] for AM appattempt_1458965576605_0001_000001
2016-03-25 21:17:15,223 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Command to launch container container_1458965576605_0001_01_000001 : $JAVA_HOME/bin/java -Djava.io.tmpdir=$PWD/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2016-03-25 21:17:15,261 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1458965576605_0001_000001
2016-03-25 21:17:15,292 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1458965576605_0001_000001
2016-03-25 21:17:17,111 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_1458965576605_0001_01_000001, NodeId: Slave1:42568, NodeHttpAddress: Slave1:8042, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 192.168.247.3:42568 }, ] for AM appattempt_1458965576605_0001_000001
2016-03-25 21:17:17,115 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1458965576605_0001_000001 State change from ALLOCATED to LAUNCHED
2016-03-25 21:17:17,957 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1458965576605_0001_01_000001 Container Transitioned from ACQUIRED to RUNNING
2016-03-25 21:22:56,403 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Release request cache is cleaned up
2016-03-25 21:29:38,249 INFO org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: Expired:appattempt_1458965576605_0001_000001 Timed out after 600 secs
2016-03-25 21:29:38,249 INFO org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: Expired:Slave2:53092 Timed out after 600 secs
2016-03-25 21:29:38,268 INFO org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: Expired:Slave1:42568 Timed out after 600 secs
2016-03-25 21:29:38,273 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1458965576605_0001_000001 with final state: FAILED, and exit status: -1000
2016-03-25 21:29:38,278 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1458965576605_0001_000001 State change from LAUNCHED to FINAL_SAVING
2016-03-25 21:29:38,284 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: Deactivating Node Slave2:53092 as it is now LOST
2016-03-25 21:29:38,286 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: Slave2:53092 Node Transitioned from RUNNING to LOST
2016-03-25 21:29:38,287 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: Deactivating Node Slave1:42568 as it is now LOST
2016-03-25 21:29:38,287 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: Slave1:42568 Node Transitioned from RUNNING to LOST
2016-03-25 21:29:38,287 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1458965576605_0001_000001
2016-03-25 21:29:38,289 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1458965576605_0001_000001
2016-03-25 21:29:38,290 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1458965576605_0001_000001 State change from FINAL_SAVING to FAILED
2016-03-25 21:29:38,291 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Removed node Slave2:53092 clusterResource: <memory:8192, vCores:8>
2016-03-25 21:29:38,299 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The number of failed attempts is 1. The max attempts is 2
2016-03-25 21:29:38,302 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1458965576605_0001_000002
2016-03-25 21:29:38,305 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1458965576605_0001_000002 State change from NEW to SUBMITTED
2016-03-25 21:29:38,305 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Cleaning master appattempt_1458965576605_0001_000001
2016-03-25 21:29:38,312 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1458965576605_0001_01_000001 Container Transitioned from RUNNING to KILLED
2016-03-25 21:29:38,312 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerApp: Completed container: container_1458965576605_0001_01_000001 in state: KILLED event:KILL
2016-03-25 21:29:38,312 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hadoop OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1458965576605_0001 CONTAINERID=container_1458965576605_0001_01_000001
2016-03-25 21:29:38,313 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Released container container_1458965576605_0001_01_000001 of capacity <memory:2048, vCores:1> on host Slave1:42568, which currently has 0 containers, <memory:0, vCores:0> used and <memory:8192, vCores:8> available, release resources=true
2016-03-25 21:29:38,313 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: default used=<memory:0, vCores:0> numContainers=0 user=hadoop user-resources=<memory:0, vCores:0>
2016-03-25 21:29:38,317 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: completedContainer container=Container: [ContainerId: container_1458965576605_0001_01_000001, NodeId: Slave1:42568, NodeHttpAddress: Slave1:8042, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 192.168.247.3:42568 }, ] queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=1, numContainers=0 cluster=<memory:0, vCores:0>
2016-03-25 21:29:38,317 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: completedContainer queue=root usedCapacity=0.0 absoluteUsedCapacity=0.0 used=<memory:0, vCores:0> cluster=<memory:0, vCores:0>
2016-03-25 21:29:38,317 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=1, numContainers=0
2016-03-25 21:29:38,318 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application attempt appattempt_1458965576605_0001_000001 released container container_1458965576605_0001_01_000001 on node: host: Slave1:42568 #containers=0 available=<memory:8192, vCores:8> used=<memory:0, vCores:0> with event: KILL
2016-03-25 21:29:38,318 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Removed node Slave1:42568 clusterResource: <memory:0, vCores:0>
2016-03-25 21:29:38,318 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1458965576605_0001_000001 is done. finalState=FAILED
2016-03-25 21:29:38,319 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1458965576605_0001 requests cleared
2016-03-25 21:29:38,319 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1458965576605_0001 user: hadoop queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0
2016-03-25 21:29:38,319 WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start
2016-03-25 21:29:38,319 WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start
2016-03-25 21:29:38,319 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1458965576605_0001 from user: hadoop activated in queue: default
2016-03-25 21:29:38,323 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1458965576605_0001 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@acb53c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2016-03-25 21:29:38,323 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1458965576605_0001_000002 to scheduler from user hadoop in queue default
2016-03-25 21:29:38,324 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1458965576605_0001_000002 State change from SUBMITTED to SCHEDULED
...全文
3028 4 打赏 收藏 转发到动态 举报
写回复
用AI写文章
4 条回复
切换为时间正序
请发表友善的回复…
发表回复
qq_29244317 2017-08-16
  • 打赏
  • 举报
回复
没有人解决吗?
sinat_26742267 2016-03-25
  • 打赏
  • 举报
回复
求助大神啊。
sinat_26742267 2016-03-25
  • 打赏
  • 举报
回复
上面是yarn启动日志

915

社区成员

发帖
与我相关
我的任务
社区描述
华为云计算论坛,提供全面深入的云计算前景分析、丰富的技术干货、程序样例,分享华为云前沿资讯动态,方便开发者快速成长与发展,欢迎提问、互动,多方位了解云计算!
社区管理员
  • 华为云计算社区
  • 海洋 之心
加入社区
  • 近7日
  • 近30日
  • 至今
社区公告
暂无公告

试试用AI创作助手写篇文章吧