关于mapreduce执行作业时，一直停留在running job

[frederick1207]

mapreduce 执行时一直处在running job 一栏
自己感觉是resourcemanager的问题，访问出问题了，因为nodemanager是启动了的

INFO mapreduce.Job: Running job: job_1440140752819_0001

日志文件为：
STARTUP_MSG: Starting NodeManager
STARTUP_MSG: host = itcast02/192.168.8.138
STARTUP_MSG: args = []
STARTUP_MSG: version = 2.2.0
STARTUP_MSG: classpath = /itcast/hadoop-2.2.0/etc/hadoop:/itcast/hadoop-2.2.0/etc/hadoop:/itcast/hadoop-2.2.0/etc/hadoop:
STARTUP_MSG: build = Unknown -r Unknown; compiled by 'root' on 2014-06-25T14:34Z
STARTUP_MSG: java = 1.7.0_75
************************************************************/
2015-08-21 14:34:16,216 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: registered UNIX signal handlers for [TERM, HUP, INT]
2015-08-21 14:34:17,297 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-08-21 14:34:17,297 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-08-21 14:34:17,298 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-08-21 14:34:17,298 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-08-21 14:34:17,298 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-08-21 14:34:17,299 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-08-21 14:34:17,316 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-08-21 14:34:17,317 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.NodeManager

frederick丶kooky~! 2015/8/21 14:58:08
2015-08-21 14:34:17,360 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2015-08-21 14:34:17,412 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2015-08-21 14:34:17,412 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system started
2015-08-21 14:34:17,424 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-08-21 14:34:17,425 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: per directory file limit = 8192
2015-08-21 14:34:17,441 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: usercache path : file:/itcast/hadoop-2.2.0/tmp/nm-local-dir/usercache_DEL_1440130574099
2015-08-21 14:34:17,444 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: usercache path : file:/itcast/hadoop-2.2.0/tmp/nm-local-dir/usercache_DEL_1440138662662

另附配置文件
etc/hosts

127.0.0.1 localhost
192.168.8.88 itcast01 （主机）
192.168.8.138 itcast02 (slave)
192.168.8.139 itcast03 (slave)

core-site.xml
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://itcast01:9000</value>
</property>

<property>
<name>hadoop.tmp.dir</name>
<value>/itcast/hadoop-2.2.0/tmp</value>
</property>
</configuration>

hdfs-site.xml
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>

yarn-site.xml
<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.resoucemanager.hostname</name>
<value>itcast01</value>
</property>
</configuration>

mapred-site.xml
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>

slaves
itcast02
itcast03

vim /etc/sysconfig/network
NETWORKING=yes
HOSTNAME=itcast01

[frederick1207]

自己顶啊，召唤大神啊

[沧海_Sea]

代码放出来

[dk9761]

我是这么做的 在执行任务的时候每一步都 写个日志文件 查看执行情况

[sinat_26742267]

楼主最后怎么解决的？？？、求教啊

[ZhouYates]

可能是磁盘资源不够了，释放空间再试试。

[leotanyang]

应该是磁盘不够

[mySS_7]

基本上就是namenode没有顺利启动，yarn配置缺失或者空间分配过小的问题，我倾向是第三种... 当初我也是这个问0题加大内存就解决了。