【求助】hadoop环境下执行自带MapReduce程序wordcount报错

[kejern_2018]

小白出入门，求教：
ubuntu上安装了最新的hadoop3.1.0，在执行自带的wordcount程序时报错如下：
-----------------------------------------------------------------------------------------------------------
[hadoop@netCodeServer /opt/modules/hadoop-3.1.0]$yarn jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.0.jar wordcount /wordcountdemo/input /wordcountdemo/output
2018-04-13 09:10:20,175 INFO client.RMProxy: Connecting to ResourceManager at /172.16.188.53:8032
2018-04-13 09:10:21,264 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/hadoop/.staging/job_1523500585886_0007
2018-04-13 09:10:22,239 INFO input.FileInputFormat: Total input files to process : 1
2018-04-13 09:10:22,346 WARN hdfs.DataStreamer: Caught exception
java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Thread.join(Thread.java:1252)
at java.lang.Thread.join(Thread.java:1326)
at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:986)
at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:640)
at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:810)
2018-04-13 09:10:22,356 INFO mapreduce.JobSubmitter: number of splits:1
2018-04-13 09:10:22,418 INFO Configuration.deprecation: yarn.resourcemanager.system-metrics-publisher.enabled is deprecated. Instead, use yarn.system-metrics-publisher.enabled
2018-04-13 09:10:22,607 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1523500585886_0007
2018-04-13 09:10:22,609 INFO mapreduce.JobSubmitter: Executing with tokens: []
2018-04-13 09:10:22,947 INFO conf.Configuration: resource-types.xml not found
2018-04-13 09:10:22,948 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2018-04-13 09:10:23,069 INFO impl.YarnClientImpl: Submitted application application_1523500585886_0007
2018-04-13 09:10:23,208 INFO mapreduce.Job: The url to track the job: http://172.16.188.53:8088/proxy/application_1523500585886_0007/
2018-04-13 09:10:23,212 INFO mapreduce.Job: Running job: job_1523500585886_0007
2018-04-13 09:10:30,386 INFO mapreduce.Job: Job job_1523500585886_0007 running in uber mode : false
2018-04-13 09:10:30,390 INFO mapreduce.Job: map 0% reduce 0%
2018-04-13 09:10:30,416 INFO mapreduce.Job: Job job_1523500585886_0007 failed with state FAILED due to: Application application_1523500585886_0007 failed 2 times due to AM Container for appattempt_1523500585886_0007_000002 exited with exitCode: 1
Failing this attempt.Diagnostics: [2018-04-13 09:10:27.568]Exception from container-launch.
Container id: container_1523500585886_0007_02_000001
Exit code: 1

[2018-04-13 09:10:27.571]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

Please check whether your etc/hadoop/mapred-site.xml contains the below configuration:
<property>
<name>yarn.app.mapreduce.am.env</name>
<value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>
<property>
<name>mapreduce.map.env</name>
<value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>
<property>
<name>mapreduce.reduce.env</name>
<value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>

[2018-04-13 09:10:27.571]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

Please check whether your etc/hadoop/mapred-site.xml contains the below configuration:
<property>
<name>yarn.app.mapreduce.am.env</name>
<value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>
<property>
<name>mapreduce.map.env</name>
<value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>
<property>
<name>mapreduce.reduce.env</name>
<value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>

For more detailed output, check the application tracking page: http://172.16.188.53:8088/cluster/app/application_1523500585886_0007 Then click on links to logs of each attempt.
. Failing the application.
2018-04-13 09:10:30,452 INFO mapreduce.Job: Counters: 0
------------------------------------------------------------------------------------------------------------------------
应该是classpath设置的不对,以下是hadoopclasspath的输出：

[hadoop@netCodeServer /opt/modules/hadoop-3.1.0]$hadoop classpath
/opt/modules/hadoop-3.1.0/etc/hadoop:/opt/modules/hadoop-3.1.0/share/hadoop/common/lib/*:/opt/modules/hadoop-3.1.0/share/hadoop/common/*:/opt/modules/hadoop-3.1.0/share/hadoop/hdfs:/opt/modules/hadoop-3.1.0/share/hadoop/hdfs/lib/*:/opt/modules/hadoop-3.1.0/share/hadoop/hdfs/*:/opt/modules/hadoop-3.1.0/share/hadoop/mapreduce/*:/opt/modules/hadoop-3.1.0/share/hadoop/yarn:/opt/modules/hadoop-3.1.0/share/hadoop/yarn/lib/*:/opt/modules/hadoop-3.1.0/share/hadoop/yarn/*

[zycxnanwang]

感觉是你的配置文件有问题。 hadoop启动成功吗？？ 可以看一下hadoop的启动日志