hadoop2.4.1用eclipse远程开发WordCount时候出现nullpointer

[wjj_cadn]

17:38:59,699 DEBUG org.apache.hadoop.ipc.ProtobufRpcEngine:221 - Call: delete took 16ms
17:38:59,699 WARN org.apache.hadoop.mapred.LocalJobRunner:560 - job_local20017_0001
java.lang.Exception: java.lang.NullPointerException
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.lang.NullPointerException
at java.lang.ProcessBuilder.start(Unknown Source)
at org.apache.hadoop.util.Shell.runCommand(Shell.java:445)
at org.apache.hadoop.util.Shell.run(Shell.java:418)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
at org.apache.hadoop.yarn.util.WindowsBasedProcessTree.isAvailable(WindowsBasedProcessTree.java:57)
at org.apache.hadoop.yarn.util.ResourceCalculatorProcessTree.getResourceCalculatorProcessTree(ResourceCalculatorProcessTree.java:153)
at org.apache.hadoop.mapred.Task.initialize(Task.java:579)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
17:38:59,714 DEBUG org.apache.hadoop.security.UserGroupInformation:1580 - PrivilegedAction as:root (auth:SIMPLE) from:org.apache.hadoop.fs.FileContext.getAbstractFileSystem(FileContext.java:330)
17:39:00,582 DEBUG org.apache.hadoop.security.UserGroupInformation:1580 - PrivilegedAction as:root (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:311)
17:39:00,582 INFO org.apache.hadoop.mapreduce.Job:1355 - Job job_local20017_0001 running in uber mode : false
17:39:00,582 INFO org.apache.hadoop.mapreduce.Job:1362 - map 0% reduce 0%
17:39:00,582 DEBUG org.apache.hadoop.security.UserGroupInformation:1580 - PrivilegedAction as:root (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:665)
17:39:00,582 DEBUG org.apache.hadoop.security.UserGroupInformation:1580 - PrivilegedAction as:root (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:311)
17:39:00,582 DEBUG org.apache.hadoop.security.UserGroupInformation:1580 - PrivilegedAction as:root (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:311)
17:39:00,582 DEBUG org.apache.hadoop.security.UserGroupInformation:1580 - PrivilegedAction as:root (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:665)
17:39:00,582 DEBUG org.apache.hadoop.security.UserGroupInformation:1580 - PrivilegedAction as:root (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:311)
17:39:00,582 DEBUG org.apache.hadoop.security.UserGroupInformation:1580 - PrivilegedAction as:root (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:311)
17:39:00,582 INFO org.apache.hadoop.mapreduce.Job:1375 - Job job_local20017_0001 failed with state FAILED due to: NA
17:39:00,582 DEBUG org.apache.hadoop.security.UserGroupInformation:1580 - PrivilegedAction as:root (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Job.getCounters(Job.java:753)
17:39:00,600 INFO org.apache.hadoop.mapreduce.Job:1380 - Counters: 0
17:39:00,600 DEBUG org.apache.hadoop.security.UserGroupInformation:1580 - PrivilegedAction as:root (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:311)
17:39:00,605 DEBUG org.apache.hadoop.ipc.Client:97 - stopping client from cache: org.apache.hadoop.ipc.Client@1f5b5fd
17:39:00,606 DEBUG org.apache.hadoop.ipc.Client:103 - removing client from cache: org.apache.hadoop.ipc.Client@1f5b5fd
17:39:00,606 DEBUG org.apache.hadoop.ipc.Client:110 - stopping actual client because no more references remain: org.apache.hadoop.ipc.Client@1f5b5fd
17:39:00,606 DEBUG org.apache.hadoop.ipc.Client:1217 - Stopping client
17:39:00,606 DEBUG org.apache.hadoop.ipc.Client:1167 - IPC Client (4999735) connection to xiaoxiong1/192.168.8.1:9000 from root: closed
17:39:00,607 DEBUG org.apache.hadoop.ipc.Client:962 - IPC Client (4999735) connection to xiaoxiong1/192.168.8.1:9000 from root: stopped, remaining connections 0

求解啊，运行之后，out 目录出现，但是没有任何东西， 在linux 下的时候能运行wordcount，hadoop.dll，winutils.exe 都已经加到我当前的win7机子上了，求解啊，是map的问题？

[skyWalker_ONLY]

楼主可以参考帖子http://bbs.csdn.net/topics/390892647，当时有人也出现你这种情况过，不过最后也没解决

[少主无翼]

java.lang.Exception: java.lang.NullPointerException at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522) 注意你的Job是LocalJobRunner，所以是在本地运行的，至于你这个本地是win7还是linux，总之不是在hadoop集群环境下运行。 遇到这种问题，其实根据错误信息定位到具体的代码然后查看到底是哪个对象引起的NullPointException，然后找具体原因会轻松很多。这里你定位到org.apache.hadoop.mapred.LocalJobRunner类的462行，查看$Job.runTasks()方法就可以了。

[wjj_cadn]

引用 2 楼 sky_walker85 的回复:

楼主可以参考帖子http://bbs.csdn.net/topics/390892647，当时有人也出现你这种情况过，不过最后也没解决

我发现了一点， wordcount 运行时候会产生一个tmp文件夹， 内部怎么产生的这个文件夹不知道，但想想应该是做shuffer的时候产生的，现在wordcount是跑在集群上的，但是这个tmp文件夹eclipse让它放在了本地win7上，这样就导致出现了null pointer，因为用的是 run hadoop。但是当我用 run java application的时候，妈蛋的，需要配置 advance parameter， 但是那么多的参数， 当初开发这个插件的人一定是一个死宅吧，所以我配置不了advanced parameter，所以现在这个问题还是一个问题，所以不想在浪费时间了，直接编出程序来 打包成jar 扔到集群里面看了， 麻烦死了，好多没必要的错误，都是因为 win7 连接 集群搞出的，浪费时间不说，而且浪费感情啊。http://www.aboutyun.com/thread-6950-1-1.html 这里面是eclipse开发的两种方式，全都费劲了 ，麻烦死了分布式

[人生偌只如初见]

一直都是打成Jar包运行，Eclipse经常出问题

[wjj_cadn]

引用 5 楼 hqshaozhu 的回复:

java.lang.Exception: java.lang.NullPointerException at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522) 注意你的Job是LocalJobRunner，所以是在本地运行的，至于你这个本地是win7还是linux，总之不是在hadoop集群环境下运行。 遇到这种问题，其实根据错误信息定位到具体的代码然后查看到底是哪个对象引起的NullPointException，然后找具体原因会轻松很多。这里你定位到org.apache.hadoop.mapred.LocalJobRunner类的462行，查看$Job.runTasks()方法就可以了。

原来为了偷懒，省去了下载源码，诶，逃不过啊，我下个看看