Nutch在Hadoop平台运行出错

F_Guardian 2015-01-06 11:08:32

Nutch版本1.9
Hadoop版本1.2.1
Nutch的local模式运行没有问题，Hadoop解压后PATH配置好后运行deploy下的脚本，运行到Fetcher部分报错如下：

15/01/06 18:54:44 WARN mapred.LocalJobRunner: job_local357481773_0001

java.lang.RuntimeException: problem advancing post rec#0

	at org.apache.hadoop.mapred.Task$ValuesIterator.next(Task.java:1217)

	at org.apache.hadoop.mapred.ReduceTask$ReduceValuesIterator.moveToNext(ReduceTask.java:250)

	at org.apache.hadoop.mapred.ReduceTask$ReduceValuesIterator.next(ReduceTask.java:246)

	at org.apache.hadoop.mapred.lib.IdentityReducer.reduce(IdentityReducer.java:40)

	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:522)

	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:421)

	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:398)

Caused by: java.io.IOException: can't find class: org.apache.nutch.protocol.ProtocolStatus because org.apache.nutch.protocol.ProtocolStatus

	at org.apache.hadoop.io.AbstractMapWritable.readFields(AbstractMapWritable.java:204)

	at org.apache.hadoop.io.MapWritable.readFields(MapWritable.java:146)

	at org.apache.nutch.crawl.CrawlDatum.readFields(CrawlDatum.java:281)

	at org.apache.nutch.util.GenericWritableConfigurable.readFields(GenericWritableConfigurable.java:55)

	at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:67)

	at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:40)

	at org.apache.hadoop.mapred.Task$ValuesIterator.readNextValue(Task.java:1276)

	at org.apache.hadoop.mapred.Task$ValuesIterator.next(Task.java:1214)

	... 6 more

15/01/06 18:54:44 INFO mapred.JobClient: Job complete: job_local357481773_0001

15/01/06 18:54:44 INFO mapred.JobClient: Counters: 22

15/01/06 18:54:44 INFO mapred.JobClient:   File Input Format Counters 

15/01/06 18:54:44 INFO mapred.JobClient:     Bytes Read=177

15/01/06 18:54:44 INFO mapred.JobClient:   FileSystemCounters

15/01/06 18:54:44 INFO mapred.JobClient:     FILE_BYTES_READ=66360399

15/01/06 18:54:44 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=66980331

15/01/06 18:54:44 INFO mapred.JobClient:   FetcherStatus

15/01/06 18:54:44 INFO mapred.JobClient:     bytes_downloaded=65536

15/01/06 18:54:44 INFO mapred.JobClient:     success=1

15/01/06 18:54:44 INFO mapred.JobClient:   Map-Reduce Framework

15/01/06 18:54:44 INFO mapred.JobClient:     Map output materialized bytes=15876

15/01/06 18:54:44 INFO mapred.JobClient:     Map input records=1

15/01/06 18:54:44 INFO mapred.JobClient:     Reduce shuffle bytes=0

15/01/06 18:54:44 INFO mapred.JobClient:     Spilled Records=2

15/01/06 18:54:44 INFO mapred.JobClient:     Map output bytes=66279

15/01/06 18:54:44 INFO mapred.JobClient:     Total committed heap usage (bytes)=175636480

15/01/06 18:54:44 INFO mapred.JobClient:     CPU time spent (ms)=0

15/01/06 18:54:44 INFO mapred.JobClient:     Map input bytes=79

15/01/06 18:54:44 INFO mapred.JobClient:     SPLIT_RAW_BYTES=169

15/01/06 18:54:44 INFO mapred.JobClient:     Combine input records=0

15/01/06 18:54:44 INFO mapred.JobClient:     Reduce input records=0

15/01/06 18:54:44 INFO mapred.JobClient:     Reduce input groups=0

15/01/06 18:54:44 INFO mapred.JobClient:     Combine output records=0

15/01/06 18:54:44 INFO mapred.JobClient:     Physical memory (bytes) snapshot=0

15/01/06 18:54:44 INFO mapred.JobClient:     Reduce output records=0

15/01/06 18:54:44 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=0

15/01/06 18:54:44 INFO mapred.JobClient:     Map output records=2

15/01/06 18:54:44 INFO mapred.JobClient: Job Failed: NA

15/01/06 18:54:44 ERROR fetcher.Fetcher: Fetcher: java.io.IOException: Job failed!

	at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1357)

	at org.apache.nutch.fetcher.Fetcher.fetch(Fetcher.java:1432)

	at org.apache.nutch.fetcher.Fetcher.run(Fetcher.java:1468)

	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)

	at org.apache.nutch.fetcher.Fetcher.main(Fetcher.java:1441)

	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

	at java.lang.reflect.Method.invoke(Method.java:606)

	at org.apache.hadoop.util.RunJar.main(RunJar.java:160)