nutch 2.2.1 运行报错InjectorJob: java.lang.RuntimeException: job failed: name=inject

枫居住的街道丶 2014-06-26 04:10:55

在windows下的eclipse中运行报错，如下，求各位大神帮帮忙，本人小白一个，急急急急

InjectorJob: starting at 2014-06-26 15:45:36
InjectorJob: Injecting urlDir: urls
InjectorJob: Using class org.apache.gora.memory.store.MemStore as the Gora storage class.
****file:/D:/workspace/nutchTest/urls
InjectorJob: java.lang.RuntimeException: job failed: name=inject urls, jobid=job_local_0001
at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:54)
at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:233)
at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:251)
at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:273)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:282)

...全文

965 5 打赏收藏举报

写回复

用AI写文章

5 条回复

切换为时间正序

请发表友善的回复…

发表回复

reed2014 2015-01-04

打赏
举报

给个地址吧：http://my.oschina.net/DLow/blog/294951，上面这个说法有问题，第一种写法是在IDE中，第二种是用命令行方式，

reed2014 2015-01-04

打赏
举报

原因是没有找到插件地址，将nutch-site.xml中的 <property> <name>plugin.folders</name> <value>src/plugin</value> </property> 改为：<property> <name>plugin.folders</name> <value>plugins</value> </property>

浅淡时光 2014-08-06

打赏
举报

请我贴住解决了吗？我也出了这个问题

枫居住的街道丶 2014-06-30

打赏
举报

下面是日志内容 2014-06-30 10:07:25,234 INFO crawl.InjectorJob - InjectorJob: Using class org.apache.gora.sql.store.SqlStore as the Gora storage class. 2014-06-30 10:07:25,875 WARN util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2014-06-30 10:07:26,046 WARN mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 2014-06-30 10:07:26,203 WARN snappy.LoadSnappy - Snappy native library not loaded 2014-06-30 10:07:27,078 INFO mapreduce.GoraRecordWriter - gora.buffer.write.limit = 10000 2014-06-30 10:07:27,375 WARN plugin.PluginRepository - java.io.FileNotFoundException: D:\workspace\nutchTest\.\src\plugin\.svn\plugin.xml (系统找不到指定的文件。) 2014-06-30 10:07:29,968 WARN regex.RegexURLNormalizer - Can't load the default rules! 2014-06-30 10:07:30,343 INFO regex.RegexURLNormalizer - can't find rules for scope 'inject', using default 2014-06-30 10:07:32,953 WARN mapred.FileOutputCommitter - Output path is null in cleanup 2014-06-30 10:07:33,703 INFO crawl.InjectorJob - InjectorJob: total number of urls rejected by filters: 0 2014-06-30 10:07:33,703 INFO crawl.InjectorJob - InjectorJob: total number of urls injected after normalization and filtering: 2 2014-06-30 10:07:33,875 INFO crawl.FetchScheduleFactory - Using FetchSchedule impl: org.apache.nutch.crawl.DefaultFetchSchedule 2014-06-30 10:07:33,875 INFO crawl.AbstractFetchSchedule - defaultInterval=2592000 2014-06-30 10:07:33,875 INFO crawl.AbstractFetchSchedule - maxInterval=7776000 2014-06-30 10:07:34,281 WARN mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 2014-06-30 10:07:34,703 INFO mapreduce.GoraRecordReader - gora.buffer.read.limit = 10000 2014-06-30 10:07:35,281 WARN regex.RegexURLNormalizer - Can't load the default rules! 2014-06-30 10:07:35,281 WARN regex.RegexURLNormalizer - Can't load the default rules! 2014-06-30 10:07:35,281 INFO crawl.FetchScheduleFactory - Using FetchSchedule impl: org.apache.nutch.crawl.DefaultFetchSchedule 2014-06-30 10:07:35,281 INFO crawl.AbstractFetchSchedule - defaultInterval=2592000 2014-06-30 10:07:35,281 INFO crawl.AbstractFetchSchedule - maxInterval=7776000 2014-06-30 10:07:35,359 INFO regex.RegexURLNormalizer - can't find rules for scope 'generate_host_count', using default 2014-06-30 10:07:37,703 INFO mapreduce.GoraRecordWriter - gora.buffer.write.limit = 10000 2014-06-30 10:07:37,750 WARN mapred.FileOutputCommitter - Output path is null in cleanup 2014-06-30 10:07:37,750 WARN mapred.LocalJobRunner - job_local_0002 java.lang.NullPointerException at org.apache.avro.util.Utf8.<init>(Utf8.java:37) at org.apache.nutch.crawl.GeneratorReducer.setup(GeneratorReducer.java:100) at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:174) at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:649) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:417) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:260)