nutch启动时异常,寻高手指点

独留一片静 2011-03-14 07:53:09
2011-03-14 18:47:05,593 INFO crawl.Crawl - crawl started in: crawled
2011-03-14 18:47:05,593 INFO crawl.Crawl - rootUrlDir = multiurls.txt
2011-03-14 18:47:05,593 INFO crawl.Crawl - threads = 5
2011-03-14 18:47:05,593 INFO crawl.Crawl - depth = 3
2011-03-14 18:47:05,593 INFO crawl.Crawl - indexer=lucene
2011-03-14 18:47:05,593 INFO crawl.Crawl - topN = 5
2011-03-14 18:47:05,609 INFO crawl.Injector - Injector: starting at 2011-03-14 18:47:05
2011-03-14 18:47:05,609 INFO crawl.Injector - Injector: crawlDb: crawled/crawldb
2011-03-14 18:47:05,609 INFO crawl.Injector - Injector: urlDir: multiurls.txt
2011-03-14 18:47:05,640 INFO crawl.Injector - Injector: Converting injected urls to crawl db entries.
2011-03-14 18:47:05,703 WARN mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
2011-03-14 18:47:05,875 WARN mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
2011-03-14 18:47:06,312 WARN plugin.PluginRepository - Plugins: directory not found: plugins
2011-03-14 18:47:06,328 INFO plugin.PluginRepository - Plugin Auto-activation mode: [true]
2011-03-14 18:47:06,328 INFO plugin.PluginRepository - Registered Plugins:
2011-03-14 18:47:06,328 INFO plugin.PluginRepository - NONE
2011-03-14 18:47:06,328 INFO plugin.PluginRepository - Registered Extension-Points:
2011-03-14 18:47:06,328 INFO plugin.PluginRepository - NONE
2011-03-14 18:47:06,328 WARN mapred.LocalJobRunner - job_local_0001
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: x point org.apache.nutch.net.URLNormalizer not found.
at org.apache.nutch.net.URLNormalizers.<init>(URLNormalizers.java:122)
at org.apache.nutch.crawl.Injector$InjectMapper.configure(Injector.java:70)
... 18 more
...全文
861 7 打赏 收藏 转发到动态 举报
写回复
用AI写文章
7 条回复
切换为时间正序
请发表友善的回复…
发表回复
zhangxueb 2011-12-13
  • 打赏
  • 举报
回复
提交任务的时候加一个-file选项,把你的脚本放上去.
幻想时代5 2011-11-01
  • 打赏
  • 举报
回复
请问楼主具体是什么问题造成这个错误的!我还是会出现上述类似的问题!
luorenhuan 2011-05-04
  • 打赏
  • 举报
回复
谢谢啊!
独留一片静 2011-05-03
  • 打赏
  • 举报
回复
之前出现这错误是没有正确的导入项目,这里有个地址可以帮你解决
http://xtfncel.iteye.com/blog/756735
luorenhuan 2011-05-03
  • 打赏
  • 举报
回复
楼主,你好,我也遇到了这个问题,请问你是怎么解决的?
独留一片静 2011-03-17
  • 打赏
  • 举报
回复
谢谢,问题已经解决。
想在请问你一个问题,nutch是怎么把url取得的?
runer 2011-03-14
  • 打赏
  • 举报
回复
改过什么配置吧?

50,526

社区成员

发帖
与我相关
我的任务
社区描述
Java相关技术讨论
javaspring bootspring cloud 技术论坛(原bbs)
社区管理员
  • Java相关社区
  • 小虚竹
  • 谙忆
加入社区
  • 近7日
  • 近30日
  • 至今
社区公告
暂无公告

试试用AI创作助手写篇文章吧