求救--cygwin中运行nutch抓取网页报错，

2015-08-27 03:12:02 241 阅读 AI 写同款 · GEO 优化AI 选题数据监测一键分发 ›

Nutch-1.9+solr4.6.1+tomcat8.5.29搭建一个搜索引擎(windows10) 一、需要的工具(尽量使用下面这些版本的软件，否则的话，不知道会出现什么问题)tomcat8.5.29(选择压缩包吧，比较方便)：tomcat8.5.29apache-nutch-1.9-bin.tar.gz：nutch-1.9solr-4.6.1.tgz：solr4.6.1eclipse：eclipseIK-Analyzer-2012FF：IK-Analyzer-2012FFhadoop-core... 阅读详情

Injecting seed URLs
/cygdrive/d/nutch/apache-nutch-2.3/runtime/local/bin/nutch inject urls -crawlId TestCrawl
InjectorJob: starting at 2015-08-27 15:09:57
InjectorJob: Injecting urlDir: urls
InjectorJob: Using class org.apache.gora.memory.store.MemStore as the Gora stora ge class.
InjectorJob: total number of urls rejected by filters: 0
InjectorJob: total number of urls injected after normalization and filtering: 1
Injector: finished at 2015-08-27 15:10:00, elapsed: 00:00:02
2015年08月27日 15:10:00 : Iteration 1 of 2
Generating batchId
Generating a new fetchlist
/cygdrive/d/nutch/apache-nutch-2.3/runtime/local/bin/nutch generate -D mapred.re duce.tasks=2 -D mapred.child.java.opts=-Xmx1000m -D mapred.reduce.tasks.speculat ive.execution=false -D mapred.map.tasks.speculative.execution=false -D mapred.co mpress.map.output=true -topN 50000 -noNorm -noFilter -adddays 0 -crawlId TestCra wl -batchId 1440659400-22627
GeneratorJob: starting at 2015-08-27 15:10:02
GeneratorJob: Selecting best-scoring urls due for fetch.
GeneratorJob: starting
GeneratorJob: filtering: false
GeneratorJob: normalizing: false
GeneratorJob: topN: 50000
java.util.NoSuchElementException
at java.util.TreeMap.key(TreeMap.java:1323)
at java.util.TreeMap.firstKey(TreeMap.java:290)
at org.apache.gora.memory.store.MemStore.execute(MemStore.java:125)
at org.apache.gora.query.impl.QueryBase.execute(QueryBase.java:73)
at org.apache.gora.mapreduce.GoraRecordReader.executeQuery(GoraRecordRea der.java:68)
at org.apache.gora.mapreduce.GoraRecordReader.nextKeyValue(GoraRecordRea der.java:110)
at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue (MapTask.java:531)
at org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:6 7)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:364)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(Local JobRunner.java:223)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:51 1)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor. java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor .java:617)
at java.lang.Thread.run(Thread.java:745)
GeneratorJob: finished at 2015-08-27 15:10:04, time elapsed: 00:00:02
GeneratorJob: generated batch id: 1440659400-22627 containing 0 URLs
Generate returned 1 (no new segments created)
Escaping loop: no more URLs to fetch now

...全文