0
크롤링을 위해 Apache Nutch의 새 버전을 실행하려고합니다. 내가 스크립트/빈/크롤링을 시작하면 실패하고 hadoop.log는 말한다 :Nutch 2.2.1 + hBase
의 java.lang.Exception를 : java.lang.NoSuchMethodError : org.apache.gora.persistency.Persistent.getSchema()를 LORG/아파치/avro/스키마; at org.apache.hadoop.mapred.LocalJobRunner $ Job.run (LocalJobRunner.java:354) 발생 원인 : java.lang.NoSuchMethodError : org.apache.gora.persistency.Persistent.getSchema() Lorg/apache/avro /개요;
2013-07-04 16:12:05,069 WARN mapred.LocalJobRunner - job_local1522971864_0001
java.lang.Exception: java.lang.NoSuchMethodError: org.apache.gora.persistency.Persistent.getSchema()Lorg/apache/avro/Schema;
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:354)
Caused by: java.lang.NoSuchMethodError: org.apache.gora.persistency.Persistent.getSchema()Lorg/apache/avro/Schema;
at org.apache.gora.hbase.store.HBaseStore.put(HBaseStore.java:177)
at org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:65)
at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:638)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.crawl.InjectorJob$UrlMapper.map(InjectorJob.java:191)
at org.apache.nutch.crawl.InjectorJob$UrlMapper.map(InjectorJob.java:88)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:364)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:223)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:722)
2013-07-04 16:12:05,720 ERROR crawl.InjectorJob - InjectorJob: java.lang.RuntimeException: job failed: name=[new]inject /opt/ir/nutch2/urls, jobid=job_local1522971864_0001
at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:54)
at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:233)
at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:251)
at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:273)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:282)
내가 ivy.xml 내부 일부 고라 아티팩트를 설정하거나해야 : org.apache.gora.hbase.store.HBaseStore.put에서 (HBaseStore.java:177는) 다음
로그입니다 어떤 것? 도와주세요.
nutch 2.2.1은 어떻게 실행합니까? 제발 어떤 조언도 해주십시오. – jackyesind
Nutch는 튜토리얼을 가지고 있습니다 : http://wiki.apache.org/nutch/NutchTutorial. 어떤 문제가 있다면 그것을보고 나서 물어 볼 수 있습니다 :) –
질문이 있으시면 저에게 ... –