nutch-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From rishi pathak <mailmaverick...@gmail.com>
Subject Re: Upgrade to hadoop-0.21.0
Date Fri, 04 Feb 2011 09:07:57 GMT
Following steps were followed and it seems like working:

#Do an upgrade as described in
http://wiki.apache.org/nutch/Upgrading_Hadoop
#Download and put jackson-all-1.7.2 in $NUTCH_HOME/lib from
http://jackson.codehaus.org/
#Download and put avro-1.3.3 in $NUTCH_HOME/lib from
avro.apache.org(avro-1.4.x breaks)




On Thu, Feb 3, 2011 at 7:36 PM, rishi pathak <mailmaverick666@gmail.com>wrote:

> Hi,
>          I tried upgrading upgrading to hadoop-0.21.0 in nutch-1.2. 'ant
> package' does not report any errors and build is sucessfull but nutch crawl
> is failing with following errors:
>
>
>
> ./bin/nutch crawl /home2/nazgul/hadoop/dfs/local/urls/ -dir
> /home2/nazgul/hadoop/dfs/local/crawl-data/ -depth 3
> 11/02/03 19:13:29 INFO security.Groups: Group mapping
> impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping;
> cacheTimeout=300000
> 11/02/03 19:13:29 INFO crawl.Crawl: crawl started in:
> /home2/internal/sysadmin/nazgul/hadoop/dfs/local/crawl-data
> 11/02/03 19:13:29 INFO crawl.Crawl: rootUrlDir =
> /home2/nazgul/hadoop/dfs/local/urls
> 11/02/03 19:13:29 INFO crawl.Crawl: threads = 2
> 11/02/03 19:13:29 INFO crawl.Crawl: depth = 3
> 11/02/03 19:13:29 INFO crawl.Crawl: indexer=lucene
> 11/02/03 19:13:29 INFO crawl.Injector: Injector: starting at 2011-02-03
> 19:13:29
> 11/02/03 19:13:29 INFO crawl.Injector: Injector: crawlDb:
> /home2/nazgul/hadoop/dfs/local/crawl-data/crawldb
> 11/02/03 19:13:29 INFO crawl.Injector: Injector: urlDir:
> /home2/nazgul/hadoop/dfs/local/urls
> 11/02/03 19:13:29 WARN conf.Configuration: mapred.temp.dir is deprecated.
> Instead, use mapreduce.cluster.temp.dir
> 11/02/03 19:13:29 INFO crawl.Injector: Injector: Converting injected urls
> to crawl db entries.
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/codehaus/jackson/map/JsonMappingException
>         at org.apache.hadoop.mapreduce.Job.submit(Job.java:960)
>         at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:534)
>         at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:779)
>         at org.apache.nutch.crawl.Injector.inject(Injector.java:217)
>         at org.apache.nutch.crawl.Crawl.main(Crawl.java:124)
> Caused by: java.lang.ClassNotFoundException:
> org.codehaus.jackson.map.JsonMappingException
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
>
>
>
>
> --
> ---
> Rishi Pathak
> National PARAM Supercomputing Facility
> C-DAC, Pune, India
>
>
>


-- 
---
Rishi Pathak
National PARAM Supercomputing Facility
C-DAC, Pune, India

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message