nutch-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From rishi pathak <mailmaverick...@gmail.com>
Subject Upgrade to hadoop-0.21.0
Date Thu, 03 Feb 2011 14:06:20 GMT
Hi,
         I tried upgrading upgrading to hadoop-0.21.0 in nutch-1.2. 'ant
package' does not report any errors and build is sucessfull but nutch crawl
is failing with following errors:



./bin/nutch crawl /home2/nazgul/hadoop/dfs/local/urls/ -dir
/home2/nazgul/hadoop/dfs/local/crawl-data/ -depth 3
11/02/03 19:13:29 INFO security.Groups: Group mapping
impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping;
cacheTimeout=300000
11/02/03 19:13:29 INFO crawl.Crawl: crawl started in:
/home2/internal/sysadmin/nazgul/hadoop/dfs/local/crawl-data
11/02/03 19:13:29 INFO crawl.Crawl: rootUrlDir =
/home2/nazgul/hadoop/dfs/local/urls
11/02/03 19:13:29 INFO crawl.Crawl: threads = 2
11/02/03 19:13:29 INFO crawl.Crawl: depth = 3
11/02/03 19:13:29 INFO crawl.Crawl: indexer=lucene
11/02/03 19:13:29 INFO crawl.Injector: Injector: starting at 2011-02-03
19:13:29
11/02/03 19:13:29 INFO crawl.Injector: Injector: crawlDb:
/home2/nazgul/hadoop/dfs/local/crawl-data/crawldb
11/02/03 19:13:29 INFO crawl.Injector: Injector: urlDir:
/home2/nazgul/hadoop/dfs/local/urls
11/02/03 19:13:29 WARN conf.Configuration: mapred.temp.dir is deprecated.
Instead, use mapreduce.cluster.temp.dir
11/02/03 19:13:29 INFO crawl.Injector: Injector: Converting injected urls to
crawl db entries.
Exception in thread "main" java.lang.NoClassDefFoundError:
org/codehaus/jackson/map/JsonMappingException
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:960)
        at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:534)
        at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:779)
        at org.apache.nutch.crawl.Injector.inject(Injector.java:217)
        at org.apache.nutch.crawl.Crawl.main(Crawl.java:124)
Caused by: java.lang.ClassNotFoundException:
org.codehaus.jackson.map.JsonMappingException
        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:248)




-- 
---
Rishi Pathak
National PARAM Supercomputing Facility
C-DAC, Pune, India

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message