Mailing-List: contact nutch-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: nutch-dev@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of sagar020785@gmail.com
 designates 209.85.198.187 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=beta;
        h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references;
        b=q83BHbrNInEARynTWMLdVrJI28p3MWIAeI1OBc8/72VAM7x6bLNBWqNQdMVr57qgq2iW53TtftAc0i0aU/9rLI57tnWRtZ77WQQE2PtOgeaPnhw223K6TDJyD2uBO/qasvhqr93W47YgOVGTYs0c+CZrURQWE+GW/sBMO8B6Uro=
Message-ID: <3eddcc810710082210w6b53bfcdm6eadee7203600c6@mail.gmail.com>
Date: Tue, 9 Oct 2007 10:40:12 +0530
From: "Sagar Vibhute" <sagar020785@gmail.com>
To: nutch-dev@lucene.apache.org
Subject: Re: Java Packages (missing)
In-Reply-To: <4709BF83.9090909@apache.org>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_24304_11116335.1191906612080"
References: <3eddcc810710070501j628e52f6kea729ec1a0b937e2@mail.gmail.com>
	 <4709BF83.9090909@apache.org>

------=_Part_24304_11116335.1191906612080
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Hi,

Thanks Dennis. But then why do I get a ClassNotFoundException when I run a
nutch crawl?

The hadoop.log says:

-------------------------------------------------------------------------------------------------------
2007-10-09 10:34:21,605 WARN  net.URLNormalizers -
URLNormalizers:PluginRuntimeException when initializing url normalizer
plugin urlnormalizer-basic instance in getURLNormalizers function:
attempting to continue instantiating plugins
2007-10-09 10:34:21,608 WARN  net.URLNormalizers -
URLNormalizers:PluginRuntimeException when initializing url normalizer
plugin urlnormalizer-regex instance in getURLNormalizers function:
attempting to continue instantiating plugins
2007-10-09 10:34:21,615 WARN  net.URLNormalizers -
URLNormalizers:PluginRuntimeException when initializing url normalizer
plugin urlnormalizer-pass instance in getURLNormalizers function: attempting
to continue instantiating plugins
2007-10-09 10:34:21,658 WARN  mapred.LocalJobRunner - job_y7yavp
java.lang.RuntimeException: org.apache.nutch.plugin.PluginRuntimeException:
java.lang.ClassNotFoundException:
org.apache.nutch.urlfilter.regex.RegexURLFilter
    at org.apache.nutch.net.URLFilters.<init>(URLFilters.java:74)
    at org.apache.nutch.crawl.Injector$InjectMapper.configure(Injector.java
:60)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java
:58)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(
ReflectionUtils.java:82)
    at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java
:58)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(
ReflectionUtils.java:82)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:170)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java
:126)
Caused by: org.apache.nutch.plugin.PluginRuntimeException:
java.lang.ClassNotFoundException:
org.apache.nutch.urlfilter.regex.RegexURLFilter
    at org.apache.nutch.plugin.Extension.getExtensionInstance(Extension.java
:166)
    at org.apache.nutch.net.URLFilters.<init>(URLFilters.java:54)
    ... 8 more
Caused by: java.lang.ClassNotFoundException:
org.apache.nutch.urlfilter.regex.RegexURLFilter
    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
    at org.apache.nutch.plugin.Extension.getExtensionInstance(Extension.java
:156)
    ... 9 more
-------------------------------------------------------------------------------------------------------

- Sagar


On 10/8/07, Dennis Kubes <kubes@apache.org> wrote:
>
> These are classes from plugins and therefore are in their specific
> plugin src directory.  For example regex url normalized is found at:
>
>
> NutchTrunk\src\plugin\urlnormalizer-regex\src\java\org\apache\nutch\net\urlnormalizer\regex\RegexURLNormalizer.java
>
> Dennis Kubes
>
> Sagar Vibhute wrote:
> > Hello,
> >
> > Does the default provided nutch0.9 package comes with certain java
> packages
> > missing?
> >
> > I could compile the source (I downloaded the tarball, not from svn)
> using
> > ant. But when I start crawling it throws ClassNotFoundException, like:
> > java.lang.ClassNotFoundException:
> > org.apache.nutch.net.urlnormalizer.basic.BasicURLNormalizer
> > java.lang.ClassNotFoundException:
> > org.apache.nutch.net.urlnormalizer.regex.RegexURLNormalizer
> > java.lang.ClassNotFoundException:
> > org.apache.nutch.net.urlnormalizer.pass.PassURLNormalizer
> > and others.
> >
> > Can I get the additional java packages anywhere? (If they are missing).
> >
> > ThankYou
> >
> > - Sagar
> >
>

------=_Part_24304_11116335.1191906612080--