Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 61883 invoked from network); 11 Jul 2009 19:46:20 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 11 Jul 2009 19:46:20 -0000 Received: (qmail 77108 invoked by uid 500); 11 Jul 2009 19:46:27 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 77014 invoked by uid 500); 11 Jul 2009 19:46:27 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 77004 invoked by uid 99); 11 Jul 2009 19:46:27 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Jul 2009 19:46:27 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of msa@schor.com designates 69.93.154.26 as permitted sender) Received: from [69.93.154.26] (HELO gateway09.websitewelcome.com) (69.93.154.26) by apache.org (qpsmtpd/0.29) with SMTP; Sat, 11 Jul 2009 19:46:16 +0000 Received: (qmail 25868 invoked from network); 11 Jul 2009 19:52:23 -0000 Received: from gator74.hostgator.com (67.18.27.130) by gateway09.websitewelcome.com with SMTP; 11 Jul 2009 19:52:23 -0000 Received: from ool-44c6c63b.dyn.optonline.net ([68.198.198.59]:18380 helo=[192.168.1.101]) by gator74.hostgator.com with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69) (envelope-from ) id 1MPiW8-0002Ob-Nr for common-user@hadoop.apache.org; Sat, 11 Jul 2009 14:45:52 -0500 Message-ID: <4A58EBF0.9070005@schor.com> Date: Sat, 11 Jul 2009 15:45:52 -0400 From: Marshall Schor User-Agent: Thunderbird 2.0.0.22 (Windows/20090605) MIME-Version: 1.0 To: common-user@hadoop.apache.org Subject: Re: MultithreadedMapper in 0.20.0 References: <375c60f40907100657g64c156fm3d487da5fd04d486@mail.gmail.com> In-Reply-To: <375c60f40907100657g64c156fm3d487da5fd04d486@mail.gmail.com> X-Enigmail-Version: 0.95.7 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - gator74.hostgator.com X-AntiAbuse: Original Domain - hadoop.apache.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - schor.com X-Virus-Checked: Checked by ClamAV on apache.org Just a wild guess: Since there are 2 Mapper classes in hadoop 20, each in a different package, did you import the right package when extending CrawlerMapper? -Marshall Schor Mathias De Maré wrote: > Hi, > > I was wondering if MultithreadedMapper is broken in 0.20.0, or perhaps I am > using it incorrectly. > The following code: > > Configuration conf = new Configuration(); > String[] otherArgs = new GenericOptionsParser(conf, > args).getRemainingArgs(); > Job job = new Job(conf, "foo"); > job.setMapperClass(MultithreadedMapper.class); > MultithreadedMapper.setMapperClass(job, CrawlerMapper.class); > > The last line always fails with the following error: > [javac] Compiling 14 source files to > /home/mathias/hadoop_testing/crawler/svn/Crawler/build/classes > [javac] > /home/mathias/hadoop_testing/crawler/svn/Crawler/src/mycrawler/CrawlerJob.java:37: > setMapperClass(org.apache.hadoop.mapreduce.Job,java.lang.Class>) > in org.apache.hadoop.mapreduce.lib.map.MultithreadedMapper cannot be applied > to > (com.acquia.web.crawler.CrawlerJob,java.lang.Class) > [javac] MultithreadedMapper.setMapperClass(this, > CrawlerMapper.class); > [javac] ^ > [javac] 1 error > > However, CrawlerMapper does extend Mapper! More precisely: public class > CrawlerMapper extends Mapper > > Is there perhaps something I'm missing? > >