hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mathias De Maré <mathias.dem...@gmail.com>
Subject MultithreadedMapper in 0.20.0
Date Fri, 10 Jul 2009 13:57:32 GMT

I was wondering if MultithreadedMapper is broken in 0.20.0, or perhaps I am
using it incorrectly.
The following code:

Configuration conf = new Configuration();
String[] otherArgs = new GenericOptionsParser(conf,
Job job = new Job(conf, "foo");
MultithreadedMapper.setMapperClass(job, CrawlerMapper.class);

The last line always fails with the following error:
    [javac] Compiling 14 source files to
in org.apache.hadoop.mapreduce.lib.map.MultithreadedMapper cannot be applied
    [javac]         MultithreadedMapper.setMapperClass(this,
    [javac]                            ^
    [javac] 1 error

However, CrawlerMapper does extend Mapper! More precisely: public class
CrawlerMapper extends Mapper<IntWritable, URLInfo, Text, URLInfo>

Is there perhaps something I'm missing?

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message