hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Amareshwari Sri Ramadasu <amar...@yahoo-inc.com>
Subject Re: Concurrent Mappers
Date Tue, 20 Jul 2010 04:52:41 GMT
There is no separate MapRunner in new api. You can override Mapper.run() method to achieve
similar goal.

On 7/20/10 5:09 AM, "Praveen Yarlagadda" <praveen.yarlagadda@gmail.com> wrote:

Hello all,

Is it possible to run mappers concurrently using the new API? Using old API,
I used to do that by setting the following:

jobConf.setMapRunnerClass(ConcurrentMapper.class);

ConcurrentMapper implementation is similar to how Fetcher works in Nutch. I
couldn't find the similar call in the new API. If anybody knows how to do
that using new API, please let me know.

Thanks,
Praveen


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message