hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Amareshwari Sri Ramadasu <amar...@yahoo-inc.com>
Subject Re: about CombineFileInputFormat
Date Wed, 05 May 2010 04:38:16 GMT

See patch on https://issues.apache.org/jira/browse/MAPREDUCE-364 as an example.

-Amareshwari

On 5/5/10 1:52 AM, "Zhenyu Zhong" <zhongresearch@gmail.com> wrote:

Hi,

I tried to use CombineFileInputFormat in 0.20.2. It seems I need to extend
it because it is an abstract class.
However, I need to implement getRecordReader method in the extended class.

May I ask how to implement this getRecordReader method?

I tried to do something like this:

public RecordReader getRecordReader(InputSplit genericSplit, JobConf job,

Reporter reporter) throws IOException {

// TODO Auto-generated method stub

reporter.setStatus(genericSplit.toString());

return new CombineFileRecordReader(job, (CombineFileSplit) genericSplit,
reporter, CombineFileRecordReader.class);

}

It doesn't seem to be working. I would be very appreciated if someone can
shed a light on this.

thanks
zhenyu


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message