hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Skipping Bad Records
Date Wed, 12 Oct 2011 20:27:43 GMT
Justin,

Unfortunately not. The new API does not have a skipping feature yet
like the older one.

I did get started on some work on
https://issues.apache.org/jira/browse/MAPREDUCE-1932 to fix this but I
haven't been able to find time to complete it with proper tests and
such. I'll try to do it within a week from now.

On Wed, Oct 12, 2011 at 10:06 PM, Justin Woody <justin.woody@gmail.com> wrote:
> Can anyone confirm whether the skip options work for MR jobs using the
> new API? I have a job using the new API and I cannot get the job to
> skip corrupted records. I tried configuring job properties manually
> and using the SkipBadRecords class.
>
> Thanks,
> Justin
>



-- 
Harsh J

Mime
View raw message