crunch-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Micah Whitacre <mkwhita...@gmail.com>
Subject Re: Using counters in OutputFormat
Date Fri, 15 Apr 2016 12:34:35 GMT
Would this issue make your life easier?
https://issues.apache.org/jira/browse/CRUNCH-579

On Fri, Apr 15, 2016 at 7:21 AM, Clément MATHIEU <clement@unportant.info>
wrote:

> Hi,
>
> While writing a Target based on FileTargetImpl and a custom OutputFormat I
> discovered that Crunch seems to prevent OutputFormats from using counters
> (CrunchOutputs#getTaskContext instanciates TaskAttemptContextImpl with its
> two args ctor which means that reporter is a black hole).
>
> Is there any technical reason to a such limitation ? Wouldn't it be
> possible to pass baseContext's reporter as third argument ?
>
> Thanks,
>
> Clement
>

Mime
View raw message