hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5847) Remove redundant code for fileOutputByteCounter in MapTask and ReduceTask
Date Fri, 18 Apr 2014 22:34:17 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13974577#comment-13974577
] 

Jason Lowe commented on MAPREDUCE-5847:
---------------------------------------

Isn't this an incompatible change?  It looks like this will no longer compute anything for
the org.apache.hadoop.mapreduce.lib.output.FileOutputFormatCounter.BYTES_WRITTEN counter which
will break clients who are expecting this to be present on the job.

> Remove redundant code for fileOutputByteCounter in MapTask and ReduceTask 
> --------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5847
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5847
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv1, mrv2, task
>    Affects Versions: 2.4.0
>            Reporter: Gera Shegalov
>            Assignee: Gera Shegalov
>         Attachments: MAPREDUCE-5847.v01.patch, MAPREDUCE-5847.v02.patch
>
>
> Both MapTask and ReduceTask carry redundant code to update BYTES_WRITTEN counter. However,
{{Task.updateCounters}} uses file system stats for this. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message