hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravi Gummadi (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-5210) Reduce Task Progress shows > 100% when the total size of map outputs (for a single reducer) is high
Date Fri, 20 Mar 2009 04:29:50 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ravi Gummadi updated HADOOP-5210:
---------------------------------

    Attachment: HADOOP-5210.v3.patch

TestReduceTask was failing with earlier patch because of ignoring the starting bytes read
from segments in the final merge.

Attaching the patch that resets totalBytesProcessed to the number of bytes read in this final
merge(instead of 0).

Please review and provide your comments.

> Reduce Task Progress shows > 100% when the total size of map outputs (for a single
reducer) is high 
> ----------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-5210
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5210
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Jothi Padmanabhan
>            Assignee: Ravi Gummadi
>            Priority: Minor
>         Attachments: HADOOP-5210.patch, HADOOP-5210.v2.1.patch, HADOOP-5210.v2.patch,
HADOOP-5210.v3.patch, Picture 3.png
>
>
> When the total map outputs size (reduce input size) is high, the reported progress is
greater than 100%.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message