hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandy Ryza (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2264) Job status exceeds 100% in some cases
Date Fri, 25 Jan 2013 00:17:14 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13562181#comment-13562181

Sandy Ryza commented on MAPREDUCE-2264:

Uploaded a patch that adds a test for the calculation when data is not compressed.
> Job status exceeds 100% in some cases 
> --------------------------------------
>                 Key: MAPREDUCE-2264
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2264
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobtracker
>    Affects Versions: 0.20.2,
>            Reporter: Adam Kramer
>            Assignee: Devaraj K
>              Labels: critical-0.22.0
>         Attachments: MAPREDUCE-2264-0.20.205-1.patch, MAPREDUCE-2264-0.20.205.patch,
MAPREDUCE-2264-0.20.3.patch, MAPREDUCE-2264-branch-1.patch, MAPREDUCE-2264-trunk-1.patch,
MAPREDUCE-2264-trunk-1.patch, MAPREDUCE-2264-trunk-2.patch, MAPREDUCE-2264-trunk-3.patch,
MAPREDUCE-2264-trunk.patch, more than 100%.bmp
> I'm looking now at my jobtracker's list of running reduce tasks. One of them is 120.05%
complete, the other is 107.28% complete.
> I understand that these numbers are estimates, but there is no case in which an estimate
of 100% for a non-complete task is better than an estimate of 99.99%, nor is there any case
in which an estimate greater than 100% is valid.
> I suggest that whatever logic is computing these set 99.99% as a hard maximum.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message