hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-243) WI shows progress as 100.00% before actual completion (rounding error)
Date Tue, 12 Sep 2006 05:30:23 GMT
     [ http://issues.apache.org/jira/browse/HADOOP-243?page=all ]

Owen O'Malley updated HADOOP-243:

    Attachment: percent-complete.patch

This patch creates a new method in StringUtils for formating percentages and uses it in all
of the progress fields in the web/ui. The method displays the percentage as "0.00%" with values
rounded down.

To ensure that complete jobs show up as 100.00% instead of 99.99%, I also needed to set the
progress to 1.0f explicitly to avoid floating point approximation problems. To avoid the problem
with late updates pushing the progress over 1.0, I made the fields private and forced all
users to go through the setters, which guarantee progress stays within 0.0 to 1.0.

> WI shows progress as 100.00% before actual completion (rounding error)
> ----------------------------------------------------------------------
>                 Key: HADOOP-243
>                 URL: http://issues.apache.org/jira/browse/HADOOP-243
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.1.0
>            Reporter: Yoram Arnon
>         Assigned To: Owen O'Malley
>            Priority: Trivial
>         Attachments: percent-complete.patch
> For jobs of over 50000 tasks, the rounding error in the WI is confusing.
> When less than 0.005% of the map (or reduce) tasks remain to execute, the WI shows progress
as 100.00%, which is misleading.
> Rounding down to the nearest .01% would be better.

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message