hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amar Kamat (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-4000) Reduce progress in the Reducer crosses 1
Date Fri, 22 Aug 2008 09:52:44 GMT
Reduce progress in the Reducer crosses 1
----------------------------------------

                 Key: HADOOP-4000
                 URL: https://issues.apache.org/jira/browse/HADOOP-4000
             Project: Hadoop Core
          Issue Type: Bug
          Components: mapred
            Reporter: Amar Kamat


I printed the progress in the {{Progress.java}} for every progress made and I found this scenario
{noformat}
update called for reduce with progress 0.99998355
update called for reduce with progress 0.99998355
update called for reduce with progress 1.0000043
update called for reduce with progress 1.0000043
update called for reduce with progress 1.0000244
{noformat}
Following are the lines I added to get this 
{code:title=Progress.java|borderStyle=solid}
/** Called during execution on a leaf node to set its progress. */
  public synchronized void set(float progress) {
    System.out.println("update called for " + status + " with progress " + progress);
    this.progress = progress;
  }
{code}

This needs investigation and will also explain why occasionally users see jobs that are complete
and their progress less that 100%.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message