hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Resolved: (HADOOP-152) Speculative tasks not being scheduled
Date Thu, 24 May 2007 06:08:17 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Owen O'Malley resolved HADOOP-152.
----------------------------------

    Resolution: Duplicate
      Assignee:     (was: Owen O'Malley)

This was fixed when we fixed the thresholds for launching speculative tasks as part of HADOOP-76.

> Speculative tasks not being scheduled
> -------------------------------------
>
>                 Key: HADOOP-152
>                 URL: https://issues.apache.org/jira/browse/HADOOP-152
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.2.0
>         Environment: ~30 node Opteron cluster
>            Reporter: Bryan Pendleton
>            Priority: Minor
>
> The criteria for starting up a speculative task includes a check that the "average progress"-"progress"
> the speculative gap, currently 0.2.
> I don't know if this is the right metric, but it doesn't seem to be correctly calculated.
I've regularly seen the "average progress" with values of less than 0.01, while the "progress"
value is showing in the range .90-1.0, and yet, still no speculative tasks are started up.
This has caused at least one long-running task to run about 10% longer while overloaded hosts
catch up.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message