hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj Das (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-717) Fix some corner case issues in speculative execution (post hadoop-2141)
Date Wed, 08 Jul 2009 08:08:14 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Devaraj Das updated MAPREDUCE-717:
----------------------------------

    Attachment: 717.patch

Patch with the fixes.

> Fix some corner case issues in speculative execution (post hadoop-2141)
> -----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-717
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-717
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobtracker
>    Affects Versions: 0.21.0
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.21.0
>
>         Attachments: 717.patch
>
>
> Some corner case issues can be fixed:
> 1) Setup task should not add anything to the job statistics (since they are really fast
and might affect the statistics of a job with few tasks)
> 2) The statistics computations should be guarded for cases where things like sumOfSquares
could become less than zero (due to rounding errors mostly).
> 3) The method TaskInProgress.getCurrentProgressRate() should take into account the COMMIT_PENDING
state
> 4) The testcase TestSpeculativeExecution.testTaskLATEScheduling could be made more robust

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message