hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joydeep Sen Sarma (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-2218) schedule additional tasks when killactions are being dispatched
Date Tue, 14 Dec 2010 23:40:01 GMT
schedule additional tasks when killactions are being dispatched

                 Key: MAPREDUCE-2218
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2218
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: jobtracker
            Reporter: Joydeep Sen Sarma

we see a very high turnaround time for preemption (from the time preemption happens to the
time other jobs are scheduled). part of the reason is that we do not dispatch new tasks until
the TT confirms termination of killed tasks. The high turnaround time causes all kinds of
issues (we keep issuing preemptions repeatedly. other jobs of higher priority arrive and get

One remediation is that one can dispatch additional tasks equal to the number of tasks killed
whenever we send killaction to a TT. that would reduce the turnaround time somewhat.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message