hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-4758) jobhistory web ui not showing correct # failed reducers
Date Tue, 30 Oct 2012 20:56:14 GMT
Thomas Graves created MAPREDUCE-4758:

             Summary: jobhistory web ui not showing correct # failed reducers
                 Key: MAPREDUCE-4758
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4758
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: jobhistoryserver, webapps
    Affects Versions: 0.23.4
            Reporter: Thomas Graves
            Priority: Critical

we had a job fail due to a reducer failing 4 times.  Unfortunately the job history UI didn't
show  this particular failed reducer which lead to confusion as to why the job failed. 

This reducer failed to launch all 4 task attempts with a Token Expiration error and the jobhistory
file only gets an event when the task attempt transitions to launched.  The webapp JobInfo
object only counts the task attempts in the jobhistory file to display under the "Attempt
Type" table, so since this task didn't have an attempt with it, it did show it on the UI.

We need to reconcile the task list with the task attempts or also shows more stats for the
tasks vs task attempts.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message