hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Kambatla (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-4758) jobhistory web ui not showing correct # failed reducers
Date Thu, 03 Jul 2014 05:33:50 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-4758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Karthik Kambatla updated MAPREDUCE-4758:

    Target Version/s: 2.6.0  (was: 3.0.0, 2.5.0)

> jobhistory web ui not showing correct # failed reducers
> -------------------------------------------------------
>                 Key: MAPREDUCE-4758
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4758
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobhistoryserver, webapps
>    Affects Versions: 0.23.4
>            Reporter: Thomas Graves
>            Priority: Critical
> we had a job fail due to a reducer failing 4 times.  Unfortunately the job history UI
didn't show  this particular failed reducer which lead to confusion as to why the job failed.

> This reducer failed to launch all 4 task attempts with a Token Expiration error and the
jobhistory file only gets an event when the task attempt transitions to launched.  The webapp
JobInfo object only counts the task attempts in the jobhistory file to display under the "Attempt
Type" table, so since this task didn't have an attempt with it, it did show it on the UI.
> We need to reconcile the task list with the task attempts or also shows more stats for
the tasks vs task attempts.

This message was sent by Atlassian JIRA

View raw message