hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanjay Dahiya (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-239) job tracker WI drops jobs after 24 hours
Date Tue, 19 Sep 2006 18:17:23 GMT
     [ http://issues.apache.org/jira/browse/HADOOP-239?page=all ]

Sanjay Dahiya updated HADOOP-239:
---------------------------------

    Attachment: Hadoop-239.patch

A patch for maintaining job tracker history. This patch - 
1. instruments JobInProgress to add log events to history file. 
2. Jobhistory management with a job master index file and one history file per job,  parser
for job history files. 
3. Contains WI for viewing Jobtracker history. 

This patch depends on Hadoop-263, it wont work otherwise. 

> job tracker WI drops jobs after 24 hours
> ----------------------------------------
>
>                 Key: HADOOP-239
>                 URL: http://issues.apache.org/jira/browse/HADOOP-239
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>            Reporter: Yoram Arnon
>         Assigned To: Sanjay Dahiya
>            Priority: Minor
>         Attachments: Hadoop-239.patch
>
>
> The jobtracker's WI, keeps track of jobs executed in the past 24 hours.
> if the cluster was idle for a day (say Sunday) it drops all its history.
> Monday morning, the page is empty.
> Better would be to store a fixed number of jobs (say 10 each of succeeded and failed
jobs).
> Also, if the job tracker is restarted, it loses all its history.
> The history should be persistent, withstanding restarts and upgrades.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message