hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "arkady borkovsky (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-1279) list of completed jobs purges jobs based on submission not on completion age
Date Wed, 25 Apr 2007 19:26:15 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491739
] 

arkady borkovsky commented on HADOOP-1279:
------------------------------------------

It would be very nice if the information about completed jobs is persitent and is NEVER lost.
Once it purged from JobTracker RAM, it should be moved into some persistent storage and still
be retrievable.

> list of completed jobs purges jobs based on submission not on completion age
> ----------------------------------------------------------------------------
>
>                 Key: HADOOP-1279
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1279
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>         Environment: all
>            Reporter: Alejandro Abdelnur
>         Assigned To: Arun C Murthy
>             Fix For: 0.13.0
>
>         Attachments: HADOOP-1279_20070420_1.patch
>
>
> The JobTracker keeps at most the last 100 completed jobs.
> One this limit is exceeded and there is a new completed job the old submitted job in
completed state is removed regardless if there are jobs that have finished much earlier in
the completed list.
> The job should be added at completion time, not a submission time to avoid this problem.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message