hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj Das (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-864) Enhance JobClient API implementations to look at history files to get information about jobs that are not in memory
Date Thu, 13 Aug 2009 15:38:16 GMT
Enhance JobClient API implementations to look at history files to get information about jobs
that are not in memory
-------------------------------------------------------------------------------------------------------------------

                 Key: MAPREDUCE-864
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-864
             Project: Hadoop Map/Reduce
          Issue Type: Sub-task
          Components: jobtracker
            Reporter: Devaraj Das
             Fix For: 0.21.0


MAPREDUCE-817 added an API to get the JobHistory URL from the JobTracker. This is useful in
two ways:
1) Users can use this API to get the URL, copy the history files to their local disk, and,
do processing on them
2) APIs like JobSubmissionProtocol.getJobCounters, can read a part of the history file, and
then return the information to the caller (if the job is not there in JT memory). This would
 mimic most of the CompletedJobsStatusStore functionality.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message