hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Runping Qi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2178) Job history on HDFS
Date Fri, 11 Jan 2008 17:15:34 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558029#action_12558029

Runping Qi commented on HADOOP-2178:

Even with hod JT, we still need to address case 3. That is,
we need a central place to store the job history files so that they can be analyzed offline.
It can be the same place in the local file system as it is now, or some common directory in
This is in addition to the one in the output directory.

> Job history on HDFS
> -------------------
>                 Key: HADOOP-2178
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2178
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: Amareshwari Sri Ramadasu
>            Assignee: Amareshwari Sri Ramadasu
>             Fix For: 0.16.0
> This issue addresses the following items :
> 1.  Check for accuracy of job tracker history logs.
> 2.  After completion of the job, copy the JobHistory.log(Master index file) and the job
history files to the DFS.
> 3. User can load the history with commands
> bin/hadoop job -history <directory> 
> or
> bin/hadoop job -history <jobid>
> This will start a stand-alone jetty and load jsps

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message