hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj Das (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5846) Log job history events to a common dump file
Date Fri, 15 May 2009 09:14:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12709770#action_12709770

Devaraj Das commented on HADOOP-5846:

The most common history configuration is to write the files in the local disk and this jira
is not changing that model.. So it will be yet another file in the local disk. Once we have
fixes that will not lock the JT on history writes, creating such files on the hdfs will be
not that big a deal (and long term that is the goal). 

> Log job history events to a common dump file
> --------------------------------------------
>                 Key: HADOOP-5846
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5846
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: mapred
>            Reporter: Amar Kamat
>            Assignee: Amar Kamat
> As of today all the jobhistory events are logged to separate files. It would be nice
to also dump all this info into a common file so that external tools (e.g Chukwa) can harvest
history info. Job configuration should also be dumped. Whether to use a same log file for
history dumps and configuration dumps should be configurable (by default everything goes to
one file). 

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message