hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5846) Log job history events to a common dump file
Date Fri, 15 May 2009 09:00:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12709765#action_12709765
] 

Arun C Murthy commented on HADOOP-5846:
---------------------------------------

Haven't we had problems with job-history being written to hdfs before? Will adding another
log not exacerbate it? Hence, I'm trying to understand the proposed solution...

> Log job history events to a common dump file
> --------------------------------------------
>
>                 Key: HADOOP-5846
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5846
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: mapred
>            Reporter: Amar Kamat
>            Assignee: Amar Kamat
>
> As of today all the jobhistory events are logged to separate files. It would be nice
to also dump all this info into a common file so that external tools (e.g Chukwa) can harvest
history info. Job configuration should also be dumped. Whether to use a same log file for
history dumps and configuration dumps should be configurable (by default everything goes to
one file). 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message