hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5834) Job History log file format is not friendly for external tools.
Date Thu, 21 May 2009 05:58:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12711477#action_12711477
] 

Todd Lipcon commented on HADOOP-5834:
-------------------------------------

Along the lines of what Philip said, I'd like to propose using HADOOP-5640 to expose the hooks
for this job-history logging system. This would allow people to log in whichever format they
prefer (eg JDBC to SQL, JSON, Thrift to something custom, etc) from an external JAR (without
modifying mapred source)

> Job History log file format is not friendly for external tools.
> ---------------------------------------------------------------
>
>                 Key: HADOOP-5834
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5834
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>            Reporter: Owen O'Malley
>
> Currently, parsing the job history logs with external tools is very difficult because
of the format. The most critical problem is that newlines aren't escaped in the strings. That
makes using tools like grep, sed, and awk very tricky.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message