hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jothi Padmanabhan (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-157) Job History log file format is not friendly for external tools.
Date Tue, 15 Sep 2009 03:37:57 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jothi Padmanabhan updated MAPREDUCE-157:
----------------------------------------

    Attachment: mapred-157-14Sep-v1.patch

Patch that incorporates most of the review comments, including the use of enum fanciness to
associate types with their enums.

bq. Honestly, the dozen or so *Event.java classes are begging to have a framework.

Yes, I agree, I realized it too. But given that we were moving to Avro which would do the
automatic code generation,  just left it simple for now, without trying to develop any other
framework.

bq. I am working to convert this patch to use Avro 
Doug, thanks. If possible, could you use this patch as your base patch?

> Job History log file format is not friendly for external tools.
> ---------------------------------------------------------------
>
>                 Key: MAPREDUCE-157
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-157
>             Project: Hadoop Map/Reduce
>          Issue Type: Sub-task
>    Affects Versions: 0.20.1
>            Reporter: Owen O'Malley
>            Assignee: Jothi Padmanabhan
>             Fix For: 0.21.0
>
>         Attachments: mapred-157-10Sep.patch, mapred-157-14Sep-v1.patch, mapred-157-4Sep.patch,
mapred-157-7Sep-v1.patch, mapred-157-7Sep.patch, mapred-157-prelim.patch, MAPREDUCE-157-avro.patch,
MAPREDUCE-157-avro.patch
>
>
> Currently, parsing the job history logs with external tools is very difficult because
of the format. The most critical problem is that newlines aren't escaped in the strings. That
makes using tools like grep, sed, and awk very tricky.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message