hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amar Kamat (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-4190) Changes to JobHistory makes it backward incompatible
Date Thu, 18 Sep 2008 15:44:44 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-4190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Amar Kamat updated HADOOP-4190:

    Attachment: HADOOP-4190-v3.patch

Attaching a patch that 
- adds version to job history which is logged to the history file as the 1st line 
- switches to old/default regex for line-end matching if the version info is missing else
uses the new regex
- adds a test case that tests the job history parser with old and new file formats

Manually tested the patch with old and new history files and works fine. More testing in progress.
Will try and make it more cleaner and optimized.

> Changes to JobHistory makes it backward incompatible
> ----------------------------------------------------
>                 Key: HADOOP-4190
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4190
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>            Reporter: Amar Kamat
>            Assignee: Amar Kamat
>            Priority: Blocker
>             Fix For: 0.19.0
>         Attachments: HADOOP-4190-v3.patch
> With HADOOP-3245, the job history format has changed. Every log line now ends with a
'.' (dot). JobHistory's parser will consider a history line valid only if it ends in a dot
> Hence the new parser wont be able to parse old history files.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message