hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1197) TextLoader should be updated to match changes to PigStorage
Date Thu, 21 Jan 2010 00:30:54 GMT

    [ https://issues.apache.org/jira/browse/PIG-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12803083#action_12803083

Alan Gates commented on PIG-1197:

I'm ok with putting it in 0.6, as it is very localized and it is a significant performance
boost.  If I don't hear any complaints over the next couple of days I'll check it in.

> TextLoader should be updated to match changes to PigStorage
> -----------------------------------------------------------
>                 Key: PIG-1197
>                 URL: https://issues.apache.org/jira/browse/PIG-1197
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.6.0
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>            Priority: Minor
>             Fix For: 0.7.0
>         Attachments: PIG-1197.patch
> In 0.6 PigStorage was changed to use LineRecordReader to parse lines out of its stream
instead of doing the parsing itself.  This resulted in about a 30% speed up in parsing time.
 TextLoader should be changed to use LineRecordReader in the same way to benefit from the
same speed up.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message