pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-1197) TextLoader should be updated to match changes to PigStorage
Date Tue, 19 Jan 2010 23:16:54 GMT

     [ https://issues.apache.org/jira/browse/PIG-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Alan Gates updated PIG-1197:

    Attachment: PIG-1197.patch

Patch that changes TextLoader to use LineRecordReader.  No unit tests are included because
there are already unit tests for TextLoader in TestBuiltin.

> TextLoader should be updated to match changes to PigStorage
> -----------------------------------------------------------
>                 Key: PIG-1197
>                 URL: https://issues.apache.org/jira/browse/PIG-1197
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.6.0
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>            Priority: Minor
>             Fix For: 0.7.0
>         Attachments: PIG-1197.patch
> In 0.6 PigStorage was changed to use LineRecordReader to parse lines out of its stream
instead of doing the parsing itself.  This resulted in about a 30% speed up in parsing time.
 TextLoader should be changed to use LineRecordReader in the same way to benefit from the
same speed up.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message