hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1197) TextLoader should be updated to match changes to PigStorage
Date Wed, 20 Jan 2010 18:22:54 GMT

    [ https://issues.apache.org/jira/browse/PIG-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12802920#action_12802920
] 

Alan Gates commented on PIG-1197:
---------------------------------

It's already been rewritten for that branch.  I'll check with Pradeep on whether he wants
to check this patch in (which will make his merges harder) or just leave it here as a patch
for anyone who wants to use it, since hopefully by 0.7 we'll have PIG-966 checked in and this
isn't going into 0.6.

> TextLoader should be updated to match changes to PigStorage
> -----------------------------------------------------------
>
>                 Key: PIG-1197
>                 URL: https://issues.apache.org/jira/browse/PIG-1197
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.6.0
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>            Priority: Minor
>             Fix For: 0.7.0
>
>         Attachments: PIG-1197.patch
>
>
> In 0.6 PigStorage was changed to use LineRecordReader to parse lines out of its stream
instead of doing the parsing itself.  This resulted in about a 30% speed up in parsing time.
 TextLoader should be changed to use LineRecordReader in the same way to benefit from the
same speed up.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message