hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pradeep Kamath (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1090) Update sources to reflect recent changes in load-store interfaces
Date Fri, 13 Nov 2009 18:33:39 GMT

    [ https://issues.apache.org/jira/browse/PIG-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777599#action_12777599

Pradeep Kamath commented on PIG-1090:

bq. What's the ReadToEndLoader?
This is a internal utility LoadFunc I wrote to make it easy to read side files. It encapsulates
the real Loader. Though this has been implemented as a LoadFunc, the only LoadFunc method
which is truly implemented is getNext(). The usage pattern is to construct an instance using
the constructor which would take a reference to the true LoadFunc (which can read the side
file data) and then repeatedly call getNext() till null is encountered in the return value.
The implementation of ReadToEndLoader hides the actions of getting InputSplits from the underlying
InputFormat and then processing each split by getting the RecordReader and processing data
in the split before moving to the next.

bq. What's the plan for BinStorage?
An input and output format has already been created and checked in in this branch for Binstorage

> Update sources to reflect recent changes in load-store interfaces
> -----------------------------------------------------------------
>                 Key: PIG-1090
>                 URL: https://issues.apache.org/jira/browse/PIG-1090
>             Project: Pig
>          Issue Type: Sub-task
>            Reporter: Pradeep Kamath
>            Assignee: Pradeep Kamath
>         Attachments: PIG-1090.patch
> There have been some changes (as recorded in the Changes Section, Nov 2 2009 sub section
of http://wiki.apache.org/pig/LoadStoreRedesignProposal) in the load/store interfaces - this
jira is to track the task of making those changes under src. Changes under test will be addresses
in a different jira.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message