hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1292) Interface Refinements
Date Thu, 11 Mar 2010 22:00:27 GMT

    [ https://issues.apache.org/jira/browse/PIG-1292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12844247#action_12844247

Ashutosh Chauhan commented on PIG-1292:

Currently LoadFunc is an abstract class. OrderedLoadFunc is another abstract class which extends
LoadFunc and adds the method which tells Pig in what order to read the splits. Similarly,
there is IndexableLoadFunc which also extends LoadFunc and adds the functionality that loader
can arbitrarily seek near to specified keys. Its not hard to imagine that there may exist
a loader which can do both. Currently there can't be such a loader since both of these are
abstract classes. Proposal is to change them to interfaces. 

Further, a loader may also provide a guarantee that all instances of a key appear together
in one split. A similar loader is required for map-side groups PIG-984 . Currently, its assumed
that underlying loader is providing data in a way its expected. We should formalize this assumption
by introducing new interface and checking if loader is implementing it.

> Interface Refinements
> ---------------------
>                 Key: PIG-1292
>                 URL: https://issues.apache.org/jira/browse/PIG-1292
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.7.0
>            Reporter: Ashutosh Chauhan
>             Fix For: 0.7.0
> A loader can't implement both OrderedLoadFunc and IndexableLoadFunc, as both are abstract
classes instead of being interfaces.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message