hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pradeep Kamath (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-653) Make fieldsToRead work in loader
Date Tue, 10 Feb 2009 19:11:59 GMT

     [ https://issues.apache.org/jira/browse/PIG-653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Pradeep Kamath updated PIG-653:
-------------------------------

    Attachment: PIG-653-3-proposal.txt

Introduced a boolean into RequiredField to indicate if all sub fields are required. The reason
I feel we cannot use RequiredFieldList internally in RequiredField to represent the subfields
is that REquiredFieldList is meant to be a class for communicating about the top level required
fields. In the future the extensions added to it may only make sense at the top level and
hence would not fit well for the sub fields.

I have attached the third version of the proposal with the above changes and have explicitly
listed the getters in the classes since these will be used by loaders.

> Make fieldsToRead work in loader
> --------------------------------
>
>                 Key: PIG-653
>                 URL: https://issues.apache.org/jira/browse/PIG-653
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Alan Gates
>            Assignee: Pradeep Kamath
>         Attachments: PIG-653-2.comment, PIG-653-3-proposal.txt
>
>
> Currently pig does not call the fieldsToRead function in LoadFunc, thus it does not provide
information to load functions on what fields are needed.  We need to implement a visitor that
determines (where possible) which fields in a file will be used and relays that information
to the load function.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message