hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Utkarsh Srivastava <utka...@yahoo-inc.com>
Subject Re: [jira] Commented: (PIG-55) Allow user control over split creation
Date Thu, 17 Jan 2008 00:33:46 GMT
Antonio, can you review this patch before it is committed? I can see  
it affecting the abstraction layer a lot.
On Jan 16, 2008, at 3:48 PM, Alan Gates (JIRA) wrote:

>
>     [ https://issues.apache.org/jira/browse/PIG-55? 
> page=com.atlassian.jira.plugin.system.issuetabpanels:comment- 
> tabpanel&focusedCommentId=12559743#action_12559743 ]
>
> Alan Gates commented on PIG-55:
> -------------------------------
>
> All the unit and end to end tests pass.  Ben, as long as you're  
> ready to give a +1, I can commit this.
>
>> Allow user control over split creation
>> --------------------------------------
>>
>>                 Key: PIG-55
>>                 URL: https://issues.apache.org/jira/browse/PIG-55
>>             Project: Pig
>>          Issue Type: Improvement
>>            Reporter: Charlie Groves
>>         Attachments: replaceable_PigSplit.diff,  
>> replaceable_PigSplit_v2.diff
>>
>>
>> I have a dataset in HDFS that's stored in a file per column that  
>> I'd like to access from pig.  This means I can't use LoadFunc to  
>> get at the data as it only allows the loader access to a single  
>> input stream at a time.  To handle this usage, I've broken the  
>> existing split creation code out into a few classes and  
>> interfaces, and allowed user specified load functions to be used  
>> in place of the existing code.
>
> -- 
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>


Mime
View raw message