hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeff Zhang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1110) Handle compressed file formats -- Gz, BZip with the new proposal
Date Fri, 11 Dec 2009 17:31:18 GMT

    [ https://issues.apache.org/jira/browse/PIG-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12789408#action_12789408
] 

Jeff Zhang commented on PIG-1110:
---------------------------------

Hi Richard, I checked your code and find that pig use the output file extension to determined
whether the output should be compressed or non-compressed ( the code in trunk also do like
this). I do not think this method is good enough, because it enforce user to add .bz2 to as
the extension of output file. 

My suggestion is as follows:

Add a new constructor to PigStorage like PigStorage(String delimiter, String extension)

the extension indicate what file format user want to store 



> Handle compressed file formats -- Gz, BZip with the new proposal
> ----------------------------------------------------------------
>
>                 Key: PIG-1110
>                 URL: https://issues.apache.org/jira/browse/PIG-1110
>             Project: Pig
>          Issue Type: Sub-task
>            Reporter: Richard Ding
>            Assignee: Richard Ding
>         Attachments: PIG-1110.patch
>
>


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message