pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitriy V. Ryaboy (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PIG-2143) Improvements for PigStorage
Date Mon, 11 Jul 2011 07:13:59 GMT

     [ https://issues.apache.org/jira/browse/PIG-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Dmitriy V. Ryaboy updated PIG-2143:
-----------------------------------

    Fix Version/s: 0.10
           Status: Patch Available  (was: Open)

I did some work on the compression thing, and had a second thought. Let's keep these changes
isolated from each other. This code is already pretty baked (in PigStorageSchema) so it's
probably better to make the other changes separately. Marking this as ready for review; will
open separate tickets for the other improvements.

> Improvements for PigStorage
> ---------------------------
>
>                 Key: PIG-2143
>                 URL: https://issues.apache.org/jira/browse/PIG-2143
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Dmitriy V. Ryaboy
>            Assignee: Dmitriy V. Ryaboy
>             Fix For: 0.10
>
>         Attachments: PIG-2143.diff
>
>
> I'd like to propose that we allow for a greater degree of customization in PigStorage.
> An incomplete list features that we might want to add:
> - flag to tell it to overwrite existing output if it exists
> - flag to tell it to compress output using gzip|bzip|lzo (currently this can be achieved
by setting the directory name to end in .gz or .bz2, which is a bit awkward)
> - flag to tell it to store the schema and header (perhaps by merging in PigStorageSchema
work?)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message