hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitriy V. Ryaboy (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-259) allow store to overwrite existing directroy
Date Tue, 09 Feb 2010 01:07:27 GMT

    [ https://issues.apache.org/jira/browse/PIG-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831237#action_12831237

Dmitriy V. Ryaboy commented on PIG-259:

Yeah I think it makes more sense on that level.
I think it's worth our while to add it to PigStorage and any other built-in engines though.
Otherwise it's not clear what the overwrite keyword means. If it's HBase, does it mean drop
the table and overwrite? Or delete old values when there is an old confilct? Does that mean
we don't delete them otherwise? What about appends? 

This request made more sense when Pig maintained strong control over file creation and such,
but now that it's pushed into IOFormats, I think it's ok to push this functionality there
as well.

It's just a lot of stuff I think we don't want to be in the business of creating interfaces
for. Different storage engines have different options for what they can and can't do.

> allow store to overwrite existing directroy
> -------------------------------------------
>                 Key: PIG-259
>                 URL: https://issues.apache.org/jira/browse/PIG-259
>             Project: Pig
>          Issue Type: Sub-task
>    Affects Versions: 0.8.0
>            Reporter: Olga Natkovich
>            Assignee: Jeff Zhang
>             Fix For: 0.8.0
>         Attachments: Pig_259.patch, Pig_259_2.patch
> we have users who are asking for a flag to overwrite existing directory

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message