hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-259) allow store to overwrite existing directroy
Date Tue, 09 Feb 2010 00:15:28 GMT

    [ https://issues.apache.org/jira/browse/PIG-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831205#action_12831205

Alan Gates commented on PIG-259:

Sorry, I missed that it was already for load-store redesign.

In the new load/store scheme we can't assume that outputs are files.  So putting a DFS remove
statement into JobControlCompiler won't be the right way to do this.  What does overwrite
mean when we're storing to HBase instead of DFS?  It seems that this needs to be defined on
the per store function basis, which implies it needs to somehow be part of the store function
interface.  This could be done by adding a boolean to validate or by adding a new method to
the StoreFunc interface to overwrite.

> allow store to overwrite existing directroy
> -------------------------------------------
>                 Key: PIG-259
>                 URL: https://issues.apache.org/jira/browse/PIG-259
>             Project: Pig
>          Issue Type: Sub-task
>    Affects Versions: 0.8.0
>            Reporter: Olga Natkovich
>            Assignee: Jeff Zhang
>             Fix For: 0.8.0
>         Attachments: Pig_259.patch, Pig_259_2.patch
> we have users who are asking for a flag to overwrite existing directory

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message