pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-258) Pig should cleanup output directory of a failed query
Date Thu, 26 Jun 2008 22:19:45 GMT

    [ https://issues.apache.org/jira/browse/PIG-258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12608608#action_12608608

Daniel Dai commented on PIG-258:

Currently only one POStore in one physical plan, so if the execution of a physical plan fails,
remove the associated output file.

Here is the plan:
1. Create an entry deleteOnFail in FileLocalizer
2. Capture POStore in physical plan. We can put this code in MRCompiler.compile
3. Clear deteleOnFail before execution of any physical plan
4. After an unsuccessful execution of a physical plan, remove output file if it exists. Add
this in PigServer.execute 

I will create a patch shortly if no problem

> Pig should cleanup output directory of a failed query
> -----------------------------------------------------
>                 Key: PIG-258
>                 URL: https://issues.apache.org/jira/browse/PIG-258
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Olga Natkovich
>            Priority: Minor
> Currently, after a failed store, the output directory is left behind and can't be re-used
without manual cleanup

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message