pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-3117) A debug mode in which pig does not delete temporary files
Date Thu, 29 Aug 2013 00:59:52 GMT

    [ https://issues.apache.org/jira/browse/PIG-3117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13753136#comment-13753136

Daniel Dai commented on PIG-3117:

[~ihadanny], the patch is empty.
> A debug mode in which pig does not delete temporary files
> ---------------------------------------------------------
>                 Key: PIG-3117
>                 URL: https://issues.apache.org/jira/browse/PIG-3117
>             Project: Pig
>          Issue Type: Wish
>    Affects Versions: 0.10.0, 0.11.1
>            Reporter: Ido Hadanny
>            Assignee: Cheolsoo Park
>             Fix For: 0.12
>         Attachments: remove_intermediate_results.diff
> when we debug our pig jobs on pre-production data, we usually find bugs we couldn't detect
in our UT, as env and data are not quite the same.
> when the final output of a script is not quite what we expect, we start divide-and-conquer,
running it line by line and inspecting the intermediate output of each stage. 
> It would be great if we could simply configure pig not to delete the intermediate MR
outputs, and store them as plaintext instead of snappy format.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message