pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cheolsoo Park (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (PIG-2553) Pig shouldn't allow attempts to write multiple relations into same directory
Date Mon, 18 Feb 2013 01:39:13 GMT

     [ https://issues.apache.org/jira/browse/PIG-2553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Cheolsoo Park resolved PIG-2553.

       Resolution: Fixed
    Fix Version/s: 0.12
     Release Note: To enforce strict checking of output location, set "pig.location.check.strict=true".
By default, it is false.

Committed to trunk. Thanks Prashant!
> Pig shouldn't allow attempts to write multiple relations into same directory
> ----------------------------------------------------------------------------
>                 Key: PIG-2553
>                 URL: https://issues.apache.org/jira/browse/PIG-2553
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Dmitriy V. Ryaboy
>            Assignee: Prashant Kommireddi
>             Fix For: 0.12
>         Attachments: PIG-2553_1.patch, PIG-2553_2.patch, PIG-2553.patch
> We've seen multiple occasions where users accidentally try to store 2 or more different
relations to the same destination directory. Currently, this passes the Pig planner and fails
on MR side due to concurrent attempts to create the same part file on the reducer. This is
extremely confusing to the user, and hard to debug.
> We should instead fail their scripts before they are even submitted, since we can identify
the erroneous condition from the beginning.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message