pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jarek Jarcec Cecho (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-3717) AvroStorage is not filtering hidden files on directory recursion
Date Thu, 23 Jan 2014 20:57:46 GMT

    [ https://issues.apache.org/jira/browse/PIG-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13880347#comment-13880347
] 

Jarek Jarcec Cecho commented on PIG-3717:
-----------------------------------------

Do you think that we can go ahead and commit this one separately or would you prefer to cover
it by your patch [~rohini]?

> AvroStorage is not filtering hidden files on directory recursion
> ----------------------------------------------------------------
>
>                 Key: PIG-3717
>                 URL: https://issues.apache.org/jira/browse/PIG-3717
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.12.0
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Jarek Jarcec Cecho
>             Fix For: 0.13.0
>
>         Attachments: PIG-3717.patch, PIG-3717.patch
>
>
> We've noticed that when we generate couple of sub-directories with Oozie and then use
AvroStorage (the older version from PiggyBank) to load those directories, hidden files such
as {{_SUCCESS}} won't get ignored as they should be and in turn will cause failures in the
Pig job. This seems to be regression caused by PIG-3223.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message