pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bill Graham (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PIG-2870) pigServer.openIterator fails for jobs with no input splits
Date Mon, 13 Aug 2012 01:42:37 GMT

     [ https://issues.apache.org/jira/browse/PIG-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Bill Graham updated PIG-2870:

    Attachment: PIG-2870.1.patch

Here's a unit test and a patch.
> pigServer.openIterator fails for jobs with no input splits
> ----------------------------------------------------------
>                 Key: PIG-2870
>                 URL: https://issues.apache.org/jira/browse/PIG-2870
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.11
>            Reporter: Bill Graham
>            Assignee: Bill Graham
>         Attachments: PIG-2870.1.patch
> Jobs that have valid input data, but 0 input splits (this is the case where indexing
implemented in the {{InputFormat}} might return 0 splits for an aggressive filter) fail when
{{pigServer.openIterator}} is called. This is because {{mapred.output.dir}} isn't set, so
the job succeeds without creating the empty output directory. The {{ReadToEndLoader}} then
fails due to the null input directory.
> It seems PIG-2578 introduced this issue. 

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message