hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-231) validation of files in ship/cache specs
Date Wed, 07 May 2008 08:17:56 GMT

     [ https://issues.apache.org/jira/browse/PIG-231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Arun C Murthy updated PIG-231:

    Attachment: PIG-231_0_20080507.patch

Patch to validate ship/cache specs and stream.skippath.

Pi, I've had to split the validation between StreamingCommand and GruntParser and can't reuse
any existing class since ValidatingInputSpec was the only option, but ship/cache specs aren't
really FileSpecs... I'd be happy to fix this once your branch becomes mainstream. Does that
work? Thanks!

> validation of files in ship/cache specs
> ---------------------------------------
>                 Key: PIG-231
>                 URL: https://issues.apache.org/jira/browse/PIG-231
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Olga Natkovich
>            Assignee: Arun C Murthy
>         Attachments: PIG-231_0_20080507.patch
> Currently the code fails after map reduce job starts if files for ship/cache don't exist.
> We should be able to detect that on the client side.
> For ship, make sure that the file(s) to be shipped exist on the client
> For cache, make sure it exists on the server.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message