pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Olga Natkovich (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-457) pig produces errors after a job is said to be 100% done
Date Wed, 01 Oct 2008 22:54:44 GMT

    [ https://issues.apache.org/jira/browse/PIG-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12636230#action_12636230

Olga Natkovich commented on PIG-457:

I reviewed the current code and the proposed changes.

The current code looks fine and should be doing the right thing. So it seems like the patch
is adding quite a bit of complexity to hide some sort of issues with hadoop progress.

I winder if the easiest change for now would be to check the progress and if it adds to 100%
not to report it until we check that the job successfully finished.

> pig produces errors after a job is said to be 100% done
> -------------------------------------------------------
>                 Key: PIG-457
>                 URL: https://issues.apache.org/jira/browse/PIG-457
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: types_branch
>            Reporter: Olga Natkovich
>            Assignee: Shravan Matthur Narayanamurthy
>             Fix For: types_branch
>         Attachments: 457-2.patch, 457-3.patch, 457-4.patch, 457-part2.patch
> It is possible that we get errors for all tasks even the ones we retried. Need to look
at the code that handles detecting end of processing and producing errors.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message