hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Olga Natkovich (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-457) pig produces errors after a job is said to be 100% done
Date Wed, 01 Oct 2008 22:54:44 GMT

    [ https://issues.apache.org/jira/browse/PIG-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12636230#action_12636230
] 

Olga Natkovich commented on PIG-457:
------------------------------------

I reviewed the current code and the proposed changes.

The current code looks fine and should be doing the right thing. So it seems like the patch
is adding quite a bit of complexity to hide some sort of issues with hadoop progress.

I winder if the easiest change for now would be to check the progress and if it adds to 100%
not to report it until we check that the job successfully finished.

> pig produces errors after a job is said to be 100% done
> -------------------------------------------------------
>
>                 Key: PIG-457
>                 URL: https://issues.apache.org/jira/browse/PIG-457
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: types_branch
>            Reporter: Olga Natkovich
>            Assignee: Shravan Matthur Narayanamurthy
>             Fix For: types_branch
>
>         Attachments: 457-2.patch, 457-3.patch, 457-4.patch, 457-part2.patch
>
>
> It is possible that we get errors for all tasks even the ones we retried. Need to look
at the code that handles detecting end of processing and producing errors.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message