hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Santhosh Srinivasan (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-646) Distinct UDF should report progress
Date Fri, 30 Jan 2009 03:36:59 GMT

     [ https://issues.apache.org/jira/browse/PIG-646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Santhosh Srinivasan updated PIG-646:
------------------------------------

    Attachment: PIG-646.patch

Attached patch fixes the issue with reporting progress in Distinct.java and also sets up the
reporter correctly in PigCombiner.java and PigMapReduce.ReduceWithComparator. In addition
there are unit test cases in TestBuiltin.java and TestEvalPipeline.java

All unit tests pass.

> Distinct UDF should report progress
> -----------------------------------
>
>                 Key: PIG-646
>                 URL: https://issues.apache.org/jira/browse/PIG-646
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Olga Natkovich
>            Assignee: Santhosh Srinivasan
>         Attachments: PIG-646.patch
>
>
> We have seen the case where if a bag passed to distinct UDF is too large to fit into
main memory the job fails with a time out because no progress is reported.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message