hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Olga Natkovich (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-357) progress reported on every tuple
Date Mon, 04 Aug 2008 18:38:44 GMT

    [ https://issues.apache.org/jira/browse/PIG-357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12619635#action_12619635

Olga Natkovich commented on PIG-357:

I agree that it is a better solution but it adds more complexity to the system. We might choose
to do this later. The count while not optimal worked reasonably well in the past

> progress reported on every tuple
> --------------------------------
>                 Key: PIG-357
>                 URL: https://issues.apache.org/jira/browse/PIG-357
>             Project: Pig
>          Issue Type: Improvement
>    Affects Versions: types_branch
>            Reporter: Olga Natkovich
>             Fix For: types_branch
> Currently, if the reporter is set, we report progress on every tuple. This could be too
expensive and impact performance. In the old code, we used to do it on every 1000th tuple
or something like that.
> We might want to go to similar model.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message