pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-4730) [Pig on Tez] Total parallelism estimation does not account load parallelism
Date Mon, 09 Nov 2015 23:24:11 GMT

    [ https://issues.apache.org/jira/browse/PIG-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14997638#comment-14997638
] 

Daniel Dai commented on PIG-4730:
---------------------------------

+1

> [Pig on Tez] Total parallelism estimation does not account load parallelism
> ---------------------------------------------------------------------------
>
>                 Key: PIG-4730
>                 URL: https://issues.apache.org/jira/browse/PIG-4730
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: 0.16.0
>
>         Attachments: PIG-4730-1.patch
>
>
> Total parallelism estimation in ParallelismSetter which is used to auto increment AM
size does not include parallelism of load vertices causing the estimation to be wrong and
not incrementing AM memory in cases where it is needed leading to OOM.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message