Mailing-List: contact dev-help@pig.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@pig.apache.org
Date: Mon, 9 Nov 2015 23:24:11 +0000 (UTC)
From: "Daniel Dai (JIRA)" <jira@apache.org>
To: pig-dev@hadoop.apache.org
Message-ID: <JIRA.12911660.1447102026000.21955.1447111451253@Atlassian.JIRA>
In-Reply-To: <JIRA.12911660.1447102026000@Atlassian.JIRA>
References: <JIRA.12911660.1447102026000@Atlassian.JIRA>
 <JIRA.12911660.1447102026667@arcas>
Subject: [jira] [Commented] (PIG-4730) [Pig on Tez] Total parallelism
 estimation does not account load parallelism
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/PIG-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14997638#comment-14997638 ] 

Daniel Dai commented on PIG-4730:
---------------------------------

+1

> [Pig on Tez] Total parallelism estimation does not account load parallelism
> ---------------------------------------------------------------------------
>
>                 Key: PIG-4730
>                 URL: https://issues.apache.org/jira/browse/PIG-4730
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: 0.16.0
>
>         Attachments: PIG-4730-1.patch
>
>
> Total parallelism estimation in ParallelismSetter which is used to auto increment AM size does not include parallelism of load vertices causing the estimation to be wrong and not incrementing AM memory in cases where it is needed leading to OOM.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)