Return-Path: X-Original-To: apmail-tez-issues-archive@minotaur.apache.org Delivered-To: apmail-tez-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 82A74181C7 for ; Tue, 23 Feb 2016 18:01:26 +0000 (UTC) Received: (qmail 22377 invoked by uid 500); 23 Feb 2016 18:01:18 -0000 Delivered-To: apmail-tez-issues-archive@tez.apache.org Received: (qmail 22322 invoked by uid 500); 23 Feb 2016 18:01:18 -0000 Mailing-List: contact issues-help@tez.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@tez.apache.org Delivered-To: mailing list issues@tez.apache.org Received: (qmail 22292 invoked by uid 99); 23 Feb 2016 18:01:18 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 23 Feb 2016 18:01:18 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 232282C14E1 for ; Tue, 23 Feb 2016 18:01:18 +0000 (UTC) Date: Tue, 23 Feb 2016 18:01:18 +0000 (UTC) From: "Rohini Palaniswamy (JIRA)" To: issues@tez.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (TEZ-2962) Use per partition stats in shuffle vertex manager auto parallelism MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/TEZ-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated TEZ-2962: ------------------------------------ Priority: Critical (was: Major) > Use per partition stats in shuffle vertex manager auto parallelism > ------------------------------------------------------------------ > > Key: TEZ-2962 > URL: https://issues.apache.org/jira/browse/TEZ-2962 > Project: Apache Tez > Issue Type: Bug > Reporter: Bikas Saha > Priority: Critical > > The original code used output size sent by completed tasks. Recently per partition stats have been added that provide granular information. Using partition stats may be more accurate and also remove the duplicate counting of data size in partition stats and per task overall. -- This message was sent by Atlassian JIRA (v6.3.4#6332)