Return-Path: 
 <issues-return-29094-apmail-tez-issues-archive=tez.apache.org@tez.apache.org>
X-Original-To: apmail-tez-issues-archive@minotaur.apache.org
Delivered-To: apmail-tez-issues-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 707E6195DB
	for <apmail-tez-issues-archive@minotaur.apache.org>;
 Sun, 28 Feb 2016 12:37:18 +0000 (UTC)
Received: (qmail 62263 invoked by uid 500); 28 Feb 2016 12:37:18 -0000
Delivered-To: apmail-tez-issues-archive@tez.apache.org
Received: (qmail 62206 invoked by uid 500); 28 Feb 2016 12:37:18 -0000
Mailing-List: contact issues-help@tez.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:issues-help@tez.apache.org>
List-Unsubscribe: <mailto:issues-unsubscribe@tez.apache.org>
List-Post: <mailto:issues@tez.apache.org>
List-Id: <issues.tez.apache.org>
Reply-To: dev@tez.apache.org
Delivered-To: mailing list issues@tez.apache.org
Received: (qmail 62177 invoked by uid 99); 28 Feb 2016 12:37:18 -0000
Received: from arcas.apache.org (HELO arcas) (140.211.11.28)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 28 Feb 2016 12:37:18 +0000
Received: from arcas.apache.org (localhost [127.0.0.1])
	by arcas (Postfix) with ESMTP id 1D1BC2C14F4
	for <issues@tez.apache.org>; Sun, 28 Feb 2016 12:37:18 +0000 (UTC)
Date: Sun, 28 Feb 2016 12:37:18 +0000 (UTC)
From: "Tsuyoshi Ozawa (JIRA)" <jira@apache.org>
To: issues@tez.apache.org
Message-ID: <JIRA.12767372.1421220233000.167229.1456663038116@Atlassian.JIRA>
In-Reply-To: <JIRA.12767372.1421220233000@Atlassian.JIRA>
References: <JIRA.12767372.1421220233000@Atlassian.JIRA>
 <JIRA.12767372.1421220233021@arcas>
Subject: [jira] [Commented] (TEZ-1944) OOM when using
 tez.runtime.shuffle.memory-to-memory.enable=true
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394


    [ https://issues.apache.org/jira/browse/TEZ-1944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171028#comment-15171028 ] 

Tsuyoshi Ozawa commented on TEZ-1944:
-------------------------------------

Can we close this as duplicated problem of TEZ-1911?

> OOM when using tez.runtime.shuffle.memory-to-memory.enable=true
> ---------------------------------------------------------------
>
>                 Key: TEZ-1944
>                 URL: https://issues.apache.org/jira/browse/TEZ-1944
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Rajesh Balamohan
>
> ETL workload at 10 TB scale 
> {code}
> $HIVE_HOME/bin/hive -hiveconf tez.runtime.io.sort.factor=200 --hiveconf hive.tez.auto.reducer.parallelism=true --hiveconf tez.am.heartbeat.interval-ms.max=20 --hiveconf tez.runtime.io.sort.mb=1200 --hiveconf tez.runtime.sort.threads=2 --hiveconf hive.tez.container.size=4096 --hiveconf tez.runtime.shuffle.memory-to-memory.enable=true --hiveconf tez.runtime.shuffle.memory-to-memory.segments=4
> create table testData as select ss_sold_date_sk,ss_sold_time_sk,ss_item_sk,ss_customer_sk,ss_quantity,ss_sold_date from store_sales distribute by ss_sold_date;
> {code}
> Tasks starts throwing OOM with the following exception.  
> {code}
> aused by: java.lang.OutOfMemoryError: Java heap space
>         at org.apache.hadoop.io.BoundedByteArrayOutputStream.<init>(BoundedByteArrayOutputStream.java:56)
>         at org.apache.hadoop.io.BoundedByteArrayOutputStream.<init>(BoundedByteArrayOutputStream.java:46)
>         at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MapOutput.<init>(MapOutput.java:81)
>         at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MapOutput.createMemoryMapOutput(MapOutput.java:133)
>         at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeManager.unconditionalReserve(MergeManager.java:397)
>         at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeManager.access$300(MergeManager.java:74)
>         at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeManager$IntermediateMemoryToMemoryMerger.merge(MergeManager.java:530)
>         at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeThread.run(MergeThread.java:89)
> , errorMessage=Shuffle Runner Failed:org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle$ShuffleError: error in shuffle in MemToMemMerger [Map_1]
>         at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle$RunShuffleCallable.call(Shuffle.java:349)
>         at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle$RunShuffleCallable.call(Shuffle.java:328)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
> {code}
> Created this to track issues related to memory to memory merging. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)