From issues-return-43532-archive-asf-public=cust-asf.ponee.io@tez.apache.org Tue Jan 19 03:41:04 2021 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-ec2-va.apache.org (mxout1-ec2-va.apache.org [3.227.148.255]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id 006DA18064F for ; Tue, 19 Jan 2021 04:41:03 +0100 (CET) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-ec2-va.apache.org (ASF Mail Server at mxout1-ec2-va.apache.org) with SMTP id 3A3B743FB0 for ; Tue, 19 Jan 2021 03:41:03 +0000 (UTC) Received: (qmail 11460 invoked by uid 500); 19 Jan 2021 03:41:02 -0000 Mailing-List: contact issues-help@tez.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@tez.apache.org Delivered-To: mailing list issues@tez.apache.org Received: (qmail 11435 invoked by uid 99); 19 Jan 2021 03:41:01 -0000 Received: from ec2-52-204-25-47.compute-1.amazonaws.com (HELO mailrelay1-ec2-va.apache.org) (52.204.25.47) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Jan 2021 03:41:01 +0000 Received: from jira2-he-de.apache.org (jira2-he-de.apache.org [168.119.33.54]) by mailrelay1-ec2-va.apache.org (ASF Mail Server at mailrelay1-ec2-va.apache.org) with ESMTPS id 80EB93EABC for ; Tue, 19 Jan 2021 03:41:01 +0000 (UTC) Received: from jira2-he-de.apache.org (localhost.localdomain [127.0.0.1]) by jira2-he-de.apache.org (ASF Mail Server at jira2-he-de.apache.org) with ESMTP id A87EAC8064E for ; Tue, 19 Jan 2021 03:41:00 +0000 (UTC) Date: Tue, 19 Jan 2021 03:41:00 +0000 (UTC) From: "yanbin.zhang (Jira)" To: issues@tez.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (TEZ-4262) Integer overflow in unordered.output.buffer.size-mb MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/TEZ-4262?page=3Dcom.atlassian.j= ira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D172676= 26#comment-17267626 ]=20 yanbin.zhang commented on TEZ-4262: ----------------------------------- @jonathan Turner eagles =EF=BC=8Cyes ,you are right .Our tez version is 0.9= .0=E3=80=82Thank you very much for your reply. > Integer overflow in unordered.output.buffer.size-mb=20 > ---------------------------------------------------- > > Key: TEZ-4262 > URL: https://issues.apache.org/jira/browse/TEZ-4262 > Project: Apache Tez > Issue Type: Bug > Reporter: yanbin.zhang > Assignee: yanbin.zhang > Priority: Critical > Attachments: TEZ-4262.test.patch > > Time Spent: 10m > Remaining Estimate: 0h > > The value of the tez.runtime.unordered.output.buffer.size-mb parameter ex= ceeds the range of the int type=E3=80=82 > Exception thrown is given below=EF=BC=9A > 2020-12-30 14:57:37,762 [INFO] [Dispatcher thread \{Central}] |HistoryEve= ntHandler.criticalEvents|: [HISTORY][DAG:dag_1609310178038_0003_1][Event:TA= SK_ATTEMPT_FINISHED]: vertexName=3DMap 1, taskAttemptId=3Dattempt_160931017= 8038_0003_1_00_000160_0, creationTime=3D1609311453532, allocationTime=3D160= 9311455291, startTime=3D1609311457280, finishTime=3D1609311457744, timeTake= n=3D464, status=3DFAILED, taskFailureType=3DNON_FATAL, errorEnum=3DFRAMEWOR= K_ERROR, diagnostics=3DError: Error while running task ( failure ) : attemp= t_1609310178038_0003_1_00_000160_0:java.lang.IllegalArgumentException2020-1= 2-30 14:57:37,762 [INFO] [Dispatcher thread \{Central}] |HistoryEventHandle= r.criticalEvents|: [HISTORY][DAG:dag_1609310178038_0003_1][Event:TASK_ATTEM= PT_FINISHED]: vertexName=3DMap 1, taskAttemptId=3Dattempt_1609310178038_000= 3_1_00_000160_0, creationTime=3D1609311453532, allocationTime=3D16093114552= 91, startTime=3D1609311457280, finishTime=3D1609311457744, timeTaken=3D464,= status=3DFAILED, taskFailureType=3DNON_FATAL, errorEnum=3DFRAMEWORK_ERROR,= diagnostics=3DError: Error while running task ( failure ) : attempt_160931= 0178038_0003_1_00_000160_0:java.lang.IllegalArgumentException at com.google= .common.base.Preconditions.checkArgument(Preconditions.java:108) at org.apa= che.tez.runtime.common.resources.MemoryDistributor.registerRequest(MemoryDi= stributor.java:177) at org.apache.tez.runtime.common.resources.MemoryDistri= butor.requestMemory(MemoryDistributor.java:110) at org.apache.tez.runtime.a= pi.impl.TezTaskContextImpl.requestInitialMemory(TezTaskContextImpl.java:214= ) at org.apache.tez.runtime.library.output.UnorderedPartitionedKVOutput.ini= tialize(UnorderedPartitionedKVOutput.java:76) at org.apache.tez.runtime.Log= icalIOProcessorRuntimeTask$InitializeOutputCallable._callInternal(LogicalIO= ProcessorRuntimeTask.java:550) at org.apache.tez.runtime.LogicalIOProcessor= RuntimeTask$InitializeOutputCallable.callInternal(LogicalIOProcessorRuntime= Task.java:533) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$Init= ializeOutputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:518) a= t org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at ja= va.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurr= ent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurr= ent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolE= xecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.Thr= eadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread= .run(Thread.java:748) -- This message was sent by Atlassian Jira (v8.3.4#803005)