Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Thu, 7 Sep 2017 02:29:00 +0000 (UTC)
From: "Jiandan Yang  (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.13100347.1504751289000.45635.1504751340075@Atlassian.JIRA>
In-Reply-To: <JIRA.13100347.1504751289000@Atlassian.JIRA>
References: <JIRA.13100347.1504751289000@Atlassian.JIRA> <JIRA.13100347.1504751289644@jira-lw-us.apache.org>
Subject: [jira] [Created] (YARN-7168) The size of dataQueue and ackQueue in
 DataStreamer has no limit when writer thread is interrupted
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Thu, 07 Sep 2017 02:29:10 -0000

Jiandan Yang  created YARN-7168:
-----------------------------------

             Summary: The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted
                 Key: YARN-7168
                 URL: https://issues.apache.org/jira/browse/YARN-7168
             Project: Hadoop YARN
          Issue Type: Bug
          Components: client
            Reporter: Jiandan Yang 


In our cluster, when found NodeManager frequently FullGC when decommissioning NodeManager, and we found the biggest object is dataQueue of DataStreamer, it has almost 6w DFSPacket, and every DFSPacket is about 64k.
!mat.jpg|memory_analysis!
The root reason is that the size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted. I know NodeManager may stop writing when interruped, but DFSOutputStream also could do something to avoid fullgc


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org