From hadoop-dev-return-7700-apmail-lucene-hadoop-dev-archive=lucene.apache.org@lucene.apache.org Thu Feb 08 19:59:43 2007 Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 33855 invoked from network); 8 Feb 2007 19:59:36 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 8 Feb 2007 19:59:35 -0000 Received: (qmail 77566 invoked by uid 500); 8 Feb 2007 19:59:35 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 77531 invoked by uid 500); 8 Feb 2007 19:59:35 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 77490 invoked by uid 99); 8 Feb 2007 19:59:35 -0000 Received: from herse.apache.org (HELO herse.apache.org) (140.211.11.133) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Feb 2007 11:59:35 -0800 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Feb 2007 11:59:26 -0800 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 6BDB341095B for ; Thu, 8 Feb 2007 11:59:06 -0800 (PST) Message-ID: <20902584.1170964746439.JavaMail.jira@brutus> Date: Thu, 8 Feb 2007 11:59:06 -0800 (PST) From: "Hairong Kuang (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Commented: (HADOOP-803) Reducing memory consumption on Namenode : Part 1 In-Reply-To: <20960270.1165538721047.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12471467 ] Hairong Kuang commented on HADOOP-803: -------------------------------------- In the patch the type of the field "blocks" in DatanodeDescriptor is changed from TreeSet to TreeMap. I think type TreeSet is the same as TreeMap, but with a cleaner interface. Is there any reason that we need the change? > Reducing memory consumption on Namenode : Part 1 > ------------------------------------------------ > > Key: HADOOP-803 > URL: https://issues.apache.org/jira/browse/HADOOP-803 > Project: Hadoop > Issue Type: Bug > Components: dfs > Reporter: Raghu Angadi > Assigned To: Raghu Angadi > Fix For: 0.12.0 > > Attachments: block-refs-2.patch, block-refs-3.patch, block-refs-5.patch, HADOOP-803-2.patch, HADOOP-803.patch, HADOOP-803_3.patch, HADOOP-803_4.patch, NameNodeMemoryHogs.txt > > > There appears to be some places in Namenode that allow reducing memory consumption without intrusive code or feature changes. This bug is an initial attempt making those changes. Please include your thoughts as well. > One change I am planning to make : > Currently one copy of each block exists for each of the replicas and one copy for blockMap. I think they are all supposed to be same. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.