Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hadoop-dev@lucene.apache.org
Message-ID: <26220496.1175562272592.JavaMail.jira@brutus>
Date: Mon, 2 Apr 2007 18:04:32 -0700 (PDT)
From: "Raghu Angadi (JIRA)" <jira@apache.org>
To: hadoop-dev@lucene.apache.org
Subject: [jira] Updated: (HADOOP-1149) DFS Scalability: high cpu usage in
 addStoredBlock
In-Reply-To: <20257411.1174596752175.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/HADOOP-1149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Raghu Angadi updated HADOOP-1149:
---------------------------------

    Attachment: HADOOP-1149.patch


Dhruba, attached patch calls processOverReplicatedBloc() only if numCurReplica is larger than expected number. Also has couple of minor changes. 

Please review it and may you could use this patch in your test case.
Thanks.

> DFS Scalability: high cpu usage in addStoredBlock
> -------------------------------------------------
>
>                 Key: HADOOP-1149
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1149
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>            Reporter: dhruba borthakur
>         Assigned To: Raghu Angadi
>         Attachments: HADOOP-1149.patch
>
>
> I have seen addStoredBlock() consume lots of CPU. One possible cause is that it invokes proccessOverReplicatedBlock. The logic to find and purge over-replicated blocks can be done much less often.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.