hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Raghu Angadi (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-1149) DFS Scalability: high cpu usage in addStoredBlock
Date Tue, 03 Apr 2007 01:04:32 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-1149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Raghu Angadi updated HADOOP-1149:

    Attachment: HADOOP-1149.patch

Dhruba, attached patch calls processOverReplicatedBloc() only if numCurReplica is larger than
expected number. Also has couple of minor changes. 

Please review it and may you could use this patch in your test case.

> DFS Scalability: high cpu usage in addStoredBlock
> -------------------------------------------------
>                 Key: HADOOP-1149
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1149
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>            Reporter: dhruba borthakur
>         Assigned To: Raghu Angadi
>         Attachments: HADOOP-1149.patch
> I have seen addStoredBlock() consume lots of CPU. One possible cause is that it invokes
proccessOverReplicatedBlock. The logic to find and purge over-replicated blocks can be done
much less often.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message