hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron T. Myers (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-4465) Optimize datanode ReplicasMap and ReplicaInfo
Date Wed, 19 Jun 2013 22:00:23 GMT

     [ https://issues.apache.org/jira/browse/HDFS-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Aaron T. Myers updated HDFS-4465:
---------------------------------

    Attachment: HDFS-4465.patch

Here's a more polished patch which implements the changes I previously described. The patch
is a bit smaller than the previous one because some of the refactoring of LightWeightGSet
was already done in other unrelated JIRAs, but the approach is still the same.
                
> Optimize datanode ReplicasMap and ReplicaInfo
> ---------------------------------------------
>
>                 Key: HDFS-4465
>                 URL: https://issues.apache.org/jira/browse/HDFS-4465
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
>         Attachments: dn-memory-improvements.patch, HDFS-4465.patch
>
>
> In Hadoop a lot of optimization has been done in namenode data structures to be memory
efficient. Similar optimizations are necessary for Datanode process. With the growth in storage
per datanode and number of blocks hosted on datanode, this jira intends to optimize long lived
ReplicasMap and ReplicaInfo objects.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message