hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suresh Srinivas (JIRA)" <j...@apache.org>
Subject [jira] Created: (HDFS-1110) Namenode heap optimization - reuse objects for commonly used file names
Date Mon, 26 Apr 2010 18:43:32 GMT
Namenode heap optimization - reuse objects for commonly used file names
-----------------------------------------------------------------------

                 Key: HDFS-1110
                 URL: https://issues.apache.org/jira/browse/HDFS-1110
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Suresh Srinivas
            Assignee: Suresh Srinivas
             Fix For: 0.22.0


There are a lot of common file names used in HDFS, mainly created by mapreduce, such as file
names starting with "part". Reusing byte[] corresponding to these recurring file names will
save significant heap space used for storing the file names in millions of INodeFile objects.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message