hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Created: (HDFS-1093) Improve namenode scalability by splitting the FSNamesystem synchronized section in a read/write lock
Date Mon, 12 Apr 2010 05:39:48 GMT
Improve namenode scalability by splitting the FSNamesystem synchronized section in a read/write
lock
----------------------------------------------------------------------------------------------------

                 Key: HDFS-1093
                 URL: https://issues.apache.org/jira/browse/HDFS-1093
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: dhruba borthakur
            Assignee: dhruba borthakur


Most critical data structures in the NameNode (NN) are protected by a syncronized methods
in the FSNamesystem class. This essentially makes critical code paths in the NN single-threaded.
However, a large percentage of the NN calls are listStatus, getBlockLocations, etc which do
not change internal data structures at all, these are read-only calls. If we change the FSNamesystem
lock to a read/write lock, many of the above operations can occur in parallel, thus improving
the scalability of the NN.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message