hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uma Maheswara Rao G (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-12911) [SPS]: Fix review comments from discussions in HDFS-10285
Date Fri, 08 Dec 2017 23:51:00 GMT
Uma Maheswara Rao G created HDFS-12911:

             Summary: [SPS]: Fix review comments from discussions in HDFS-10285
                 Key: HDFS-12911
                 URL: https://issues.apache.org/jira/browse/HDFS-12911
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: datanode, namenode
            Reporter: Uma Maheswara Rao G
            Assignee: Rakesh R

This is the JIRA for tracking the possible improvements or issues discussed in main JIRA

So, far from Daryn:
  1. Lock should not kept while executing placement policy.
   2. While starting up the NN, SPS Xattrs checks happen even if feature disabled. This could
potentially impact the startup speed. 

I am adding one more possible improvement to reduce Xattr objects significantly.
 SPS Xattr is constant object. So, we create one Xattr deduplication object once statically
and use the same object reference when required to add SPS Xattr to Inode. So, here additional
bytes required for storing SPS Xattr would turn to same as single object ref ( i.e 4 bytes
in 32 bit). So Xattr overhead should come down significantly IMO. Lets explore the feasibility
on this option.

Xattr list Future will not be specially created for SPS, that list would have been created
by SetStoragePolicy already on the same directory. So, no extra Future creation because of
SPS alone.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message