hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suresh Srinivas (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-4988) Datanode must support all the volumes as individual storages
Date Fri, 12 Jul 2013 22:07:48 GMT
Suresh Srinivas created HDFS-4988:
-------------------------------------

             Summary: Datanode must support all the volumes as individual storages
                 Key: HDFS-4988
                 URL: https://issues.apache.org/jira/browse/HDFS-4988
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: Suresh Srinivas


Currently all the volumes on datanode is reported as a single storage. This change proposes
reporting them as individual storage. This requires:
# A unique storage ID for each storage
#* This needs to be generated during formatting
# There should be an option to allow existing disks to be reported as single storage unit
for backward compatibility.
# A functionality is also needed to split the existing all volumes as single storage unit
to to individual storage units.
# Configuration must allow for each storage unit a storage type attribute.
# Block reports must be sent on a per storage basis. In some cases (such memory tier) block
reports may need to be sent more frequently. That means block reporting period must be on
a per storage type basis.

My proposal is for new clusters to configure volumes by default as separate storage unit.
Lets discuss.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message