hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hanisha Koneru (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDDS-48) ContainerIO - Storage Management
Date Fri, 11 May 2018 22:47:00 GMT
Hanisha Koneru created HDDS-48:

             Summary: ContainerIO - Storage Management
                 Key: HDDS-48
                 URL: https://issues.apache.org/jira/browse/HDDS-48
             Project: Hadoop Distributed Data Store
          Issue Type: Improvement
            Reporter: Hanisha Koneru
            Assignee: Hanisha Koneru
         Attachments: ContainerIO-StorageManagement-DesignDoc.pdf

We propose refactoring the HDDS DataNode IO path to enforce clean separation between the Container
management and the Storage layers. All components requiring access to HDDS containers on a
Datanode should do so via this Storage layer.

The proposed Storage layer would be responsible for end-to-end disk and volume management.
This involves running disk checks and detecting disk failures, distributing data across disks
as per the configured policy, collecting performance statistics and verifying the integrity
of the data. 

Attached Design Doc gives an overview of the proposed class diagram.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org

View raw message