hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bharat Viswanadham (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDDS-48) ContainerIO - Storage Management
Date Sat, 12 May 2018 16:59:00 GMT

    [ https://issues.apache.org/jira/browse/HDDS-48?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16473197#comment-16473197

Bharat Viswanadham commented on HDDS-48:

Attached the design document of Datanode Disk Layout refactoring.

Pls have a look at it and provide your comments. 


> ContainerIO - Storage Management
> --------------------------------
>                 Key: HDDS-48
>                 URL: https://issues.apache.org/jira/browse/HDDS-48
>             Project: Hadoop Distributed Data Store
>          Issue Type: Improvement
>            Reporter: Hanisha Koneru
>            Assignee: Hanisha Koneru
>            Priority: Major
>         Attachments: ContainerIO-StorageManagement-DesignDoc.pdf, HDDS DataNode Disk
> We propose refactoring the HDDS DataNode IO path to enforce clean separation between
the Container management and the Storage layers. All components requiring access to HDDS containers
on a Datanode should do so via this Storage layer.
> The proposed Storage layer would be responsible for end-to-end disk and volume management.
This involves running disk checks and detecting disk failures, distributing data across disks
as per the configured policy, collecting performance statistics and verifying the integrity
of the data. 
> Attached Design Doc gives an overview of the proposed class diagram.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message