hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bharat Viswanadham (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDDS-48) ContainerIO - Storage Management
Date Sat, 12 May 2018 16:59:00 GMT

    [ https://issues.apache.org/jira/browse/HDDS-48?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16473197#comment-16473197
] 

Bharat Viswanadham commented on HDDS-48:
----------------------------------------

Attached the design document of Datanode Disk Layout refactoring.

Pls have a look at it and provide your comments. 

 

> ContainerIO - Storage Management
> --------------------------------
>
>                 Key: HDDS-48
>                 URL: https://issues.apache.org/jira/browse/HDDS-48
>             Project: Hadoop Distributed Data Store
>          Issue Type: Improvement
>            Reporter: Hanisha Koneru
>            Assignee: Hanisha Koneru
>            Priority: Major
>         Attachments: ContainerIO-StorageManagement-DesignDoc.pdf, HDDS DataNode Disk
Layout.pdf
>
>
> We propose refactoring the HDDS DataNode IO path to enforce clean separation between
the Container management and the Storage layers. All components requiring access to HDDS containers
on a Datanode should do so via this Storage layer.
> The proposed Storage layer would be responsible for end-to-end disk and volume management.
This involves running disk checks and detecting disk failures, distributing data across disks
as per the configured policy, collecting performance statistics and verifying the integrity
of the data. 
> Attached Design Doc gives an overview of the proposed class diagram.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message