hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS
Date Fri, 06 Sep 2013 18:49:57 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13760509#comment-13760509
] 

Arpit Agarwal commented on HDFS-2832:
-------------------------------------

Thanks for the feedback Eric. Both of these would be good to have and came up during design
discussions but we have not addressed either.

For #2, in addition to your points there are other locations where storage directories are
assumed to be File-addressable. I am not sure of the amount of work involved here.

Multiple replicas per Datanode looks easier and can be done on top of the Heterogeneous Storage
work. We would need phase 1 of the feature to support multiple storages.
                
> Enable support for heterogeneous storages in HDFS
> -------------------------------------------------
>
>                 Key: HDFS-2832
>                 URL: https://issues.apache.org/jira/browse/HDFS-2832
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>    Affects Versions: 0.24.0
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
>         Attachments: 20130813-HeterogeneousStorage.pdf
>
>
> HDFS currently supports configuration where storages are a list of directories. Typically
each of these directories correspond to a volume with its own file system. All these directories
are homogeneous and therefore identified as a single storage at the namenode. I propose, change
to the current model where Datanode * is a * storage, to Datanode * is a collection * of strorages.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message