hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanjay Radia (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS
Date Fri, 12 Jul 2013 21:47:55 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707422#comment-13707422

Sanjay Radia commented on HDFS-2832:

Andrew, I was always confused about the creation of HDFS-4672 given that HDFS-2832 existed
for quite a while and with a bunch of subtasks complete. 

note: Konstantine asked you about the duplication in April "What is the difference between
this issue and HDFS-2832?" in [comment | https://issues.apache.org/jira/browse/HDFS-4672?focusedCommentId=13629403&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13629403]
to which you have not responded to date.

However noting the description and comments on HDFS-4672 it is clear that HDFS-4672 seems
to be focusing on policies for placement. I resigned to letting this Jira (HDFS-2832) focus
on the raw mechanisms and  HDFS-4672 focus on the policies; as a result I did not raise the
issue about you duplicating this jira when you created HDFS-4672. I did that out of politeness
and moving forward but perhaps that was a mistake on my part. Also note that I have commented
on the other jira and have not ignored it. 

Your recent tweet about this before giving me a chance to respond is unfortunate, especially
given that HDFS-4682 has is overlapping with HDFS-2832. - isn't this the pot calling the kettle

Getting back to the business building Hadoop:
We need to move quickly forward by adding mechanism in HDFS to allow different kinds of storage
while the longer discussions on policies continue. Given that a recent Jira on ram caching
(HDFS-4949)  is planning to move quickly, it is important that we start by providing the the
needed mechanisms.   We plan to add additional mechanisms via sub-jiras  which can support
HDFS-4949. You are welcome to contribute with patches and discussions. Similarly we plan to
continue to participate in the longer ranged discussions on policies and also contribute with

> Enable support for heterogeneous storages in HDFS
> -------------------------------------------------
>                 Key: HDFS-2832
>                 URL: https://issues.apache.org/jira/browse/HDFS-2832
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>    Affects Versions: 0.24.0
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
> HDFS currently supports configuration where storages are a list of directories. Typically
each of these directories correspond to a volume with its own file system. All these directories
are homogeneous and therefore identified as a single storage at the namenode. I propose, change
to the current model where Datanode * is a * storage, to Datanode * is a collection * of strorages.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message