hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joe Pallas (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11118) Block Storage for HDFS
Date Fri, 11 Nov 2016 21:50:59 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15658275#comment-15658275
] 

Joe Pallas commented on HDFS-11118:
-----------------------------------

I have the same concern about this that I have about Ozone: it's cool stuff that is useful,
but I just am not convinced that it belongs in the existing HDFS service.  Like Ozone, it
increases the complexity of the datanode, and the datanode already has a history of being,
well, rather buggy.

I'm also frankly astonished that there's a feature branch with work being committed already
without any discussion on this proposal, but maybe I just don't have a good understanding
of Hadoop norms.

> Block Storage for HDFS
> ----------------------
>
>                 Key: HDFS-11118
>                 URL: https://issues.apache.org/jira/browse/HDFS-11118
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: hdfs
>            Reporter: Anu Engineer
>            Assignee: Anu Engineer
>         Attachments: cblock-proposal.pdf
>
>
> This JIRA proposes extending HDFS to provide replicated block storage capabilities using
Storage Containers. This is would allow users to run unmodified programs that assume that
they are running on a posix file system.
> With this extension, HDFS can be used like a block store. For example, YARN jobs could
mount and use a volume at will. This is made possible by leveraging Storage Containers and
will share the storage layer with Ozone and HDFS in future.
> Please see the attached design document for more details on this proposal.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message