hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anu Engineer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7240) Object store in HDFS
Date Wed, 25 May 2016 18:13:15 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300565#comment-15300565
] 

Anu Engineer commented on HDFS-7240:
------------------------------------

[~steve_l] [~drankye] We will certainly have a call to discuss the design once a detailed
design doc is posted.

[~andrew.wang] Thanks for your comments. 

bq. Here, I'm also trying to be as constructive as possible, raising questions as well as
proposing possible solutions.
I appreciate the spirit and rest assured that we really appreciate you raising questions.
It is just that writing a design doc takes a little time.

bq. We discussed the need for range instead of hash partitioning (which I'm happy to see made
it), as well as the overhead of doing metadata and data lookups (which could motivate storing
Ozone metadata in Raft instead of in a container). 

This has been my sentiment all along, that we have been listening to the community feedback
and making changes. we will certainly do the same going forward. I look forward to your comments
and thoughts on the ozone once we post the design doc.

[~zhz] [~cmccabe] and [~andrew.wang] I would like to discuss the technical issues that have
been raised in this JIRA after I post the design doc. It will allow us to have a shared understanding
of where we are and will eliminate lot of repetition.  I personally believe it would be much
more productive to have the discussion once we all have a shared view of the issues and suggested
solutions.


> Object store in HDFS
> --------------------
>
>                 Key: HDFS-7240
>                 URL: https://issues.apache.org/jira/browse/HDFS-7240
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jitendra Nath Pandey
>         Attachments: Ozone-architecture-v1.pdf, ozone_user_v0.pdf
>
>
> This jira proposes to add object store capabilities into HDFS. 
> As part of the federation work (HDFS-1052) we separated block storage as a generic storage
layer. Using the Block Pool abstraction, new kinds of namespaces can be built on top of the
storage layer i.e. datanodes.
> In this jira I will explore building an object store using the datanode storage, but
independent of namespace metadata.
> I will soon update with a detailed design document.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message