hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anu Engineer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12464) Ozone: More detailed documentation about the ozone components
Date Thu, 28 Sep 2017 22:55:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185060#comment-16185060

Anu Engineer commented on HDFS-12464:

[~elek] All of the above are excellent questions and I complete agree we need to have documentation
for each one of them. 

bq. One high level overview, with diagram, and explain the basic concepts. Typically for end-users:
for the existing users of the HDFS to understand what's new, and why it's important
I have just done that in HDFS-12551.
bq. I created this more in-depth documentation for the developers/sys-admin who would like
to use the system after they understood what is ozone and how it works.
That is a very good point, Let us write this and attach it as a document to HDFS-7240. Rather
than shipping it as part of the standard documentation. However, if you think end users are
going to benefit from it, I am open to doing this.
bq. It could help to understand the Ozone during the HDFS-7240 merge vote.
. I agree that we need more documentation, but I wanted to make sure that we document the
concepts, not the details.
bq. It could help to understand the consequences of turning on ozone. For example it's a tipical
question where will be any data written. I also missed the definition of the network commiunication
for the existing HDFS/YARN. It could help a lot to debug the network issues.
There is another JIRA the talks about documenting the file system layout and data storage
layout. Let us write docs for those too.

I am posting this as work in progress so that we can break this Patch into multiple as you
have suggested.

> Ozone: More detailed documentation about the ozone components
> -------------------------------------------------------------
>                 Key: HDFS-12464
>                 URL: https://issues.apache.org/jira/browse/HDFS-12464
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: HDFS-7240
>    Affects Versions: HDFS-7240
>            Reporter: Elek, Marton
>            Assignee: Elek, Marton
>              Labels: ozoneDoc
>         Attachments: HDFS-12464-HDFS-7240.001.patch, HDFS-7240-HDFS-12464.001.patch
> I started to write a more detailed introduction about the Ozone components. The goal
is to explain the basic responsibility of the components and the basic network topology (which
components sends messages and to where?). 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message