hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Weiwei Yang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12454) Ozone : the sample ozone-site.xml in OzoneGettingStarted does not work
Date Fri, 15 Sep 2017 03:00:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167266#comment-16167266

Weiwei Yang commented on HDFS-12454:

Hi [~vagarychen], [~anu], [~xyao]

Based on Chen Liang's comment, I have some more suggestions,

# I think we do need {{ozone.ksm.address}}, let user explicitly set this property helps them
to understand the primitive services' location. And this should be an address, not a hostname.
# I think we should not require user to set up {{ozone.scm.datanode.id}}, this is an internal
property, can we let it default to {{ozone.container.metadata.dirs}}/datanode.id?
# At present, {{ozone.container.metadata.dirs}} is actually used for SCM (also KSM) metadata
dir, the property name is a bit confusing to me. Can we rename this to something else? Maybe
we can define an {{ozone.metadata.dir}}, e.g /hadoop/data/ozone/, then default metadata dirs
for SCM/KSM could be /hadoop/data/ozone/scm and /hadoop/data/ozone/ksm. This layout seems

Does this make sense?

> Ozone : the sample ozone-site.xml in OzoneGettingStarted does not work
> ----------------------------------------------------------------------
>                 Key: HDFS-12454
>                 URL: https://issues.apache.org/jira/browse/HDFS-12454
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Chen Liang
>            Assignee: Chen Liang
>            Priority: Blocker
>              Labels: ozoneMerge
>         Attachments: HDFS-12454-HDFS-7240.001.patch
> In OzoneGettingStarted.md there is a sample ozone-site.xml file. But there are a few
issues with it.
> 1.
> {code}
>         <property>
>           <name>ozone.scm.block.client.address</name>
>           <value>scm.hadoop.apache.org</value>
>         </property>
>          <property>
>             <name>ozone.ksm.address</name>
>             <value>ksm.hadoop.apache.org</value>
>           </property>
> {code}
> The value should be an address instead.
> 2.
> {{datanode.ObjectStoreHandler.<init>(ObjectStoreHandler.java:103)}} requires {{ozone.scm.client.address}}
to be set, which is missing from this sample file. Missing this config will seem to cause
failure on starting datanode.
> 3.
> {code}
>         <property>
>           <name>ozone.scm.names</name>
>           <value>scm.hadoop.apache.org</value>
>         </property>
> {code}
> This value did not make much sense to, I found the comment in {{ScmConfigKeys}} that
> {code}
> // ozone.scm.names key is a set of DNS | DNS:PORT | IP Address | IP:PORT.
> // Written as a comma separated string. e.g. scm1, scm2:8020,
> {code}
> So maybe we should write something like scm1 as value here.
> 4. I'm not entirely sure about this, but [here|https://wiki.apache.org/hadoop/Ozone#Configuration]
it says 
> {code}
> <property>
>     <name>ozone.handler.type</name>
>     <value>local</value>
>   </property>
> {code}
> is also part of minimum setting, do we need to add this [~anu]?

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message