hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Elek, Marton (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDDS-44) Ozone: start-ozone.sh fail to start datanode because of incomplete classpaths
Date Wed, 23 May 2018 06:28:00 GMT

    [ https://issues.apache.org/jira/browse/HDDS-44?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16480379#comment-16480379
] 

Elek, Marton edited comment on HDDS-44 at 5/23/18 6:27 AM:
-----------------------------------------------------------

+1

I tested the latest patch and works well. The classpath is set because datanode is started
with ozone command instead of hdfs command:

{code}
/opt/hadoop/bin/ozone --workers --config /opt/hadoop/etc/hadoop --daemon start datanode
{code}

I can see the plugin activation in the datanode output.

Note: I tried to create a docker-compose file for testing start-all continuously, unfortunatelly
the home directory of hadoop user is /opt/hadoop which is mounted from outside so I can't
provide .ssh config from the original image as it will be overwritten by the mounted volume.
We may need to modify the base image... (This is not related to the issue, but I just shared
it as it it could be useful in the future to create an acceptance test)


was (Author: elek):
+1

I tested the latest patch and works well. The classpath is set because datanode is started
with ozone command instead of hdfs command:

{code}
/opt/hadoop/bin/ozone --workers --config /opt/hadoop/etc/hadoop --daemon start datanode
{code}

I can see the plugin activation in the datanode output.

Note: I tried to create a docker-compose file for testing start-all continuously, unfortunatelly
the home directory of hadoop user is /opt/hadoop which is mounted from outside so I can't
provide .ssh config from the original image as it will be overwritten by the mounted volume.
We may need to modify the base image...

> Ozone: start-ozone.sh fail to start datanode because of incomplete classpaths
> -----------------------------------------------------------------------------
>
>                 Key: HDDS-44
>                 URL: https://issues.apache.org/jira/browse/HDDS-44
>             Project: Hadoop Distributed Data Store
>          Issue Type: Bug
>          Components: Tools
>    Affects Versions: 0.2.1
>            Reporter: Mukul Kumar Singh
>            Assignee: Mukul Kumar Singh
>            Priority: Major
>             Fix For: 0.2.1
>
>         Attachments: HDDS-44.003.patch, HDDS-44.004.patch, HDFS-13383-HDFS-7240.001.patch,
HDFS-13383-HDFS-7240.002.patch
>
>
> start-ozone.sh calls start-dfs.sh to start the NN and DN in a ozone cluster. Starting
of datanode fails because of incomplete classpaths as datanode is unable to load all the plugins.
> Setting the class path to the following values does resolve the issue:
> {code}
> export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/opt/hadoop/hadoop-3.2.0-SNAPSHOT/share/hadoop/ozone/*:/opt/hadoop/hadoop-3.2.0-SNAPSHOT/share/hadoop/hdsl/*:/opt/hadoop/hadoop-3.2.0-SNAPSHOT/share/hadoop/ozone/lib/*:/opt/hadoop/hadoop-3.2.0-SNAPSHOT/share/hadoop/hdsl/lib/*:/opt/hadoop/hadoop-3.2.0-SNAPSHOT/share/hadoop/cblock/*:/opt/hadoop/hadoop-3.2.0-SNAPSHOT/share/hadoop/cblock/lib/*
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message