Return-Path: 
 <hdfs-issues-return-146199-apmail-hadoop-hdfs-issues-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 6ED8418D3A
	for <apmail-hadoop-hdfs-issues-archive@minotaur.apache.org>;
 Tue, 24 Nov 2015 23:05:11 +0000 (UTC)
Received: (qmail 67096 invoked by uid 500); 24 Nov 2015 23:05:11 -0000
Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org
Received: (qmail 67034 invoked by uid 500); 24 Nov 2015 23:05:11 -0000
Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:hdfs-issues-help@hadoop.apache.org>
List-Unsubscribe: <mailto:hdfs-issues-unsubscribe@hadoop.apache.org>
List-Post: <mailto:hdfs-issues@hadoop.apache.org>
List-Id: <hdfs-issues.hadoop.apache.org>
Reply-To: hdfs-issues@hadoop.apache.org
Delivered-To: mailing list hdfs-issues@hadoop.apache.org
Received: (qmail 67023 invoked by uid 99); 24 Nov 2015 23:05:11 -0000
Received: from arcas.apache.org (HELO arcas) (140.211.11.28)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 24 Nov 2015 23:05:11 +0000
Received: from arcas.apache.org (localhost [127.0.0.1])
	by arcas (Postfix) with ESMTP id 0616B2C1F5B
	for <hdfs-issues@hadoop.apache.org>; Tue, 24 Nov 2015 23:05:11 +0000 (UTC)
Date: Tue, 24 Nov 2015 23:05:11 +0000 (UTC)
From: "Anu Engineer (JIRA)" <jira@apache.org>
To: hdfs-issues@hadoop.apache.org
Message-ID: <JIRA.12848374.1437597955000.183664.1448406311023@Atlassian.JIRA>
In-Reply-To: <JIRA.12848374.1437597955000@Atlassian.JIRA>
References: <JIRA.12848374.1437597955000@Atlassian.JIRA>
 <JIRA.12848374.1437597955998@arcas>
Subject: [jira] [Updated] (HDFS-8807) dfs.datanode.data.dir does not handle
 spaces between storageType and URI correctly
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394


     [ https://issues.apache.org/jira/browse/HDFS-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Anu Engineer updated HDFS-8807:
-------------------------------
    Attachment: HDFS-8807.002.patch

Fix removing space from lic. header

> dfs.datanode.data.dir does not handle spaces between storageType and URI correctly
> ----------------------------------------------------------------------------------
>
>                 Key: HDFS-8807
>                 URL: https://issues.apache.org/jira/browse/HDFS-8807
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode
>    Affects Versions: 2.8.0
>            Reporter: Anu Engineer
>            Assignee: Anu Engineer
>             Fix For: 2.8.0
>
>         Attachments: HDFS-8807.001.patch, HDFS-8807.002.patch
>
>
> if you add a space between the storage type and file URI then datanodes fail during startup.
> Here is an example of "mis-configration" that leads to datanode failure.
> {code}
> <property>
>     <name>dfs.datanode.data.dir</name>
>     <value>
>       [DISK] file://tmp/hadoop-aengineer/disk1/dfs/data
>     </value>
>   </property>
> {code}
> Here is the "fixed" version. Please *note* the lack of space between \[DISK\] and file URI
> {code}
> <property>
>     <name>dfs.datanode.data.dir</name>
>     <value>
>       [DISK]file://tmp/hadoop-aengineer/disk1/dfs/data
>     </value>
>   </property>
> {code}
> we fail with a parsing error, here is the info from the datanode logs.
> {code}
> 2015-07-22 13:34:36,812 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Exception in secureMain
> java.lang.IllegalArgumentException: java.net.URISyntaxException: Illegal character in scheme name at index 0:  file://tmp/hadoop-aengineer/disk1/dfs/data
>         at org.apache.hadoop.fs.Path.initialize(Path.java:204)
>         at org.apache.hadoop.fs.Path.<init>(Path.java:170)
>         at org.apache.hadoop.hdfs.server.datanode.StorageLocation.parse(StorageLocation.java:97)
>         at org.apache.hadoop.hdfs.server.datanode.DataNode.getStorageLocations(DataNode.java:2314)
>         at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2298)
>         at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2349)
>         at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2529)
>         at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2553)
> Caused by: java.net.URISyntaxException: Illegal character in scheme name at index 0:  file://tmp/hadoop-aengineer/disk1/dfs/data
>         at java.net.URI$Parser.fail(URI.java:2829)
>         at java.net.URI$Parser.checkChars(URI.java:3002)
>         at java.net.URI$Parser.checkChar(URI.java:3012)
>         at java.net.URI$Parser.parse(URI.java:3028)
>         at java.net.URI.<init>(URI.java:753)
>         at org.apache.hadoop.fs.Path.initialize(Path.java:201)
>         ... 7 more
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)