Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 83407 invoked from network); 6 Dec 2007 17:40:07 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 6 Dec 2007 17:40:07 -0000 Received: (qmail 92882 invoked by uid 500); 6 Dec 2007 17:39:55 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 92653 invoked by uid 500); 6 Dec 2007 17:39:54 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 92644 invoked by uid 99); 6 Dec 2007 17:39:54 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Dec 2007 09:39:54 -0800 X-ASF-Spam-Status: No, hits=-100.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Dec 2007 17:40:04 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 324B571424F for ; Thu, 6 Dec 2007 09:39:43 -0800 (PST) Message-ID: <10033545.1196962783203.JavaMail.jira@brutus> Date: Thu, 6 Dec 2007 09:39:43 -0800 (PST) From: "Ted Dunning (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Created: (HADOOP-2366) Space in the value for dfs.data.dir can cause great problems MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Space in the value for dfs.data.dir can cause great problems ------------------------------------------------------------ Key: HADOOP-2366 URL: https://issues.apache.org/jira/browse/HADOOP-2366 Project: Hadoop Issue Type: Bug Components: conf Affects Versions: 0.13.1 Reporter: Ted Dunning The following configuration causes problems: dfs.data.dir /mnt/hstore2/hdfs, /home/foo/dfs Determines where on the local filesystem an DFS data node should store its bl ocks. If this is a comma-delimited list of directories, then data will be stor ed in all named directories, typically on different devices. Directories that do not exist are ignored. The problem is that the space after the comma causes the second directory for storage to be " /home/foo/dfs" which is in a directory named which contains a sub-dir named "home" in the hadoop datanodes default directory. This will typically cause the user's home partition to fill, but will be very hard for the user to understand since a directory with a whitespace name is hard to understand. My proposed solution would be to trimLeft all path names from this and similar property after splitting on comma. This still allows spaces in file and directory names but avoids this problem. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.