Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 78379 invoked from network); 10 Jun 2009 23:37:19 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 10 Jun 2009 23:37:19 -0000 Received: (qmail 83099 invoked by uid 500); 10 Jun 2009 23:37:30 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 83027 invoked by uid 500); 10 Jun 2009 23:37:29 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 83017 invoked by uid 99); 10 Jun 2009 23:37:29 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Jun 2009 23:37:29 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Jun 2009 23:37:27 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 7B804234C055 for ; Wed, 10 Jun 2009 16:37:07 -0700 (PDT) Message-ID: <1638405205.1244677027505.JavaMail.jira@brutus> Date: Wed, 10 Jun 2009 16:37:07 -0700 (PDT) From: "Michele (aka pirroh) Catasta (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Updated: (HADOOP-2366) Space in the value for dfs.data.dir can cause great problems MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michele (aka pirroh) Catasta updated HADOOP-2366: ------------------------------------------------- Attachment: HADOOP-2366.patch > Space in the value for dfs.data.dir can cause great problems > ------------------------------------------------------------ > > Key: HADOOP-2366 > URL: https://issues.apache.org/jira/browse/HADOOP-2366 > Project: Hadoop Core > Issue Type: Bug > Components: conf > Reporter: Ted Dunning > Assignee: Todd Lipcon > Attachments: HADOOP-2366.patch > > > The following configuration causes problems: > > dfs.data.dir > /mnt/hstore2/hdfs, /home/foo/dfs > > Determines where on the local filesystem an DFS data node should store its bl > ocks. If this is a comma-delimited list of directories, then data will be stor > ed in all named directories, typically on different devices. Directories that > do not exist are ignored. > > > The problem is that the space after the comma causes the second directory for storage to be " /home/foo/dfs" which is in a directory named which contains a sub-dir named "home" in the hadoop datanodes default directory. This will typically cause the user's home partition to fill, but will be very hard for the user to understand since a directory with a whitespace name is hard to understand. > My proposed solution would be to trimLeft all path names from this and similar property after splitting on comma. This still allows spaces in file and directory names but avoids this problem. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.