Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BEC6310EFE for ; Mon, 3 Mar 2014 06:23:47 +0000 (UTC) Received: (qmail 69215 invoked by uid 500); 3 Mar 2014 06:23:36 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 68965 invoked by uid 500); 3 Mar 2014 06:23:33 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 68958 invoked by uid 99); 3 Mar 2014 06:23:33 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Mar 2014 06:23:33 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of chengwei.yang.cn@gmail.com designates 209.85.220.53 as permitted sender) Received: from [209.85.220.53] (HELO mail-pa0-f53.google.com) (209.85.220.53) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Mar 2014 06:23:26 +0000 Received: by mail-pa0-f53.google.com with SMTP id ld10so3364440pab.26 for ; Sun, 02 Mar 2014 22:23:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:content-transfer-encoding :in-reply-to:user-agent; bh=i/dZ9E6GKs8/ESKDpdCnlRWXl3YHbyZYYoOzL0E2On0=; b=C+SFmAkSoZBUBStwFP+cuzJ8p6zcox1gwzbWWCRdqGe7PCVUiw6E/IkQ7eCLltmtHi vtJ+hzA6328sAZBsfoHSgFpRq0aMhzr0wKOEgGQLMrUKEO0gT6HnA5PI9a5gInpA/ZXX +ojDK4wYg1iXRPn3Tl6QYZiPnirU0ma0F18ulAiMn5863PLKuFXra3z6tsYrMFWLpUUe 0WZ0VvK3QHvUH+HJKbS3W/IhsfrID+3Jqx6iupXHNz7/h2dlCh0M/ocLlIQZEndVcvKB 55EKP7Kyr5/uqznzDu/1Z4mFek9J4Pdeun6m/idiOrqvcGenvxcTai7cEKRwbIxcKFJb 4EmQ== X-Received: by 10.66.11.66 with SMTP id o2mr1652403pab.142.1393827785326; Sun, 02 Mar 2014 22:23:05 -0800 (PST) Received: from localhost (jfdmzpr03-ext.jf.intel.com. [134.134.139.72]) by mx.google.com with ESMTPSA id dk1sm32142311pbc.46.2014.03.02.22.23.01 for (version=TLSv1.2 cipher=RC4-SHA bits=128/128); Sun, 02 Mar 2014 22:23:03 -0800 (PST) Date: Mon, 3 Mar 2014 14:22:59 +0800 From: Chengwei Yang To: shashwat shriparv Cc: user , chengwei.yang.cn@gmail.com Subject: Re: Need help to understand hadoop.tmp.dir Message-ID: <20140303062259.GD13272@chengwei-workstation.bj.intel.com> References: <20140303053711.GC13272@chengwei-workstation.bj.intel.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-Virus-Checked: Checked by ClamAV on apache.org On Mon, Mar 03, 2014 at 11:25:59AM +0530, shashwat shriparv wrote: > You can use any directory you like beside permissions are right. I mean if it's better if we change the default hadoop.tmp.dir? Because it can not work cross reboot in default Linux environment. -- Thanks, Chengwei > > > Warm Regards_∞_ > Shashwat Shriparv > http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9https://twitter.com/ > shriparvhttps://www.facebook.com/shriparvhttp://google.com/+ShashwatShriparv > http://www.youtube.com/user/sShriparv/videoshttp://profile.yahoo.com/ > SWXSTW3DVSDTF2HHSRM47AV6DI/ > > > > On Mon, Mar 3, 2014 at 11:07 AM, Chengwei Yang > wrote: > > Hi List, > > I'm confusing by hadoop.tmp.dir currently because its default value > "/tmp/hadoop-${user.name}" always means a directory in tmpfs in Linux. > So after the name node machine reboot, it gone away and then name node > fail to start. > > I found this was reported here. > http://mail-archives.apache.org/mod_mbox/hadoop-hdfs-user/201205.mbox/ > %3CBAY148-W22BF95C5FBE2C40BF7CD9F86020@phx.gbl%3E > > As I found from http://hadoop.apache.org/docs/r2.3.0/, there are a lot > properties are based on hadoop.tmp.dir, like > dfs.namenode.name.dir   file://${hadoop.tmp.dir}/dfs/name > > I'm wondering, if we can set the default value of hadoop.tmp.dir to > a non-tmpfs direcotry if it doesn't work at all by using a real tmpfs > directory? > > -- > Thanks, > Chengwei > >