hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chengwei Yang <chengwei.yang...@gmail.com>
Subject Re: Need help to understand hadoop.tmp.dir
Date Mon, 03 Mar 2014 08:25:16 GMT
On Mon, Mar 03, 2014 at 11:56:08AM +0530, shashwat shriparv wrote:
> Ya its always better to change the temp dir path in hadoop, as it will prevent
> deletion of file while the server reboots.

Thanks, so is there anyway to recovery from this state? Or I have to format
namenode again?

--
Thanks,
Chengwei

> 
> 
> Warm Regards_∞_
> Shashwat Shriparv
> http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9https://twitter.com/
> shriparvhttps://www.facebook.com/shriparvhttp://google.com/+ShashwatShriparv
> http://www.youtube.com/user/sShriparv/videoshttp://profile.yahoo.com/
> SWXSTW3DVSDTF2HHSRM47AV6DI/
> 
> 
> 
> On Mon, Mar 3, 2014 at 11:52 AM, Chengwei Yang <chengwei.yang.cn@gmail.com>
> wrote:
> 
>     On Mon, Mar 03, 2014 at 11:25:59AM +0530, shashwat shriparv wrote:
>     > You can use any directory you like beside permissions are right.
> 
>     I mean if it's better if we change the default hadoop.tmp.dir? Because it
>     can not work cross reboot in default Linux environment.
> 
>     --
>     Thanks,
>     Chengwei
> 
>     >
>     >
>     > Warm Regards_∞_
>     > Shashwat Shriparv
>     > http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9https://
>     twitter.com/
>     > shriparvhttps://www.facebook.com/shriparvhttp://google.com/
>     +ShashwatShriparv
>     > http://www.youtube.com/user/sShriparv/videoshttp://profile.yahoo.com/
>     > SWXSTW3DVSDTF2HHSRM47AV6DI/
>     >
>     >
>     >
>     > On Mon, Mar 3, 2014 at 11:07 AM, Chengwei Yang <
>     chengwei.yang.cn@gmail.com>
>     > wrote:
>     >
>     >     Hi List,
>     >
>     >     I'm confusing by hadoop.tmp.dir currently because its default value
>     >     "/tmp/hadoop-${user.name}" always means a directory in tmpfs in
>     Linux.
>     >     So after the name node machine reboot, it gone away and then name
>     node
>     >     fail to start.
>     >
>     >     I found this was reported here.
>     >     http://mail-archives.apache.org/mod_mbox/hadoop-hdfs-user/201205.mbox
>     /
>     >     %3CBAY148-W22BF95C5FBE2C40BF7CD9F86020@phx.gbl%3E
>     >
>     >     As I found from http://hadoop.apache.org/docs/r2.3.0/, there are a
>     lot
>     >     properties are based on hadoop.tmp.dir, like
>     >     dfs.namenode.name.dir   file://${hadoop.tmp.dir}/dfs/name
>     >
>     >     I'm wondering, if we can set the default value of hadoop.tmp.dir to
>     >     a non-tmpfs direcotry if it doesn't work at all by using a real tmpfs
>     >     directory?
>     >
>     >     --
>     >     Thanks,
>     >     Chengwei
>     >
>     >
> 
> 

Mime
View raw message