hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chengwei Yang <chengwei.yang...@gmail.com>
Subject Re: Need help to understand hadoop.tmp.dir
Date Mon, 03 Mar 2014 10:55:28 GMT
On Mon, Mar 03, 2014 at 01:57:49PM +0530, shashwat shriparv wrote:
> NO need to format just change the value and restart the cluster;

Hmm, seems it doesn't work for me, if the only need to do is to change
to another directory, then why it can not re-init the directory in /tmp
just as another directory?

If I changed to another directory, a new directory, the same error
happen.

--
Thanks,
Chengwei

> 
> 
> Warm Regards_∞_
> Shashwat Shriparv
> http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9https://twitter.com/
> shriparvhttps://www.facebook.com/shriparvhttp://google.com/+ShashwatShriparv
> http://www.youtube.com/user/sShriparv/videoshttp://profile.yahoo.com/
> SWXSTW3DVSDTF2HHSRM47AV6DI/
> 
> 
> 
> On Mon, Mar 3, 2014 at 1:55 PM, Chengwei Yang <chengwei.yang.cn@gmail.com>
> wrote:
> 
>     On Mon, Mar 03, 2014 at 11:56:08AM +0530, shashwat shriparv wrote:
>     > Ya its always better to change the temp dir path in hadoop, as it will
>     prevent
>     > deletion of file while the server reboots.
> 
>     Thanks, so is there anyway to recovery from this state? Or I have to format
>     namenode again?
> 
>     --
>     Thanks,
>     Chengwei
> 
>     >
>     >
>     > Warm Regards_∞_
>     > Shashwat Shriparv
>     > http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9https://
>     twitter.com/
>     > shriparvhttps://www.facebook.com/shriparvhttp://google.com/
>     +ShashwatShriparv
>     > http://www.youtube.com/user/sShriparv/videoshttp://profile.yahoo.com/
>     > SWXSTW3DVSDTF2HHSRM47AV6DI/
>     >
>     >
>     >
>     > On Mon, Mar 3, 2014 at 11:52 AM, Chengwei Yang <
>     chengwei.yang.cn@gmail.com>
>     > wrote:
>     >
>     >     On Mon, Mar 03, 2014 at 11:25:59AM +0530, shashwat shriparv wrote:
>     >     > You can use any directory you like beside permissions are right.
>     >
>     >     I mean if it's better if we change the default hadoop.tmp.dir?
>     Because it
>     >     can not work cross reboot in default Linux environment.
>     >
>     >     --
>     >     Thanks,
>     >     Chengwei
>     >
>     >     >
>     >     >
>     >     > Warm Regards_∞_
>     >     > Shashwat Shriparv
>     >     > http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9https://
>     >     twitter.com/
>     >     > shriparvhttps://www.facebook.com/shriparvhttp://google.com/
>     >     +ShashwatShriparv
>     >     > http://www.youtube.com/user/sShriparv/videoshttp://
>     profile.yahoo.com/
>     >     > SWXSTW3DVSDTF2HHSRM47AV6DI/
>     >     >
>     >     >
>     >     >
>     >     > On Mon, Mar 3, 2014 at 11:07 AM, Chengwei Yang <
>     >     chengwei.yang.cn@gmail.com>
>     >     > wrote:
>     >     >
>     >     >     Hi List,
>     >     >
>     >     >     I'm confusing by hadoop.tmp.dir currently because its default
>     value
>     >     >     "/tmp/hadoop-${user.name}" always means a directory in tmpfs
in
>     >     Linux.
>     >     >     So after the name node machine reboot, it gone away and then
>     name
>     >     node
>     >     >     fail to start.
>     >     >
>     >     >     I found this was reported here.
>     >     >     http://mail-archives.apache.org/mod_mbox/hadoop-hdfs-user/
>     201205.mbox
>     >     /
>     >     >     %3CBAY148-W22BF95C5FBE2C40BF7CD9F86020@phx.gbl%3E
>     >     >
>     >     >     As I found from http://hadoop.apache.org/docs/r2.3.0/, there
>     are a
>     >     lot
>     >     >     properties are based on hadoop.tmp.dir, like
>     >     >     dfs.namenode.name.dir   file://${hadoop.tmp.dir}/dfs/name
>     >     >
>     >     >     I'm wondering, if we can set the default value of
>     hadoop.tmp.dir to
>     >     >     a non-tmpfs direcotry if it doesn't work at all by using a
real
>     tmpfs
>     >     >     directory?
>     >     >
>     >     >     --
>     >     >     Thanks,
>     >     >     Chengwei
>     >     >
>     >     >
>     >
>     >
> 
> 

Mime
View raw message