hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From shashwat shriparv <dwivedishash...@gmail.com>
Subject Re: Need help to understand hadoop.tmp.dir
Date Mon, 03 Mar 2014 08:27:49 GMT
NO need to format just change the value and restart the cluster;


*Warm Regards_**∞_*
* Shashwat Shriparv*
 [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
http://google.com/+ShashwatShriparv]
<http://google.com/+ShashwatShriparv>[image:
http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] <shriparv@yahoo.com>



On Mon, Mar 3, 2014 at 1:55 PM, Chengwei Yang <chengwei.yang.cn@gmail.com>wrote:

> On Mon, Mar 03, 2014 at 11:56:08AM +0530, shashwat shriparv wrote:
> > Ya its always better to change the temp dir path in hadoop, as it will
> prevent
> > deletion of file while the server reboots.
>
> Thanks, so is there anyway to recovery from this state? Or I have to format
> namenode again?
>
> --
> Thanks,
> Chengwei
>
> >
> >
> > Warm Regards_∞_
> > Shashwat Shriparv
> >
> http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9https://twitter.com/
> > shriparvhttps://
> www.facebook.com/shriparvhttp://google.com/+ShashwatShriparv
> > http://www.youtube.com/user/sShriparv/videoshttp://profile.yahoo.com/
> > SWXSTW3DVSDTF2HHSRM47AV6DI/
> >
> >
> >
> > On Mon, Mar 3, 2014 at 11:52 AM, Chengwei Yang <
> chengwei.yang.cn@gmail.com>
> > wrote:
> >
> >     On Mon, Mar 03, 2014 at 11:25:59AM +0530, shashwat shriparv wrote:
> >     > You can use any directory you like beside permissions are right.
> >
> >     I mean if it's better if we change the default hadoop.tmp.dir?
> Because it
> >     can not work cross reboot in default Linux environment.
> >
> >     --
> >     Thanks,
> >     Chengwei
> >
> >     >
> >     >
> >     > Warm Regards_∞_
> >     > Shashwat Shriparv
> >     > http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9https://
> >     twitter.com/
> >     > shriparvhttps://www.facebook.com/shriparvhttp://google.com/
> >     +ShashwatShriparv
> >     >
> http://www.youtube.com/user/sShriparv/videoshttp://profile.yahoo.com/
> >     > SWXSTW3DVSDTF2HHSRM47AV6DI/
> >     >
> >     >
> >     >
> >     > On Mon, Mar 3, 2014 at 11:07 AM, Chengwei Yang <
> >     chengwei.yang.cn@gmail.com>
> >     > wrote:
> >     >
> >     >     Hi List,
> >     >
> >     >     I'm confusing by hadoop.tmp.dir currently because its default
> value
> >     >     "/tmp/hadoop-${user.name}" always means a directory in tmpfs
> in
> >     Linux.
> >     >     So after the name node machine reboot, it gone away and then
> name
> >     node
> >     >     fail to start.
> >     >
> >     >     I found this was reported here.
> >     >
> http://mail-archives.apache.org/mod_mbox/hadoop-hdfs-user/201205.mbox
> >     /
> >     >     %3CBAY148-W22BF95C5FBE2C40BF7CD9F86020@phx.gbl%3E
> >     >
> >     >     As I found from http://hadoop.apache.org/docs/r2.3.0/, there
> are a
> >     lot
> >     >     properties are based on hadoop.tmp.dir, like
> >     >     dfs.namenode.name.dir   file://${hadoop.tmp.dir}/dfs/name
> >     >
> >     >     I'm wondering, if we can set the default value of
> hadoop.tmp.dir to
> >     >     a non-tmpfs direcotry if it doesn't work at all by using a
> real tmpfs
> >     >     directory?
> >     >
> >     >     --
> >     >     Thanks,
> >     >     Chengwei
> >     >
> >     >
> >
> >
>

Mime
View raw message