hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Backup NameNode metadata in HA configuration
Date Tue, 04 Feb 2014 07:42:57 GMT
Nothing wrong in copying it - except it would come with a bunch of
redundant information (extra retained edit logs already merged into
one of the recent fsimages).

On Tue, Feb 4, 2014 at 12:07 PM, Ivan Tretyakov
<itretyakov@griddynamics.com> wrote:
> Thank you Harsh!
> But I would like to know if just copying NN data directory (dfs.name.dir,
> dfs.namenode.name.dir) is appropriate or not?
>
>
> On Tue, Feb 4, 2014 at 6:00 AM, Harsh J <harsh@cloudera.com> wrote:
>>
>> Hi,
>>
>> You'll ideally just need the latest
>> fsimage file, which includes the whole check pointed namespace, so
>> "hdfs dfsadmin -fetch" is appropriate.
>>
>> On Tue, Feb 4, 2014 at 3:02 AM, Ivan Tretyakov
>> <itretyakov@griddynamics.com> wrote:
>> > Does anybody can comment 'copying NN metadata directory' vs 'hdfs
>> > dfsadmin
>> > -fetch', using NN HA configuration?
>> >
>> >
>> > On Fri, Jan 31, 2014 at 8:26 PM, Ivan Tretyakov
>> > <itretyakov@griddynamics.com> wrote:
>> >>
>> >> Hi!
>> >>
>> >> We are using following version of Hadoop software: 2.0.0-cdh4.1.1.
>> >>
>> >> HDFS HA configuration is applied.
>> >>
>> >> I would like to ask if there are any difference or possible side
>> >> effects
>> >> of backing up namenode data directory.
>> >>
>> >> It is ok to just copy NN data directory from active NN to another host,
>> >> what about standby NN?
>> >> Or it may NN metadate can be in inconsistent state?
>> >> Is there any advantages of using "hdfs dfsadmin -fetch <file>" command?
>> >>
>> >> --
>> >> Best Regards
>> >> Ivan Tretyakov
>> >>
>> >> Deployment Engineer
>> >> Grid Dynamics
>> >> +7 812 640 38 76
>> >> Skype: ivan.v.tretyakov
>> >> www.griddynamics.com
>> >> itretyakov@griddynamics.com
>> >
>> >
>> >
>> >
>> > --
>> > Best Regards
>> > Ivan Tretyakov
>> >
>> > Deployment Engineer
>> > Grid Dynamics
>> > +7 812 640 38 76
>> > Skype: ivan.v.tretyakov
>> > www.griddynamics.com
>> > itretyakov@griddynamics.com
>>
>>
>>
>> --
>> Harsh J
>
>
>
>
> --
> Best Regards
> Ivan Tretyakov
>
> Deployment Engineer
> Grid Dynamics
> +7 812 640 38 76
> Skype: ivan.v.tretyakov
> www.griddynamics.com
> itretyakov@griddynamics.com



-- 
Harsh J

Mime
View raw message