hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Torsten Curdt <tcu...@apache.org>
Subject Re: corrupted fsimage and edits
Date Wed, 30 Jul 2008 22:00:14 GMT

On Jul 30, 2008, at 20:35, Raghu Angadi wrote:

> You should always have more than one location (preferably on  
> different disks) for fsimage and editslog.

On production we do frequent backups. Is there a mechanism from inside  
hadoop now to do something like that now? The "more than one location"  
bit sounds a little like that.

> A few months back I had a proposal to keep checksums for each record  
> on fsimage and editslog and NameNode would recover transparently  
> from such corruptions when there are more than one copies available.  
> It didn't come up in priority since there were no such failures  
> observed.
>
> You should certainly report these cases and will help the feature  
> gain more traction.

Will file a bug report tomorrow.

cheers
--
Torsten

Mime
View raw message