hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jason Venner <jason.had...@gmail.com>
Subject Re: Problem with the secondary namenode being unable to getImage?putImage due to edit file time differences, hadoop 0.19.0
Date Wed, 14 Oct 2009 06:09:10 GMT
I might attach to the secondary in the debugger so I can catch more details
tomorrow.

On Tue, Oct 13, 2009 at 11:08 PM, Jason Venner <jason.hadoop@gmail.com>wrote:

> That is the entire log message,
> The only way to get the actual error is via tcpdump and packet reassembly
>
> I can't find a getImage log messages on the namenode, they would be in the
> jetty error log, but I think that is set to /dev/null.
>
>
>
>
> On Tue, Oct 13, 2009 at 10:57 PM, Raghu Angadi <rangadi@apache.org> wrote:
>
>>
>> It should not be very sensitive to drift. I think timestamp is meant
>> mostly as an increasing number. implementation might have a bug. will check.
>>
>>
>> Could paste a larger portion of the log?
>>
>> Raghu.
>>
>> On Tue, Oct 13, 2009 at 10:47 PM, Jason Venner <jason.hadoop@gmail.com>wrote:
>>
>>> The actual body of the error contains a statement to the effect that the
>>>
>>>      Namenode has an edit log with timestamp of ..... but new checkpoint
>>> was created using editlog with timestamp ....
>>>
>>> This is from FSImage.validateCheckpointUpload. The drift is about the
>>> difft in time in the edit logs.
>>>
>>> THe unique situation in my experience here is that one of the
>>> dfs.name.dir directories is on an nfs mounted file system, and that
>>> particular file has a mode time that is often 0.5+/-0.5 seconds different.
>>>
>>> Any simple fixes? Even with the best ntp, we are going to be +/- a few
>>> msec and the test in validateCheckpointUpoad is exact equals comparison.
>>> The other thing that confuses me is why, the time stamp is differenet,
>>> the code from a reading, appears to always pick the same file for modtime
>>> comparisons.
>>> --
>>> Pro Hadoop, a book to guide you from beginner to hadoop mastery,
>>> http://www.amazon.com/dp/1430219424?tag=jewlerymall
>>> www.prohadoopbook.com a community for Hadoop Professionals
>>>
>>
>>
>
>
> --
> Pro Hadoop, a book to guide you from beginner to hadoop mastery,
> http://www.amazon.com/dp/1430219424?tag=jewlerymall
> www.prohadoopbook.com a community for Hadoop Professionals
>



-- 
Pro Hadoop, a book to guide you from beginner to hadoop mastery,
http://www.amazon.com/dp/1430219424?tag=jewlerymall
www.prohadoopbook.com a community for Hadoop Professionals

Mime
View raw message