hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: One NameNode keeps Rolling Edit Log on HDFS Federation
Date Mon, 25 Feb 2013 07:16:08 GMT
Could you send us the log messages (with timestamps) which you think
is behind the behavior you see? The new edit log format is different
than the one in 1.x, and uses several smaller edit log files. This new
format is described in PDFs attached at
https://issues.apache.org/jira/browse/HDFS-1073, and the logs may mean
that the NN just opened a new file and closed the older transactions
file.

On Mon, Feb 25, 2013 at 10:16 AM, YouPeng Yang
<yypvsxf19870706@gmail.com> wrote:
> Hi Azuryy,Harsh
>
>    It is strange that  the NameNode rolling edits log rolls edits logs all
> the times,even i do nothing on the NameNode vi client.
>
>   Any futher help will be appreciated.
>
>
> regard.
>
>
>
>
>
>
> 2013/2/25 YouPeng Yang <yypvsxf19870706@gmail.com>
>>
>> Hi Azuryy
>>
>>    Yes.that is what is.
>>    Thank you for your reply. I am making effort  to make clear about
>> federation and HA.
>>
>> Regards.
>>
>>
>>
>>
>> 2013/2/25 Azuryy Yu <azuryyyu@gmail.com>
>>>
>>> I think you mixed federation with HA. am I right?
>>>
>>> If another name node hasn't changes, then It doesn't do any edit log
>>> rolling. federated NNs don't keep concurrency( I think you want say keep
>>> sync-able?)
>>>
>>>
>>> On Sun, Feb 24, 2013 at 11:09 PM, YouPeng Yang
>>> <yypvsxf19870706@gmail.com> wrote:
>>>>
>>>> Hi All
>>>>
>>>>  I'm testing the HDFS Federation.I have 2 namenodes in  my cluster.
>>>>  I find that it is  Rolling Edit Log continuously on one
>>>> namenode,however the other one  changes nothing.
>>>>
>>>>  My question :
>>>>  1. Is it the right situation.
>>>>  2. I have thought that the two namenodes shoud keep concurrency.
>>>> why they get differences.
>>>>  3. is there any advanced docs about HDFS Federation.
>>>>
>>>> thanks.
>>>>
>>>> Regards.
>>>>
>>>>
>>>>
>>>
>>>
>>
>



--
Harsh J

Mime
View raw message