hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 杨浩 <yangha...@gmail.com>
Subject Re: How to know when datanode are marked dead by namenode
Date Mon, 30 Mar 2015 11:32:00 GMT
Hi Ted
I have read the feature, and it says,  "The patch appears to be a
documentation patch that doesn't require tests."

Can you tell me what patch should add UT, and which would not

2015-03-29 9:44 GMT+08:00 Ted Yu <yuzhihong@gmail.com>:

> Himawan:
> You don't need to recompile the code.
> Please see this thread http://search-hadoop.com/m/LgpTk2FkzEk
>
> The last comment in that thread led to:
> https://issues.apache.org/jira/browse/HDFS-7685
>
> Cheers
>
> On Sat, Mar 28, 2015 at 6:36 PM, Himawan Mahardianto <
> mahardianto@ugm.ac.id> wrote:
>
>> So, if I want to change the default dead time, I have to compile from
>> source first?
>> Is there any other way that I use to change dead time from native
>> hadoop-2.6 (not from source)?
>> Or maybe the native doesn't have a feature to change the dead time?
>>
>> Thank's all for the responses :)
>>
>> On Sun, Mar 29, 2015 at 8:13 AM, Ted Yu <yuzhihong@gmail.com> wrote:
>>
>>> Himawan:
>>> Please see the following constants
>>> in hadoop-hdfs-project//hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
>>> :
>>>
>>>   public static final String
>>> DFS_NAMENODE_HEARTBEAT_RECHECK_INTERVAL_KEY =
>>> "dfs.namenode.heartbeat.recheck-interval";
>>>
>>>   public static final int
>>> DFS_NAMENODE_HEARTBEAT_RECHECK_INTERVAL_DEFAULT = 5*60*1000;
>>>
>>> Cheers
>>>
>>> On Sat, Mar 28, 2015 at 5:48 PM, Himawan Mahardianto <
>>> mahardianto@ugm.ac.id> wrote:
>>>
>>>> Thank you for your response and explanation, but I couldn't find "
>>>> dfs.namenode.heartbeat.recheck-interval" parameter on
>>>> http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml
>>>> that you told before, maybe any other formula with this version?
>>>>
>>>> On Sat, Mar 28, 2015 at 6:42 PM, Brahma Reddy Battula <
>>>> brahmareddy.battula@huawei.com> wrote:
>>>>
>>>>>  HI
>>>>>
>>>>> The NameNode updates this detail after 10.30 minutes by default. You
>>>>> can see the dead and live datanodes at that time.
>>>>>
>>>>> It computes this heartbeatExpireInterval time by the following formula
>>>>>
>>>>>   heartbeatExpireInterval = 2 * heartbeatRecheckInterval +
>>>>>       10 * 1000* heartbeatInterval
>>>>>
>>>>> where heartbeatRecheckInterval is defined by the configuration
>>>>> dfs.namenode.heartbeat.recheck-interval which is 5 minutes by default
and
>>>>> heartbeatInterval by dfs.heartbeat.interval which is 3 seconds by default.
>>>>>
>>>>> Hence
>>>>> heartbeatExpireInterval = 10.30 minutes
>>>>>
>>>>>
>>>>> SO If you want keep more time, you can configure
>>>>> dfs.namenode.heartbeat.recheck-interval based one your requirement..
>>>>>
>>>>>
>>>>>  Thanks & Regards
>>>>>
>>>>> Brahma Reddy Battula
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>   ------------------------------
>>>>> *From:* Himawan Mahardianto [mahardianto@ugm.ac.id]
>>>>> *Sent:* Saturday, March 28, 2015 4:42 PM
>>>>> *To:* user@hadoop.apache.org
>>>>> *Subject:* How to know when datanode are marked dead by namenode
>>>>>
>>>>>   Hi guys I'm newbie here, do you know how to time calculation when
>>>>> datanode are marked dead by namenode, what parameters on HDFS-SITE.xml
>>>>> should I look for to calculate it, and how can I reduce dead time from
>>>>> default 10 minutes to 5 minutes or increase it to 20 minutes?
>>>>> Thank's before
>>>>>
>>>>>  best regards
>>>>> Himawan Mahardianto
>>>>>
>>>>
>>>>
>>>
>>
>

Mime
View raw message