hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Henry Hung <YTHu...@winbond.com>
Subject RE: how to increate data node expire time
Date Tue, 25 Nov 2014 05:22:28 GMT
Thank you for the information.

Another thing, if I set the expire time to 1 hour, will it have bad impact to cluster when
I shutdown 1 of the data node?

From: Brahma Reddy Battula [mailto:brahmareddy.battula@huawei.com]
Sent: Tuesday, November 25, 2014 12:40 PM
To: user@hadoop.apache.org
Subject: RE: how to increate data node expire time

Hi Henry


The NameNode updates this detail after 10.30 minutes by default. You can see the dead and
live datanodes at that time.

It computes this heartbeatExpireInterval time by the following formula

  heartbeatExpireInterval = 2 * heartbeatRecheckInterval +
      10 * 1000* heartbeatInterval

where heartbeatRecheckInterval is defined by the configuration dfs.namenode.heartbeat.recheck-interval
which is 5 minutes by default and heartbeatInterval by dfs.heartbeat.interval which is 3 seconds
by default.

Hence
heartbeatExpireInterval = 10.30 minutes


SO If you want keep more time, you can configure dfs.namenode.heartbeat.recheck-interval based
one your requirement..


Thanks & Regards

Brahma Reddy Battula



________________________________
From: Henry Hung [YTHung1@winbond.com]
Sent: Tuesday, November 25, 2014 8:05 AM
To: user@hadoop.apache.org<mailto:user@hadoop.apache.org>
Subject: how to increate data node expire time
Hi All,

In Hadoop 2.2.0, how to increase the data node expire time before name node list it as a dead
node?

I want to shut down a data node for 30 minutes, and I don't want the name node to list it
as dead node to prevent the re-replication process.

Best regards,
Henry

________________________________
The privileged confidential information contained in this email is intended for use only by
the addressees as indicated by the original sender of this email. If you are not the addressee
indicated in this email or are not responsible for delivery of the email to such a person,
please kindly reply to the sender indicating this fact and delete all copies of it from your
computer and network server immediately. Your cooperation is highly appreciated. It is advised
that any unauthorized use of confidential information of Winbond is strictly prohibited; and
any information in this email irrelevant to the official business of Winbond shall be deemed
as neither given nor endorsed by Winbond.

________________________________
The privileged confidential information contained in this email is intended for use only by
the addressees as indicated by the original sender of this email. If you are not the addressee
indicated in this email or are not responsible for delivery of the email to such a person,
please kindly reply to the sender indicating this fact and delete all copies of it from your
computer and network server immediately. Your cooperation is highly appreciated. It is advised
that any unauthorized use of confidential information of Winbond is strictly prohibited; and
any information in this email irrelevant to the official business of Winbond shall be deemed
as neither given nor endorsed by Winbond.

Mime
View raw message