hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: how does datanodes know where to send the block report in HA
Date Sun, 01 Feb 2015 00:23:44 GMT
The JournalNodes are only spoken to by the NameNode - they are part of
the shared edits storage. The ZKFC is a controller that talks to the
NN for failover activities. Neither of these roles care/know about
DataNodes.

The DataNodes send the block reports to the NameNodes just like they
send their heartbeats. You don't need to set any extra properties to
allow these - if your DNs are registering onto the HDFS cluster
properly, they are also sending their block reports properly as an
automatic result. The DNs seek the NN address via the rpc-address or
servicerpc-address configs for the NNs.

On Sun, Feb 1, 2015 at 1:43 AM, SP <sajidmca@gmail.com> wrote:
> Hi All,
>
> How does datanodes know where to send the block report and heart beat info
> in HA  cluster implemented using Quorum Based Storage?
>
> What are the properties that need to set for the data node in the *-site.xml
> ?
>
> Will the data node send report directly to Name Node or will it send to
> Journal Nodes / ZKFC?
>
> Thanks
> SP
>
>
>



-- 
Harsh J

Mime
View raw message