hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stas Oskin <stas.os...@gmail.com>
Subject Re: Datanode high memory usage
Date Tue, 01 Sep 2009 18:53:41 GMT

The datanode would be using the major part of memory to do following-
> a. Continuously (at regular interval) send heartbeat messages to namenode
> to
> say 'I am live and awake'
> b. In case, any data/file is added to DFS, OR Map Reduce jobs are running,
> datanode would again be talking to namenode or transferring data from its
> local copy to either client or other slave datanodes in the cluster
These operations don't seem as quite memory intensive, any idea why DN will
take most of the memory?


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message