hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Scott Chen <cy.scott.c...@facebook.com>
Subject Re: What is the biggest problem of extremely large hadoop cluster ?
Date Mon, 22 Feb 2010 18:54:45 GMT
The other problem is that the slowness of the TT heartbeats will make the
job latency worse.


On 2/21/10 7:49 AM, "Jeff Zhang" <zjffdu@gmail.com> wrote:

> Hi ,
> 
> I am curious to know what is the biggest problem of extremely large hadoop
> cluster. What I can imagine now is the memory cost of meta data of hdfs in
> name node. One solution I can think about now is to use other storage
> implementation such as database to store the metadata, although it has
> performance cost. Is there any other solutions or any problems of extremely
> large hadoop cluster ?
> 
> 


Mime
View raw message