The other problem is that the slowness of the TT heartbeats will make the
job latency worse.
On 2/21/10 7:49 AM, "Jeff Zhang" <zjffdu@gmail.com> wrote:
> Hi ,
>
> I am curious to know what is the biggest problem of extremely large hadoop
> cluster. What I can imagine now is the memory cost of meta data of hdfs in
> name node. One solution I can think about now is to use other storage
> implementation such as database to store the metadata, although it has
> performance cost. Is there any other solutions or any problems of extremely
> large hadoop cluster ?
>
>
|