hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <tdunn...@maprtech.com>
Subject Re: We are looking to the root of the problem that caused us IOException
Date Wed, 06 Apr 2011 07:55:08 GMT
yes.  At least periodically.

You now have a situation where the age distribution of blocks in each
datanode is quite different.  This will lead to different evolution of which
files are retained and that is likely to cause imbalances again.  It will
also cause the performance of your system to be degraded since any given
program probably will have a non-uniform distribution of content in your

Over time, this effect will probably decrease unless you keep your old files

On Tue, Apr 5, 2011 at 11:34 PM, Guy Doulberg <Guy.Doulberg@conduit.com>wrote:

> Do you think we should always run the balance, with low bandwidth, and not
> only after adding new nodes?

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message