hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Patrick Angeles <patr...@cloudera.com>
Subject Re: Large amount of corruption after balancer
Date Wed, 27 Oct 2010 13:54:24 GMT
Nick,

The corruption may have been caused by running out of disk space. At that
point, even after rebalancing, you will still have corruption. Under normal
circumstances, balancing by itself should not result in corruption.

Regards,

- Patrick

On Wed, Oct 27, 2010 at 9:40 AM, Jones, Nick <nick.jones@amd.com> wrote:

> Hello everyone,
>
> I just recently started running the balancer to fix job errors where a
> particular task runs out of local disk; however, I've noticed that I usually
> end up with a significant amount of corruption after it completes.  Has
> anyone else observed this behavior?
>
> I'm using Cloudera's CDH2 distribution (0.20.1+169.89) and the balancer
> completes successfully.
>
> Thanks.
>
> Nick Jones
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message