hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Hadoop hardware failure recovery
Date Sun, 12 Aug 2012 12:45:12 GMT

Your question seems to be about data (blocks) loss. Hadoop would
recover by detecting the blocks you've lost from that disk failure
(auto) and re-replicate their copies from the other available
redundant copies in the cluster (Controlled via the configurable
replication factor).

On Sat, Aug 11, 2012 at 12:08 AM, Aji Janis <aji1705@gmail.com> wrote:
> I am very new to Hadoop. I am considering setting up a Hadoop cluster
> consisting of 5 nodes where each node has 3 internal hard drives. I
> understand HDFS has a configurable redundancy feature but what happens if an
> entire drive crashes (physically) for whatever reason? How does Hadoop
> recover, if it can, from this situation? What else should I know before
> setting up my cluster this way? Thanks in advance.

Harsh J

View raw message