hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tarandeep Singh <tarand...@gmail.com>
Subject Re: Doubt regarding Replication Factor
Date Wed, 12 Aug 2009 19:55:22 GMT
A similar question-

If in an N node cluster, a file's replication is set to N (replicate on each
node) and later if a node goes down, will HDFS throw an exception since the
file's replication has gone down below the specified number ?

Thanks,
Tarandeep

On Wed, Aug 12, 2009 at 12:11 PM, Konstantin Shvachko <shv@yahoo-inc.com>wrote:

> You can try it: start a 3 node cluster and create a file with replication
> 5.
>
> The answer is that each data-node can store only one replica of a block.
> So in your case you will get an exception on close() saying the file cannot
> be fully replicated.
>
> Thanks,
> --Konstantin
>
>
> Rakhi Khatwani wrote:
>
>> Hi,
>>   I just wanted to know what if we have set the replication factor greater
>> than the number of nodes in the cluster.
>> for example, i have only 3 nodes in my cluster but i set the replication
>> factor to 5.
>>
>> will it create 3 copies and save it in each node, or can it create more
>> than
>> one copy per node?
>>
>> Regards,
>> Raakhi Khatwani
>>
>>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message