hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <tdunn...@veoh.com>
Subject Re: [core] problems while coping files from local file system to dfs
Date Mon, 24 Mar 2008 23:58:57 GMT

I hate to point this out, but losing *any* data node will decrease the
replication of some blocks.

On 3/24/08 4:53 PM, "lohit" <lohit_bv@yahoo.com> wrote:

>> Improves performance on the basis that files are copied locally in
>> that node, so there is no need network transmission. But isn't that
>> policy more weak?  If that node crashes ( he worst case), you loses 1
>> redundancy level.
> This policy was for better write performance. As you mentioned, yes in your
> case you have only 2 copies and it increases the probability of losing
> replicas. There has been discussion about having different policy for
> different files, but hasn't been implemented yet.

View raw message