hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sergey Murylev <sergeymury...@gmail.com>
Subject Re: How to keep data consistency?
Date Wed, 19 Feb 2014 09:10:24 GMT
Hi Edward,

You can't achieve data consistency on your cluster configuration. To do
this you need at least 3 data nodes and enabled replication with level 3
( dfs.replication property in hdfs-site.xml).

On 19/02/14 13:02, EdwardKing wrote:
> Hadoop 2.2.0, two computer, one is master,another is node1. I want to
> know following scene:
> If node1 is down by some reason, but I don't know node1 can't work,
> then I use hadoop command to put a file,such as:
> $ hadoop fs -put graph.txtgraphin/graph.txt
> I know graph.txt file will be put master machine,but node1 computer
> don't contains this file. After some time, node1 machine can repair,
> there will be inconsistent because of graph.txt file,how to realize
> consistency between master machine and node1 machine? Thanks.
> ---------------------------------------------------------------------------------------------------
> Confidentiality Notice: The information contained in this e-mail and
> any accompanying attachment(s)
> is intended only for the use of the intended recipient and may be
> confidential and/or privileged of
> Neusoft Corporation, its subsidiaries and/or its affiliates. If any
> reader of this communication is
> not the intended recipient, unauthorized use, forwarding, printing,
> storing, disclosure or copying
> is strictly prohibited, and may be unlawful.If you have received this
> communication in error,please
> immediately notify the sender by return e-mail, and delete the
> original message and all copies from
> your system. Thank you.
> ---------------------------------------------------------------------------------------------------

View raw message