hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Емельянов Борис <emelya...@post.km.ru>
Subject Re: a question about dfs.replication
Date Mon, 01 Jul 2013 07:17:51 GMT
On 01.07.2013 10:19, Francis.Hu wrote:
>
> Hi, All
>
> I am installing a cluster with Hadoop 2.0.5-alpha. I have one namenode 
> and two datanodes. The dfs.replication is set as 2 in hdfs-site.xml. 
> After all configuration work is done, I started all nodes. Then I 
> saved a file into HDFS through java client. nOW I can access hdfs web 
> page: x.x.x.x:50070,and also see the file is already listed in the 
> hdfs list.
>
> My question is: *The replication column in HDFS web page is showing as 
> 3, not 2.  Does anyone know What the problem is?*
>
> **
>
> ---Actual setting of hdfs-site.xml
>
> <property>
>
> <name>dfs.replication</name>
>
> <value>2</value>
>
> </property>
>
> After that, I typed dfsamdin command to check the file:
>
> hdfs fsck /test3/
>
> The result of above command:
>
> /test3/hello005.txt:  Under replicated 
> BP-609310498-192.168.219.129-1372323727200:blk_-1069303317294683372_1006. 
> Target Replicas is 3 but found 2 replica(s).
>
> Status: HEALTHY
>
>  Total size:    35 B
>
>  Total dirs:    1
>
>  Total files:   1
>
>  Total blocks (validated):      1 (avg. block size 35 B)
>
>  Minimally replicated blocks:   1 (100.0 %)
>
>  Over-replicated blocks: 0 (0.0 %)
>
>  Under-replicated blocks:       1 (100.0 %)
>
>  Mis-replicated blocks:         0 (0.0 %)
>
>  Default replication factor:    2
>
>  Average block replication:     2.0
>
>  Corrupt blocks: 0
>
>  Missing replicas: 1 (33.333332 %)
>
>  Number of data-nodes:          3
>
>  Number of racks: 1
>
> FSCK ended at Sat Jun 29 16:51:37 CST 2013 in 6 milliseconds
>
> Thanks,
>
> Francis Hu
>
If I'm not mistaking "dfs.replication" parameter in config sets only 
default replication factor, which can be overrided when putting file to 
hdfs.

Mime
View raw message