hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adam Kawa <kawa.a...@gmail.com>
Subject Re: empty file
Date Wed, 11 Dec 2013 19:37:22 GMT
i have never seen something like that.

Can you read that file?

$ hadoop fs -text  /tmp/corrupt_lzo/lc_hadoop16.1386270004881.lzo


2013/12/11 chenchun <chenchun.feed@gmail.com>

> Hi,
> I find some files on hdfs which command “hadoop fs -ls” tells they are not
> empty. But command “fsck” tells that  these files have no replications. Is
> it normal?
>
> $ hadoop fs -ls /tmp/corrupt_lzo/lc_hadoop16.1386270004881.lzo;
> Found 1 items
> -rw-r--r--   3 sankuai supergroup    1123927 2013-12-06 03:22
> /tmp/corrupt_lzo/lc_hadoop16.1386270004881.lzo
>
> $  /opt/local/hadoop/bin/hadoop fsck
> /tmp/corrupt_lzo/lc_hadoop16.1386270004881.lzo  -files -blocks -locations
> -racks
> FSCK started by sankuai from /10.64.10.102 for path
> /tmp/corrupt_lzo/lc_hadoop16.1386270004881.lzo at Wed Dec 11 20:35:30 CST
> 2013
> Status: HEALTHY
>  Total size:    0 B (Total open files size: 1123927 B)
>  Total dirs:    0
>  Total files:   0 (Files currently being written: 1)
>  Total blocks (validated):   0 (Total open file blocks (not validated): 1)
>  Minimally replicated blocks:   0
>  Over-replicated blocks:     0
>  Under-replicated blocks:    0
>  Mis-replicated blocks:      0
>  Default replication factor: 3
>  Average block replication:  0.0
>  Corrupt blocks:             0
>  Missing replicas:           0
>  Number of data-nodes:       38
>  Number of racks:            6
> FSCK ended at Wed Dec 11 20:35:30 CST 2013 in 1 milliseconds
>
>
> The filesystem under path '/tmp/corrupt_lzo/lc_hadoop16.1386270004881.lzo'
> is HEALTHY
>
> --
> chenchun
>
>

Mime
View raw message