hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From John Lilley <john.lil...@redpoint.net>
Subject Need help: fsck FAILs, refuses to clean up corrupt fs
Date Tue, 04 Mar 2014 13:08:07 GMT
I have a file system with some missing/corrupt blocks.  However, running hdfs fsck -delete
also fails with errors.  How do I get around this?
Thanks
John

[hdfs@metallica yarn]$ hdfs fsck -delete /rpdm/tmp/ProjectTemp_461_40/TempFolder_4/data00012_000000.dld
Connecting to namenode via http://anthrax.office.datalever.com:50070
FSCK started by hdfs (auth:SIMPLE) from /192.168.57.110 for path /rpdm/tmp/ProjectTemp_461_40/TempFolder_4/data00012_000000.dld
at Tue Mar 04 06:05:40 MST 2014
.
/rpdm/tmp/ProjectTemp_461_40/TempFolder_4/data00012_000000.dld: CORRUPT blockpool BP-1827033441-192.168.57.112-1384284857542
block blk_1074200714

/rpdm/tmp/ProjectTemp_461_40/TempFolder_4/data00012_000000.dld: CORRUPT blockpool BP-1827033441-192.168.57.112-1384284857542
block blk_1074200741

/rpdm/tmp/ProjectTemp_461_40/TempFolder_4/data00012_000000.dld: CORRUPT blockpool BP-1827033441-192.168.57.112-1384284857542
block blk_1074200778

/rpdm/tmp/ProjectTemp_461_40/TempFolder_4/data00012_000000.dld: MISSING 3 blocks of total
size 299116266 B.Status: CORRUPT
Total size:    299116266 B
Total dirs:    0
Total files:   1
Total symlinks:                0
Total blocks (validated):      3 (avg. block size 99705422 B)
  ********************************
  CORRUPT FILES:        1
  MISSING BLOCKS:       3
  MISSING SIZE:         299116266 B
  CORRUPT BLOCKS:       3
  ********************************
Minimally replicated blocks:   0 (0.0 %)
Over-replicated blocks:        0 (0.0 %)
Under-replicated blocks:       0 (0.0 %)
Mis-replicated blocks:         0 (0.0 %)
Default replication factor:    3
Average block replication:     0.0
Corrupt blocks:                3
Missing replicas:              0
Number of data-nodes:          8
Number of racks:               1
FSCK ended at Tue Mar 04 06:05:40 MST 2014 in 1 milliseconds
FSCK ended at Tue Mar 04 06:05:40 MST 2014 in 1 milliseconds
fsck encountered internal errors!


Fsck on path '/rpdm/tmp/ProjectTemp_461_40/TempFolder_4/data00012_000000.dld' FAILED

Mime
View raw message