hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ikweesung (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-5809) BlockPoolSliceScanner make datanode to drop into infinite loop
Date Wed, 22 Jan 2014 07:53:22 GMT
ikweesung created HDFS-5809:

             Summary: BlockPoolSliceScanner make datanode to drop into infinite loop
                 Key: HDFS-5809
                 URL: https://issues.apache.org/jira/browse/HDFS-5809
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: datanode
    Affects Versions: 2.0.0-alpha
         Environment: jdk1.6, centos6.4
            Reporter: ikweesung
            Priority: Critical

Hello, everyone.

When hadoop cluster starts, BlockPoolSliceScanner start scanning the blocks in my cluster.
Then, randomly one datanode drop into infinite loop as the log show, and finally all datanodes
drop into infinite loop.
Every datanode just verify fail by one block. 
When i check the fail block like this : hadoop fsck / -files -blocks | grep blk_1223474551535936089_4702249,
no hdfs file contains the block.

It seems that in while block of BlockPoolSliceScanner's scan method drop into infinite loop
BlockPoolSliceScanner: 650

while (datanode.shouldRun
&& !datanode.blockScanner.blockScannerThread.isInterrupted()
&& datanode.isBPServiceAlive(blockPoolId)) { ....

The log finally printed in method verifyBlock(BlockPoolSliceScanner:453).

Please excuse my poor English.

This message was sent by Atlassian JIRA

View raw message