hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "suja s (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3162) BlockMap's corruptNodes count and CorruptReplicas map count is not matching.
Date Thu, 29 Mar 2012 09:02:31 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241089#comment-13241089
] 

suja s commented on HDFS-3162:
------------------------------

Here is the grepped logs with the block:

11:35:02,926 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3912)) - BLOCK* NameSystem.addStoredBlock:
blockMap updated: xx.xx.xx.55:50086 is added to blk_1332906029734_1719 size 30
11:37:00,818 INFO  hdfs.StateChange (FSNamesystem.java:processReport(3773)) - BLOCK* NameSystem.processReport:
block blk_1332906029734_1490 on xx.xx.xx.55:50086 size 30 does not belong to any file.
11:37:00,818 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(2002)) - BLOCK* NameSystem.addToInvalidates:
blk_1332906029734 to xx.xx.xx.55:50086
11:37:02,777 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3459)) - BLOCK*
ask xx.xx.xx.55:50086 to delete  blk_1332906029758_1514 blk_1332906029734_1490 blk_1332906029745_1501
blk_1332906029703_1459 blk_1332906029746_1502 blk_1332906029704_1460 blk_1332906029693_1449
blk_1332906029761_1517
12:36:59,865 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3321))
- BLOCK* ask xx.xx.xx.102:50086 to replicate blk_1332906029734_1719 to datanode(s) xx.xx.xx.102:50010
12:37:01,416 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3912)) - BLOCK* NameSystem.addStoredBlock:
blockMap updated: xx.xx.xx.102:50010 is added to blk_1332906029734_1719 size 30
14:30:15,537 INFO  hdfs.StateChange (CorruptReplicasMap.java:addToCorruptReplicasMap(55))
- BLOCK NameSystem.addToCorruptReplicasMap: blk_1332906029734 added as corrupt on xx.xx.xx.55:50086
by /xx.xx.xx.55
14:30:15,537 INFO  hdfs.StateChange (FSNamesystem.java:invalidateBlock(2125)) - DIR* NameSystem.invalidateBlock:
blk_1332906029734_1719 on xx.xx.xx.55:50086
14:30:15,537 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(2002)) - BLOCK* NameSystem.addToInvalidates:
blk_1332906029734 to xx.xx.xx.55:50086
14:30:18,156 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3459)) - BLOCK*
ask xx.xx.xx.55:50086 to delete  blk_1332906029734_1719
14:38:47,685 WARN  namenode.FSNamesystem (FSNamesystem.java:getBlockLocationsInternal(1119))
- Inconsistent number of corrupt replicas for blk_1332906029734_1719blockMap has 0 but corrupt
replicas map has 1
14:44:34,542 WARN  namenode.FSNamesystem (FSNamesystem.java:getBlockLocationsInternal(1119))
- Inconsistent number of corrupt replicas for blk_1332906029734_1719blockMap has 0 but corrupt
replicas map has 1
14:44:46,937 WARN  namenode.FSNamesystem (FSNamesystem.java:getBlockLocationsInternal(1119))
- Inconsistent number of corrupt replicas for blk_1332906029734_1719blockMap has 0 but corrupt
replicas map has 1
14:45:15,794 WARN  namenode.FSNamesystem (FSNamesystem.java:getBlockLocationsInternal(1119))
- Inconsistent number of corrupt replicas for blk_1332906029734_1719blockMap has 0 but corrupt
replicas map has 1
14:45:37,893 WARN  namenode.FSNamesystem (FSNamesystem.java:getBlockLocationsInternal(1119))
- Inconsistent number of corrupt replicas for blk_1332906029734_1719blockMap has 0 but corrupt
replicas map has 1
14:53:43,656 WARN  namenode.FSNamesystem (FSNamesystem.java:getBlockLocationsInternal(1119))
- Inconsistent number of corrupt replicas for blk_1332906029734_1719blockMap has 0 but corrupt
replicas map has 1
14:57:31,448 WARN  namenode.FSNamesystem (FSNamesystem.java:getBlockLocationsInternal(1119))
- Inconsistent number of corrupt replicas for blk_1332906029734_1719blockMap has 0 but corrupt
replicas map has 1
15:17:22,642 WARN  namenode.FSNamesystem (FSNamesystem.java:getBlockLocationsInternal(1119))
- Inconsistent number of corrupt replicas for blk_1332906029734_1719blockMap has 0 but corrupt
replicas map has 1
15:21:20,961 WARN  namenode.FSNamesystem (FSNamesystem.java:getBlockLocationsInternal(1119))
- Inconsistent number of corrupt replicas for blk_1332906029734_1719blockMap has 0 but corrupt
replicas map has 1
                
> BlockMap's corruptNodes count and CorruptReplicas map count is not matching.
> ----------------------------------------------------------------------------
>
>                 Key: HDFS-3162
>                 URL: https://issues.apache.org/jira/browse/HDFS-3162
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: name-node
>    Affects Versions: 1.0.0
>            Reporter: suja s
>            Priority: Minor
>             Fix For: 1.0.3
>
>
> Even after invalidating the block, continuosly below log is coming
>  
> Inconsistent number of corrupt replicas for blk_1332906029734_1719blockMap has 0 but
corrupt replicas map has 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message