hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Koji Noguchi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-1220) block not found in blockMap
Date Wed, 25 Apr 2007 20:37:15 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-1220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491761
] 

Koji Noguchi commented on HADOOP-1220:
--------------------------------------

bq. This time the block in question does not appear in the dfs data directory.

We've seen both cases.

1) block exist on local dfs dir. 
     Error messages repeats every second.

2) block doesn't exist on local dfs dir.
     Error message only shows up once.


It happened when a large number of files were deleted on the cluster.


> block not found in blockMap
> ---------------------------
>
>                 Key: HADOOP-1220
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1220
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Koji Noguchi
>
> From Hadoop-973  debug message, we had datanode constantly printing out the following
message.
> ...
> 2007-04-02 23:59:50,122 WARN org.apache.hadoop.dfs.DataNode: java.io.IOException: Unexpected
error trying to delete block blk_-3400783150525166031. Block not found in blockMap.
>   at org.apache.hadoop.dfs.FSDataset.invalidate(FSDataset.java:596)
>   at org.apache.hadoop.dfs.DataNode.offerService(DataNode.java:460)
>   at org.apache.hadoop.dfs.DataNode.run(DataNode.java:1053)
>   at java.lang.Thread.run(Thread.java:619)
> 2007-04-02 23:59:50,433 INFO org.apache.hadoop.dfs.DataNode: Served block blk_-8672111663356339464
to /72.30.127.164
> 2007-04-02 23:59:52,993 WARN org.apache.hadoop.dfs.DataNode: java.io.IOException: Unexpected
error trying to delete block blk_-3400783150525166031. Block not found in blockMap.
>   at org.apache.hadoop.dfs.FSDataset.invalidate(FSDataset.java:596)
>   at org.apache.hadoop.dfs.DataNode.offerService(DataNode.java:460)
>   at org.apache.hadoop.dfs.DataNode.run(DataNode.java:1053)
>   at java.lang.Thread.run(Thread.java:619)
> ....
>  Ten minutes before these logs, there was 
> 2007-04-02 20:42:49,648 INFO org.apache.hadoop.dfs.DataNode: Deleting block blk_-3400783150525166031
> There was a  file for that block in the directory.
> /../../hadoop/dfs/data/data/subdir17/blk_-3400783150525166031

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message