hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suresh Srinivas (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-1220) block not found in blockMap
Date Tue, 17 Feb 2009 23:46:59 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-1220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12674400#action_12674400
] 

Suresh Srinivas commented on HADOOP-1220:
-----------------------------------------

dhruba, should we remove the following code from {{FSDataset.java}}?

{noformat}
      if (f.exists()) {
        //
        // This is a temporary check especially for hadoop-1220. 
        // This will go away in the future.
        //
        DataNode.LOG.info("File " + f + " was deleted but still exists!");
      }
{noformat}

> block not found in blockMap
> ---------------------------
>
>                 Key: HADOOP-1220
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1220
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Koji Noguchi
>            Assignee: dhruba borthakur
>         Attachments: datanodeDeleteBlocks.patch
>
>
> From Hadoop-973  debug message, we had datanode constantly printing out the following
message.
> ...
> 2007-04-02 23:59:50,122 WARN org.apache.hadoop.dfs.DataNode: java.io.IOException: Unexpected
error trying to delete block blk_-3400783150525166031. Block not found in blockMap.
>   at org.apache.hadoop.dfs.FSDataset.invalidate(FSDataset.java:596)
>   at org.apache.hadoop.dfs.DataNode.offerService(DataNode.java:460)
>   at org.apache.hadoop.dfs.DataNode.run(DataNode.java:1053)
>   at java.lang.Thread.run(Thread.java:619)
> 2007-04-02 23:59:50,433 INFO org.apache.hadoop.dfs.DataNode: Served block blk_-8672111663356339464
to /72.30.127.164
> 2007-04-02 23:59:52,993 WARN org.apache.hadoop.dfs.DataNode: java.io.IOException: Unexpected
error trying to delete block blk_-3400783150525166031. Block not found in blockMap.
>   at org.apache.hadoop.dfs.FSDataset.invalidate(FSDataset.java:596)
>   at org.apache.hadoop.dfs.DataNode.offerService(DataNode.java:460)
>   at org.apache.hadoop.dfs.DataNode.run(DataNode.java:1053)
>   at java.lang.Thread.run(Thread.java:619)
> ....
>  Ten minutes before these logs, there was 
> 2007-04-02 20:42:49,648 INFO org.apache.hadoop.dfs.DataNode: Deleting block blk_-3400783150525166031
> There was a  file for that block in the directory.
> /../../hadoop/dfs/data/data/subdir17/blk_-3400783150525166031

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message