hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Plamen Jeliazkov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4867) metaSave NPEs when there are invalid blocks in repl queue.
Date Sun, 02 Jun 2013 17:04:20 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13672598#comment-13672598
] 

Plamen Jeliazkov commented on HDFS-4867:
----------------------------------------

I agree with Todd. metaSave should not modify the queue -- abandoned blocks should be taken
care of by the BlockManager, specifically the computeDatanodeWork method in the ReplicationMonitor.
I can write up a patch to log the block as abandoned and a test for this. Ravi, have you started
work already? Otherwise I'd like to take this up.
                
> metaSave NPEs when there are invalid blocks in repl queue.
> ----------------------------------------------------------
>
>                 Key: HDFS-4867
>                 URL: https://issues.apache.org/jira/browse/HDFS-4867
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: namenode
>    Affects Versions: 0.23.7, 2.0.4-alpha
>            Reporter: Kihwal Lee
>            Assignee: Ravi Prakash
>
> Since metaSave cannot get the inode holding a orphaned/invalid block, it NPEs and stops
generating further report. Normally ReplicationMonitor removes them quickly, but if the queue
is huge, it takes very long time. Also in safe mode, they stay.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message