hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-4867) metaSave NPEs when there are invalid blocks in repl queue.
Date Thu, 06 Jun 2013 20:52:20 GMT

     [ https://issues.apache.org/jira/browse/HDFS-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Konstantin Shvachko updated HDFS-4867:
--------------------------------------

    Attachment: HDFS-4867.branch-0.23.patch

I took liberty to reorder imports for 0.23 to bring it in sync with branch 2. That may save
us time in the future.
                
> metaSave NPEs when there are invalid blocks in repl queue.
> ----------------------------------------------------------
>
>                 Key: HDFS-4867
>                 URL: https://issues.apache.org/jira/browse/HDFS-4867
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: namenode
>    Affects Versions: 0.23.7, 2.0.4-alpha, 0.23.8
>            Reporter: Kihwal Lee
>            Assignee: Plamen Jeliazkov
>             Fix For: 3.0.0, 2.0.5-alpha
>
>         Attachments: HDFS-4867.branch-0.23.patch, HDFS-4867.branch-0.23.patch, HDFS-4867.branch-0.23.patch,
HDFS-4867.branch-0.23.patch, HDFS-4867.branch-2.patch, HDFS-4867.branch2.patch, HDFS-4867.branch2.patch,
HDFS-4867.branch2.patch, HDFS-4867.trunk.patch, HDFS-4867.trunk.patch, HDFS-4867.trunk.patch,
HDFS-4867.trunk.patch, testMetaSave.log
>
>
> Since metaSave cannot get the inode holding a orphaned/invalid block, it NPEs and stops
generating further report. Normally ReplicationMonitor removes them quickly, but if the queue
is huge, it takes very long time. Also in safe mode, they stay.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message