hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suresh Srinivas (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2971) some improvements to the manual NN metadata recovery tools
Date Thu, 23 Feb 2012 21:11:57 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13215057#comment-13215057
] 

Suresh Srinivas commented on HDFS-2971:
---------------------------------------

bq. programmer using a hex editor, which is the current situation.
OfflineEditsViewer was done for this reason. It could convert edits to human readable file.
You can edit it and convert it back to editlog. It is not perfect though.

Other idea we had considered was, ignoring the last corrupt edit (most cases corruption),
if you start namenode with a flag.
                
> some improvements to the manual NN metadata recovery tools
> ----------------------------------------------------------
>
>                 Key: HDFS-2971
>                 URL: https://issues.apache.org/jira/browse/HDFS-2971
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: libhdfs
>    Affects Versions: 1.1.0
>            Reporter: Colin Patrick McCabe
>            Assignee: Colin Patrick McCabe
>         Attachments: 2012-02-17_0001-OEV-enhancements-pt.-2.patch, HDFS-2971__print_highest_generation_stamp.txt
>
>
> Some improvements to the manual NN metadata recovery tools.
> Specifically, we want the Offline Edit Viewer (oev) tool to prints out the highest generation
stamp that was encountered when processing the edit log.
> We also want OEV to look for large gaps in the generation stamp, as these can indicate
corruption.  The minimum gap to look for should be configurable with -G or --genStampGap.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message