hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-3725) Fix QJM startup when individual JNs have gaps
Date Thu, 26 Jul 2012 00:51:34 GMT
Todd Lipcon created HDFS-3725:

             Summary: Fix QJM startup when individual JNs have gaps
                 Key: HDFS-3725
                 URL: https://issues.apache.org/jira/browse/HDFS-3725
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: ha
    Affects Versions: QuorumJournalManager (HDFS-3077)
            Reporter: Todd Lipcon
            Assignee: Todd Lipcon
            Priority: Minor

This fixes a bug in the HDFS-3077 branch:
If one of the JNs goes down and comes back up, it may have a discontiguous set of logs in
its storage directories. This means that a future {{getEditLogManifest}} call will return
a manifest that has gaps - eg it may have txn 1-3 and 7-9 but be missing 4-6. This is OK because
it's guaranteed that a quorum of JNs do have those edits elsewhere.

This situation currently causes an exception since the RemoteEditLogManifest constructor verifies
that the returned log files form a contiguous set of edits. That was true for the NameNode
but no longer true for this new usage.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message