hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-4298) StorageRetentionManager spews warnings when used with QJM
Date Tue, 11 Dec 2012 00:37:23 GMT
Todd Lipcon created HDFS-4298:

             Summary: StorageRetentionManager spews warnings when used with QJM
                 Key: HDFS-4298
                 URL: https://issues.apache.org/jira/browse/HDFS-4298
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: namenode
    Affects Versions: 3.0.0, 2.0.3-alpha
            Reporter: Todd Lipcon
            Assignee: Aaron T. Myers

When the NN is configured with a QJM, we see the following warning message every time a checkpoint
is made or uploaded:
12/12/10 16:07:52 WARN namenode.FSEditLog: Unable to determine input streams from QJM to [,,]. Skipping.
org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve
quorum size 2/3. 3 exceptions thrown: Asked for firstTxId 114837 which is in the middle of file /tmp/jn-2/myjournal/current/edits_0000000000000095185-0000000000000114846

This is because, since HDFS-2946, the NN calls {{selectInputStreams}} to determine the number
of log segments and put a cap on the number. This API throws an exception in the case of QJM
if the argument falls in the middle of an edit log boundary.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message