hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11877) FileJournalManager#getLogFile should ignore in progress edit logs during JN sync
Date Tue, 24 Apr 2018 20:51:09 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16450779#comment-16450779
] 

Hudson commented on HDFS-11877:
-------------------------------

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14057 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/14057/])
HDFS-11877. FileJournalManager#getLogFile should ignore in progress edit (xyao: rev 0646fb2fa5cf7385a39cd9a80e713384d7540f44)
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/GetJournalEditServlet.java
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/client/IPCLoggerChannel.java
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FileJournalManager.java
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalNodeSyncer.java


> FileJournalManager#getLogFile should ignore in progress edit logs during JN sync
> --------------------------------------------------------------------------------
>
>                 Key: HDFS-11877
>                 URL: https://issues.apache.org/jira/browse/HDFS-11877
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs
>            Reporter: Hanisha Koneru
>            Assignee: Hanisha Koneru
>            Priority: Major
>             Fix For: 3.0.0-alpha4
>
>         Attachments: HDFS-11877.001.patch
>
>
> Due to synchronization introduced in HDFS-4025, a journal might have an edit log and
an in progress edit log with the same start tx id. This would create an exception if GetJournalEditServlet
tries to download edit with that start tx id from FileJournalManager. JournalNodeSyncer can
fail when trying to fetch an edit log in this scenario.
> FileJournalManager#getLogFile should ignore in progress edit logs for JN sync downloads.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message