hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hanisha Koneru (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-11877) FileJournalManager#getLogFile should ignore in progress edit logs during JN sync
Date Wed, 24 May 2017 19:41:09 GMT

     [ https://issues.apache.org/jira/browse/HDFS-11877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Hanisha Koneru updated HDFS-11877:
----------------------------------
    Description: 
Due to synchronization introduced in HDFS-4025, a journal might have an edit log and an in
progress edit log with the same start tx id. This would create an exception if GetJournalEditServlet
tries to download edit with that start tx id from FileJournalManager. JournalNodeSyncer can
fail when trying to fetch an edit log in this scenario.

FileJournalManager#getLogFile should ignore in progress edit logs for JN sync downloads.

  was:
Due to synchronization introduced in HDFS-4025, a journal might have an edit log and an in
progress edit log with the same start tx id. This would create an exception if GetJournalEditServlet
tries to download edit with that start tx id from FileJournalManager. JournalNodeSyncer can
fail when trying to fetch an edit log in this scenario.

FileJournalManager#getLogFile should have an option to specify whether in progress edit logs
should be considered or not.


> FileJournalManager#getLogFile should ignore in progress edit logs during JN sync
> --------------------------------------------------------------------------------
>
>                 Key: HDFS-11877
>                 URL: https://issues.apache.org/jira/browse/HDFS-11877
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs
>            Reporter: Hanisha Koneru
>            Assignee: Hanisha Koneru
>
> Due to synchronization introduced in HDFS-4025, a journal might have an edit log and
an in progress edit log with the same start tx id. This would create an exception if GetJournalEditServlet
tries to download edit with that start tx id from FileJournalManager. JournalNodeSyncer can
fail when trying to fetch an edit log in this scenario.
> FileJournalManager#getLogFile should ignore in progress edit logs for JN sync downloads.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message