hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron T. Myers (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2794) HA: Active NN may purge edit log files before standby NN has a chance to read them
Date Mon, 16 Jan 2012 07:39:40 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13186752#comment-13186752
] 

Aaron T. Myers commented on HDFS-2794:
--------------------------------------

Agree it's not super high priority, but we should try to improve the situation if we can.
Easy things which would help would be to:

* Automatically configure a higher minimum retention count if HA is enabled
* Make sure to document that admins should also configure a remote fsimage dir in addition
to the shared remote edits dir
                
> HA: Active NN may purge edit log files before standby NN has a chance to read them
> ----------------------------------------------------------------------------------
>
>                 Key: HDFS-2794
>                 URL: https://issues.apache.org/jira/browse/HDFS-2794
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ha, name-node
>    Affects Versions: HA branch (HDFS-1623)
>            Reporter: Aaron T. Myers
>            Assignee: Aaron T. Myers
>
> Given that the active NN is solely responsible for purging finalized edit log segments,
and given that the active NN has no way of knowing when the standby reads edit logs, it's
 possible that the standby NN could fail to read all edits it needs before the active purges
the files.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message