hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brandon Li (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-3425) Enable standby namenode to tail edits from journal service
Date Tue, 15 May 2012 20:27:06 GMT

     [ https://issues.apache.org/jira/browse/HDFS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Brandon Li updated HDFS-3425:
-----------------------------

    Attachment: HDFS-3425.HDFS-3092.patch

This is the initial patch to show the approach and the scope of changes. 

To tail edits, SNN downloads finalized segments from journal service to storage directories
and then load them. Here I try to minimize the change on NN and refuse the same methods used
by journal sync. 

It is expected to be improved later on by directly streaming the edit logs from journal service
to SNN. The security change in Http server will be addressed in a different JIRA HDFS-3426.
                
> Enable standby namenode to tail edits from journal service
> ----------------------------------------------------------
>
>                 Key: HDFS-3425
>                 URL: https://issues.apache.org/jira/browse/HDFS-3425
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ha, name-node
>            Reporter: Brandon Li
>            Assignee: Brandon Li
>         Attachments: HDFS-3425.HDFS-3092.patch
>
>
> In an HA cluster with the journal service configured, namenode should get edit logs from
journal service instead of from local or shared storage directories.  
> As one of the first steps towards this goal, this JIRA is to enable standby namenode
to tail edits from journal services. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message