hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brandon Li (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (HDFS-3300) stream the edit segments to NameNode when NameNode starts up
Date Tue, 01 May 2012 17:02:49 GMT

     [ https://issues.apache.org/jira/browse/HDFS-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Brandon Li reassigned HDFS-3300:

    Assignee: Brandon Li
> stream the edit segments to NameNode when NameNode starts up
> ------------------------------------------------------------
>                 Key: HDFS-3300
>                 URL: https://issues.apache.org/jira/browse/HDFS-3300
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ha, name-node
>            Reporter: Brandon Li
>            Assignee: Brandon Li
> Edit logs are saved on Journal daemon. When NameNode starts, it loads the latest image
file and then streams the edit logs from an active Journal daemon. 
> Currently we are using http to transfer edit files between two journal daemons/nodes
or between a journal daemon and a NameNode. To get edit file from Journal daemon, the NameNode
has to download it first and then read it from the disk.
> To avoid the slow start-up time, NameNode should be enhance to read the http data stream
and update its in memory name space instead of saving the streamed data on disk first.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message