hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2731) Autopopulate standby name dirs if they're empty
Date Fri, 13 Jan 2012 18:58:39 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13185751#comment-13185751
] 

Todd Lipcon commented on HDFS-2731:
-----------------------------------

bq. I am missing this: both Image and Edits should be on shared dirs (ie no need to copy image
from primary - it should be available in shared dir).

Since we generalized the edit log interface, we can't store images on the shared edit storage.
We only get the stream abstraction for it. We could also extend the system to require a shared
*image* dir, but then we couldn't support BK-based HA. (In the future when we can store checkpoints
in HDFS itself we wouldn't have that issue)
                
> Autopopulate standby name dirs if they're empty
> -----------------------------------------------
>
>                 Key: HDFS-2731
>                 URL: https://issues.apache.org/jira/browse/HDFS-2731
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ha
>    Affects Versions: HA branch (HDFS-1623)
>            Reporter: Eli Collins
>            Assignee: Eli Collins
>
> To setup a SBN we currently format the primary then manually copy the name dirs to the
SBN. The SBN should do this automatically. Specifically, on NN startup, if HA with a shared
edits dir is configured and populated, if the SBN has empty name dirs it should downloads
the image and log from the primary (as an optimization it could copy the logs from the shared
dir). If the other NN is still in standby then it should fail to start as it does currently.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message