hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hairong Kuang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-1509) Resync discarded directories in fs.name.dir during saveNamespace command
Date Thu, 16 Dec 2010 08:01:03 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12971992#action_12971992
] 

Hairong Kuang commented on HDFS-1509:
-------------------------------------

I agree with Eli that this looks good except for a couple of improvements:
1. Could restore the accidentally commented-out tests?
2. attemptRestoreRemovedStorage formats the newly added previously removed storage directories,
which calls saveCurrent that save fsimage to disk. Later on saveNamespace save the namespace
again. Could you make name space saving to be done only once? 

> Resync discarded directories in fs.name.dir during saveNamespace command
> ------------------------------------------------------------------------
>
>                 Key: HDFS-1509
>                 URL: https://issues.apache.org/jira/browse/HDFS-1509
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: name-node
>            Reporter: dhruba borthakur
>            Assignee: dhruba borthakur
>         Attachments: resyncBadNameDir1.txt, resyncBadNameDir2.txt
>
>
> In the current implementation, if the Namenode encounters an error while writing to a
fs.name.dir directory it stops writing new edits to that directory. My proposal is to make
 the namenode write the fsimage to all configured directories in fs.name.dir, and from then
on, continue writing fsedits to all configured directories.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message