hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-1509) Resync discarded directories in fs.name.dir during saveNamespace command
Date Fri, 19 Nov 2010 18:10:15 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933895#action_12933895
] 

dhruba borthakur commented on HDFS-1509:
----------------------------------------

Absolutely agree that constantly trying to write to  a failed directory will slow things down,
I am not suggesting we do this. Instead, "bin/hadoop dfsadmin -savenamespace" is a command
line utility and is likely to be run manually by an administrator; when this command is run
the namenode saves its entire image from memory in fsimage (and truncates fsedits). I would
like this operation to try writing the fsimage to all configured directories.

> Resync discarded directories in fs.name.dir during saveNamespace command
> ------------------------------------------------------------------------
>
>                 Key: HDFS-1509
>                 URL: https://issues.apache.org/jira/browse/HDFS-1509
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: name-node
>            Reporter: dhruba borthakur
>            Assignee: dhruba borthakur
>
> In the current implementation, if the Namenode encounters an error while writing to a
fs.name.dir directory it stops writing new edits to that directory. My proposal is to make
 the namenode write the fsimage to all configured directories in fs.name.dir, and from then
on, continue writing fsedits to all configured directories.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message