hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matt Foley (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-1798) saveNamespace should background the writing of the FSImage files when in SafeMode
Date Tue, 05 Jul 2011 22:38:16 GMT

     [ https://issues.apache.org/jira/browse/HDFS-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matt Foley updated HDFS-1798:
-----------------------------

    Assignee:     (was: Matt Foley)

This is a complex change, and after HDFS-1071 only saves the time to write one FSImage, not
four.
Suspending work on this for now.  Re-evaluate after HDFS-1073 is merged back and the new performance
is benchmarked.

> saveNamespace should background the writing of the FSImage files when in SafeMode
> ---------------------------------------------------------------------------------
>
>                 Key: HDFS-1798
>                 URL: https://issues.apache.org/jira/browse/HDFS-1798
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Matt Foley
>         Attachments: 1798_asyncSaveNamespace_v1.patch
>
>
> Even with parallel writes of the FSImage files (HDFS-1071), large clusters still typically
spend 5 minutes writing the files.  When in SafeMode, it should be safe to background these
writes instead of waiting for them.  To enable this, the namenode must be prevented from leaving
SafeMode until the writes are done.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message