hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hairong Kuang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-1458) Improve checkpoint performance by avoiding unnecessary image downloads
Date Thu, 12 May 2011 16:49:47 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13032501#comment-13032501
] 

Hairong Kuang commented on HDFS-1458:
-------------------------------------

Todd, you need the fix to HDFS-1627. We already run this and HDFS-1627, together with image
compression for around 2 months on our large cluster. All seem to pretty stable and have improved
NN availability/responsiveness a lot.

> Improve checkpoint performance by avoiding unnecessary image downloads
> ----------------------------------------------------------------------
>
>                 Key: HDFS-1458
>                 URL: https://issues.apache.org/jira/browse/HDFS-1458
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: name-node
>    Affects Versions: 0.22.0
>            Reporter: Hairong Kuang
>            Assignee: Hairong Kuang
>             Fix For: 0.23.0
>
>         Attachments: checkpoint-checkfsimageissame.patch, trunkNoDownloadImage.patch,
trunkNoDownloadImage1.patch, trunkNoDownloadImage2.patch, trunkNoDownloadImage3.patch
>
>
> If secondary namenode could verify that the image it has on its disk is the same as the
one in the primary NameNode, it could skip downloading the image from the primary NN, thus
completely eliminating the image download overhead.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message