hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hairong Kuang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-1458) Improve checkpoint performance by avoiding unnecessary image downloads
Date Tue, 23 Nov 2010 19:25:18 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934991#action_12934991
] 

Hairong Kuang commented on HDFS-1458:
-------------------------------------

Note that this patch uses checksum to compare if primary & secondary have the same image
or not. Once HDFS-1073 is in, we could switch to use transaction id.

> Improve checkpoint performance by avoiding unnecessary image downloads
> ----------------------------------------------------------------------
>
>                 Key: HDFS-1458
>                 URL: https://issues.apache.org/jira/browse/HDFS-1458
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: name-node
>    Affects Versions: 0.22.0
>            Reporter: Hairong Kuang
>            Assignee: Hairong Kuang
>             Fix For: 0.22.0
>
>         Attachments: checkpoint-checkfsimageissame.patch, trunkNoDownloadImage.patch,
trunkNoDownloadImage1.patch
>
>
> If secondary namenode could verify that the image it has on its disk is the same as the
one in the primary NameNode, it could skip downloading the image from the primary NN, thus
completely eliminating the image download overhead.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message