hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ming Ma (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7123) Run legacy fsimage checkpoint in parallel with PB fsimage checkpoint
Date Tue, 23 Sep 2014 03:11:34 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14144253#comment-14144253
] 

Ming Ma commented on HDFS-7123:
-------------------------------

Alternative approach is to release the lock between PB fsimage checkpoint and legacy fsimage
checkpoint so that edit log replay can catch up. The two formats will have different contents;
but that might be acceptable for certain scenarios. We can make it configurable w.r.t. whether
to release lock between PB fsimage checkpoint and legacy fsimage checkpoint.

> Run legacy fsimage checkpoint in parallel with PB fsimage checkpoint
> --------------------------------------------------------------------
>
>                 Key: HDFS-7123
>                 URL: https://issues.apache.org/jira/browse/HDFS-7123
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Ming Ma
>            Assignee: Ming Ma
>         Attachments: HDFS-7123.patch
>
>
> HDFS-7097 will address the checkpoint and BR issue. In addition, it might still be useful
to reduce the overall checkpoint duration, given it blocks edit log replay. If there is large
volume of edit log to catch up and NN fail overs, it will impact the availability.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message