hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lohit Vijayarenu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7123) Run legacy fsimage checkpoint in parallel with PB fsimage checkpoint
Date Tue, 23 Sep 2014 17:24:35 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14145065#comment-14145065
] 

Lohit Vijayarenu commented on HDFS-7123:
----------------------------------------

If we drop the lock then users of these images will have to have the knowledge that both are
of them could be out of sync. Parallel checkpoint takes more CPU, but that that point it is
holding big lock where no other CPU intensive task is going on anyways. Changes look good.
+1 on the patch. 

> Run legacy fsimage checkpoint in parallel with PB fsimage checkpoint
> --------------------------------------------------------------------
>
>                 Key: HDFS-7123
>                 URL: https://issues.apache.org/jira/browse/HDFS-7123
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Ming Ma
>            Assignee: Ming Ma
>         Attachments: HDFS-7123.patch
>
>
> HDFS-7097 will address the checkpoint and BR issue. In addition, it might still be useful
to reduce the overall checkpoint duration, given it blocks edit log replay. If there is large
volume of edit log to catch up and NN fail overs, it will impact the availability.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message