Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id B3D36200C6C for ; Fri, 5 May 2017 12:08:09 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id B27CB160BBE; Fri, 5 May 2017 10:08:09 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 0B74F160B97 for ; Fri, 5 May 2017 12:08:08 +0200 (CEST) Received: (qmail 2672 invoked by uid 500); 5 May 2017 10:08:08 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 2651 invoked by uid 99); 5 May 2017 10:08:08 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 May 2017 10:08:08 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id C826FC002B for ; Fri, 5 May 2017 10:08:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id G5RgUgRUeWYU for ; Fri, 5 May 2017 10:08:05 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 19F015F5CA for ; Fri, 5 May 2017 10:08:05 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 58380E08BB for ; Fri, 5 May 2017 10:08:04 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 178A721DEC for ; Fri, 5 May 2017 10:08:04 +0000 (UTC) Date: Fri, 5 May 2017 10:08:04 +0000 (UTC) From: "Reid Chan (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HDFS-11760) Make CHECK_CANCEL_INTERVAL configurable MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 05 May 2017 10:08:09 -0000 [ https://issues.apache.org/jira/browse/HDFS-11760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reid Chan updated HDFS-11760: ----------------------------- Attachment: HDFS-11760-trunk.003.patch Use *DFSConfigKeys* instead of initializing in FSImageFormat.Saver > Make CHECK_CANCEL_INTERVAL configurable > --------------------------------------- > > Key: HDFS-11760 > URL: https://issues.apache.org/jira/browse/HDFS-11760 > Project: Hadoop HDFS > Issue Type: Improvement > Affects Versions: 2.7.0, 2.7.1, 2.7.2, 2.7.3, 3.0.0-alpha1, 3.0.0-alpha2 > Reporter: Reid Chan > Priority: Minor > Attachments: HDFS-11760-trunk.001.patch, HDFS-11760-trunk.002.patch, HDFS-11760-trunk.003.patch > > > There's a case in my company: when two namenodes tried to transit state, checkpoint took place in standbynode and it didn't check cancellation until every after 4096 inodes saved, which took too much time between checks in our case and caused state transition fail at the end. After we changed it to 50, state transition succeed. > The *CHECK_CANCEL_INTERVAL* in *FSImageFormat.Saver* was introduced in HDFS-7097 and set to 4096, previously was 50. There may be some reasons for the choice of 4096, but i'm not sure that, so I suggest to make it configurable. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org