Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A8F4011A61 for ; Tue, 15 Apr 2014 13:50:25 +0000 (UTC) Received: (qmail 97842 invoked by uid 500); 15 Apr 2014 13:50:20 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 96873 invoked by uid 500); 15 Apr 2014 13:50:17 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 96758 invoked by uid 99); 15 Apr 2014 13:50:16 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Apr 2014 13:50:16 +0000 Date: Tue, 15 Apr 2014 13:50:16 +0000 (UTC) From: "Hudson (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-6243) HA NameNode transition to active or shutdown may leave lingering image transfer thread. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-6243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13969553#comment-13969553 ] Hudson commented on HDFS-6243: ------------------------------ FAILURE: Integrated in Hadoop-Hdfs-trunk #1733 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1733/]) HDFS-6243. HA NameNode transition to active or shutdown may leave lingering image transfer thread. Contributed by Chris Nauroth. (cnauroth: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1587410) * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/TransferFsImage.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/StandbyCheckpointer.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/util/DataTransferThrottler.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestStandbyCheckpoints.java > HA NameNode transition to active or shutdown may leave lingering image transfer thread. > --------------------------------------------------------------------------------------- > > Key: HDFS-6243 > URL: https://issues.apache.org/jira/browse/HDFS-6243 > Project: Hadoop HDFS > Issue Type: Bug > Components: ha, namenode > Affects Versions: 3.0.0, 2.4.0 > Reporter: Chris Nauroth > Assignee: Chris Nauroth > Fix For: 3.0.0, 2.5.0 > > Attachments: HDFS-6243.1.patch, HDFS-6243.2.patch > > > With HDFS-4816, the standby uploads the new checkpoint to the active in a background thread. This thread may continue to execute after transitioning to active or shutting down. This is marginally wasteful of bandwidth if the image transfer is large, and it also breaks subsequent tests on Windows since the thread continues to hold a lock on a file descriptor in the storage directory. -- This message was sent by Atlassian JIRA (v6.2#6252)