Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A2422181AA for ; Fri, 30 Oct 2015 18:46:28 +0000 (UTC) Received: (qmail 68470 invoked by uid 500); 30 Oct 2015 18:46:28 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 68384 invoked by uid 500); 30 Oct 2015 18:46:28 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 68333 invoked by uid 99); 30 Oct 2015 18:46:27 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Oct 2015 18:46:27 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id C7AEE2C1F58 for ; Fri, 30 Oct 2015 18:46:27 +0000 (UTC) Date: Fri, 30 Oct 2015 18:46:27 +0000 (UTC) From: "Zhe Zhang (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HDFS-9329) TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer size MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-9329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9329: ---------------------------- Attachment: HDFS-9329.00.patch Actually the original test also uses {{waitFor}} in a wrong way. {{waitFor}} waits for a condition to become true, rather than running a thread for a fixed amount of time. Now the test finishes much faster (<15 seconds vs > 1 mins before) > TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer size > ---------------------------------------------------------------------------------------------------- > > Key: HDFS-9329 > URL: https://issues.apache.org/jira/browse/HDFS-9329 > Project: Hadoop HDFS > Issue Type: Bug > Components: test > Affects Versions: 2.7.1 > Reporter: Zhe Zhang > Assignee: Zhe Zhang > Priority: Minor > Attachments: HDFS-9329.00.patch > > > {{testRateThrottling}} verifies that bootstrap transfer should timeout with a very small {{DFS_IMAGE_TRANSFER_BOOTSTRAP_STANDBY_RATE_KEY}} value. However, throttling on the image sender only happens after sending each IO buffer. Therefore, the test sometimes fails if the receiver receives the full fsimage (which is smaller than IO buffer size) before throttling begins. -- This message was sent by Atlassian JIRA (v6.3.4#6332)