hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhe Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-9329) TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer size
Date Fri, 30 Oct 2015 18:46:27 GMT

     [ https://issues.apache.org/jira/browse/HDFS-9329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Zhe Zhang updated HDFS-9329:
----------------------------
    Attachment: HDFS-9329.00.patch

Actually the original test also uses {{waitFor}} in a wrong way. {{waitFor}} waits for a condition
to become true, rather than running a thread for a fixed amount of time. Now the test finishes
much faster (<15 seconds vs > 1 mins before)

> TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than
IO buffer size
> ----------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-9329
>                 URL: https://issues.apache.org/jira/browse/HDFS-9329
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 2.7.1
>            Reporter: Zhe Zhang
>            Assignee: Zhe Zhang
>            Priority: Minor
>         Attachments: HDFS-9329.00.patch
>
>
> {{testRateThrottling}} verifies that bootstrap transfer should timeout with a very small
{{DFS_IMAGE_TRANSFER_BOOTSTRAP_STANDBY_RATE_KEY}} value. However, throttling on the image
sender only happens after sending each IO buffer. Therefore, the test sometimes fails if the
receiver receives the full fsimage (which is smaller than IO buffer size) before throttling
begins.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message