hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaoyu Yao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7475) Make TestLazyPersistFiles#testLazyPersistBlocksAreSaved deterministic
Date Wed, 10 Dec 2014 21:41:13 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14241792#comment-14241792
] 

Xiaoyu Yao commented on HDFS-7475:
----------------------------------

Findbugs warnings are not introduced by the patch. Filed HDFS-7507 to fix findbugs issue in
hadoop-hdfs project. 

> Make TestLazyPersistFiles#testLazyPersistBlocksAreSaved deterministic 
> ----------------------------------------------------------------------
>
>                 Key: HDFS-7475
>                 URL: https://issues.apache.org/jira/browse/HDFS-7475
>             Project: Hadoop HDFS
>          Issue Type: Test
>          Components: test
>    Affects Versions: 2.6.0
>            Reporter: Xiaoyu Yao
>            Assignee: Xiaoyu Yao
>         Attachments: HDFS-7475.0.patch, HDFS-7475.1.patch
>
>
> TestLazyPersistFiles#testLazyPersistBlocksAreSaved verifies that the memory block is
saved in lazy persist directory after some sleep with the following code. 
> {code}
>     // Sleep for a short time to allow the lazy writer thread to do its job
>     Thread.sleep(6 * LAZY_WRITER_INTERVAL_SEC * 1000);
> {code} 
> However, the sleep only guarantees an async lazy persist task is scheduled. The task
running on a per volume thread pool thread can take longer to finish persisting. It will be
more deterministic to wait the pending lazy persist task count reduce to 0 before verifying
the block file exist in lazy persist dir. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message