hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-13144) Avoid writing files to disk in unit tests
Date Tue, 03 Mar 2015 05:33:05 GMT
Andrew Purtell created HBASE-13144:

             Summary: Avoid writing files to disk in unit tests
                 Key: HBASE-13144
                 URL: https://issues.apache.org/jira/browse/HBASE-13144
             Project: HBase
          Issue Type: Test
            Reporter: Andrew Purtell

We have a number of unit tests that read and write relatively small files, but do it often
and run under a timeout clock. If the build or test host is virtual or IO contended or both
then the test can become flaky. Even if the host is up to the IO pressure the test would run
a lot faster if we were not asking the OS to persist anything. Consider both:
- If built against Hadoop 2.6+, spin up miniclusters that keep all blocks in memory-only storage
- Write a simple Hadoop filesystem implementation (or find one) that keeps all state in memory
and use in lieu of LocalFileSystem for unit tests. 

This message was sent by Atlassian JIRA

View raw message