hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9962) Erasure Coding: need a way to test multiple EC policies
Date Fri, 06 Oct 2017 01:05:02 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16194007#comment-16194007

Andrew Wang commented on HDFS-9962:

Hi [~tasanuma0829], thanks for working on this,

Is your concern about flakiness related to test timeouts? We've been struggling with that
recently, since increasing the cell size from 64k to 1MB greatly increased test runtimes.
The approach we've been taking is to split long running tests into separate classes, or "parameterizing"
by creating a lot of subclasses.

We randomized the policy tests to reduce the runtime of the test suite, under the belief that
there wasn't much incremental benefit from running all of them every time. I think that's
still true, and would prefer we randomize any long-running tests. If the tests run quickly,
then it's okay to be exhaustive.

> Erasure Coding: need a way to test multiple EC policies
> -------------------------------------------------------
>                 Key: HDFS-9962
>                 URL: https://issues.apache.org/jira/browse/HDFS-9962
>             Project: Hadoop HDFS
>          Issue Type: Test
>            Reporter: Rui Li
>            Assignee: Takanobu Asanuma
>              Labels: hdfs-ec-3.0-nice-to-have
> Now that we support multiple EC policies, we need a way test it to catch potential issues.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message