hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Takanobu Asanuma (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12637) Extend TestDistributedFileSystemWithECFile with a random EC policy
Date Fri, 13 Oct 2017 10:21:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203349#comment-16203349

Takanobu Asanuma commented on HDFS-12637:

Thanks for the comment, [~xiaochen].

Yes, that's right. But the random ec policy test is needed for a few reasons which are discussed
in HDFS-7866 and HDFS-9962. I would like to quote Andrew's comment from HDFS-9962 that I agree.

bq. We randomized the policy tests to reduce the runtime of the test suite, under the belief
that there wasn't much incremental benefit from running all of them every time.

In summary, I'm working on this task following below:
* Default policy (RS-6-3) always gets tested.
* Create a random ec policy test if the test is long-running (e.g. using minicluster many
* If the test is short-running, all policies test with parametrizing would be better.

> Extend TestDistributedFileSystemWithECFile with a random EC policy
> ------------------------------------------------------------------
>                 Key: HDFS-12637
>                 URL: https://issues.apache.org/jira/browse/HDFS-12637
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: erasure-coding, test
>            Reporter: Takanobu Asanuma
>            Assignee: Takanobu Asanuma
>         Attachments: HDFS-12637.1.patch

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message