hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Junping Du (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDDS-1532) Ozone: Freon: Improve the concurrent testing framework.
Date Tue, 02 Jul 2019 03:05:00 GMT

    [ https://issues.apache.org/jira/browse/HDDS-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16876624#comment-16876624

Junping Du commented on HDDS-1532:

bq. In this environment, writing the same amount of data, by improving the concurrent framework,
test performance is 8 times faster.
Amazing patch! Great work, [~xudongcao]!

> Ozone: Freon: Improve the concurrent testing framework.
> -------------------------------------------------------
>                 Key: HDDS-1532
>                 URL: https://issues.apache.org/jira/browse/HDDS-1532
>             Project: Hadoop Distributed Data Store
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.4.0
>            Reporter: Xudong Cao
>            Assignee: Xudong Cao
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.4.1
>          Time Spent: 50m
>  Remaining Estimate: 0h
> Currently, Freon's concurrency framework is just on volume-level, but in actual testing,
users are likely to provide a smaller volume number(typically 1), and a larger bucket
number and key number, in which case the existing concurrency framework can not make good
use of the thread pool.
> We need to improve the concurrency policy, make the volume creation task, bucket creation
task, and key creation task all can be equally submitted to the thread pool as a general task. 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message