hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "liaoyuxiangqin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7786) Handle slow writers for DFSStripedOutputStream
Date Wed, 07 Feb 2018 03:10:03 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16354898#comment-16354898

liaoyuxiangqin commented on HDFS-7786:

[~libo-intel] I take a think on this issue, and want to process as follows:

1.select the slow streamers when one block group write end through comprehensive consideration
slow threshold and time consuming Median. 

2.use slow streams target datanodes as excluded nodes for next block group allocate, so that
avoid write data to slow datanodes. Thanks.

Can you give me more advice!

> Handle slow writers for DFSStripedOutputStream
> ----------------------------------------------
>                 Key: HDFS-7786
>                 URL: https://issues.apache.org/jira/browse/HDFS-7786
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Li Bo
>            Priority: Major
>              Labels: hdfs-ec-3.0-nice-to-have
>             Fix For: HDFS-7285
> The streamers in DFSStripedOutputStream may have different write speed. We need to consider
and handle the situation when one or more streamers begin to write slowly.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message