hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "liaoyuxiangqin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7786) Handle slow writers for DFSStripedOutputStream
Date Wed, 07 Feb 2018 03:10:03 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16354898#comment-16354898
] 

liaoyuxiangqin commented on HDFS-7786:
--------------------------------------

[~libo-intel] I take a think on this issue, and want to process as follows:

1.select the slow streamers when one block group write end through comprehensive consideration
slow threshold and time consuming Median. 

2.use slow streams target datanodes as excluded nodes for next block group allocate, so that
avoid write data to slow datanodes. Thanks.

Can you give me more advice!

> Handle slow writers for DFSStripedOutputStream
> ----------------------------------------------
>
>                 Key: HDFS-7786
>                 URL: https://issues.apache.org/jira/browse/HDFS-7786
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Li Bo
>            Priority: Major
>              Labels: hdfs-ec-3.0-nice-to-have
>             Fix For: HDFS-7285
>
>
> The streamers in DFSStripedOutputStream may have different write speed. We need to consider
and handle the situation when one or more streamers begin to write slowly.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message