hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-7265) Use a throttler for replica write in datanode
Date Wed, 06 May 2015 03:37:42 GMT

     [ https://issues.apache.org/jira/browse/HDFS-7265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Allen Wittenauer updated HDFS-7265:
-----------------------------------
    Labels: BB2015-05-TBR  (was: )

> Use a throttler for replica write in datanode
> ---------------------------------------------
>
>                 Key: HDFS-7265
>                 URL: https://issues.apache.org/jira/browse/HDFS-7265
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Tsz Wo Nicholas Sze
>              Labels: BB2015-05-TBR
>         Attachments: h7265_20141018.patch
>
>
> BlockReceiver process packets in BlockReceiver.receivePacket() as follows
> # read from socket
> # enqueue the ack
> # write to downstream
> # write to disk
> The above steps is repeated for each packet in a single thread.  When there are a lot
of concurrent writes in a datanode, the write time in #4 becomes very long.  As a result,
it leads to SocketTimeoutException since it cannot read from the socket for a long time.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message