hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lukas Majercak (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-12514) Cancelled HedgedReads cause block to be marked as suspect on Windows
Date Wed, 20 Sep 2017 16:51:00 GMT

     [ https://issues.apache.org/jira/browse/HDFS-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Lukas Majercak updated HDFS-12514:
----------------------------------
    Description: 
DFSClient with hedged reads enabled will often close previous spawned connections if it successfully
reads from one of them. This can result in DataNode's BlockSender getting a socket exception
and wrongly marking the block as suspect and to be rescanned for errors.

This patch is aimed at adding windows specific network related exception messages to be ignored
in BlockSender.sendPacket.

> Cancelled HedgedReads cause block to be marked as suspect on Windows
> --------------------------------------------------------------------
>
>                 Key: HDFS-12514
>                 URL: https://issues.apache.org/jira/browse/HDFS-12514
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode, hdfs-client
>            Reporter: Lukas Majercak
>            Assignee: Lukas Majercak
>         Attachments: HDFS-12514.001.patch
>
>
> DFSClient with hedged reads enabled will often close previous spawned connections if
it successfully reads from one of them. This can result in DataNode's BlockSender getting
a socket exception and wrongly marking the block as suspect and to be rescanned for errors.
> This patch is aimed at adding windows specific network related exception messages to
be ignored in BlockSender.sendPacket.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message