Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 96D94200D0C for ; Wed, 20 Sep 2017 18:51:04 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 9570D1609D8; Wed, 20 Sep 2017 16:51:04 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id D78C11609E2 for ; Wed, 20 Sep 2017 18:51:03 +0200 (CEST) Received: (qmail 5959 invoked by uid 500); 20 Sep 2017 16:51:02 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 5948 invoked by uid 99); 20 Sep 2017 16:51:02 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 Sep 2017 16:51:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 6A3CB1A3D38 for ; Wed, 20 Sep 2017 16:51:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id aDVONWT3kuhL for ; Wed, 20 Sep 2017 16:51:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 48B025F297 for ; Wed, 20 Sep 2017 16:51:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 9312DE0EA5 for ; Wed, 20 Sep 2017 16:51:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 45F11218F8 for ; Wed, 20 Sep 2017 16:51:00 +0000 (UTC) Date: Wed, 20 Sep 2017 16:51:00 +0000 (UTC) From: "Lukas Majercak (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HDFS-12514) Cancelled HedgedReads cause block to be marked as suspect on Windows MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 20 Sep 2017 16:51:04 -0000 [ https://issues.apache.org/jira/browse/HDFS-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12514: ---------------------------------- Description: DFSClient with hedged reads enabled will often close previous spawned connections if it successfully reads from one of them. This can result in DataNode's BlockSender getting a socket exception and wrongly marking the block as suspect and to be rescanned for errors. This patch is aimed at adding windows specific network related exception messages to be ignored in BlockSender.sendPacket. > Cancelled HedgedReads cause block to be marked as suspect on Windows > -------------------------------------------------------------------- > > Key: HDFS-12514 > URL: https://issues.apache.org/jira/browse/HDFS-12514 > Project: Hadoop HDFS > Issue Type: Bug > Components: datanode, hdfs-client > Reporter: Lukas Majercak > Assignee: Lukas Majercak > Attachments: HDFS-12514.001.patch > > > DFSClient with hedged reads enabled will often close previous spawned connections if it successfully reads from one of them. This can result in DataNode's BlockSender getting a socket exception and wrongly marking the block as suspect and to be rescanned for errors. > This patch is aimed at adding windows specific network related exception messages to be ignored in BlockSender.sendPacket. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org