Return-Path: X-Original-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 07785DE7B for ; Wed, 1 Aug 2012 20:49:07 +0000 (UTC) Received: (qmail 70584 invoked by uid 500); 1 Aug 2012 20:49:04 -0000 Delivered-To: apmail-hadoop-hdfs-dev-archive@hadoop.apache.org Received: (qmail 70369 invoked by uid 500); 1 Aug 2012 20:49:03 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-dev@hadoop.apache.org Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 69990 invoked by uid 99); 1 Aug 2012 20:49:03 -0000 Received: from issues-vm.apache.org (HELO issues-vm) (140.211.11.160) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Aug 2012 20:49:03 +0000 Received: from isssues-vm.apache.org (localhost [127.0.0.1]) by issues-vm (Postfix) with ESMTP id 4FB7D14285A for ; Wed, 1 Aug 2012 20:49:03 +0000 (UTC) Date: Wed, 1 Aug 2012 20:49:03 +0000 (UTC) From: "Todd Lipcon (JIRA)" To: hdfs-dev@hadoop.apache.org Message-ID: <196707676.2120.1343854143330.JavaMail.jiratomcat@issues-vm> Subject: [jira] [Created] (HDFS-3751) DN should log warnings for lengthy disk IOs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Todd Lipcon created HDFS-3751: --------------------------------- Summary: DN should log warnings for lengthy disk IOs Key: HDFS-3751 URL: https://issues.apache.org/jira/browse/HDFS-3751 Project: Hadoop HDFS Issue Type: Improvement Components: data-node Affects Versions: 1.2.0, 2.1.0-alpha Reporter: Todd Lipcon Assignee: Todd Lipcon Occasionally failing disks or other OS-and-below issues cause a single IO to take tens of seconds, or even minutes in the case of failures. This often results in timeout exceptions at the client side which are hard to diagnose. It would be easier to root-cause these issues if the DN logged a WARN like "IO of 64kb to volume /data/1/dfs/dn for block 12345234 client 1.2.3.4 took 61.3 seconds" or somesuch. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira