Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6B3C2CE79 for ; Thu, 12 Jul 2012 18:57:35 +0000 (UTC) Received: (qmail 44522 invoked by uid 500); 12 Jul 2012 18:57:35 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 44449 invoked by uid 500); 12 Jul 2012 18:57:35 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 44348 invoked by uid 99); 12 Jul 2012 18:57:35 -0000 Received: from issues-vm.apache.org (HELO issues-vm) (140.211.11.160) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Jul 2012 18:57:35 +0000 Received: from isssues-vm.apache.org (localhost [127.0.0.1]) by issues-vm (Postfix) with ESMTP id B7F3A142822 for ; Thu, 12 Jul 2012 18:57:34 +0000 (UTC) Date: Thu, 12 Jul 2012 18:57:34 +0000 (UTC) From: "Steve Hoffman (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <462552217.43346.1342119454755.JavaMail.jiratomcat@issues-vm> In-Reply-To: <1367562225.43251.1342118735154.JavaMail.jiratomcat@issues-vm> Subject: [jira] [Commented] (HDFS-3647) Expose current xcievers count as metric MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13413072#comment-13413072 ] Steve Hoffman commented on HDFS-3647: ------------------------------------- Yea, like I said, wasn't sure if this had already been implemented. I'll open a CDH DISTRO jira asking for the back port, but as you point out, could be useful in the general 1.X sense. > Expose current xcievers count as metric > --------------------------------------- > > Key: HDFS-3647 > URL: https://issues.apache.org/jira/browse/HDFS-3647 > Project: Hadoop HDFS > Issue Type: Improvement > Components: data-node, performance > Affects Versions: 0.20.2 > Reporter: Steve Hoffman > > Not sure if this is in a newer version of Hadoop, but in CDH3u3 it isn't there. > There is a lot of mystery surrounding how large to set dfs.datanode.max.xcievers. Most people say to just up it to 4096, but given that exceeding this will cause an HBase RegionServer shutdown (see Lars' blog post here: http://www.larsgeorge.com/2012/03/hadoop-hbase-and-xceivers.html), it would be nice if we could expose the current count via the built-in metrics framework (most likely under dfs). In this way we could watch it to see if we have it set too high, too low, time to bump it up, etc. > Thoughts? -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira