Return-Path: X-Original-To: apmail-accumulo-notifications-archive@minotaur.apache.org Delivered-To: apmail-accumulo-notifications-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4112C18BFA for ; Wed, 12 Aug 2015 20:54:49 +0000 (UTC) Received: (qmail 28914 invoked by uid 500); 12 Aug 2015 20:54:46 -0000 Delivered-To: apmail-accumulo-notifications-archive@accumulo.apache.org Received: (qmail 28876 invoked by uid 500); 12 Aug 2015 20:54:46 -0000 Mailing-List: contact notifications-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: jira@apache.org Delivered-To: mailing list notifications@accumulo.apache.org Received: (qmail 28860 invoked by uid 99); 12 Aug 2015 20:54:46 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 12 Aug 2015 20:54:45 +0000 Date: Wed, 12 Aug 2015 20:54:45 +0000 (UTC) From: "Josh Elser (JIRA)" To: notifications@accumulo.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (ACCUMULO-3957) Consider moving off getContentSummary in the monitor MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/ACCUMULO-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694153#comment-14694153 ] Josh Elser commented on ACCUMULO-3957: -------------------------------------- Since we're calling getContentSummary on "/" we have to assume any other components use of HDFS, not just how we use HDFS, is called into question. I'm guessing that we ourselves aren't misusing HDFS itself. We figured that out a long time ago. > Consider moving off getContentSummary in the monitor > ---------------------------------------------------- > > Key: ACCUMULO-3957 > URL: https://issues.apache.org/jira/browse/ACCUMULO-3957 > Project: Accumulo > Issue Type: Bug > Components: monitor > Reporter: Josh Elser > Assignee: Josh Elser > Priority: Critical > Fix For: 1.6.4, 1.7.1, 1.8.0, 1.5.4 > > > Recently heard about an issue where a large Hadoop installation which had Accumulo running was experiencing long pauses in the Namenode. Inspecting NN audit logs, it was found that the user running Accumulo issues a {{getContentSummary("/")}} call just before the NN pauses were experienced. > In {{DefaultServlet.java}}, we use this call to compute the total HDFS disk usage and present a ratio of space that Accumulo uses relative to the total available space. > It's still unclear why this was causing issues in this case (as this operation should only be acquiring a read-lock in the namenode), it was recommended to me that Accumulo use the JMX metrics for the NN instead of making this call. -- This message was sent by Atlassian JIRA (v6.3.4#6332)