Mailing-List: contact issues-help@ambari.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@ambari.apache.org
Date: Thu, 28 Jul 2016 21:15:20 +0000 (UTC)
From: "Aravindan Vijayan (JIRA)" <jira@apache.org>
To: issues@ambari.apache.org
Message-ID: <JIRA.12993368.1469740420000.162026.1469740520697@Atlassian.JIRA>
In-Reply-To: <JIRA.12993368.1469740420000@Atlassian.JIRA>
References: <JIRA.12993368.1469740420000@Atlassian.JIRA> <JIRA.12993368.1469740420504@arcas>
Subject: [jira] [Updated] (AMBARI-17949) Disable INFO logs from
 HadoopMetrics2Reporter for hive on upgrade to 2.5
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Thu, 28 Jul 2016 21:15:23 -0000


     [ https://issues.apache.org/jira/browse/AMBARI-17949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aravindan Vijayan updated AMBARI-17949:
---------------------------------------
    Description: 
Out of disk space issues are seen due to the sheer amount of logs being produced by hive after addition of metrics. For this, a single change needs to be done to the log4j properties offered by Ambari to fix this.

In hive-log4j content, the following needs to be added.

{noformat}
# Silence HadoopMetrics2Reporter INFO logs
log4j.logger.com.github.joshelser.dropwizard.metrics.hadoop=WARN,DRFA
{noformat}

This upgrade jira is only for adding the log level changes for Hive components part of HDP 2.4 stack. Hive components that have been added in HDP2.5 fall into the category of either not needing this change or using default from stack.

  was:
Out of disk space issues are seen due to the sheer amount of logs being produced by hive after addition of metrics. For this, a single change needs to be done to the log4j properties offered by Ambari to fix this.

In Hive Config -> "Advanced hive-log4j", the following needs to be added.
# Silence HadoopMetrics2Reporter INFO logs
log4j.logger.com.github.joshelser.dropwizard.metrics.hadoop=WARN,DRFA

-# Silence HadoopMetrics2Reporter INFO logs
log4j.logger.com.github.joshelser.dropwizard.metrics.hadoop=WARN,DRFA
{noformat}

FYI, this upgrade jira is only for adding the log level changes for Hive components part of HDP 2.4 stack. Hive components that have been added in HDP2.5 fall into the category of either not needing this change or using default from stack.


> Disable INFO logs from HadoopMetrics2Reporter for hive on upgrade to 2.5
> ------------------------------------------------------------------------
>
>                 Key: AMBARI-17949
>                 URL: https://issues.apache.org/jira/browse/AMBARI-17949
>             Project: Ambari
>          Issue Type: Bug
>    Affects Versions: 2.4.0
>            Reporter: Aravindan Vijayan
>            Assignee: Aravindan Vijayan
>            Priority: Blocker
>             Fix For: 2.4.0
>
>
> Out of disk space issues are seen due to the sheer amount of logs being produced by hive after addition of metrics. For this, a single change needs to be done to the log4j properties offered by Ambari to fix this.
> In hive-log4j content, the following needs to be added.
> {noformat}
> # Silence HadoopMetrics2Reporter INFO logs
> log4j.logger.com.github.joshelser.dropwizard.metrics.hadoop=WARN,DRFA
> {noformat}
> This upgrade jira is only for adding the log level changes for Hive components part of HDP 2.4 stack. Hive components that have been added in HDP2.5 fall into the category of either not needing this change or using default from stack.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)