Return-Path: X-Original-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A79F7118A9 for ; Fri, 12 Sep 2014 13:45:38 +0000 (UTC) Received: (qmail 82380 invoked by uid 500); 12 Sep 2014 13:45:38 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 82330 invoked by uid 500); 12 Sep 2014 13:45:38 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-issues@hadoop.apache.org Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 82318 invoked by uid 99); 12 Sep 2014 13:45:38 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Sep 2014 13:45:38 +0000 Date: Fri, 12 Sep 2014 13:45:38 +0000 (UTC) From: "Hudson (JIRA)" To: common-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HADOOP-11085) Excessive logging by org.apache.hadoop.util.Progress when value is NaN MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HADOOP-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131535#comment-14131535 ] Hudson commented on HADOOP-11085: --------------------------------- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1894 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1894/]) HADOOP-11085. Excessive logging by org.apache.hadoop.util.Progress when value is NaN. Contributed by Mit Desai (jlowe: rev 581176cdc868b8701a761b5a0d52f771cbba709a) * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/Progress.java * hadoop-common-project/hadoop-common/CHANGES.txt > Excessive logging by org.apache.hadoop.util.Progress when value is NaN > ---------------------------------------------------------------------- > > Key: HADOOP-11085 > URL: https://issues.apache.org/jira/browse/HADOOP-11085 > Project: Hadoop Common > Issue Type: Bug > Affects Versions: 2.6.0 > Reporter: Mit Desai > Assignee: Mit Desai > Fix For: 2.6.0 > > Attachments: MAPREDUCE-6082.patch > > > MAPREDUCE-5671 fixed the "illegal" progress values that do not fall into (0,1) interval when the progress value is given. Whenever illegal value was encountered, LOG.warn would log that incident. > As a result, each of the task's syslog will be full of WARN [main] org.apache.hadoop.util.Progress: Illegal progress value found, progress is Float.NaN. Progress will be changed to 0 > Each input record will contribute to one line of such log, leading to most > of the tasks' syslog > 1GB. > We will need to change the log level to debug to avoid such excessive logging. -- This message was sent by Atlassian JIRA (v6.3.4#6332)