hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11085) Excessive logging by org.apache.hadoop.util.Progress when value is NaN
Date Fri, 12 Sep 2014 13:45:38 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131535#comment-14131535

Hudson commented on HADOOP-11085:

FAILURE: Integrated in Hadoop-Mapreduce-trunk #1894 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1894/])
HADOOP-11085. Excessive logging by org.apache.hadoop.util.Progress when value is NaN. Contributed
by Mit Desai (jlowe: rev 581176cdc868b8701a761b5a0d52f771cbba709a)
* hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/Progress.java
* hadoop-common-project/hadoop-common/CHANGES.txt

> Excessive logging by org.apache.hadoop.util.Progress when value is NaN
> ----------------------------------------------------------------------
>                 Key: HADOOP-11085
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11085
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 2.6.0
>            Reporter: Mit Desai
>            Assignee: Mit Desai
>             Fix For: 2.6.0
>         Attachments: MAPREDUCE-6082.patch
> MAPREDUCE-5671 fixed the "illegal" progress values that do not fall into (0,1) interval
when the progress value is given. Whenever illegal value was encountered, LOG.warn would log
that incident.
> As  a result, each of the task's syslog will be full of  WARN [main] org.apache.hadoop.util.Progress:
Illegal progress value found, progress is Float.NaN. Progress will be changed to 0
> Each input record will contribute to one line of such log, leading to most
> of the tasks' syslog > 1GB.
> We will need to change the log level to debug to avoid such excessive logging.

This message was sent by Atlassian JIRA

View raw message