hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Erik Krogen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15726) Create utility to limit frequency of log statements
Date Mon, 10 Sep 2018 20:14:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16609738#comment-16609738

Erik Krogen commented on HADOOP-15726:

I was unable to replicate any of the {{hadoop.util}} test failures locally, or the {{TestFSImage}}
failure. The {{TestLeaseRecovery2}} failure occurred intermittently for me with or without
this patch applied, and seeing as the only existing code which was changed in this patch is
a small logging change to {{TestFSNamesystemLock}}, I don't think these failures are related

> Create utility to limit frequency of log statements
> ---------------------------------------------------
>                 Key: HADOOP-15726
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15726
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: common, util
>            Reporter: Erik Krogen
>            Assignee: Erik Krogen
>            Priority: Major
>         Attachments: HADOOP-15726.000.patch, HADOOP-15726.001.patch
> There is a common pattern of logging a behavior that is normally extraneous. Under some
circumstances, such a behavior becomes common, flooding the logs and making it difficult to
see what else is going on in the system. Under such situations it is beneficial to limit how
frequently the extraneous behavior is logged, while capturing some summary information about
the suppressed log statements.
> This is currently implemented in {{FSNamesystemLock}} (in HDFS-10713). We have additional
use cases for this in HDFS-13791, so this is a good time to create a common utility for different
sites to share this logic.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message