hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kihwal Lee (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-5241) Provide alternate queuing audit logger to reduce logging contention
Date Mon, 06 Apr 2015 14:57:13 GMT

    [ https://issues.apache.org/jira/browse/HDFS-5241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14481285#comment-14481285
] 

Kihwal Lee commented on HDFS-5241:
----------------------------------

Forgot to mention that we do not audit log getFileInfo.

> Provide alternate queuing audit logger to reduce logging contention
> -------------------------------------------------------------------
>
>                 Key: HDFS-5241
>                 URL: https://issues.apache.org/jira/browse/HDFS-5241
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: namenode
>    Affects Versions: 2.0.0-alpha, 3.0.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>             Fix For: 2.3.0
>
>         Attachments: HDFS-5241.patch, HDFS-5241.patch
>
>
> The default audit logger has extremely poor performance.  The internal synchronization
of log4j causes massive contention between the call handlers (100 by default) which drastically
limits the throughput of the NN.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message