hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-5241) Provide alternate queuing audit logger to reduce logging contention
Date Sat, 25 Jan 2014 13:30:06 GMT

    [ https://issues.apache.org/jira/browse/HDFS-5241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13881860#comment-13881860
] 

Hudson commented on HDFS-5241:
------------------------------

FAILURE: Integrated in Hadoop-Mapreduce-trunk #1678 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1678/])
HDFS-5241.  Provide alternate queuing audit logger to reduce logging contention (daryn) (daryn:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1560761)
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestAuditLogs.java


> Provide alternate queuing audit logger to reduce logging contention
> -------------------------------------------------------------------
>
>                 Key: HDFS-5241
>                 URL: https://issues.apache.org/jira/browse/HDFS-5241
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: namenode
>    Affects Versions: 2.0.0-alpha, 3.0.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>         Attachments: HDFS-5241.patch, HDFS-5241.patch
>
>
> The default audit logger has extremely poor performance.  The internal synchronization
of log4j causes massive contention between the call handlers (100 by default) which drastically
limits the throughput of the NN.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message