hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4532) RPC call queue may fill due to current user lookup
Date Tue, 05 Mar 2013 13:05:16 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13593380#comment-13593380
] 

Hudson commented on HDFS-4532:
------------------------------

Integrated in Hadoop-Hdfs-trunk #1335 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1335/])
    HDFS-4532. RPC call queue may fill due to current user lookup (daryn) (Revision 1452435)

     Result = SUCCESS
daryn : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1452435
Files : 
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java

                
> RPC call queue may fill due to current user lookup
> --------------------------------------------------
>
>                 Key: HDFS-4532
>                 URL: https://issues.apache.org/jira/browse/HDFS-4532
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: namenode
>    Affects Versions: 0.23.0, 2.0.0-alpha, 3.0.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 3.0.0, 0.23.7, 2.0.4-beta
>
>         Attachments: HDFS-4532.branch-23.patch, HDFS-4532.patch, HDFS-4532.patch
>
>
> Audit logging need to invoke {{UGI.getCurrentUser}} to log the user performing an operation.
 This is a synch'ed method, so audit logging is effectively serializing the completion of
concurrent read ops.  Under very heavy load, RPC throughput drops dramatically, the call queue
fills with thousands of waiting operations, and clients begin timing out.  Jstack shows all
but one call handler blocked on {{UGI.getCurrentUser}}.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message