hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (Jira)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-16207) Remove NN logs stack trace for non-existent xattr query
Date Thu, 09 Sep 2021 06:32:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-16207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17412370#comment-17412370
] 

Chris Nauroth commented on HDFS-16207:
--------------------------------------

[~ahussein], thank you.  I merged this to trunk, branch-3.3 and branch-3.2, resolving some
trivial merge conflicts along the way.  From the Affects Version/s, it sounds like you also
wanted to merge to branch-2.10.  Trying to merge to that branch fails with this compilation
error:

{code}
ERROR] /home/cnauroth/hadoop/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java:[524,9]
cannot find symbol
  symbol:   class XAttrNotFoundException
  location: class org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer
{code}

I stopped there.  If you still want to merge to branch-2.10, please provide a separate patch
compatible with the branch.

> Remove NN logs stack trace for non-existent xattr query
> -------------------------------------------------------
>
>                 Key: HDFS-16207
>                 URL: https://issues.apache.org/jira/browse/HDFS-16207
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: namenode
>    Affects Versions: 3.4.0, 2.10.2, 3.3.2, 3.2.4
>            Reporter: Ahmed Hussein
>            Assignee: Ahmed Hussein
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> The NN logs a full stack trace every time a getXAttrs is called for a non-existent xattr.
The logging has zero value add. The increased logging load may harm performance. Something
is now probing for xattrs resulting in many lines of:
> {code:bash}
> 2021-09-02 13:48:03,340 [IPC Server handler 5 on default port 59951] INFO  ipc.Server
(Server.java:logException(3149)) - IPC Server handler 5 on default port 59951, call Call#17
Retry#0 org.apache.hadoop.hdfs.protocol.ClientProtocol.getXAttrs from 127.0.0.1:59961
> java.io.IOException: At least one of the attributes provided was not found.
> 	at org.apache.hadoop.hdfs.server.namenode.FSDirXAttrOp.getXAttrs(FSDirXAttrOp.java:134)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getXAttrs(FSNamesystem.java:8472)
> 	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getXAttrs(NameNodeRpcServer.java:2317)
> 	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getXAttrs(ClientNamenodeProtocolServerSideTranslatorPB.java:1745)
> 	at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
> 	at org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:604)
> 	at org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:572)
> 	at org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:556)
> 	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1093)
> 	at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:1155)
> 	at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:1083)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:422)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1900)
> 	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:3088)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message