hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anu Engineer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11559) Ozone: MiniOzoneCluster prints too many log messages by default
Date Tue, 21 Mar 2017 22:49:42 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15935493#comment-15935493
] 

Anu Engineer commented on HDFS-11559:
-------------------------------------

[~szetszwo] It is true that MiniOzoneCluster is very noisy. But while we were developing Ozone
HTTP stuff this was very handy. Especially setting this single flag will enable tracing in
netty and jersy layers. I don't mind this being removed now, but just wanted to ask if it
is good enough set this flag to false by default.

As I said, I don't mind removing it now, but It was pretty useful at some point of time.

+1, in case you wanted to go ahead and commit this.

> Ozone: MiniOzoneCluster prints too many log messages by default
> ---------------------------------------------------------------
>
>                 Key: HDFS-11559
>                 URL: https://issues.apache.org/jira/browse/HDFS-11559
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ozone, test
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Tsz Wo Nicholas Sze
>            Priority: Minor
>         Attachments: HDFS-11559-HDFS-7240.20170321.patch
>
>
> When running tests using MiniOzoneCluster, it prints out tons of debug and trace log
messages from all logs including the ones in from the libraries such as  
> - ipc.Server
> {code}
> 2017-03-21 15:13:13,053 [Thread-0] DEBUG ipc.Server (RPC.java:registerProtocolAndImpl(895))
- RpcKind = RPC_PROTOCOL_BUFFER Protocol Name = org.apache.hadoop.ipc.ProtocolMetaInfoPB version=1
ProtocolImpl=org.apache.hadoop.ipc.protobuf.ProtocolInfoProtos$ProtocolInfoService$2 protocolClass=org.apache.hadoop.ipc.ProtocolMetaInfoPB
> 2017-03-21 15:13:13,058 [Thread-0] DEBUG ipc.Server (RPC.java:registerProtocolAndImpl(895))
- RpcKind = RPC_PROTOCOL_BUFFER Protocol Name = org.apache.hadoop.hdfs.protocol.ClientProtocol
version=1 ProtocolImpl=org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2
protocolClass=org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolPB
> 2017-03-21 15:13:13,058 [Thread-0] DEBUG ipc.Server (RPC.java:registerProtocolAndImpl(895))
- RpcKind = RPC_PROTOCOL_BUFFER Protocol Name = org.apache.hadoop.ha.HAServiceProtocol version=1
ProtocolImpl=org.apache.hadoop.ha.proto.HAServiceProtocolProtos$HAServiceProtocolService$2
protocolClass=org.apache.hadoop.ha.protocolPB.HAServiceProtocolPB
> {code}
> - netty
> {code}
> 2017-03-21 15:13:14,912 [Thread-0] DEBUG nio.NioEventLoop (Slf4JLogger.java:debug(76))
- -Dio.netty.noKeySetOptimization: false
> 2017-03-21 15:13:14,912 [Thread-0] DEBUG nio.NioEventLoop (Slf4JLogger.java:debug(76))
- -Dio.netty.selectorAutoRebuildThreshold: 512
> 2017-03-21 15:13:14,916 [Thread-0] TRACE nio.NioEventLoop (Slf4JLogger.java:trace(46))
- Instrumented an optimized java.util.Set into: sun.nio.ch.KQueueSelectorImpl@501c140b
> 2017-03-21 15:13:14,916 [Thread-0] TRACE nio.NioEventLoop (Slf4JLogger.java:trace(46))
- Instrumented an optimized java.util.Set into: sun.nio.ch.KQueueSelectorImpl@30ebe2a0
> 2017-03-21 15:13:14,917 [Thread-0] TRACE nio.NioEventLoop (Slf4JLogger.java:trace(46))
- Instrumented an optimized java.util.Set into: sun.nio.ch.KQueueSelectorImpl@98cbeb6
> {code}
> - beanutils
> {code}
> 2017-03-21 15:13:10,490 [Thread-0] TRACE beanutils.BeanUtils (BeanUtilsBean.java:setProperty(888))
-   setProperty(org.apache.commons.configuration2.PropertiesConfiguration@18f07b01, listDelimiterHandler,
org.apache.commons.configuration2.convert.DefaultListDelimiterHandler@5473ddc2)
> 2017-03-21 15:13:10,491 [Thread-0] TRACE beanutils.BeanUtils (BeanUtilsBean.java:setProperty(906))
-     Target bean = org.apache.commons.configuration2.PropertiesConfiguration@18f07b01
> 2017-03-21 15:13:10,491 [Thread-0] TRACE beanutils.BeanUtils (BeanUtilsBean.java:setProperty(907))
-     Target name = listDelimiterHandler
> {code}
> - eclipse.jetty
> {code} 
> 2017-03-21 15:13:14,796 [Thread-0] DEBUG component.ContainerLifeCycle (ContainerLifeCycle.java:addBean(323))
- org.eclipse.jetty.server.Server@32cd6303 added {qtp48399352{STOPPED,8<=0<=200,i=0,q=0},AUTO}
> 2017-03-21 15:13:14,797 [Thread-0] DEBUG util.DecoratedObjectFactory (DecoratedObjectFactory.java:addDecorator(52))
- Adding Decorator: org.eclipse.jetty.util.DeprecationWarning@b7a0755
> 2017-03-21 15:13:14,797 [Thread-0] DEBUG component.ContainerLifeCycle (ContainerLifeCycle.java:addBean(323))
- org.eclipse.jetty.server.session.SessionHandler@47175536 added {org.eclipse.jetty.server.session.HashSessionManager@51fce36f,AUTO}
> {code}
> The test output becomes very very long.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message