hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDDS-555) RandomKeyGenerator runs not closing the XceiverClient properly
Date Fri, 12 Oct 2018 18:39:00 GMT

    [ https://issues.apache.org/jira/browse/HDDS-555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16648285#comment-16648285
] 

Hudson commented on HDDS-555:
-----------------------------

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15195 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/15195/])
HDDS-555. RandomKeyGenerator runs not closing the XceiverClient (xyao: rev 07d55292dc1536d3b34a89d4a45edf688d62a9e5)
* (edit) hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/scm/TestXceiverClientMetrics.java


> RandomKeyGenerator runs not closing the XceiverClient properly
> --------------------------------------------------------------
>
>                 Key: HDDS-555
>                 URL: https://issues.apache.org/jira/browse/HDDS-555
>             Project: Hadoop Distributed Data Store
>          Issue Type: Bug
>            Reporter: Shashikant Banerjee
>            Assignee: Mukul Kumar Singh
>            Priority: Major
>             Fix For: 0.3.0
>
>         Attachments: HDDS-555.001.patch
>
>
> The issue is with closing of the xceiverClients in Ozone. The below shows the leak in
XceiverClientGrpc. Similar issue can be seen intermittentkly with XceiverClientRatis as well
as shown in https://issues.apache.org/jira/browse/RATIS-318 as well.
> {code:java}
> Sep 26, 2018 8:11:01 PM org.apache.ratis.shaded.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference
cleanQueue
> SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=136, target=192.168.1.2:50712} was not
shutdown properly!!! ~*~*~*
> Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns
true.
> java.lang.RuntimeException: ManagedChannel allocation site
> at org.apache.ratis.shaded.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
> at org.apache.ratis.shaded.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
> at org.apache.ratis.shaded.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
> at org.apache.ratis.shaded.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
> at org.apache.hadoop.hdds.scm.XceiverClientGrpc.connect(XceiverClientGrpc.java:92)
> at org.apache.hadoop.hdds.scm.XceiverClientManager$2.call(XceiverClientManager.java:159)
> at org.apache.hadoop.hdds.scm.XceiverClientManager$2.call(XceiverClientManager.java:144)
> at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4767)
> at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3568)
> at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2350)
> at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2313)
> at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2228)
> at com.google.common.cache.LocalCache.get(LocalCache.java:3965)
> at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4764)
> at org.apache.hadoop.hdds.scm.XceiverClientManager.getClient(XceiverClientManager.java:143)
> at org.apache.hadoop.hdds.scm.XceiverClientManager.acquireClient(XceiverClientManager.java:122)
> at org.apache.hadoop.ozone.client.io.ChunkGroupOutputStream.checkKeyLocationInfo(ChunkGroupOutputStream.java:192)
> at org.apache.hadoop.ozone.client.io.ChunkGroupOutputStream.addPreallocateBlocks(ChunkGroupOutputStream.java:180)
> at org.apache.hadoop.ozone.client.rpc.RpcClient.createKey(RpcClient.java:472)
> at org.apache.hadoop.ozone.client.OzoneBucket.createKey(OzoneBucket.java:262)
> at org.apache.hadoop.ozone.freon.RandomKeyGenerator$OfflineProcessor.run(RandomKeyGenerator.java:601)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
> at java.util.concurrent.FutureTask.run(FutureTask.java)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748){code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message