From user-return-14472-archive-asf-public=cust-asf.ponee.io@storm.apache.org Thu Jun 20 19:17:42 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id D5A9D180670 for ; Thu, 20 Jun 2019 21:17:41 +0200 (CEST) Received: (qmail 33138 invoked by uid 500); 20 Jun 2019 19:17:39 -0000 Mailing-List: contact user-help@storm.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@storm.apache.org Delivered-To: mailing list user@storm.apache.org Received: (qmail 33128 invoked by uid 99); 20 Jun 2019 19:17:39 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Jun 2019 19:17:39 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 060C4C0350 for ; Thu, 20 Jun 2019 19:17:39 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.303 X-Spam-Level: *** X-Spam-Status: No, score=3.303 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=2, KAM_NUMSUBJECT=0.5, MANY_SPAN_IN_TEXT=1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 4rODKa1qXkwA for ; Thu, 20 Jun 2019 19:17:35 +0000 (UTC) Received: from mail-ot1-f66.google.com (mail-ot1-f66.google.com [209.85.210.66]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 85E745F544 for ; Thu, 20 Jun 2019 19:17:35 +0000 (UTC) Received: by mail-ot1-f66.google.com with SMTP id i4so3927414otk.0 for ; Thu, 20 Jun 2019 12:17:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=l9GliqQjWPmyd/rcjkAVWhcSoo2yd8bd7qoZ6iskGkc=; b=t3lzLaPAkuSuBxU3zxP/Nx2s5kBYK8zjd+h+37l3REarxqUqMxeaCgZ0hCDtIWLTtk aQbDIeosRWGsEOUqCRwVQhbAkjvW21taxw1FU4XmCsg4yTuqKwB8yYuNKiQ2SwFPKwQz oW1HeunTLR3TX5ZUtd0MwRdHW2+iSECfIEfhNOYGQ8n9D3xmPfu1+6SWiL2yjNWr6M5L plUGxAU4mvQiSdBc+lysZDdlX6Iz2vTHIwJebuZYIvIZSwBcpAiZW50kSqWzB32xHzRg OKWTZj0Ibt5B1gETB9IVtyyuhsiVakMJcLVyMSjW/T2gu56KNTXD2ZYwtPpF6vgG2WHO Eklg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=l9GliqQjWPmyd/rcjkAVWhcSoo2yd8bd7qoZ6iskGkc=; b=RdjZQ326jPUZyRKVvoCv+ykSqq+mOD4lx+eYHQuaSK551bV41n8mAeMvtNJONSqzfj EPtY6m52jOkl8mXX4aWki7XdKyPCIi9Q2HWwbT6sRMRYK96I7JlO9+oeohnXj5MUr1nQ XBI7iYpeQsis1pP6dYSQwWX/e9JCo31h72FbI7HcBwTxsOSMRSFZG1rTnrgawhVyIFTM U/LHw5j6wbgbsqr5hsklzeEfEq2C+S/M9P7BKNNgJMXvj+JcdspzjlNWeOTGXxpJKhR+ YFPlYtLx/+Iw4ayDDVr24K5nZvs0qCYRcJ9y5TN4nc28oen5n1/dqfJLle1lP02Bwm/h NXOA== X-Gm-Message-State: APjAAAUDogVmuqSKAsxLEBOLzatyxH5lEiL+B5AxeX6SFUyZ9RhCxf/T U1OS/dMXtMVbccT0lbDUgw6TlRcvXYI2cd7x0nc9xhjW X-Google-Smtp-Source: APXvYqw1D/YfZ/FTKDDksEySJmDkMssj6VtHLetEkrZuMW/8UwkvKOGnyHCewYX7hSPmjRkdSDQZBjbhvOmOyH2x+jY= X-Received: by 2002:a9d:4c8b:: with SMTP id m11mr16184079otf.293.1561058254782; Thu, 20 Jun 2019 12:17:34 -0700 (PDT) MIME-Version: 1.0 References: <92eeb7cb93caea5556979b62ac4d5b2e9edc4728.camel@tomtom.com> In-Reply-To: <92eeb7cb93caea5556979b62ac4d5b2e9edc4728.camel@tomtom.com> From: =?UTF-8?Q?Stig_Rohde_D=C3=B8ssing?= Date: Thu, 20 Jun 2019 21:17:23 +0200 Message-ID: Subject: Re: Kryo errors after upgrading to Storm 2.0 To: user@storm.apache.org Content-Type: multipart/alternative; boundary="000000000000c0051f058bc6323f" --000000000000c0051f058bc6323f Content-Type: text/plain; charset="UTF-8" I don't think we've changed Kryo stuff much since 1.0.0. Last version upgrade was https://github.com/apache/storm/pull/1255. Maybe it could be a threading issue in the Netty messaging implementation in https://github.com/apache/storm/tree/master/storm-client/src/jvm/org/apache/storm/messaging/netty. I know a couple of issues of that sort were fixed in 2.0.0. 2.0.0 also upgraded Netty, so maybe there's an issue in that code somewhere. Den tor. 20. jun. 2019 kl. 19.10 skrev Michal Koziorowski < Michal.Koziorowski@tomtom.com>: > Hi, > > After upgrading to Storm 2.0 and running in production couple of days I > saw following error: > > server errors in handling the request > com.esotericsoftware.kryo.KryoException: Unable to find class: j, > Serialization trace: value > (org.apache.storm.metric.api.IMetricsConsumer$DataPoint) at > com.esotericsoftware.kryo.util.DefaultClassResolver.readName(DefaultClassResolver.java:156) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.util.DefaultClassResolver.readClass(DefaultClassResolver.java:133) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.Kryo.readClass(Kryo.java:670) ~[kryo-3.0.3.jar:?] > at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:781) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:161) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:39) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:711) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:125) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:551) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:793) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:134) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:40) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:793) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:134) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:40) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:689) > ~[kryo-3.0.3.jar:?] at > org.apache.storm.serialization.KryoValuesDeserializer.deserializeFrom(KryoValuesDeserializer.java:31) > ~[storm-client-2.0.0.jar:2.0.0] at > org.apache.storm.serialization.KryoTupleDeserializer.deserialize(KryoTupleDeserializer.java:45) > ~[storm-client-2.0.0.jar:2.0.0] at > org.apache.storm.messaging.DeserializingConnectionCallback.recv(DeserializingConnectionCallback.java:66) > ~[storm-client-2.0.0.jar:2.0.0] at > org.apache.storm.messaging.netty.Server.enqueue(Server.java:140) > ~[storm-client-2.0.0.jar:2.0.0] at > org.apache.storm.messaging.netty.Server.received(Server.java:269) > ~[storm-client-2.0.0.jar:2.0.0] at org.apache.storm.messaging.netty.StormServerHandler.channelRead(StormServerHandler.java:51) > ~[storm-client-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:579) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:496) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:458) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > java.lang.Thread.run(Thread.java:748) [?:1.8.0_212] Caused by: > java.lang.ClassNotFoundException: j, at > java.net.URLClassLoader.findClass(URLClassLoader.java:382) ~[?:1.8.0_212] > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[?:1.8.0_212] at > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) > ~[?:1.8.0_212] at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > ~[?:1.8.0_212] at java.lang.Class.forName0(Native Method) ~[?:1.8.0_212] at > java.lang.Class.forName(Class.java:348) ~[?:1.8.0_212] at > com.esotericsoftware.kryo.util.DefaultClassResolver.readName(DefaultClassResolver.java:154) > ~[kryo-3.0.3.jar:?] ... 40 more > > and also messages similar to one below, but with different class IDs > > server errors in handling the request > com.esotericsoftware.kryo.KryoException: Encountered unregistered class ID: > 108 Serialization trace: value > (org.apache.storm.metric.api.IMetricsConsumer$DataPoint) at > com.esotericsoftware.kryo.util.DefaultClassResolver.readClass(DefaultClassResolver.java:137) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.Kryo.readClass(Kryo.java:670) ~[kryo-3.0.3.jar:?] > at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:781) ~[kryo-3.0.3.jar:?] > at > com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:161) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:39) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:711) ~[kryo-3.0.3.jar:?] > at > com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:125) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:551) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:793) ~[kryo-3.0.3.jar:?] > at > com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:134) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:40) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:793) ~[kryo-3.0.3.jar:?] > at > com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:134) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:40) > ~[kryo-3.0.3.jar:?] at > com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:689) ~[kryo-3.0.3.jar:?] > at > org.apache.storm.serialization.KryoValuesDeserializer.deserializeFrom(KryoValuesDeserializer.java:31) > ~[storm-client-2.0.0.jar:2.0.0] at > org.apache.storm.serialization.KryoTupleDeserializer.deserialize(KryoTupleDeserializer.java:45) > ~[storm-client-2.0.0.jar:2.0.0] at > org.apache.storm.messaging.DeserializingConnectionCallback.recv(DeserializingConnectionCallback.java:66) > ~[storm-client-2.0.0.jar:2.0.0] at > org.apache.storm.messaging.netty.Server.enqueue(Server.java:140) > ~[storm-client-2.0.0.jar:2.0.0] at > org.apache.storm.messaging.netty.Server.received(Server.java:269) > ~[storm-client-2.0.0.jar:2.0.0] at > org.apache.storm.messaging.netty.StormServerHandler.channelRead(StormServerHandler.java:51) > ~[storm-client-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:310) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:426) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:278) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:579) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:496) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:458) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > java.lang.Thread.run(Thread.java:748) [?:1.8.0_212] > > > And also: > server errors in handling the request > com.esotericsoftware.kryo.KryoException: Buffer underflow. at > com.esotericsoftware.kryo.io.Input.require(Input.java:182) ~[kryo-3.0.3.jar:?] > at com.esotericsoftware.kryo.io.Input.readLong(Input.java:686) ~[kryo-3.0.3.jar:?] > at org.apache.storm.tuple.MessageId.deserialize(MessageId.java:56) > ~[storm-client-2.0.0.jar:2.0.0] at > org.apache.storm.serialization.KryoTupleDeserializer.deserialize(KryoTupleDeserializer.java:44) > ~[storm-client-2.0.0.jar:2.0.0] at > org.apache.storm.messaging.DeserializingConnectionCallback.recv(DeserializingConnectionCallback.java:66) > ~[storm-client-2.0.0.jar:2.0.0] at > org.apache.storm.messaging.netty.Server.enqueue(Server.java:140) > ~[storm-client-2.0.0.jar:2.0.0] at > org.apache.storm.messaging.netty.Server.received(Server.java:269) > ~[storm-client-2.0.0.jar:2.0.0] at > org.apache.storm.messaging.netty.StormServerHandler.channelRead(StormServerHandler.java:51) > ~[storm-client-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:579) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:496) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:458) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > org.apache.storm.shade.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897) > [storm-shaded-deps-2.0.0.jar:2.0.0] at > java.lang.Thread.run(Thread.java:748) [?:1.8.0_212] > > After which storm process is dying. > > I'm not 100% that this is related to upgrade to 2.0 version of storm or if > anything related to kryo was touched, but I haven't seen anything similar > with previous version of storm (1.1.x) > > Have you seen anything similar? > > Best regards, > Michal > > --000000000000c0051f058bc6323f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I don't think we've changed Kryo stuff much s= ince 1.0.0. Last version upgrade was https://github.com/apache/storm/pull/1255.

Den tor. 20. jun. 2019 kl. 19.10 skrev Michal Koziorowski <Michal.Koziorowski@tomtom.com>= ;:
Hi,

After upgrading to Storm 2.0 and running in production couple of days = I saw following error:

server errors in handling the request com.esotericsoftware.kryo.KryoException: Unable to fi= nd class: j, Serialization trace: value (org.apache.storm.metric.api.IMetri= csConsumer$DataPoint) at com.esotericsoftware.kryo.util.DefaultClassResolve= r.readName(DefaultClassResolver.java:156) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.util.DefaultClassResolver= .readClass(DefaultClassResolver.java:133) ~[kryo-3.0.3.jar:?] at com.esoter= icsoftware.kryo.Kryo.readClass(Kryo.java:670) ~[kryo-3.0.3.jar:?] at com.es= otericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:781) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.serializers.MapSerializer= .read(MapSerializer.java:161) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.k= ryo.serializers.MapSerializer.read(MapSerializer.java:39) ~[kryo-3.0.3.jar:= ?] at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:711) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.serializers.ObjectField.r= ead(ObjectField.java:125) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.= serializers.FieldSerializer.read(FieldSerializer.java:551) ~[kryo-3.0.3.jar= :?] at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:793) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.serializers.CollectionSer= ializer.read(CollectionSerializer.java:134) ~[kryo-3.0.3.jar:?] at com.esot= ericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerialize= r.java:40) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:793) ~[kryo-3.= 0.3.jar:?] at com.esotericsoftware.kryo.serializers.CollectionSerializer.re= ad(CollectionSerializer.java:134) ~[kryo-3.0.3.jar:?] at com.esotericsoftwa= re.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:40) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java= :689) ~[kryo-3.0.3.jar:?] at org.apache.storm.serialization.KryoValuesDeser= ializer.deserializeFrom(KryoValuesDeserializer.java:31) ~[storm-client-2.0.= 0.jar:2.0.0] at org.apache.storm.serialization.KryoTupleDeserializer.deseri= alize(KryoTupleDeserializer.java:45) ~[storm-client-2.0.0.jar:2.0.0] at org.apache.storm.messaging.Deserializin= gConnectionCallback.recv(DeserializingConnectionCallback.java:66) ~[storm-c= lient-2.0.0.jar:2.0.0] at org.apache.storm.messaging.netty.Server.enqueue(S= erver.java:140) ~[storm-client-2.0.0.jar:2.0.0] at org.apache.storm.messaging.netty.Server.received(Server.java:269) ~[sto= rm-client-2.0.0.jar:2.0.0] at org.apache.storm.messaging.netty.StormServerHandler.channelRead(St= ormServerHandler.java:51) ~[storm-client-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.channel= .AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerCont= ext.java:362) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade= .io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractC= hannelHandlerContext.java:348) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerCo= ntext.java:340) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.sha= de.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessag= eDecoder.java:323) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.han= dler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297) = [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.chan= nel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerC= ontext.java:362) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandler= Context.java:348) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.s= hade.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(Abstrac= tChannelHandlerContext.java:340) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.= java:1434) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io= .netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChan= nelHandlerContext.java:362) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandler= Context.java:348) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.s= hade.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannel= Pipeline.java:965) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.j= ava:163) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.n= etty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:579) [= storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.chann= el.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:496) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.nio.NioEventLoop.run(NioEventLoop.java:458) [storm-shaded-deps-2.0.0.j= ar:2.0.0] at org.apache.storm.shade.io.netty.util.concurrent.SingleThreadEv= entExecutor$5.run(SingleThreadEventExecutor.java:897) [storm-shaded-deps-2.0.0.jar:2.0.0] at java.lang.Thread.run(Thread.java:74= 8) [?:1.8.0_212] Caused by: java.lang.ClassNotFoundException: j, at java.ne= t.URLClassLoader.findClass(URLClassLoader.java:382) ~[?:1.8.0_212] at java.= lang.ClassLoader.loadClass(ClassLoader.java:424) ~[?:1.8.0_212] at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java= :349) ~[?:1.8.0_212] at java.lang.ClassLoader.loadClass(ClassLoader.java:35= 7) ~[?:1.8.0_212] at java.lang.Class.forName0(Native Method) ~[?:1.8.0_212]= at java.lang.Class.forName(Class.java:348) ~[?:1.8.0_212] at com.esotericsoftware.kryo.util.DefaultClassResolver.read= Name(DefaultClassResolver.java:154) ~[kryo-3.0.3.jar:?] ... 40 more<= /span>

and also messages similar to one below, but with different class IDs

server errors in handling the request com.esotericsoftware.kryo.KryoException: En= countered unregistered class ID: 108 Serialization trace: value (org.apache= .storm.metric.api.IMetricsConsumer$DataPoint) at com.esotericsoftware.kryo.= util.DefaultClassResolver.readClass(DefaultClassResolver.java:137) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.Kryo.readClass(Kryo.java:670) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:781) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.= java:161) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.= java:39) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:711) ~[kryo<= span style=3D"font-size:12px;font-variant-ligatures:normal;letter-spacing:-= 0.08px">-3.0.3.jar:?] at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java= :125) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSeriali= zer.java:551) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:793) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.serializers.CollectionSerializer.read(Collect= ionSerializer.java:134) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.serializers.CollectionSerializer.read(Collect= ionSerializer.java:40) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:793) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.serializers.CollectionSerializer.read(Collect= ionSerializer.java:134) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.serializers.CollectionSerializer.read(Collect= ionSerializer.java:40) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:689) ~[kryo<= span style=3D"font-size:12px;font-variant-ligatures:normal;letter-spacing:-= 0.08px">-3.0.3.jar:?] at org.apache.storm.serialization.KryoValuesDeserializer.deserializeFrom(K= ryoValuesDeserializer.java:31) ~[storm-client-2.0.0.jar:2.0.0] at org.apach= e.storm.serialization.KryoTupleDeserializer.deserialize(KryoTupleDeserializ= er.java:45) ~[storm-client-2.0.0.jar:2.0.0] at org.apache.storm.messaging.DeserializingConnectionCallback.recv(Deseria= lizingConnectionCallback.java:66) ~[storm-client-2.0.0.jar:2.0.0] at org.ap= ache.storm.messaging.netty.Server.enqueue(Server.java:140) ~[storm-client-2= .0.0.jar:2.0.0] at org.apache.storm.messaging.netty.Server.received(Server.= java:269) ~[storm-client-2.0.0.jar:2.0.0] at org.apache.storm.messaging.netty.StormS= erverHandler.channelRead(StormServerHandler.java:51) ~[storm-client-2.0.0.j= ar:2.0.0] at org.apache.storm.shade.io.netty.channel.AbstractChannelHandler= Context.invokeChannelRead(AbstractChannelHandlerContext.java:362) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandler= Context.java:348) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.s= hade.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(Abstrac= tChannelHandlerContext.java:340) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.han= dler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:3= 23) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.= handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.jav= a:310) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.han= dler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:426) [= storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.handl= er.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:278) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandler= Context.java:362) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.s= hade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(Abstr= actChannelHandlerContext.java:348) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerCo= ntext.java:340) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.sha= de.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultC= hannelPipeline.java:1434) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandler= Context.java:362) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.s= hade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(Abstr= actChannelHandlerContext.java:348) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965= ) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.ch= annel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.= java:163) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) [storm-shad= ed-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.channel.nio.Nio= EventLoop.processSelectedKeysOptimized(NioEventLoop.java:579) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:496) [storm-sha= ded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.channel.nio.Ni= oEventLoop.run(NioEventLoop.java:458) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.uti= l.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java= :897) [storm-shaded-deps-2.0.0.jar:2.0.0] at java.lang.Thread.run(Thread.ja= va:748) [?:1.8.0_212]


And also:
server errors in handling the request com.esotericsoftware.kryo.KryoException: Bu= ffer underflow. at com.esotericsoftware.kryo.io.Input.require(Input.java:18= 2) ~[kryo-3.0.3.jar:?] at com.esotericsoftware.kryo.io.Input.readLong(Input.java:686) ~[kr= yo-3.0.3.jar:?] at org.apache.storm.tuple.MessageId.deserialize(MessageId.java:56) ~[storm= -client-2.0.0.jar:2.0.0] at org.apache.storm.serialization.KryoTupleDeseria= lizer.deserialize(KryoTupleDeserializer.java:44) ~[storm-client-2.0.0.jar:2= .0.0] at org.apache.storm.messaging.DeserializingConnectionCallback.recv(De= serializingConnectionCallback.java:66) ~[storm-client-2.0.0.jar:2.0.0] at org.apache.storm.messaging.netty.Server= .enqueue(Server.java:140) ~[storm-client-2.0.0.jar:2.0.0] at org.apache.sto= rm.messaging.netty.Server.received(Server.java:269) ~[storm-client-2.0.0.ja= r:2.0.0] at org.apache.storm.messaging.netty.StormServerHandler.channelRead= (StormServerHandler.java:51) ~[storm-client-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.channel= .AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerCont= ext.java:362) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade= .io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractC= hannelHandlerContext.java:348) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerCo= ntext.java:340) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.sha= de.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessag= eDecoder.java:323) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.han= dler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297) = [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.chan= nel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerC= ontext.java:362) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandler= Context.java:348) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.s= hade.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(Abstrac= tChannelHandlerContext.java:340) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.= java:1434) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io= .netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChan= nelHandlerContext.java:362) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandler= Context.java:348) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.s= hade.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannel= Pipeline.java:965) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.j= ava:163) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.n= etty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:579) [= storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.chann= el.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:496) [storm-shaded-deps-2.0.0.jar:2.0.0] at org.apache.storm.shade.io.netty.cha= nnel.nio.NioEventLoop.run(NioEventLoop.java:458) [storm-shaded-deps-2.0.0.j= ar:2.0.0] at org.apache.storm.shade.io.netty.util.concurrent.SingleThreadEv= entExecutor$5.run(SingleThreadEventExecutor.java:897) [storm-shaded-deps-2.0.0.jar:2.0.0] at java.lang.Thread.run(Thread.java:74= 8) [?:1.8.0_212]

After which storm process is dying.

I'm not 100% that this is related to upgrade to 2.0 version of sto= rm or if anything related to kryo was touched, but I haven't seen anyth= ing similar with previous version of storm (1.1.x)

Have you seen anything similar?

Best regards,
Michal

--000000000000c0051f058bc6323f--