From user-return-32701-archive-asf-public=cust-asf.ponee.io@flink.apache.org Tue Feb 18 17:59:58 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id E4D5418060E for ; Tue, 18 Feb 2020 18:59:57 +0100 (CET) Received: (qmail 25830 invoked by uid 500); 18 Feb 2020 17:59:55 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 25820 invoked by uid 99); 18 Feb 2020 17:59:55 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Feb 2020 17:59:55 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id D72301A318B for ; Tue, 18 Feb 2020 17:59:54 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.21 X-Spam-Level: X-Spam-Status: No, score=0.21 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, T_SPF_PERMERROR=0.01] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=sensingfeeling-com.20150623.gappssmtp.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id 2xrjtCpJ2z5i for ; Tue, 18 Feb 2020 17:59:53 +0000 (UTC) Received-SPF: Permerror (mailfrom) identity=mailfrom; client-ip=209.85.128.48; helo=mail-wm1-f48.google.com; envelope-from=chris@sensingfeeling.com; receiver= Received: from mail-wm1-f48.google.com (mail-wm1-f48.google.com [209.85.128.48]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id CD132BB801 for ; Tue, 18 Feb 2020 17:59:52 +0000 (UTC) Received: by mail-wm1-f48.google.com with SMTP id p9so3728547wmc.2 for ; Tue, 18 Feb 2020 09:59:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sensingfeeling-com.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to; bh=uqS3TIuPhA1t6pdHEqb9qwC80O9jCema4Sx5sH0wBgc=; b=BRact3aydEybQWIX3XaezxGwtW5LrNbGgm3bd1z6Gvr5Z8AWNYm40SOLk3wuQJuXu+ bQoGZsxPb6mAS6cX3uoNC7jonAC1vLODAzIsEtzra6SgE2SIM2S+cjObmlgDQvK1lko0 ooeP9TP+GtwsAXsWuFxEDMrUVbY/rZv2dizpUAaN7jFtJu4odfiwr3h+UDIsPpN/qwh+ YCSHECNeDKUaUMKg6SMOInX16xx57oXRZZ7r2nSooum7U4f7aHEXas8hprw+ODyqXNQm uE9XO5cv7ZXdpkSZ6gUX621raPH4VZCT5BrsjfRnJADu+nyVrdbCZ0TwyaYW8aVruDF6 8u7A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=uqS3TIuPhA1t6pdHEqb9qwC80O9jCema4Sx5sH0wBgc=; b=VHiWRQq0UL98q3XsLOJOq4rya2u4DSjHGpY2dM/KBmPBNK2T54CbJ9oPmcW8Vn7o36 W267ccgmtidqq0ZNlhvrtYhdsn95BjD7ZHbxMJlWno2QNjUYOpttk2QUw4I8ByNT70fZ QJuAg6HgHS/fxhB4021C0dQYX+y1tMoiK57tity6bvtNlf4bdry4bp3OXEAoy8eaYfGC nFLiwQzLMo0jD3RVQQsuExdu7Vsmxt2W7U3XGfwqp0eJECppZ7VzUCY6jOffWJfikD5h 2JVRndaZv4ulIFU/xjrklvcPMU7vDTJIPyPcWnH1rMdQggLYd/cj3WmVpdr2AmPrJU5x ZdMw== X-Gm-Message-State: APjAAAXw+F/2P33SafkALT15q/Tcl9N2V1SPm85g6aT1kQO+FrAZCBtL +cxPpR4vMcYnzdyKecGy5YYf/jp55R8gcMcn/SIFXf4R5TbT7Q== X-Google-Smtp-Source: APXvYqwoEBlprESLmyq3J4V5RrNE4SA5sVq2pPieuYGsPlVB5xblS5eC/9LmnwowQw1h3E7AGU4otO0sQzuN4LJ/etE= X-Received: by 2002:a7b:cbd6:: with SMTP id n22mr4522313wmi.118.1582048791450; Tue, 18 Feb 2020 09:59:51 -0800 (PST) MIME-Version: 1.0 From: Chris Stevens Date: Tue, 18 Feb 2020 17:59:40 +0000 Message-ID: Subject: Updating ValueState not working in hosted Kinesis To: user@flink.apache.org Content-Type: multipart/alternative; boundary="0000000000003b6a40059edd70ec" --0000000000003b6a40059edd70ec Content-Type: text/plain; charset="UTF-8" Hi there, I'm trying to update state in one of my applications hosted in Kinesis Data Analytics. private transient ValueState sensorState; using sensorState.update(sensor); Get error: An error occurred: org.apache.flink.util.FlinkRuntimeException: Error while adding data to RocksDB at org.apache.flink.contrib.streaming.state.RocksDBValueState.update(RocksDBValueState.java:108) at org.apache.flink.runtime.state.ttl.TtlValueState.update(TtlValueState.java:50) at sensingfeeling.functions.mapping.FrameMotionPathsToTelemetryJoinFunction.join(FrameMotionPathsToTelemetryJoinFunction.java:97) at sensingfeeling.functions.mapping.FrameMotionPathsToTelemetryJoinFunction.join(FrameMotionPathsToTelemetryJoinFunction.java:48) at org.apache.flink.streaming.api.datastream.JoinedStreams$JoinCoGroupFunction.coGroup(JoinedStreams.java:460) at org.apache.flink.streaming.api.datastream.CoGroupedStreams$CoGroupWindowFunction.apply(CoGroupedStreams.java:777) at org.apache.flink.streaming.runtime.operators.windowing.functions.InternalIterableWindowFunction.process(InternalIterableWindowFunction.java:44) at org.apache.flink.streaming.runtime.operators.windowing.functions.InternalIterableWindowFunction.process(InternalIterableWindowFunction.java:32) at org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.emitWindowContents(WindowOperator.java:546) at org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.onEventTime(WindowOperator.java:454) at org.apache.flink.streaming.api.operators.InternalTimerServiceImpl.advanceWatermark(InternalTimerServiceImpl.java:255) at org.apache.flink.streaming.api.operators.InternalTimeServiceManager.advanceWatermark(InternalTimeServiceManager.java:128) at org.apache.flink.streaming.api.operators.AbstractStreamOperator.processWatermark(AbstractStreamOperator.java:775) at org.apache.flink.streaming.runtime.io.StreamInputProcessor$ForwardingValveOutputHandler.handleWatermark(StreamInputProcessor.java:262) at org.apache.flink.streaming.runtime.streamstatus.StatusWatermarkValve.findAndOutputNewMinWatermarkAcrossAlignedChannels(StatusWatermarkValve.java:189) at org.apache.flink.streaming.runtime.streamstatus.StatusWatermarkValve.inputWatermark(StatusWatermarkValve.java:111) at org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:184) at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:105) at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:308) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:714) at java.lang.Thread.run(Thread.java:748) Caused by: com.esotericsoftware.kryo.KryoException: java.lang.IllegalArgumentException: Unable to create serializer "com.esotericsoftware.kryo.serializers.FieldSerializer" for class: org.apache.logging.log4j.core.layout.AbstractCsvLayout Serialization trace: classes (sun.misc.Launcher$AppClassLoader) classloader (java.security.ProtectionDomain) cachedPDs (javax.security.auth.SubjectDomainCombiner) combiner (java.security.AccessControlContext) acc (sun.security.ssl.SSLSocketImpl) connection (org.postgresql.core.PGStream) pgStream (org.postgresql.core.v3.QueryExecutorImpl) transferModeRegistry (org.postgresql.core.v3.SimpleQuery) commitQuery (org.postgresql.jdbc.PgConnection) connection (org.postgresql.jdbc.PgResultSet) val$rs (sensingfeeling.functions.mapping.FrameMotionPathsToTelemetryJoinFunction$4) at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:82) at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495) at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523) at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61) at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495) at com.esotericsoftware.kryo.Kryo.writeClassAndObject(Kryo.java:599) at com.esotericsoftware.kryo.serializers.MapSerializer.write(MapSerializer.java:88) at com.esotericsoftware.kryo.serializers.MapSerializer.write(MapSerializer.java:21) at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523) at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61) at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495) at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523) at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61) at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495) at com.esotericsoftware.kryo.Kryo.writeObjectOrNull(Kryo.java:577) at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:68) at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495) at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523) at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61) at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495) at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523) at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61) at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495) at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523) at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61) at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495) at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523) at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61) at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495) at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523) at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61) at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495) at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523) at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61) at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495) at com.esotericsoftware.kryo.Kryo.writeClassAndObject(Kryo.java:599) at org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.serialize(KryoSerializer.java:305) at org.apache.flink.api.java.typeutils.runtime.PojoSerializer.serialize(PojoSerializer.java:362) at org.apache.flink.api.common.typeutils.CompositeSerializer.serialize(CompositeSerializer.java:142) at org.apache.flink.contrib.streaming.state.AbstractRocksDBState.serializeValueInternal(AbstractRocksDBState.java:158) at org.apache.flink.contrib.streaming.state.AbstractRocksDBState.serializeValue(AbstractRocksDBState.java:178) at org.apache.flink.contrib.streaming.state.AbstractRocksDBState.serializeValue(AbstractRocksDBState.java:167) at org.apache.flink.contrib.streaming.state.RocksDBValueState.update(RocksDBValueState.java:106) ... 20 more Caused by: java.lang.IllegalArgumentException: Unable to create serializer "com.esotericsoftware.kryo.serializers.FieldSerializer" for class: org.apache.logging.log4j.core.layout.AbstractCsvLayout at com.esotericsoftware.kryo.factories.ReflectionSerializerFactory.makeSerializer(ReflectionSerializerFactory.java:48) at com.esotericsoftware.kryo.factories.ReflectionSerializerFactory.makeSerializer(ReflectionSerializerFactory.java:26) at com.esotericsoftware.kryo.Kryo.newDefaultSerializer(Kryo.java:351) at com.twitter.chill.KryoBase.newDefaultSerializer(KryoBase.scala:58) at com.esotericsoftware.kryo.Kryo.getDefaultSerializer(Kryo.java:344) at com.esotericsoftware.kryo.util.DefaultClassResolver.registerImplicit(DefaultClassResolver.java:56) at com.esotericsoftware.kryo.Kryo.getRegistration(Kryo.java:461) at com.twitter.chill.KryoBase.getRegistration(KryoBase.scala:52) at com.esotericsoftware.kryo.util.DefaultClassResolver.writeClass(DefaultClassResolver.java:79) at com.esotericsoftware.kryo.Kryo.writeClass(Kryo.java:488) at com.esotericsoftware.kryo.serializers.DefaultSerializers$ClassSerializer.write(DefaultSerializers.java:239) at com.esotericsoftware.kryo.serializers.DefaultSerializers$ClassSerializer.write(DefaultSerializers.java:232) at com.esotericsoftware.kryo.Kryo.writeObjectOrNull(Kryo.java:577) at com.esotericsoftware.kryo.serializers.CollectionSerializer.write(CollectionSerializer.java:75) at com.esotericsoftware.kryo.serializers.CollectionSerializer.write(CollectionSerializer.java:22) at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523) at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61) ... 62 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.GeneratedConstructorAccessor42.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at com.esotericsoftware.kryo.factories.ReflectionSerializerFactory.makeSerializer(ReflectionSerializerFactory.java:35) ... 78 more Caused by: java.lang.NoClassDefFoundError: Lorg/apache/commons/csv/CSVFormat; at java.lang.Class.getDeclaredFields0(Native Method) at java.lang.Class.privateGetDeclaredFields(Class.java:2583) at java.lang.Class.getDeclaredFields(Class.java:1916) at com.esotericsoftware.kryo.serializers.FieldSerializer.rebuildCachedFields(FieldSerializer.java:193) at com.esotericsoftware.kryo.serializers.FieldSerializer.rebuildCachedFields(FieldSerializer.java:156) at com.esotericsoftware.kryo.serializers.FieldSerializer.(FieldSerializer.java:133) ... 82 more Caused by: java.lang.ClassNotFoundException: org.apache.commons.csv.CSVFormat at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ... 88 more Any help would be great. I tried manually including CSVFormat from apache commons but didn't change anything. Many thanks, Chris Stevens Head of Research & Development +44 7565 034 595 --0000000000003b6a40059edd70ec Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi there,

I'm trying to update state in = one of my applications hosted in Kinesis Data Analytics.

privat= e transient ValueState<Sensor> sensorState;
using sensorSta= te.update(sensor);

Get error:

=
An error occurred: org.apache.flink.util.FlinkRuntimeException: Error = while adding data to RocksDB
at org.apache.flink.contrib.streaming.state= .RocksDBValueState.update(RocksDBValueState.java:108)
at org.apache.flin= k.runtime.state.ttl.TtlValueState.update(TtlValueState.java:50)
at sensi= ngfeeling.functions.mapping.FrameMotionPathsToTelemetryJoinFunction.join(Fr= ameMotionPathsToTelemetryJoinFunction.java:97)
at sensingfeeling.functio= ns.mapping.FrameMotionPathsToTelemetryJoinFunction.join(FrameMotionPathsToT= elemetryJoinFunction.java:48)
at org.apache.flink.streaming.api.datastre= am.JoinedStreams$JoinCoGroupFunction.coGroup(JoinedStreams.java:460)
at = org.apache.flink.streaming.api.datastream.CoGroupedStreams$CoGroupWindowFun= ction.apply(CoGroupedStreams.java:777)
at org.apache.flink.streaming.run= time.operators.windowing.functions.InternalIterableWindowFunction.process(I= nternalIterableWindowFunction.java:44)
at org.apache.flink.streaming.run= time.operators.windowing.functions.InternalIterableWindowFunction.process(I= nternalIterableWindowFunction.java:32)
at org.apache.flink.streaming.run= time.operators.windowing.WindowOperator.emitWindowContents(WindowOperator.j= ava:546)
at org.apache.flink.streaming.runtime.operators.windowing.Windo= wOperator.onEventTime(WindowOperator.java:454)
at org.apache.flink.strea= ming.api.operators.InternalTimerServiceImpl.advanceWatermark(InternalTimerS= erviceImpl.java:255)
at org.apache.flink.streaming.api.operators.Interna= lTimeServiceManager.advanceWatermark(InternalTimeServiceManager.java:128)at org.apache.flink.streaming.api.operators.AbstractStreamOperator.proces= sWatermark(AbstractStreamOperator.java:775)
at org.apache.flink.streamin= g.runtime.io.StreamInputProcessor$ForwardingValveOutputHandler.handleWaterm= ark(StreamInputProcessor.java:262)
at org.apache.flink.streaming.runtime= .streamstatus.StatusWatermarkValve.findAndOutputNewMinWatermarkAcrossAligne= dChannels(StatusWatermarkValve.java:189)
at org.apache.flink.streaming.r= untime.streamstatus.StatusWatermarkValve.inputWatermark(StatusWatermarkValv= e.java:111)
at org.apache.flink.streaming.runtime.io.StreamInputProcesso= r.processInput(StreamInputProcessor.java:184)
at org.apache.flink.stream= ing.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:105)
at= org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java= :308)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:714)at java.lang.Thread.run(Thread.java:748)
Caused by: com.esotericsoftwar= e.kryo.KryoException: java.lang.IllegalArgumentException: Unable to create = serializer "com.esotericsoftware.kryo.serializers.FieldSerializer"= ; for class: org.apache.logging.log4j.core.layout.AbstractCsvLayout
Seri= alization trace:
classes (sun.misc.Launcher$AppClassLoader)
classload= er (java.security.ProtectionDomain)
cachedPDs (javax.security.auth.Subje= ctDomainCombiner)
combiner (java.security.AccessControlContext)
acc (= sun.security.ssl.SSLSocketImpl)
connection (org.postgresql.core.PGStream= )
pgStream (org.postgresql.core.v3.QueryExecutorImpl)
transferModeReg= istry (org.postgresql.core.v3.SimpleQuery)
commitQuery (org.postgresql.j= dbc.PgConnection)
connection (org.postgresql.jdbc.PgResultSet)
val$rs= (sensingfeeling.functions.mapping.FrameMotionPathsToTelemetryJoinFunction$= 4)
at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectFiel= d.java:82)
at com.esotericsoftware.kryo.serializers.FieldSerializer.writ= e(FieldSerializer.java:495)
at com.esotericsoftware.kryo.Kryo.writeObjec= t(Kryo.java:523)
at com.esotericsoftware.kryo.serializers.ObjectField.wr= ite(ObjectField.java:61)
at com.esotericsoftware.kryo.serializers.FieldS= erializer.write(FieldSerializer.java:495)
at com.esotericsoftware.kryo.K= ryo.writeClassAndObject(Kryo.java:599)
at com.esotericsoftware.kryo.seri= alizers.MapSerializer.write(MapSerializer.java:88)
at com.esotericsoftwa= re.kryo.serializers.MapSerializer.write(MapSerializer.java:21)
at com.es= otericsoftware.kryo.Kryo.writeObject(Kryo.java:523)
at com.esotericsoftw= are.kryo.serializers.ObjectField.write(ObjectField.java:61)
at com.esote= ricsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495= )
at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)
at com= .esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSeria= lizer.java:495)
at com.esotericsoftware.kryo.Kryo.writeObjectOrNull(Kryo= .java:577)
at com.esotericsoftware.kryo.serializers.ObjectField.write(Ob= jectField.java:68)
at com.esotericsoftware.kryo.serializers.FieldSeriali= zer.write(FieldSerializer.java:495)
at com.esotericsoftware.kryo.Kryo.wr= iteObject(Kryo.java:523)
at com.esotericsoftware.kryo.serializers.Object= Field.write(ObjectField.java:61)
at com.esotericsoftware.kryo.serializer= s.FieldSerializer.write(FieldSerializer.java:495)
at com.esotericsoftwar= e.kryo.Kryo.writeObject(Kryo.java:523)
at com.esotericsoftware.kryo.seri= alizers.ObjectField.write(ObjectField.java:61)
at com.esotericsoftware.k= ryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
at com.e= sotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)
at com.esotericsoft= ware.kryo.serializers.ObjectField.write(ObjectField.java:61)
at com.esot= ericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:49= 5)
at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)
at co= m.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)<= br>at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSeri= alizer.java:495)
at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java= :523)
at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectF= ield.java:61)
at com.esotericsoftware.kryo.serializers.FieldSerializer.w= rite(FieldSerializer.java:495)
at com.esotericsoftware.kryo.Kryo.writeOb= ject(Kryo.java:523)
at com.esotericsoftware.kryo.serializers.ObjectField= .write(ObjectField.java:61)
at com.esotericsoftware.kryo.serializers.Fie= ldSerializer.write(FieldSerializer.java:495)
at com.esotericsoftware.kry= o.Kryo.writeClassAndObject(Kryo.java:599)
at org.apache.flink.api.java.t= ypeutils.runtime.kryo.KryoSerializer.serialize(KryoSerializer.java:305)
= at org.apache.flink.api.java.typeutils.runtime.PojoSerializer.serialize(Poj= oSerializer.java:362)
at org.apache.flink.api.common.typeutils.Composite= Serializer.serialize(CompositeSerializer.java:142)
at org.apache.flink.c= ontrib.streaming.state.AbstractRocksDBState.serializeValueInternal(Abstract= RocksDBState.java:158)
at org.apache.flink.contrib.streaming.state.Abstr= actRocksDBState.serializeValue(AbstractRocksDBState.java:178)
at org.apa= che.flink.contrib.streaming.state.AbstractRocksDBState.serializeValue(Abstr= actRocksDBState.java:167)
at org.apache.flink.contrib.streaming.state.Ro= cksDBValueState.update(RocksDBValueState.java:106)
... 20 more
Caused= by: java.lang.IllegalArgumentException: Unable to create serializer "= com.esotericsoftware.kryo.serializers.FieldSerializer" for class: org.= apache.logging.log4j.core.layout.AbstractCsvLayout
at com.esotericsoftwa= re.kryo.factories.ReflectionSerializerFactory.makeSerializer(ReflectionSeri= alizerFactory.java:48)
at com.esotericsoftware.kryo.factories.Reflection= SerializerFactory.makeSerializer(ReflectionSerializerFactory.java:26)
at= com.esotericsoftware.kryo.Kryo.newDefaultSerializer(Kryo.java:351)
at c= om.twitter.chill.KryoBase.newDefaultSerializer(KryoBase.scala:58)
at com= .esotericsoftware.kryo.Kryo.getDefaultSerializer(Kryo.java:344)
at com.e= sotericsoftware.kryo.util.DefaultClassResolver.registerImplicit(DefaultClas= sResolver.java:56)
at com.esotericsoftware.kryo.Kryo.getRegistration(Kry= o.java:461)
at com.twitter.chill.KryoBase.getRegistration(KryoBase.scala= :52)
at com.esotericsoftware.kryo.util.DefaultClassResolver.writeClass(D= efaultClassResolver.java:79)
at com.esotericsoftware.kryo.Kryo.writeClas= s(Kryo.java:488)
at com.esotericsoftware.kryo.serializers.DefaultSeriali= zers$ClassSerializer.write(DefaultSerializers.java:239)
at com.esoterics= oftware.kryo.serializers.DefaultSerializers$ClassSerializer.write(DefaultSe= rializers.java:232)
at com.esotericsoftware.kryo.Kryo.writeObjectOrNull(= Kryo.java:577)
at com.esotericsoftware.kryo.serializers.CollectionSerial= izer.write(CollectionSerializer.java:75)
at com.esotericsoftware.kryo.se= rializers.CollectionSerializer.write(CollectionSerializer.java:22)
at co= m.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)
at com.esoterics= oftware.kryo.serializers.ObjectField.write(ObjectField.java:61)
... 62 m= ore
Caused by: java.lang.reflect.InvocationTargetException
at sun.ref= lect.GeneratedConstructorAccessor42.newInstance(Unknown Source)
at sun.r= eflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorA= ccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constr= uctor.java:423)
at com.esotericsoftware.kryo.factories.ReflectionSeriali= zerFactory.makeSerializer(ReflectionSerializerFactory.java:35)
... 78 mo= re
Caused by: java.lang.NoClassDefFoundError: Lorg/apache/commons/csv/CS= VFormat;
at java.lang.Class.getDeclaredFields0(Native Method)
at java= .lang.Class.privateGetDeclaredFields(Class.java:2583)
at java.lang.Class= .getDeclaredFields(Class.java:1916)
at com.esotericsoftware.kryo.seriali= zers.FieldSerializer.rebuildCachedFields(FieldSerializer.java:193)
at co= m.esotericsoftware.kryo.serializers.FieldSerializer.rebuildCachedFields(Fie= ldSerializer.java:156)
at com.esotericsoftware.kryo.serializers.FieldSer= ializer.<init>(FieldSerializer.java:133)
... 82 more
Caused by:= java.lang.ClassNotFoundException: org.apache.commons.csv.CSVFormat
at j= ava.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.C= lassLoader.loadClass(ClassLoader.java:418)
at sun.misc.Launcher$AppClass= Loader.loadClass(Launcher.java:352)
at java.lang.ClassLoader.loadClass(C= lassLoader.java:351)
... 88 more

Any help would= be great. I tried manually including CSVFormat from apache commons but did= n't change anything.

<= div>
Many thanks,
Chri= s Stevens
Head of Research & Development
+44 7565 0= 34 595
--0000000000003b6a40059edd70ec--