flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Metzger <rmetz...@apache.org>
Subject Re: Caused by: java.lang.Exception: Serialized representation of java.lang.StackOverflowError: null
Date Tue, 21 Jun 2016 16:02:47 GMT
Hi,
maybe Kryo is not able to serialize the class. Is the class holding the
data outside of the heap?

In those cases, I would recommend implementing a custom serializer (either
by using Flink's TypeInformation system or Kryo).



On Tue, Jun 21, 2016 at 5:43 PM, Debaditya Roy <roydcat14@gmail.com> wrote:

> Hi,
>
> I am using flink-1.0.3.
>
> Warm Regards,
> Debaditya
>
> On Tue, Jun 21, 2016 at 5:29 PM, Robert Metzger <rmetzger@apache.org>
> wrote:
>
>> Hi,
>> which version of Flink are you using? There has been a recent fix for the
>> issue: https://issues.apache.org/jira/browse/FLINK-3762
>>
>> Regards,
>> Robert
>>
>> On Tue, Jun 21, 2016 at 5:22 PM, Debaditya Roy <roydcat14@gmail.com>
>> wrote:
>>
>>> Hello users,
>>>
>>> I am getting an error from the flat map function while running my
>>> program. My program is sending an object of type Mat(OpenCV) from the
>>> custom source function and passing it to the flat map function for
>>> processing. However while executing I am getting this error:
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> *org.apache.flink.runtime.client.JobExecutionException: Job execution
>>> failed.    at
>>> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply$mcV$sp(JobManager.scala:717)
>>> at
>>> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:663)
>>> at
>>> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:663)
>>> at
>>> scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
>>> at
>>> scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
>>> at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41)    at
>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401)
>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
>>> at
>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
>>> at
>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
>>> at
>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
>>> at
>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused
>>> by: java.lang.StackOverflowError    at
>>> com.esotericsoftware.kryo.util.DefaultClassResolver.writeClass(DefaultClassResolver.java:79)
>>> at com.esotericsoftware.kryo.Kryo.writeClass(Kryo.java:488)    at
>>> com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:57)
>>> at
>>> com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
>>> at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)    at
>>> com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)
>>> at
>>> com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
>>> at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)    at
>>> com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)
>>> at
>>> com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
>>> at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)    at
>>> com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)
>>> at
>>> com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
>>> at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)    at
>>> com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)
>>> at
>>> com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
>>> at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)    at
>>> com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)
>>> at
>>> com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
>>> at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)    at
>>> com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)
>>> at
>>> com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
>>> at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)    at
>>> com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)
>>> at
>>> com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
>>> at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)    *
>>> Any help would be highly appreciated. Thanks in advance.
>>>
>>> Warm Regards,
>>> Debaditya
>>>
>>
>>
>

Mime
View raw message