flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexander Alexandrov <alexander.s.alexand...@gmail.com>
Subject Re: ReduceGroup fails on server
Date Thu, 29 Jan 2015 15:25:59 GMT
Forget what I just said, didn't realize that it's Scala :)

2015-01-29 16:24 GMT+01:00 Alexander Alexandrov <
alexander.s.alexandrov@gmail.com>:

> have you tried declaring your UDF classes (e.g. TotalRankDistribution) as
> static?
>
> 2015-01-29 16:14 GMT+01:00 Arvid Heise <arvid.heise@gmail.com>:
>
>> Hi Flinker,
>>
>> I'm currently desparetely trying to get a workflow to run remotely on a
>> server. The workflow works fine in the local execution environment (both
>> with ExecutionEnvironment.getExecutionEnvironment and
>> ExecutionEnvironment.createLocalEnvironment(2)).
>>
>> On the server, I get
>>
>> 01/29/2015 16:05:22:    GroupReduce (GroupReduce at
>> de.bund.bfr.flink.outbreakanalysis.OutbreakAnalysis$.main(OutbreakAnalysis.scala:79))
>> (1/1) switched to FAILED
>> java.lang.RuntimeException: : Repeated instantiation of serializer failed.
>>         at
>> org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:340)
>>         at
>> org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:257)
>>         at java.lang.Thread.run(Thread.java:722)
>> Caused by: java.lang.RuntimeException: Repeated instantiation of
>> serializer failed.
>>         at
>> org.apache.flink.api.java.typeutils.runtime.RuntimeStatefulSerializerFactory.getSerializer(RuntimeStatefulSerializerFactory.java:102)
>>         at
>> org.apache.flink.api.java.typeutils.runtime.TupleComparatorBase.instantiateDeserializationUtils(TupleComparatorBase.java:267)
>>         at
>> org.apache.flink.api.scala.typeutils.CaseClassComparator.duplicate(CaseClassComparator.scala:42)
>>         at
>> org.apache.flink.runtime.operators.sort.UnilateralSortMerger.<init>(UnilateralSortMerger.java:360)
>>         at
>> org.apache.flink.runtime.operators.sort.UnilateralSortMerger.<init>(UnilateralSortMerger.java:227)
>>         at
>> org.apache.flink.runtime.operators.sort.UnilateralSortMerger.<init>(UnilateralSortMerger.java:195)
>>         at
>> org.apache.flink.runtime.operators.RegularPactTask.initInputLocalStrategy(RegularPactTask.java:981)
>>         at
>> org.apache.flink.runtime.operators.RegularPactTask.initLocalStrategies(RegularPactTask.java:842)
>>         at
>> org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:336)
>>         ... 2 more
>> Caused by: java.lang.ClassNotFoundException:
>> de.bund.bfr.flink.outbreakanalysis.OutbreakAnalysis$$anon$13$$anon$14$$anon$15
>>
>> The class is of course in the submitted jar and I use the same flink and
>> java version on both machines. Could it be that the wrong class loader is
>> used for duplicating the comparator?
>>
>> The code is available here
>> https://github.com/SiLeBAT/Other/tree/master/de.bund.bfr.flink.outbreakanalysis
>> .
>> If you need help to invoke the program, please msg me privately, so that
>> I can send you the non-public datasets.
>>
>> Thank you in advance,
>>
>> Arvid
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message