flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kedar Mhaswade (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-9267) Classloading issues when using RemoteEnvironment ...
Date Tue, 01 May 2018 19:46:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460061#comment-16460061
] 

Kedar Mhaswade commented on FLINK-9267:
---------------------------------------

Wow! Thank you for the tip above. I have been able to talk to the cluster now. There are still
serialization errors:
{noformat}
2018-05-01 12:30:17,598 ERROR Remoting                                                   
  - scala.Option; local class incompatible: stream classdesc serialVersionUID = -114498752079829388,
local class serialVersionUID = -2062608324514658839
java.io.InvalidClassException: scala.Option; local class incompatible: stream classdesc serialVersionUID
= -114498752079829388, local class serialVersionUID = -2062608324514658839
	at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:687)
	at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1876)
	at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1745)
	at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1876)
	at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1745)
	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2033)
	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1567)
	at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2278)
	at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2202)
	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2060)
	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1567)
	at java.io.ObjectInputStream.readObject(ObjectInputStream.java:427)
	at akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136)
	at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)
	at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136)
	at akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104)
	at scala.util.Try$.apply(Try.scala:161)
	at akka.serialization.Serialization.deserialize(Serialization.scala:98)
	at akka.remote.serialization.MessageContainerSerializer.fromBinary(MessageContainerSerializer.scala:63)
	at akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104)
	at scala.util.Try$.apply(Try.scala:161)
	at akka.serialization.Serialization.deserialize(Serialization.scala:98)
	at akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23)
	at akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:58)
	at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:58)
	at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:76)
	at akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:967)
	at akka.actor.Actor$class.aroundReceive(Actor.scala:467)
	at akka.remote.EndpointActor.aroundReceive(Endpoint.scala:437)
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
	at akka.actor.ActorCell.invoke(ActorCell.scala:487)
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
	at akka.dispatch.Mailbox.run(Mailbox.scala:220)
	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
	at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
	at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
	at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
	at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
{noformat}
but this gives me something to work with. Thanks again. We would soon close this as "not a
Flink  issue". Will do that.

> Classloading issues when using RemoteEnvironment ...
> ----------------------------------------------------
>
>                 Key: FLINK-9267
>                 URL: https://issues.apache.org/jira/browse/FLINK-9267
>             Project: Flink
>          Issue Type: Bug
>          Components: Job-Submission
>    Affects Versions: 1.4.2
>         Environment: I have tried with Flink 1.3.3, Flink 1.4.2 and Flink 1.6.0-SNAPSHOT.
> Oracle JDK 1.8.0_161 on Mac with a local cluster containing one JM and one TM.
>            Reporter: Kedar Mhaswade
>            Priority: Major
>
> See these two threads:
>  * [Nov 2017|http://mail-archives.apache.org/mod_mbox/flink-user/201711.mbox/%3C66D706AD-5E47-4BD2-A7AF-1DB41CCE7AEA@gmail.com%3E]
>  * [April 2018|http://mail-archives.apache.org/mod_mbox/flink-user/201804.mbox/%3CCABzSAw_sQ149F8%2BS2Mpg%3DCH75F_7PuUx3hQYjdnLmOUL5O23oQ%40mail.gmail.com%3E]
> Both these threads show the classloading problems with using the {{RemoteEnvironment}}.
The instructions to [reproduce are here|http://mail-archives.apache.org/mod_mbox/flink-user/201804.mbox/%3CCABzSAw_0Qw_44XVJdTWz9Y+S-Pfgg2+CFx2C46gwQqNGJj0B3A@mail.gmail.com%3E]. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message