Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id C8E77200D35 for ; Tue, 7 Nov 2017 10:17:38 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id C721D160BED; Tue, 7 Nov 2017 09:17:38 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id E631A1609C8 for ; Tue, 7 Nov 2017 10:17:37 +0100 (CET) Received: (qmail 52008 invoked by uid 500); 7 Nov 2017 09:17:36 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 51999 invoked by uid 99); 7 Nov 2017 09:17:36 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Nov 2017 09:17:36 +0000 Received: from mail-qk0-f179.google.com (mail-qk0-f179.google.com [209.85.220.179]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id B66861A071F for ; Tue, 7 Nov 2017 09:17:35 +0000 (UTC) Received: by mail-qk0-f179.google.com with SMTP id b15so14345911qkg.9 for ; Tue, 07 Nov 2017 01:17:35 -0800 (PST) X-Gm-Message-State: AJaThX5EpJgmJp7ytCq9iCM8uKuOibsaPBx58mb6kkg8r6KkolGk35n3 bIAxvxx2yjGPHWh2QfyTsSc8SUQUjJR+bBFaag8= X-Google-Smtp-Source: ABhQp+TLq8I7b4CzOl8JAbyIm0XpXI03QzGdu0VnURbXCE7+6T3r/ZFZ71113aSGdS8UBxs4MembPeLeCBbZ9Mfk8HI= X-Received: by 10.55.19.158 with SMTP id 30mr10555956qkt.0.1510046253639; Tue, 07 Nov 2017 01:17:33 -0800 (PST) MIME-Version: 1.0 Received: by 10.12.172.70 with HTTP; Tue, 7 Nov 2017 01:16:53 -0800 (PST) In-Reply-To: References: From: Till Rohrmann Date: Tue, 7 Nov 2017 10:16:53 +0100 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: ExecutionGraph not serializable To: Fabian Hueske Cc: XiangWei Huang , user Content-Type: multipart/alternative; boundary="001a113f8dbc8aeda2055d610a68" archived-at: Tue, 07 Nov 2017 09:17:39 -0000 --001a113f8dbc8aeda2055d610a68 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi XiangWei, how do you use the JobMasterGateway with the actor message RequestJob? The JobMasterGateway is a Java interface and does not represent an ActorCell to which you can send actor messages. Instead you should call JobMasterGateway#requestArchivedExecutionGraph. Cheers, Till =E2=80=8B On Tue, Nov 7, 2017 at 9:58 AM, Fabian Hueske wrote: > Hi XiangWei, > > I don't think this is a public interface, but Till (in CC) might know > better. > > Best, > Fabian > > 2017-11-06 3:27 GMT+01:00 XiangWei Huang : > >> Hi Flink users, >> Flink Jobmanager throw a NotSerializableException when i used >> JobMasterGateway to get ExecutionGraph of a specific job with >> message *RequestJob(jobID). *Blow is the detail of Exception: >> >> >> [ERROR] [akka.remote.EndpointWriter] - Transient association error (asso= ciation remains live)java.io.NotSerializableException: org.apache.flink.run= time.executiongraph.ExecutionGraph >> at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1184= ) >> at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.jav= a:1548) >> at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1= 509) >> at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.ja= va:1432) >> at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178= ) >> at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348) >> at akka.serialization.JavaSerializer$$anonfun$toBinary$1.apply$mcV$sp(S= erializer.scala:129) >> at akka.serialization.JavaSerializer$$anonfun$toBinary$1.apply(Serializ= er.scala:129) >> at akka.serialization.JavaSerializer$$anonfun$toBinary$1.apply(Serializ= er.scala:129) >> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:58) >> at akka.serialization.JavaSerializer.toBinary(Serializer.scala:129) >> at akka.remote.MessageSerializer$.serialize(MessageSerializer.scala:36) >> at akka.remote.EndpointWriter$$anonfun$serializeMessage$1.apply(Endpoin= t.scala:875) >> at akka.remote.EndpointWriter$$anonfun$serializeMessage$1.apply(Endpoin= t.scala:875) >> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:58) >> at akka.remote.EndpointWriter.serializeMessage(Endpoint.scala:874) >> at akka.remote.EndpointWriter.writeSend(Endpoint.scala:769) >> at akka.remote.EndpointWriter$$anonfun$4.applyOrElse(Endpoint.scala:744= ) >> at akka.actor.Actor$class.aroundReceive(Actor.scala:467) >> at akka.remote.EndpointActor.aroundReceive(Endpoint.scala:437) >> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516) >> at akka.actor.ActorCell.invoke(ActorCell.scala:487) >> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238) >> at akka.dispatch.Mailbox.run(Mailbox.scala:220) >> at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(Abs= tractDispatcher.scala:397) >> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >> at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPoo= l.java:1339) >> at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1= 979) >> at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThr= ead.java:107) >> >> >> So,is it a bug or the way to get job=E2=80=99s executionGraph is invalid= . >> >> >> Best,XiangWei >> >> >> > --001a113f8dbc8aeda2055d610a68 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable

Hi XiangWei,

how do you use the JobMasterGateway with the actor message Reque= stJob? The JobMasterGateway is a Java interf= ace and does not represent an ActorCell to which yo= u can send actor messages. Instead you should call JobMast= erGateway#requestArchivedExecutionGraph.

Cheers,
Till

=E2=80=8B

On Tue, Nov 7, 2017= at 9:58 AM, Fabian Hueske <fhueske@gmail.com> wrote:
Hi XiangWei,
I don't think this is a public interface, but Till (in CC) m= ight know better.

Best,
Fabian

2017-11-06 3:27 GMT+01:00 XiangWei Huang <xw.huang.hz@gmail.= com>:
Hi Flink users,
Fl= ink Jobmanager throw a NotSerializableException when i used JobMasterGatewa= y to get ExecutionGraph of a specific job with=C2=A0
message=C2=A0RequestJob(jobID). Blow is the detail of Exc= eption:


[ERROR] [akka.remote.EndpointWri=
ter] - Transient association error (association remains live)
java.io.NotSerializableExc=
eption: org.apache.flink.runtime.executiongraph.ExecutionGraph
	at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.ja=
va:1184)
	at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStr=
eam.java:1548)
	at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream=
.java:1509)
	at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputSt=
ream.java:1432)
	at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.ja=
va:1178)
	at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.jav=
a:348)
	at akka.serialization.JavaSerializer$$anonfun$toBinary$1.apply$m=
cV$sp(Serializer.scala:129)
	at akka.serialization.JavaSerializer$$anonfun$toBinary$1.apply(S=
erializer.scala:129)
	at akka.serialization.JavaSerializer$$anonfun$toBinary$1.apply(S=
erializer.scala:129)
	at scala.util.DynamicVariable.withValue(DynamicVariable.scala:58=
)
	at akka.serialization.JavaSerializer.toBinary(Serializer.scala:1=
29)
	at akka.remote.MessageSerializer$.serialize(MessageSerializer.sc=
ala:36)
	at akka.remote.EndpointWriter$$anonfun$serializeMessage$1.apply(=
Endpoint.scala:875)
	at akka.remote.EndpointWriter$$anonfun$serializeMessage$1.apply(=
Endpoint.scala:875)
	at scala.util.DynamicVariable.withValue(DynamicVariable.scala:58=
)
	at akka.remote.EndpointWriter.serializeMessage(Endpoint.scala:87=
4)
	at akka.remote.EndpointWriter.writeSend(Endpoint.scala:769)
	at akka.remote.EndpointWriter$$anonfun$4.applyOrElse(Endpoint.sc=
ala:744)
	at akka.actor.Actor$class.aroundReceive(Actor.scala:467)
	at akka.remote.EndpointActor.aroundReceive(Endpoint.scala:437)
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
	at akka.actor.ActorCell.invoke(ActorCell.scala:487)
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
	at akka.dispatch.Mailbox.run(Mailbox.scala:220)
	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.e=
xec(AbstractDispatcher.scala:397)
	at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.ja=
va:260)
	at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(Fork=
JoinPool.java:1339)
	at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool=
.java:1979)
	at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWo=
rkerThread.java:107)


So,is it a bug or the way to get jo=
b=E2=80=99s executionGraph is invalid.

Best,XiangWei



--001a113f8dbc8aeda2055d610a68--