Return-Path: X-Original-To: apmail-flink-dev-archive@www.apache.org Delivered-To: apmail-flink-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F129C18D2D for ; Thu, 31 Mar 2016 15:05:53 +0000 (UTC) Received: (qmail 15408 invoked by uid 500); 31 Mar 2016 15:05:48 -0000 Delivered-To: apmail-flink-dev-archive@flink.apache.org Received: (qmail 15329 invoked by uid 500); 31 Mar 2016 15:05:48 -0000 Mailing-List: contact dev-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list dev@flink.apache.org Received: (qmail 15317 invoked by uid 99); 31 Mar 2016 15:05:48 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Mar 2016 15:05:48 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 15C381A08AD for ; Thu, 31 Mar 2016 15:05:48 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.3 X-Spam-Level: * X-Spam-Status: No, score=1.3 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, WEIRD_PORT=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id QHlBsCvTQ6OY for ; Thu, 31 Mar 2016 15:05:45 +0000 (UTC) Received: from mail-io0-f177.google.com (mail-io0-f177.google.com [209.85.223.177]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id ECE355F246 for ; Thu, 31 Mar 2016 15:05:44 +0000 (UTC) Received: by mail-io0-f177.google.com with SMTP id g185so118649001ioa.2 for ; Thu, 31 Mar 2016 08:05:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to; bh=EfD4fnk1ImFYkhjd5bvWMc/3OqjRlJH9zKZ5Rzci46M=; b=xMtY/0dToV/rtDKqQdOrjd8j8He+33iJEc3t0zl/vQFQIdBOzSDo7fcmtZd92IjtPA UsEiwuo1XBik8gYZkLPa+zP38k64t1dAyzYUgRmnnfiQ7cnIVrXtF5I1o9ij5FwoTbsl SEOcOacenRcsoAsy7nX32yfQMhCTy+I5/7DLk0nrgwgwmyXuXk5Uk+zAjZU7aFvh3hql NR5LQceExnHCSDH3TfVR5cius+lSc6un4liAY1cKfWzOhHmkIjzzYejAIgqKiAQQvzz9 rh5yWOySFpVGOmRO4FarDAVvYwEewj1gVq+66cHCL2Ej9fy+vPGVoMM96Vbfy6FggyZi vSGw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:in-reply-to:references:date :message-id:subject:from:to; bh=EfD4fnk1ImFYkhjd5bvWMc/3OqjRlJH9zKZ5Rzci46M=; b=bAcs+MdgwGYslakSff5rH3q/5xA/afcZMY8JGzn6o2673uriX6dFCfP8aMz65PzAPq qx7tnFke1sjjBtCn3zG5faxtu0RH7FIFRY5t7RAs++2HQfwa3btacPmGFX1ZwZX8bLV4 TA744oecpEywRHiJMBzbjIx9TEdpP+bqWJ6fdSAi7+Y6+t91CsJ9kdZ5sZn7Iie/LM3k EMURZ9rMzPVog0E09mkB9hDjg62s7lerAr2dinCusJqLh4bPjrCpeoFABrc4lYPTUwx2 rzZ7GyAKVnWYGrVzoIQdbJLkfIAwwM3x0bNPM7KM5AtF21PoKVbSwIuVKjAftXKehZtS soVQ== X-Gm-Message-State: AD7BkJLKlUjdFBR+IvwbdYC/G7FopO3VYdAQEM/Pd3w+VFs/4aaiTsrJ2X61z/ZFfOILoBhznBNin/b8XRkqcg== MIME-Version: 1.0 X-Received: by 10.107.185.134 with SMTP id j128mr4726563iof.23.1459436737609; Thu, 31 Mar 2016 08:05:37 -0700 (PDT) Sender: ewenstephan@gmail.com Received: by 10.107.10.68 with HTTP; Thu, 31 Mar 2016 08:05:37 -0700 (PDT) In-Reply-To: <56FD3977.304@apache.org> References: <56FD16FA.7000209@apache.org> <56FD3263.4040500@apache.org> <56FD3977.304@apache.org> Date: Thu, 31 Mar 2016 17:05:37 +0200 X-Google-Sender-Auth: nInW5rqU6Zc399kCPlNyGv1hP5E Message-ID: Subject: Re: Submission Problem From: Stephan Ewen To: "dev@flink.apache.org" Content-Type: multipart/alternative; boundary=94eb2c0810ac514bf6052f5998a5 --94eb2c0810ac514bf6052f5998a5 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hmm, it is wrong that the JobManager tries to load that class directly from the actor message. All user code should be deserialized lazily. How is that class passed? Implicitly through some config? On Thu, Mar 31, 2016 at 4:51 PM, Matthias J. Sax wrote: > Here we go... > > StormConfig.class is contained in the user jar file. I guess I need to > "register" it somehow? Or is it a class loading issue? > > > > 2016-03-31 16:47:33,095 ERROR akka.remote.EndpointWriter > - AssociationError [akka.tcp://flink@127.0.0.1:6123] > <- [akka.tcp://flink@127.0.0.1:32775]: Error > [org.apache.flink.storm.util.StormConfig] [ > > java.lang.ClassNotFoundException: org.apache.flink.storm.util.StormConf= ig > > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > > at java.security.AccessController.doPrivileged(Native Method) > > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > > at java.lang.Class.forName0(Native Method) > > at java.lang.Class.forName(Class.java:278) > > at > java.io.ObjectInputStream.resolveClass(ObjectInputStream.java:625) > > at > akka.util.ClassLoaderObjectInputStream.resolveClass(ClassLoaderObjectInpu= tStream.scala:19) > > at > java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1612) > > at > java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1517) > > at > java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) > > at > java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) > > at > java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1997) > > at > java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1921) > > at > java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798) > > at > java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) > > at > java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1997) > > at > java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1921) > > at > java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798) > > at > java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) > > at > java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1997) > > at > java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1921) > > at > java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798) > > at > java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) > > at > java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1997) > > at > java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1921) > > at > java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798) > > at > java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) > > at java.io.ObjectInputStream.readObject(ObjectInputStream.java:37= 0) > > at > akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) > > at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) > > at > akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) > > at > akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serializati= on.scala:104) > > at scala.util.Try$.apply(Try.scala:161) > > at > akka.serialization.Serialization.deserialize(Serialization.scala:98) > > at > akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) > > at > akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:= 58) > > at > akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:58) > > at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:7= 6) > > at > akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:= 937) > > at akka.actor.Actor$class.aroundReceive(Actor.scala:465) > > at akka.remote.EndpointActor.aroundReceive(Endpoint.scala:415) > > at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516) > > at akka.actor.ActorCell.invoke(ActorCell.scala:487) > > at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254) > > at akka.dispatch.Mailbox.run(Mailbox.scala:221) > > at akka.dispatch.Mailbox.exec(Mailbox.scala:231) > > at > scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) > > at > scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.jav= a:1339) > > at > scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) > > at > scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.j= ava:107) > > ] > > > > On 03/31/2016 04:31 PM, Till Rohrmann wrote: > > Could you please rerun the whole job with debug log level and logging o= f > > Akka's lifecycle events turned on? > > > > Cheers, > > Till > > > > On Thu, Mar 31, 2016 at 4:21 PM, Matthias J. Sax > wrote: > > > >> enclosed the logs.. maybe you can make some sense out if them. > >> > >> On 03/31/2016 02:52 PM, Till Rohrmann wrote: > >>> I would assume that something went wrong on the JobManager side. Coul= d > >> you > >>> check the logs if they contain something suspicious? Additionally you > >> could > >>> turn on lifecycle event logging=E2=80=8B for Akka. > >>> > >>> Cheers, > >>> Till > >>> =E2=80=8B > >>> > >> > > > > --94eb2c0810ac514bf6052f5998a5--