flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vasiliki Kalavri <vasilikikala...@gmail.com>
Subject Re: ArrayIndexOutOfBoundsException when running job from JAR
Date Fri, 26 Jun 2015 09:10:32 GMT
Hi Mihail,

could you share your code or at least the implementations of
getVerticesDataSet() and InitVerticesMapper so I can take a look?
Where is InitVerticesMapper called above?

Cheers,
Vasia.


On 26 June 2015 at 10:51, Mihail Vieru <vieru@informatik.hu-berlin.de>
wrote:

>  Hi Robert,
>
> I'm using the same input data, as well as the same parameters I use in the
> IDE's run configuration.
> I don't run the job on the cluster (yet), but locally, by starting Flink
> with the start-local.sh script.
>
>
> I will try to explain my code a bit. The *Integer[] *array is initialized
> in the *getVerticesDataSet()* method.
>
> *        DataSet<Vertex<Integer, Tuple2<Integer[],String> >> vertices
=
> getVerticesDataSet(env);*
> *        ...*
> *        Graph<Integer, Tuple2<Integer[],String>, NullValue> graph =
> Graph.fromDataSet(vertices, edges, env);*
> *        ...*
> *        Graph<Integer, Tuple2<Integer[],String>, NullValue>
> intermediateGraph = *
> *                graph.run(new APSP<Integer>(srcVertexId, maxIterations));*
>
>
> In APSP I'm addressing it in the *InitVerticesMapper*, but is now
> suddenly empty.
>
> Best,
> Mihail
>
>
> On 26.06.2015 10:00, Robert Metzger wrote:
>
> Hi Mihail,
>
>  the NPE has been thrown from
> *graphdistance.APSP$InitVerticesMapper.map(APSP.java:74)*. I guess that
> is code written by you or a library you are using.
> Maybe the data you are using on the cluster is different from your local
> test data?
>
>  Best,
> Robert
>
>
> On Thu, Jun 25, 2015 at 7:41 PM, Mihail Vieru <
> vieru@informatik.hu-berlin.de> wrote:
>
>>  Hi,
>>
>> I get an ArrayIndexOutOfBoundsException when I run my job from a JAR in
>> the CLI.
>> This doesn't occur in the IDE.
>>
>> I've build the JAR using the "maven-shade-plugin" and the pom.xml
>> configuration Robert has provided here:
>>
>> https://stackoverflow.com/questions/30102523/linkage-failure-when-running-apache-flink-jobs
>> I specify the entry point using the "-c" option.
>>
>> The array the Exception refers to is actually initialized when a vertices
>> dataset is read from the file system.
>>
>> Any ideas on what could cause this issue?
>>
>> Best,
>> Mihail
>>
>> P.S.: the stack trace:
>>
>> *org.apache.flink.client.program.ProgramInvocationException: The program
>> execution failed: Job execution failed.*
>> *    at org.apache.flink.client.program.Client.run(Client.java:413)*
>> *    at org.apache.flink.client.program.Client.run(Client.java:356)*
>> *    at org.apache.flink.client.program.Client.run(Client.java:349)*
>> *    at
>> org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:63)*
>> *    at graphdistance.KAPSPNaiveJob.main(KAPSPNaiveJob.java:56)*
>> *    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)*
>> *    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)*
>> *    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)*
>> *    at java.lang.reflect.Method.invoke(Method.java:606)*
>> *    at
>> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:437)*
>> *    at
>> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:353)*
>> *    at org.apache.flink.client.program.Client.run(Client.java:315)*
>> *    at
>> org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:584)*
>> *    at org.apache.flink.client.CliFrontend.run(CliFrontend.java:290)*
>> *    at
>> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:880)*
>> *    at org.apache.flink.client.CliFrontend.main(CliFrontend.java:922)*
>> *Caused by: org.apache.flink.runtime.client.JobExecutionException: Job
>> execution failed.*
>> *    at
>> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$receiveWithLogMessages$1.applyOrElse(JobManager.scala:314)*
>> *    at
>> scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33)*
>> *    at
>> scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33)*
>> *    at
>> scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25)*
>> *    at
>> org.apache.flink.runtime.ActorLogMessages$$anon$1.apply(ActorLogMessages.scala:36)*
>> *    at
>> org.apache.flink.runtime.ActorLogMessages$$anon$1.apply(ActorLogMessages.scala:29)*
>> *    at
>> scala.PartialFunction$class.applyOrElse(PartialFunction.scala:118)*
>> *    at
>> org.apache.flink.runtime.ActorLogMessages$$anon$1.applyOrElse(ActorLogMessages.scala:29)*
>> *    at akka.actor.Actor$class.aroundReceive(Actor.scala:465)*
>> *    at
>> org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:92)*
>> *    at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)*
>> *    at akka.actor.ActorCell.invoke(ActorCell.scala:487)*
>> *    at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254)*
>> *    at akka.dispatch.Mailbox.run(Mailbox.scala:221)*
>> *    at akka.dispatch.Mailbox.exec(Mailbox.scala:231)*
>> *    at
>> scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)*
>> *    at
>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)*
>> *    at
>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)*
>> *    at
>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)*
>> *Caused by: java.lang.ArrayIndexOutOfBoundsException: 0*
>> *    at graphdistance.APSP$InitVerticesMapper.map(APSP.java:74)*
>> *    at graphdistance.APSP$InitVerticesMapper.map(APSP.java:48)*
>> *    at org.apache.flink.graph.Graph$2.map(Graph.java:389)*
>> *    at org.apache.flink.graph.Graph$2.map(Graph.java:387)*
>> *    at
>> org.apache.flink.runtime.operators.MapDriver.run(MapDriver.java:97)*
>> *    at
>> org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:496)*
>> *    at
>> org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:362)*
>> *    at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)*
>> *    at java.lang.Thread.run(Thread.java:745)*
>>
>
>
>

Mime
View raw message