flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Debaditya Roy <roydca...@gmail.com>
Subject Re: .so linkage error in Cluster
Date Tue, 26 Jul 2016 14:39:38 GMT
Hello,

I am using the jar builder from IntelliJ IDE (the mvn one was causing
problems). After that I executed it successfully locally. But in remote it
is causing problem.

Warm Regards,
Debaditya

On Tue, Jul 26, 2016 at 4:36 PM, Ufuk Celebi <uce@apache.org> wrote:

> Yes, the BlobCache on each TaskManager node should fetch it from the
> JobManager. How are you packaging your JAR?
>
> On Tue, Jul 26, 2016 at 4:32 PM, Debaditya Roy <roydcat14@gmail.com>
> wrote:
> > Hello users,
> >
> > I am having a problem while running my flink program in a cluster. It
> gives
> > me an error that it is unable to find an .so file in a tmp directory.
> >
> > Caused by: java.lang.UnsatisfiedLinkError: no jniopencv_core in
> > java.library.path
> >     at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
> >     at java.lang.Runtime.loadLibrary0(Runtime.java:870)
> >     at java.lang.System.loadLibrary(System.java:1122)
> >     at org.bytedeco.javacpp.Loader.loadLibrary(Loader.java:654)
> >     at org.bytedeco.javacpp.Loader.load(Loader.java:492)
> >     at org.bytedeco.javacpp.Loader.load(Loader.java:409)
> >     at org.bytedeco.javacpp.opencv_core.<clinit>(opencv_core.java:10)
> >     at java.lang.Class.forName0(Native Method)
> >     at java.lang.Class.forName(Class.java:348)
> >     at org.bytedeco.javacpp.Loader.load(Loader.java:464)
> >     at org.bytedeco.javacpp.Loader.load(Loader.java:409)
> >     at
> >
> org.bytedeco.javacpp.helper.opencv_core$AbstractArray.<clinit>(opencv_core.java:109)
> >     at loc.video.FlinkStreamSource.run(FlinkStreamSource.java:95)
> >     at
> >
> org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:78)
> >     at
> >
> org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:56)
> >     at
> >
> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:225)
> >     at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)
> >     at java.lang.Thread.run(Thread.java:745)
> > Caused by: java.lang.UnsatisfiedLinkError:
> > /tmp/javacpp5400264496782/libjniopencv_core.so: libgomp.so.1: cannot open
> > shared object file: No such file or directory
> >     at java.lang.ClassLoader$NativeLibrary.load(Native Method)
> >     at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1941)
> >     at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1824)
> >     at java.lang.Runtime.load0(Runtime.java:809)
> >     at java.lang.System.load(System.java:1086)
> >     at org.bytedeco.javacpp.Loader.loadLibrary(Loader.java:637)
> >
> >
> > I searched for the temp directory and in one of the nodes this directory
> and
> > the .jar file was present. Is it required to have the file across all the
> > nodes? If yes is there any way to control it? Since this tmp directory
> and
> > the .so file gets extracted during the runtime without any external
> > manipulation.
> >
> >
> > Thanks in advance.
> >
> > Regards,
> > Debaditya
>

Mime
View raw message