flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ufuk Celebi <...@apache.org>
Subject Re: .so linkage error in Cluster
Date Tue, 26 Jul 2016 18:06:48 GMT
Out of curiosity I've tried this locally by adding the following
dependencies to my Maven project:

<dependency>
   <groupId>org.bytedeco</groupId>
   <artifactId>javacpp</artifactId>
   <version>1.2.2</version>
</dependency>
<dependency>
   <groupId>org.bytedeco.javacpp-presets</groupId>
   <artifactId>opencv</artifactId>
   <version>3.1.0-1.2</version>
</dependency>

With this, running mvn clean package works as expected.



On Tue, Jul 26, 2016 at 7:09 PM, Ufuk Celebi <uce@apache.org> wrote:
> What error message to you get from Maven?
>
> On Tue, Jul 26, 2016 at 4:39 PM, Debaditya Roy <roydcat14@gmail.com> wrote:
>> Hello,
>>
>> I am using the jar builder from IntelliJ IDE (the mvn one was causing
>> problems). After that I executed it successfully locally. But in remote it
>> is causing problem.
>>
>> Warm Regards,
>> Debaditya
>>
>> On Tue, Jul 26, 2016 at 4:36 PM, Ufuk Celebi <uce@apache.org> wrote:
>>>
>>> Yes, the BlobCache on each TaskManager node should fetch it from the
>>> JobManager. How are you packaging your JAR?
>>>
>>> On Tue, Jul 26, 2016 at 4:32 PM, Debaditya Roy <roydcat14@gmail.com>
>>> wrote:
>>> > Hello users,
>>> >
>>> > I am having a problem while running my flink program in a cluster. It
>>> > gives
>>> > me an error that it is unable to find an .so file in a tmp directory.
>>> >
>>> > Caused by: java.lang.UnsatisfiedLinkError: no jniopencv_core in
>>> > java.library.path
>>> >     at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
>>> >     at java.lang.Runtime.loadLibrary0(Runtime.java:870)
>>> >     at java.lang.System.loadLibrary(System.java:1122)
>>> >     at org.bytedeco.javacpp.Loader.loadLibrary(Loader.java:654)
>>> >     at org.bytedeco.javacpp.Loader.load(Loader.java:492)
>>> >     at org.bytedeco.javacpp.Loader.load(Loader.java:409)
>>> >     at org.bytedeco.javacpp.opencv_core.<clinit>(opencv_core.java:10)
>>> >     at java.lang.Class.forName0(Native Method)
>>> >     at java.lang.Class.forName(Class.java:348)
>>> >     at org.bytedeco.javacpp.Loader.load(Loader.java:464)
>>> >     at org.bytedeco.javacpp.Loader.load(Loader.java:409)
>>> >     at
>>> >
>>> > org.bytedeco.javacpp.helper.opencv_core$AbstractArray.<clinit>(opencv_core.java:109)
>>> >     at loc.video.FlinkStreamSource.run(FlinkStreamSource.java:95)
>>> >     at
>>> >
>>> > org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:78)
>>> >     at
>>> >
>>> > org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:56)
>>> >     at
>>> >
>>> > org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:225)
>>> >     at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)
>>> >     at java.lang.Thread.run(Thread.java:745)
>>> > Caused by: java.lang.UnsatisfiedLinkError:
>>> > /tmp/javacpp5400264496782/libjniopencv_core.so: libgomp.so.1: cannot
>>> > open
>>> > shared object file: No such file or directory
>>> >     at java.lang.ClassLoader$NativeLibrary.load(Native Method)
>>> >     at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1941)
>>> >     at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1824)
>>> >     at java.lang.Runtime.load0(Runtime.java:809)
>>> >     at java.lang.System.load(System.java:1086)
>>> >     at org.bytedeco.javacpp.Loader.loadLibrary(Loader.java:637)
>>> >
>>> >
>>> > I searched for the temp directory and in one of the nodes this directory
>>> > and
>>> > the .jar file was present. Is it required to have the file across all
>>> > the
>>> > nodes? If yes is there any way to control it? Since this tmp directory
>>> > and
>>> > the .so file gets extracted during the runtime without any external
>>> > manipulation.
>>> >
>>> >
>>> > Thanks in advance.
>>> >
>>> > Regards,
>>> > Debaditya
>>
>>

Mime
View raw message