arrow-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Mior <mm...@apache.org>
Subject Arrow/Gandiva dependency management in Java
Date Tue, 05 Jan 2021 16:11:26 GMT
I am working on integrating Arrow and Gandiva with the Apache Calcite
query processing framework so Calcite is able to process SQL queries
using Arrow data sources. The basics are working well but I'm having
trouble getting a reproducible development environment set up.

For example, on a Linux Travis CI right now, I get the following error:

java.lang.RuntimeException: libgandiva_jni.so was not found inside JAR.

I get something similar with AppVeyor on Windows:

java.lang.RuntimeException: gandiva_jni.dll was not found inside JAR.

Starting with a fresh clone of the repository, on my macOS machine I
use for development, I get the following which seems to be related to
a protobuf version mismatch:

java.lang.UnsatisfiedLinkError:
/private/var/folders/0h/n0jrz4qn5x37gj25sxx4z2wm0000gp/T/libgandiva_jni.dylib43feded5-f265-4a6d-b1f7-2aa56e94f392:
dlopen(/private/var/folders/0h/n0jrz4qn5x37gj25sxx4z2wm0000gp/T/libgandiva_jni.dylib43feded5-f265-4a6d-b1f7-2aa56e94f392,
1): Library not loaded:
/usr/local/opt/protobuf/lib/libprotobuf.24.dylib
      Referenced from:
/private/var/folders/0h/n0jrz4qn5x37gj25sxx4z2wm0000gp/T/libgandiva_jni.dylib43feded5-f265-4a6d-b1f7-2aa56e94f392

I have dependencies declared on arrow-memory-netty, arrow-vector, and
arrow-gandiva but this doesn't seem to be sufficient. Any ideas what
I'm missing here?

--
Michael Mior
mmior@apache.org

Mime
View raw message