impala-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alex Behm <alex.b...@cloudera.com>
Subject Re: Where is testdata/target/dependency/ populated
Date Tue, 11 Oct 2016 00:57:13 GMT
I still think it has to do with libfesupport.so. The stack is pretty clear.
We are trying to call into native code from the FE and it's failing to find
the native library (of which there is only libfesupport.so).

Maven picks up the path for native code from the fe/pom.xml:

<backend.library.path>${env.IMPALA_HOME}/be/build/debug/service:${env.IMPALA_HOME}/be/build/release/service</backend.library.path>

Maybe you can manually specify the path to libfesupport when running the
tests through mvn?

mvn -Dbackend.library.path=/your/path/goes/here







On Mon, Oct 10, 2016 at 5:40 PM, Lars Volker <lv@cloudera.com> wrote:

> No change, still the same error. I tried cleaning the repo, building from
> scratch, new terminal.
>
> Running org.apache.impala.analysis.ParserTest
> Tests run: 80, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.447 sec
> <<< FAILURE! - in org.apache.impala.analysis.ParserTest
> TestKuduUpdate(org.apache.impala.analysis.ParserTest)  Time elapsed: 0.007
> sec  <<< ERROR!
> java.lang.UnsatisfiedLinkError:
> org.apache.impala.service.FeSupport.NativeGetStartupOptions()[B
>         at
> org.apache.impala.service.FeSupport.NativeGetStartupOptions(Native Method)
>         at
> org.apache.impala.service.FeSupport.GetStartupOptions(FeSupport.java:268)
>         at org.apache.impala.common.RuntimeEnv.<init>(RuntimeEnv.java:47)
>         at org.apache.impala.common.RuntimeEnv.<clinit>(
> RuntimeEnv.java:34)
>         at
> org.apache.impala.testutil.TestUtils.assumeKuduIsSupported(
> TestUtils.java:288)
>         at
> org.apache.impala.analysis.ParserTest.TestKuduUpdate(ParserTest.java:1632)
>
> On Tue, Oct 11, 2016 at 2:33 AM, Alex Behm <alex.behm@cloudera.com> wrote:
>
> > Maybe try running "mvn dependency:copy-dependencies" from the testdata
> > directory?
> >
> > On Mon, Oct 10, 2016 at 5:04 PM, Lars Volker <lv@cloudera.com> wrote:
> >
> > > Thanks for helping me, Alex. Apparently the .jar dependencies get
> > > downloaded to fe/target/dependency, and bin/set-classpath.sh tries
> both,
> > > that location and testdata/target/dependency, and using zsh the latter
> > > throws a (maybe insignificant) error. The problem still persists
> though.
> > >
> > > I should have libfesupport.so in my LD_LIBRARY_PATH:
> > >
> > > ✔ ~/i2(i2) ✗$ echo $LD_LIBRARY_PATH
> > > :/usr/lib/jvm/java-8-oracle/jre/lib/amd64:/usr/lib/jvm/
> > > java-8-oracle/jre/lib/amd64/server:/usr/lib/jvm/java-8-
> > > oracle/jre/lib/amd64/server:/opt/Impala-Toolchain/cdh_
> > > components/hadoop-2.6.0-cdh5.10.0-SNAPSHOT//lib/native:
> > > */home/lv/i2/be/build/debug/service*
> > > :/opt/Impala-Toolchain/snappy-1.1.3/lib:/home/lv/i2/../
> > > Impala-lzo/build:/opt/Impala-Toolchain/gcc-4.9.2/lib64
> > > ✔ ~/i2(i2) ✗$ ls /home/lv/i2/be/build/debug/service
> > > impalad  libfesupport.so  libService.a
> > >
> > >
> > >
> > > On Tue, Oct 11, 2016 at 1:36 AM, Alex Behm <alex.behm@cloudera.com>
> > wrote:
> > >
> > > > This looks more like it could not find libfesupport.so. Do you have
> it
> > on
> > > > your LD_LIBRARY_PATH?
> > > >
> > > > Regarding the dependency stuff. As part of "mvn package" we execute
> the
> > > > "copy-dependencies" plugin which populates target/dependency.
> > > > You can manually run that step only with "mvn
> > > dependency:copy-dependencies"
> > > > from the fe dir.
> > > >
> > > >
> > > > On Mon, Oct 10, 2016 at 4:25 PM, Lars Volker <lv@cloudera.com>
> wrote:
> > > >
> > > > > I'm trying to run the ParserTest but cannot get it to work.
> > > > >
> > > > > Running org.apache.impala.analysis.ParserTest
> > > > > > Tests run: 80, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> > > 0.856
> > > > > sec
> > > > > > <<< FAILURE! - in org.apache.impala.analysis.ParserTest
> > > > > > TestKuduUpdate(org.apache.impala.analysis.ParserTest)  Time
> > elapsed:
> > > > > 0.011
> > > > > > sec  <<< ERROR!
> > > > > > java.lang.UnsatisfiedLinkError:
> > > > > > org.apache.impala.service.FeSupport.NativeGetStartupOptions()[B
> > > > > >         at
> > > > > > org.apache.impala.service.FeSupport.
> NativeGetStartupOptions(Native
> > > > > Method)
> > > > > >         at
> > > > > > org.apache.impala.service.FeSupport.GetStartupOptions(
> > > > > FeSupport.java:268)
> > > > > >         at org.apache.impala.common.
> RuntimeEnv.<init>(RuntimeEnv.
> > > > > java:47)
> > > > > >         at org.apache.impala.common.RuntimeEnv.<clinit>(
> > > > > RuntimeEnv.java:34)
> > > > > >         at
> > > > > > org.apache.impala.testutil.TestUtils.assumeKuduIsSupported(
> > > > > TestUtils.java:288)
> > > > > >         at
> > > > > > org.apache.impala.analysis.ParserTest.TestKuduUpdate(
> > > > > ParserTest.java:1632)
> > > > > >
> > > > > > Results :
> > > > > >
> > > > > > Tests in error:
> > > > > >   ParserTest.TestKuduUpdate:1632 » UnsatisfiedLink
> > > > > > org.apache.impala.service.FeS...
> > > > >
> > > > >
> > > > >
> > > > > My working copy does not seem to have the necessary dependencies
> > > > > in testdata/target/dependency/. I suspect this causes my issue.
> > > > >
> > > > > $ source bin/set-classpath.sh
> > > > > > bin/set-classpath.sh:40: no matches found:
> > > > > > /home/lv/i2/testdata/target/dependency/*.jar
> > > > >
> > > > >
> > > > > Where do those files come from and how can I get them?
> > > > >
> > > > > Thanks for the help, Lars
> > > > >
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message