impala-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bikramjeet Vig <bikramjeet....@cloudera.com>
Subject Re: Problem running Impala built with dynamic linking
Date Fri, 21 Jul 2017 19:02:56 GMT
Henry is looking into it. Meanwhile I am working impala statically linked.

On Fri, Jul 21, 2017 at 11:54 AM, Matthew Jacobs <mj@cloudera.com> wrote:

> Did you ever come to a conclusion on this?
>
> On Wed, Jul 19, 2017 at 5:14 PM, Bikramjeet Vig
> <bikramjeet.vig@cloudera.com> wrote:
> > Didn't work, heres the output of rm CMakeCache.txt && cmake .
> >
> >
> > -- Setup toolchain link flags
> > -Wl,-rpath,/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > -L/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > -- Build type is DEBUG
> > -- ENABLE_CODE_COVERAGE: false
> > -- Boost version: 1.57.0
> > -- Found the following Boost libraries:
> > --   thread
> > --   regex
> > --   filesystem
> > --   system
> > --   date_time
> > -- Boost include dir:
> > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/include
> > -- Boost libraries:
> > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/
> libboost_thread.a/home/bikram/dev/Impala/toolchain/boost-1.
> 57.0-p3/lib/libboost_regex.a/home/bikram/dev/Impala/
> toolchain/boost-1.57.0-p3/lib/libboost_filesystem.a/home/
> bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_
> system.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-
> p3/lib/libboost_date_time.a
> > -- Found OpenSSL:
> > /usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64-
> linux-gnu/libcrypto.so
> > (found version "1.0.2g")
> > -- ----------> Adding thirdparty library openssl_ssl. <----------
> > -- Header files: /usr/include
> > -- Added shared library dependency openssl_ssl:
> > /usr/lib/x86_64-linux-gnu/libssl.so
> > -- ----------> Adding thirdparty library openssl_crypto. <----------
> > -- Added shared library dependency openssl_crypto:
> > /usr/lib/x86_64-linux-gnu/libcrypto.so
> > -- Bzip2: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
> > -- ----------> Adding thirdparty library bzip2. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/
> include
> > -- Added static library dependency bzip2:
> > /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/lib/libbz2.a
> > -- Zlib: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> > -- ----------> Adding thirdparty library zlib. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> > -- Added static library dependency zlib:
> > /home/bikram/dev/Impala/toolchain/zlib-1.2.8/lib/libz.a
> > -- ----------> Adding thirdparty library hdfs. <----------
> > -- Header files:
> > /home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-
> SNAPSHOT/include
> > -- Added static library dependency hdfs:
> > /home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-
> SNAPSHOT/lib/native/libhdfs.a
> > -- ----------> Adding thirdparty library glog. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/include
> > -- Added static library dependency glog:
> > /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/lib/libglog.a
> > -- ----------> Adding thirdparty library gflags. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/
> include
> > -- Added static library dependency gflags:
> > /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/lib/libgflags.a
> > -- ----------> Adding thirdparty library pprof. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/gperftools-2.5/
> include
> > -- Added static library dependency pprof:
> > /home/bikram/dev/Impala/toolchain/gperftools-2.5/lib/libprofiler.a
> > -- ----------> Adding thirdparty library gtest. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/gtest-1.6.0/include
> > -- Added static library dependency gtest:
> > /home/bikram/dev/Impala/toolchain/gtest-1.6.0/lib/libgtest.a
> > -- LLVM llvm-config found at:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/llvm-config
> > -- LLVM clang++ found at:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/clang++
> > -- LLVM opt found at:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/opt
> > -- LLVM_ROOT: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1
> > -- LLVM llvm-config found at:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/bin/llvm-config
> > -- LLVM include dir:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/include
> > -- LLVM lib dir: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-
> p1/lib
> > -- ----------> Adding thirdparty library cyrus_sasl. <----------
> > -- Header files: /usr/include
> > -- Added shared library dependency cyrus_sasl:
> > /usr/lib/x86_64-linux-gnu/libsasl2.so
> > -- ----------> Adding thirdparty library ldap. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/openldap-2.4.25/
> include
> > -- Added static library dependency ldap:
> > /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/libldap.a
> > -- ----------> Adding thirdparty library lber. <----------
> > -- Added static library dependency lber:
> > /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/liblber.a
> > -- ----------> Adding thirdparty library thrift. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/
> include
> > -- Added static library dependency thrift:
> > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/lib/libthrift.a
> > -- Thrift version: Thrift version 0.9.0
> > -- Thrift contrib dir: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9
> > -- Thrift compiler:
> > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
> > -- Found FLATBUFFERS:
> > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/include
> > -- ----------> Adding thirdparty library flatbuffers. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/
> include
> > -- Added static library dependency flatbuffers:
> > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/lib/libflatbuffers.a
> > -- FlatBuffers compiler:
> > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
> > -- ----------> Adding thirdparty library snappy. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/snappy-1.1.4/include
> > -- Added static library dependency snappy:
> > /home/bikram/dev/Impala/toolchain/snappy-1.1.4/lib/libsnappy.a
> > -- ----------> Adding thirdparty library lz4. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/lz4-1.7.5/include
> > -- Added static library dependency lz4:
> > /home/bikram/dev/Impala/toolchain/lz4-1.7.5/lib/liblz4.a
> > -- /home/bikram/dev/Impala/toolchain/re2-20130115-p1/include
> > -- ----------> Adding thirdparty library re2. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/re2-20130115-p1/
> include
> > -- Added static library dependency re2:
> > /home/bikram/dev/Impala/toolchain/re2-20130115-p1/lib/libre2.a
> > -- RapidJson include dir:
> > /home/bikram/dev/Impala/toolchain/rapidjson-0.11/include
> > -- ----------> Adding thirdparty library avro. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/include
> > -- Added static library dependency avro:
> > /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/lib/libavro.a
> > -- Found PROTOBUF:
> > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.so
> > -- ----------> Adding thirdparty library protobuf. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/
> include
> > -- Added static library dependency protobuf:
> > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.a
> > -- ----------> Adding thirdparty library protoc. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/
> include
> > -- Added static library dependency protoc:
> > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotoc.a
> > -- Found LIBEV: /home/bikram/dev/Impala/toolchain/libev-4.20/lib/
> libev.so
> > -- ----------> Adding thirdparty library libev. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/libev-4.20/include
> > -- Added static library dependency libev:
> > /home/bikram/dev/Impala/toolchain/libev-4.20/lib/libev.a
> > -- Found CRCUTIL:
> > /home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c76
> 7f184e946e-p1/lib/libcrcutil.so
> >
> > -- ----------> Adding thirdparty library crcutil. <----------
> > -- Header files:
> > /home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c76
> 7f184e946e-p1/include
> > -- Added static library dependency crcutil:
> > /home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c76
> 7f184e946e-p1/lib/libcrcutil.a
> > -- Found JNI:
> > /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/libjawt.so;/usr/lib/
> jvm/jdk1.7.0_80/jre/lib/amd64/libjsig.so;/usr/lib/jvm/jdk1.
> 7.0_80/jre/lib/amd64/server/libjvm.so
> >
> > -- ----------> Adding thirdparty library java_jvm. <----------
> > -- Header files:
> > /usr/lib/jvm/jdk1.7.0_80/include;/usr/lib/jvm/jdk1.7.0_
> 80/include/linux;/usr/lib/jvm/jdk1.7.0_80/include
> > -- Added static library dependency java_jvm:
> > /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/server/libjvm.so
> > -- ----------> Adding thirdparty library breakpad. <----------
> > -- Header files:
> > /home/bikram/dev/Impala/toolchain/breakpad-
> ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/include/breakpad
> > -- Added static library dependency breakpad:
> > /home/bikram/dev/Impala/toolchain/breakpad-
> ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/lib/libbreakpad_client.a
> > -- Added shared library dependency rt: /usr/lib/x86_64-linux-gnu/
> librt.so
> > -- Added shared library dependency dl: /usr/lib/x86_64-linux-gnu/
> libdl.so
> > Using Thrift compiler:
> > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
> > Found output dir: /home/bikram/dev/Impala/shell/
> > Using FlatBuffers compiler:
> > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
> > --java-o/home/bikram/dev/Impala/fe/generated-sources/gen-java-b
> > --cpp-o/home/bikram/dev/Impala/be/generated-sources/gen-cpp-b
> > -- Could NOT find Doxygen (missing:  DOXYGEN_EXECUTABLE)
> > -- WARNING: Doxygen not found - Docs will not be created
> > -- Looking for sched_getcpu
> > -- Looking for sched_getcpu - found
> > -- Compiler Flags:  -Wall -Wno-sign-compare -Wno-unknown-pragmas -pthread
> > -fno-strict-aliasing -std=c++14 -Wno-deprecated -Wno-vla
> > -DBOOST_DATE_TIME_POSIX_TIME_STD_CONFIG -DBOOST_SYSTEM_NO_DEPRECATED -B
> > /home/bikram/dev/Impala/toolchain/binutils-2.26.1/bin/ -fuse-ld=gold -g
> > -Wno-unused-local-typedefs -ggdb -gdwarf-2 -Werror -fverbose-asm
> > -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS
> > -D__STDC_LIMIT_MACROS
> > -- Common /home/bikram/dev/Impala/be/build/debug/
> > -- Configuring done
> > -- Generating done
> > -- Build files have been written to: /home/bikram/dev/Impala
> >
> >
> > On Wed, Jul 19, 2017 at 5:09 PM, Bikramjeet Vig <
> bikramjeet.vig@cloudera.com
> >> wrote:
> >
> >> Thanks, lemme try it real quick and I'll get back to you
> >>
> >> On Wed, Jul 19, 2017 at 5:04 PM, Henry Robinson <henry@apache.org>
> wrote:
> >>
> >>> Can you try:
> >>>
> >>> cd $IMPALA_HOME
> >>> rm CMakeCache.txt
> >>> cmake .
> >>> <make impala, however you usually do it>
> >>>
> >>> If that doesn't work, can you send me the output of rm CMakeCache.txt
> &&
> >>> cmake . from IMPALA_HOME?
> >>>
> >>> Thanks,
> >>> Henry
> >>>
> >>> On 19 July 2017 at 17:03, Henry Robinson <henry@cloudera.com> wrote:
> >>>
> >>> > Sorry, I read too quickly - you've done that already! Let me take a
> >>> look.
> >>> >
> >>> > On 19 July 2017 at 17:01, Henry Robinson <henry@apache.org> wrote:
> >>> >
> >>> >> Yep, you need to remove the downloaded version of gflags and
> replace it
> >>> >> with a recent toolchain version. See my mail from yesterday for
> >>> >> instructions: https://lists.apache.org/api/source.lua/a154f4
> >>> >> 3ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%3Cdev.
> >>> >> impala.apache.org%3E
> >>> >>
> >>> >> On 19 July 2017 at 16:56, Bikramjeet Vig <
> bikramjeet.vig@cloudera.com>
> >>> >> wrote:
> >>> >>
> >>> >>> After fetching latest from asf-gerrit (that has the toolchain
> commit
> >>> >>> related to gflags) and doing a manual toolchain refresh, I
am
> unable
> >>> to
> >>> >>> run
> >>> >>> impala when I build with "make_debug" or "buildall -so", both
> >>> statestore
> >>> >>> and catalogd show the following error:
> >>> >>>
> >>> >>> ERROR: something wrong with flag 'flagfile' in file
> >>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
> >>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
> >>> >>> gflags-2.2.0-p1/src/gflags.cc'.
> >>> >>> One possibility: file
> >>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
> >>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
> >>> >>> gflags-2.2.0-p1/src/gflags.cc'
> >>> >>> is being linked both statically and dynamically into this
> executable.
> >>> >>>
> >>> >>> I am only able to make it work if I go with static linking
by
> >>> building it
> >>> >>> with "buildall" without the "-so"
> >>> >>>
> >>> >>> Anyone facing the same issue?
> >>> >>>
> >>> >>
> >>> >>
> >>> >
> >>> >
> >>> > --
> >>> > Henry Robinson
> >>> > Software Engineer
> >>> > Cloudera
> >>> > 415-994-6679 <(415)%20994-6679>
> >>> >
> >>>
> >>
> >>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message