impala-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matthew Jacobs ...@cloudera.com>
Subject Re: Problem running Impala built with dynamic linking
Date Fri, 21 Jul 2017 18:54:50 GMT
Did you ever come to a conclusion on this?

On Wed, Jul 19, 2017 at 5:14 PM, Bikramjeet Vig
<bikramjeet.vig@cloudera.com> wrote:
> Didn't work, heres the output of rm CMakeCache.txt && cmake .
>
>
> -- Setup toolchain link flags
> -Wl,-rpath,/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> -L/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> -- Build type is DEBUG
> -- ENABLE_CODE_COVERAGE: false
> -- Boost version: 1.57.0
> -- Found the following Boost libraries:
> --   thread
> --   regex
> --   filesystem
> --   system
> --   date_time
> -- Boost include dir:
> /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/include
> -- Boost libraries:
> /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_thread.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_regex.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_filesystem.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_system.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_date_time.a
> -- Found OpenSSL:
> /usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64-linux-gnu/libcrypto.so
> (found version "1.0.2g")
> -- ----------> Adding thirdparty library openssl_ssl. <----------
> -- Header files: /usr/include
> -- Added shared library dependency openssl_ssl:
> /usr/lib/x86_64-linux-gnu/libssl.so
> -- ----------> Adding thirdparty library openssl_crypto. <----------
> -- Added shared library dependency openssl_crypto:
> /usr/lib/x86_64-linux-gnu/libcrypto.so
> -- Bzip2: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
> -- ----------> Adding thirdparty library bzip2. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
> -- Added static library dependency bzip2:
> /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/lib/libbz2.a
> -- Zlib: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> -- ----------> Adding thirdparty library zlib. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> -- Added static library dependency zlib:
> /home/bikram/dev/Impala/toolchain/zlib-1.2.8/lib/libz.a
> -- ----------> Adding thirdparty library hdfs. <----------
> -- Header files:
> /home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-SNAPSHOT/include
> -- Added static library dependency hdfs:
> /home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-SNAPSHOT/lib/native/libhdfs.a
> -- ----------> Adding thirdparty library glog. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/include
> -- Added static library dependency glog:
> /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/lib/libglog.a
> -- ----------> Adding thirdparty library gflags. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/include
> -- Added static library dependency gflags:
> /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/lib/libgflags.a
> -- ----------> Adding thirdparty library pprof. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/gperftools-2.5/include
> -- Added static library dependency pprof:
> /home/bikram/dev/Impala/toolchain/gperftools-2.5/lib/libprofiler.a
> -- ----------> Adding thirdparty library gtest. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/gtest-1.6.0/include
> -- Added static library dependency gtest:
> /home/bikram/dev/Impala/toolchain/gtest-1.6.0/lib/libgtest.a
> -- LLVM llvm-config found at:
> /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/llvm-config
> -- LLVM clang++ found at:
> /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/clang++
> -- LLVM opt found at:
> /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/opt
> -- LLVM_ROOT: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1
> -- LLVM llvm-config found at:
> /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/bin/llvm-config
> -- LLVM include dir:
> /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/include
> -- LLVM lib dir: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/lib
> -- ----------> Adding thirdparty library cyrus_sasl. <----------
> -- Header files: /usr/include
> -- Added shared library dependency cyrus_sasl:
> /usr/lib/x86_64-linux-gnu/libsasl2.so
> -- ----------> Adding thirdparty library ldap. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/openldap-2.4.25/include
> -- Added static library dependency ldap:
> /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/libldap.a
> -- ----------> Adding thirdparty library lber. <----------
> -- Added static library dependency lber:
> /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/liblber.a
> -- ----------> Adding thirdparty library thrift. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/include
> -- Added static library dependency thrift:
> /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/lib/libthrift.a
> -- Thrift version: Thrift version 0.9.0
> -- Thrift contrib dir: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9
> -- Thrift compiler:
> /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
> -- Found FLATBUFFERS:
> /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/include
> -- ----------> Adding thirdparty library flatbuffers. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/include
> -- Added static library dependency flatbuffers:
> /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/lib/libflatbuffers.a
> -- FlatBuffers compiler:
> /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
> -- ----------> Adding thirdparty library snappy. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/snappy-1.1.4/include
> -- Added static library dependency snappy:
> /home/bikram/dev/Impala/toolchain/snappy-1.1.4/lib/libsnappy.a
> -- ----------> Adding thirdparty library lz4. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/lz4-1.7.5/include
> -- Added static library dependency lz4:
> /home/bikram/dev/Impala/toolchain/lz4-1.7.5/lib/liblz4.a
> -- /home/bikram/dev/Impala/toolchain/re2-20130115-p1/include
> -- ----------> Adding thirdparty library re2. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/re2-20130115-p1/include
> -- Added static library dependency re2:
> /home/bikram/dev/Impala/toolchain/re2-20130115-p1/lib/libre2.a
> -- RapidJson include dir:
> /home/bikram/dev/Impala/toolchain/rapidjson-0.11/include
> -- ----------> Adding thirdparty library avro. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/include
> -- Added static library dependency avro:
> /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/lib/libavro.a
> -- Found PROTOBUF:
> /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.so
> -- ----------> Adding thirdparty library protobuf. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/include
> -- Added static library dependency protobuf:
> /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.a
> -- ----------> Adding thirdparty library protoc. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/include
> -- Added static library dependency protoc:
> /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotoc.a
> -- Found LIBEV: /home/bikram/dev/Impala/toolchain/libev-4.20/lib/libev.so
> -- ----------> Adding thirdparty library libev. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/libev-4.20/include
> -- Added static library dependency libev:
> /home/bikram/dev/Impala/toolchain/libev-4.20/lib/libev.a
> -- Found CRCUTIL:
> /home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c767f184e946e-p1/lib/libcrcutil.so
>
> -- ----------> Adding thirdparty library crcutil. <----------
> -- Header files:
> /home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c767f184e946e-p1/include
> -- Added static library dependency crcutil:
> /home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c767f184e946e-p1/lib/libcrcutil.a
> -- Found JNI:
> /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/libjawt.so;/usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/libjsig.so;/usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/server/libjvm.so
>
> -- ----------> Adding thirdparty library java_jvm. <----------
> -- Header files:
> /usr/lib/jvm/jdk1.7.0_80/include;/usr/lib/jvm/jdk1.7.0_80/include/linux;/usr/lib/jvm/jdk1.7.0_80/include
> -- Added static library dependency java_jvm:
> /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/server/libjvm.so
> -- ----------> Adding thirdparty library breakpad. <----------
> -- Header files:
> /home/bikram/dev/Impala/toolchain/breakpad-ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/include/breakpad
> -- Added static library dependency breakpad:
> /home/bikram/dev/Impala/toolchain/breakpad-ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/lib/libbreakpad_client.a
> -- Added shared library dependency rt: /usr/lib/x86_64-linux-gnu/librt.so
> -- Added shared library dependency dl: /usr/lib/x86_64-linux-gnu/libdl.so
> Using Thrift compiler:
> /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
> Found output dir: /home/bikram/dev/Impala/shell/
> Using FlatBuffers compiler:
> /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
> --java-o/home/bikram/dev/Impala/fe/generated-sources/gen-java-b
> --cpp-o/home/bikram/dev/Impala/be/generated-sources/gen-cpp-b
> -- Could NOT find Doxygen (missing:  DOXYGEN_EXECUTABLE)
> -- WARNING: Doxygen not found - Docs will not be created
> -- Looking for sched_getcpu
> -- Looking for sched_getcpu - found
> -- Compiler Flags:  -Wall -Wno-sign-compare -Wno-unknown-pragmas -pthread
> -fno-strict-aliasing -std=c++14 -Wno-deprecated -Wno-vla
> -DBOOST_DATE_TIME_POSIX_TIME_STD_CONFIG -DBOOST_SYSTEM_NO_DEPRECATED -B
> /home/bikram/dev/Impala/toolchain/binutils-2.26.1/bin/ -fuse-ld=gold -g
> -Wno-unused-local-typedefs -ggdb -gdwarf-2 -Werror -fverbose-asm
> -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS
> -D__STDC_LIMIT_MACROS
> -- Common /home/bikram/dev/Impala/be/build/debug/
> -- Configuring done
> -- Generating done
> -- Build files have been written to: /home/bikram/dev/Impala
>
>
> On Wed, Jul 19, 2017 at 5:09 PM, Bikramjeet Vig <bikramjeet.vig@cloudera.com
>> wrote:
>
>> Thanks, lemme try it real quick and I'll get back to you
>>
>> On Wed, Jul 19, 2017 at 5:04 PM, Henry Robinson <henry@apache.org> wrote:
>>
>>> Can you try:
>>>
>>> cd $IMPALA_HOME
>>> rm CMakeCache.txt
>>> cmake .
>>> <make impala, however you usually do it>
>>>
>>> If that doesn't work, can you send me the output of rm CMakeCache.txt &&
>>> cmake . from IMPALA_HOME?
>>>
>>> Thanks,
>>> Henry
>>>
>>> On 19 July 2017 at 17:03, Henry Robinson <henry@cloudera.com> wrote:
>>>
>>> > Sorry, I read too quickly - you've done that already! Let me take a
>>> look.
>>> >
>>> > On 19 July 2017 at 17:01, Henry Robinson <henry@apache.org> wrote:
>>> >
>>> >> Yep, you need to remove the downloaded version of gflags and replace
it
>>> >> with a recent toolchain version. See my mail from yesterday for
>>> >> instructions: https://lists.apache.org/api/source.lua/a154f4
>>> >> 3ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%3Cdev.
>>> >> impala.apache.org%3E
>>> >>
>>> >> On 19 July 2017 at 16:56, Bikramjeet Vig <bikramjeet.vig@cloudera.com>
>>> >> wrote:
>>> >>
>>> >>> After fetching latest from asf-gerrit (that has the toolchain commit
>>> >>> related to gflags) and doing a manual toolchain refresh, I am unable
>>> to
>>> >>> run
>>> >>> impala when I build with "make_debug" or "buildall -so", both
>>> statestore
>>> >>> and catalogd show the following error:
>>> >>>
>>> >>> ERROR: something wrong with flag 'flagfile' in file
>>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
>>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
>>> >>> gflags-2.2.0-p1/src/gflags.cc'.
>>> >>> One possibility: file
>>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
>>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
>>> >>> gflags-2.2.0-p1/src/gflags.cc'
>>> >>> is being linked both statically and dynamically into this executable.
>>> >>>
>>> >>> I am only able to make it work if I go with static linking by
>>> building it
>>> >>> with "buildall" without the "-so"
>>> >>>
>>> >>> Anyone facing the same issue?
>>> >>>
>>> >>
>>> >>
>>> >
>>> >
>>> > --
>>> > Henry Robinson
>>> > Software Engineer
>>> > Cloudera
>>> > 415-994-6679 <(415)%20994-6679>
>>> >
>>>
>>
>>

Mime
View raw message