Mailing-List: contact dev-help@impala.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@impala.incubator.apache.org
MIME-Version: 1.0
In-Reply-To: <CAG6bgB4Fuw57z0Y2y+9fHDXz=-XoZB16szG+C5+yJ7UEUn6qiw@mail.gmail.com>
References: <CAG6bgB6T0gmYk-BCoPK3-=_hyatYSO-gpWuoL+VUGLaaGyNqzQ@mail.gmail.com>
 <CADZba-RVYRkY_Nq1kzTynaAvMw8AhPWOVexW7JH-Liqrx-FQjQ@mail.gmail.com>
 <CADZba-Tg=1ShXdSXbSwQTjgm-M-SgF9AERTdqiTS_d+-ytZ3nA@mail.gmail.com>
 <CADZba-SWvN3Q_Q8aQhEjCUq6ESvhabTQVomaoFi0pryYBeK+cA@mail.gmail.com> <CAG6bgB4Fuw57z0Y2y+9fHDXz=-XoZB16szG+C5+yJ7UEUn6qiw@mail.gmail.com>
From: Bikramjeet Vig <bikramjeet.vig@cloudera.com>
Date: Wed, 19 Jul 2017 17:14:06 -0700
Message-ID: <CAG6bgB7Hr9qx0DtGh3jZXWoX_FiQOoxGaE52m5KnYa4FDBPV0g@mail.gmail.com>
Subject: Re: Problem running Impala built with dynamic linking
To: dev@impala.incubator.apache.org
Content-Type: multipart/alternative; boundary="001a114eea8e4b22270554b4a26e"
archived-at: Thu, 20 Jul 2017 00:14:45 -0000

--001a114eea8e4b22270554b4a26e
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Didn't work, heres the output of rm CMakeCache.txt && cmake .


-- Setup toolchain link flags
-Wl,-rpath,/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
-L/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
-- Build type is DEBUG
-- ENABLE_CODE_COVERAGE: false
-- Boost version: 1.57.0
-- Found the following Boost libraries:
--   thread
--   regex
--   filesystem
--   system
--   date_time
-- Boost include dir:
/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/include
-- Boost libraries:
/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_thread.a/hom=
e/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_regex.a/home/bik=
ram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_filesystem.a/home/bik=
ram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_system.a/home/bikram/=
dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_date_time.a
-- Found OpenSSL:
/usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64-linux-gnu/libcrypto.so
(found version "1.0.2g")
-- ----------> Adding thirdparty library openssl_ssl. <----------
-- Header files: /usr/include
-- Added shared library dependency openssl_ssl:
/usr/lib/x86_64-linux-gnu/libssl.so
-- ----------> Adding thirdparty library openssl_crypto. <----------
-- Added shared library dependency openssl_crypto:
/usr/lib/x86_64-linux-gnu/libcrypto.so
-- Bzip2: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
-- ----------> Adding thirdparty library bzip2. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
-- Added static library dependency bzip2:
/home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/lib/libbz2.a
-- Zlib: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
-- ----------> Adding thirdparty library zlib. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
-- Added static library dependency zlib:
/home/bikram/dev/Impala/toolchain/zlib-1.2.8/lib/libz.a
-- ----------> Adding thirdparty library hdfs. <----------
-- Header files:
/home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-SNA=
PSHOT/include
-- Added static library dependency hdfs:
/home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-SNA=
PSHOT/lib/native/libhdfs.a
-- ----------> Adding thirdparty library glog. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/include
-- Added static library dependency glog:
/home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/lib/libglog.a
-- ----------> Adding thirdparty library gflags. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/include
-- Added static library dependency gflags:
/home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/lib/libgflags.a
-- ----------> Adding thirdparty library pprof. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/gperftools-2.5/include
-- Added static library dependency pprof:
/home/bikram/dev/Impala/toolchain/gperftools-2.5/lib/libprofiler.a
-- ----------> Adding thirdparty library gtest. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/gtest-1.6.0/include
-- Added static library dependency gtest:
/home/bikram/dev/Impala/toolchain/gtest-1.6.0/lib/libgtest.a
-- LLVM llvm-config found at:
/home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/llvm-config
-- LLVM clang++ found at:
/home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/clang++
-- LLVM opt found at:
/home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/opt
-- LLVM_ROOT: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1
-- LLVM llvm-config found at:
/home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/bin/llvm-config
-- LLVM include dir:
/home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/include
-- LLVM lib dir: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/li=
b
-- ----------> Adding thirdparty library cyrus_sasl. <----------
-- Header files: /usr/include
-- Added shared library dependency cyrus_sasl:
/usr/lib/x86_64-linux-gnu/libsasl2.so
-- ----------> Adding thirdparty library ldap. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/openldap-2.4.25/include
-- Added static library dependency ldap:
/home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/libldap.a
-- ----------> Adding thirdparty library lber. <----------
-- Added static library dependency lber:
/home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/liblber.a
-- ----------> Adding thirdparty library thrift. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/include
-- Added static library dependency thrift:
/home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/lib/libthrift.a
-- Thrift version: Thrift version 0.9.0
-- Thrift contrib dir: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9
-- Thrift compiler:
/home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
-- Found FLATBUFFERS:
/home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/include
-- ----------> Adding thirdparty library flatbuffers. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/includ=
e
-- Added static library dependency flatbuffers:
/home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/lib/libflatbuffers.a
-- FlatBuffers compiler:
/home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
-- ----------> Adding thirdparty library snappy. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/snappy-1.1.4/include
-- Added static library dependency snappy:
/home/bikram/dev/Impala/toolchain/snappy-1.1.4/lib/libsnappy.a
-- ----------> Adding thirdparty library lz4. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/lz4-1.7.5/include
-- Added static library dependency lz4:
/home/bikram/dev/Impala/toolchain/lz4-1.7.5/lib/liblz4.a
-- /home/bikram/dev/Impala/toolchain/re2-20130115-p1/include
-- ----------> Adding thirdparty library re2. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/re2-20130115-p1/include
-- Added static library dependency re2:
/home/bikram/dev/Impala/toolchain/re2-20130115-p1/lib/libre2.a
-- RapidJson include dir:
/home/bikram/dev/Impala/toolchain/rapidjson-0.11/include
-- ----------> Adding thirdparty library avro. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/include
-- Added static library dependency avro:
/home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/lib/libavro.a
-- Found PROTOBUF:
/home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.so
-- ----------> Adding thirdparty library protobuf. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/include
-- Added static library dependency protobuf:
/home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.a
-- ----------> Adding thirdparty library protoc. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/include
-- Added static library dependency protoc:
/home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotoc.a
-- Found LIBEV: /home/bikram/dev/Impala/toolchain/libev-4.20/lib/libev.so
-- ----------> Adding thirdparty library libev. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/libev-4.20/include
-- Added static library dependency libev:
/home/bikram/dev/Impala/toolchain/libev-4.20/lib/libev.a
-- Found CRCUTIL:
/home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c767f1=
84e946e-p1/lib/libcrcutil.so

-- ----------> Adding thirdparty library crcutil. <----------
-- Header files:
/home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c767f1=
84e946e-p1/include
-- Added static library dependency crcutil:
/home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c767f1=
84e946e-p1/lib/libcrcutil.a
-- Found JNI:
/usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/libjawt.so;/usr/lib/jvm/jdk1.7.0_80/=
jre/lib/amd64/libjsig.so;/usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/server/libj=
vm.so

-- ----------> Adding thirdparty library java_jvm. <----------
-- Header files:
/usr/lib/jvm/jdk1.7.0_80/include;/usr/lib/jvm/jdk1.7.0_80/include/linux;/us=
r/lib/jvm/jdk1.7.0_80/include
-- Added static library dependency java_jvm:
/usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/server/libjvm.so
-- ----------> Adding thirdparty library breakpad. <----------
-- Header files:
/home/bikram/dev/Impala/toolchain/breakpad-ffe3e478657dc7126fca6329dfcedc49=
f4c726d9-p2/include/breakpad
-- Added static library dependency breakpad:
/home/bikram/dev/Impala/toolchain/breakpad-ffe3e478657dc7126fca6329dfcedc49=
f4c726d9-p2/lib/libbreakpad_client.a
-- Added shared library dependency rt: /usr/lib/x86_64-linux-gnu/librt.so
-- Added shared library dependency dl: /usr/lib/x86_64-linux-gnu/libdl.so
Using Thrift compiler:
/home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
Found output dir: /home/bikram/dev/Impala/shell/
Using FlatBuffers compiler:
/home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
--java-o/home/bikram/dev/Impala/fe/generated-sources/gen-java-b
--cpp-o/home/bikram/dev/Impala/be/generated-sources/gen-cpp-b
-- Could NOT find Doxygen (missing:  DOXYGEN_EXECUTABLE)
-- WARNING: Doxygen not found - Docs will not be created
-- Looking for sched_getcpu
-- Looking for sched_getcpu - found
-- Compiler Flags:  -Wall -Wno-sign-compare -Wno-unknown-pragmas -pthread
-fno-strict-aliasing -std=3Dc++14 -Wno-deprecated -Wno-vla
-DBOOST_DATE_TIME_POSIX_TIME_STD_CONFIG -DBOOST_SYSTEM_NO_DEPRECATED -B
/home/bikram/dev/Impala/toolchain/binutils-2.26.1/bin/ -fuse-ld=3Dgold -g
-Wno-unused-local-typedefs -ggdb -gdwarf-2 -Werror -fverbose-asm
-D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS
-D__STDC_LIMIT_MACROS
-- Common /home/bikram/dev/Impala/be/build/debug/
-- Configuring done
-- Generating done
-- Build files have been written to: /home/bikram/dev/Impala


On Wed, Jul 19, 2017 at 5:09 PM, Bikramjeet Vig <bikramjeet.vig@cloudera.co=
m
> wrote:

> Thanks, lemme try it real quick and I'll get back to you
>
> On Wed, Jul 19, 2017 at 5:04 PM, Henry Robinson <henry@apache.org> wrote:
>
>> Can you try:
>>
>> cd $IMPALA_HOME
>> rm CMakeCache.txt
>> cmake .
>> <make impala, however you usually do it>
>>
>> If that doesn't work, can you send me the output of rm CMakeCache.txt &&
>> cmake . from IMPALA_HOME?
>>
>> Thanks,
>> Henry
>>
>> On 19 July 2017 at 17:03, Henry Robinson <henry@cloudera.com> wrote:
>>
>> > Sorry, I read too quickly - you've done that already! Let me take a
>> look.
>> >
>> > On 19 July 2017 at 17:01, Henry Robinson <henry@apache.org> wrote:
>> >
>> >> Yep, you need to remove the downloaded version of gflags and replace =
it
>> >> with a recent toolchain version. See my mail from yesterday for
>> >> instructions: https://lists.apache.org/api/source.lua/a154f4
>> >> 3ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%3Cdev.
>> >> impala.apache.org%3E
>> >>
>> >> On 19 July 2017 at 16:56, Bikramjeet Vig <bikramjeet.vig@cloudera.com=
>
>> >> wrote:
>> >>
>> >>> After fetching latest from asf-gerrit (that has the toolchain commit
>> >>> related to gflags) and doing a manual toolchain refresh, I am unable
>> to
>> >>> run
>> >>> impala when I build with "make_debug" or "buildall -so", both
>> statestore
>> >>> and catalogd show the following error:
>> >>>
>> >>> ERROR: something wrong with flag 'flagfile' in file
>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
>> >>> gflags-2.2.0-p1/src/gflags.cc'.
>> >>> One possibility: file
>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
>> >>> gflags-2.2.0-p1/src/gflags.cc'
>> >>> is being linked both statically and dynamically into this executable=
.
>> >>>
>> >>> I am only able to make it work if I go with static linking by
>> building it
>> >>> with "buildall" without the "-so"
>> >>>
>> >>> Anyone facing the same issue?
>> >>>
>> >>
>> >>
>> >
>> >
>> > --
>> > Henry Robinson
>> > Software Engineer
>> > Cloudera
>> > 415-994-6679 <(415)%20994-6679>
>> >
>>
>
>

--001a114eea8e4b22270554b4a26e--