impala-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Anup Tiwari <anupsdtiw...@gmail.com>
Subject Re: Install Impala on Apache Hadoop and Hive
Date Tue, 06 Feb 2018 09:22:48 GMT
Hi Zoltan,

I followed the steps mention in https://cwiki.apache.org/
confluence/display/IMPALA/Building+Impala and when i executed below command
, i got error after some time :-

*Build Command :*
${IMPALA_HOME}/buildall.sh -noclean -skiptests -build_shared_libs -format



*Error :-- ----------> Adding thirdparty library cyrus_sasl. <----------*CMake
Error at CMakeLists.txt:136 (message):
  Library 'cyrus_sasl' has neither shared nor static library files
Call Stack (most recent call first):
  CMakeLists.txt:227 (IMPALA_ADD_THIRDPARTY_LIB)

-- Configuring incomplete, errors occurred!
See also
"/opt/apache-s/apache-impala/apache-impala-2.11.0/CMakeFiles/CMakeOutput.log".
See also
"/opt/apache-s/apache-impala/apache-impala-2.11.0/CMakeFiles/CMakeError.log".
Error in
/opt/apache-s/apache-impala/apache-impala-2.11.0/bin/make_impala.sh at line
161: cmake . ${CMAKE_ARGS[@]}




*Logs in "CMakeOutput.log" :-*Determining if the function pthread_create
exists in the pthread passed with the following output:
Change Dir:
/opt/apache-s/apache-impala/apache-impala-2.11.0/CMakeFiles/CMakeTmp

Run Build Command:"/usr/bin/gmake" "cmTC_ee4f0/fast"
/usr/bin/gmake -f CMakeFiles/cmTC_ee4f0.dir/build.make
CMakeFiles/cmTC_ee4f0.dir/build
gmake[1]: Entering directory
`/opt/apache-s/apache-impala/apache-impala-2.11.0/CMakeFiles/CMakeTmp'
Building C object CMakeFiles/cmTC_ee4f0.dir/CheckFunctionExists.c.o
/opt/apache-s/apache-impala/apache-impala-2.11.0/toolchain/gcc-4.9.2/bin/gcc
-DCHECK_FUNCTION_EXISTS=pthread_create   -o
CMakeFiles/cmTC_ee4f0.dir/CheckFunctionExists.c.o   -c
/opt/apache-s/apache-impala/apache-impala-2.11.0/toolchain/cmake-3.8.2-p1/share/cmake-3.8/Modules/CheckFunctionExists.c
Linking C executable cmTC_ee4f0
/opt/apache-s/apache-impala/apache-impala-2.11.0/toolchain/cmake-3.8.2-p1/bin/cmake
-E cmake_link_script CMakeFiles/cmTC_ee4f0.dir/link.txt --verbose=1
/opt/apache-s/apache-impala/apache-impala-2.11.0/toolchain/gcc-4.9.2/bin/gcc
-DCHECK_FUNCTION_EXISTS=pthread_create    -rdynamic
CMakeFiles/cmTC_ee4f0.dir/CheckFunctionExists.c.o  -o cmTC_ee4f0 -lpthread
gmake[1]: Leaving directory
`/opt/apache-s/apache-impala/apache-impala-2.11.0/CMakeFiles/CMakeTmp'



*Logs in "CMakeError.log" :-*Determining if the function pthread_create
exists in the pthreads failed with the following output:
Change Dir:
/opt/apache-s/apache-impala/apache-impala-2.11.0/CMakeFiles/CMakeTmp

Run Build Command:"/usr/bin/gmake" "cmTC_18bf3/fast"
/usr/bin/gmake -f CMakeFiles/cmTC_18bf3.dir/build.make
CMakeFiles/cmTC_18bf3.dir/build
gmake[1]: Entering directory
`/opt/apache-s/apache-impala/apache-impala-2.11.0/CMakeFiles/CMakeTmp'
Building C object CMakeFiles/cmTC_18bf3.dir/CheckFunctionExists.c.o
/opt/apache-s/apache-impala/apache-impala-2.11.0/toolchain/gcc-4.9.2/bin/gcc
-DCHECK_FUNCTION_EXISTS=pthread_create   -o
CMakeFiles/cmTC_18bf3.dir/CheckFunctionExists.c.o   -c
/opt/apache-s/apache-impala/apache-impala-2.11.0/toolchain/cmake-3.8.2-p1/share/cmake-3.8/Modules/CheckFunctionExists.c
Linking C executable cmTC_18bf3
/opt/apache-s/apache-impala/apache-impala-2.11.0/toolchain/cmake-3.8.2-p1/bin/cmake
-E cmake_link_script CMakeFiles/cmTC_18bf3.dir/link.txt --verbose=1
/opt/apache-s/apache-impala/apache-impala-2.11.0/toolchain/gcc-4.9.2/bin/gcc
-DCHECK_FUNCTION_EXISTS=pthread_create    -rdynamic
CMakeFiles/cmTC_18bf3.dir/CheckFunctionExists.c.o  -o cmTC_18bf3 -lpthreads
/usr/bin/ld: cannot find -lpthreads
collect2: error: ld returned 1 exit status
gmake[1]: *** [cmTC_18bf3] Error 1
gmake[1]: Leaving directory
`/opt/apache-s/apache-impala/apache-impala-2.11.0/CMakeFiles/CMakeTmp'
gmake: *** [cmTC_18bf3/fast] Error 2

Also it seems that this is related to toolchain error so i followed this
link :
https://cwiki.apache.org/confluence/display/IMPALA/Building+native-toolchain+from+scratch+and+using+with+Impala
where i first builded native-toolchain and then followed step mention in
"Using custom toolchain with Impala" but while creating symbolic link i got
error "ln: ‘./gcc-4.9.2’: cannot overwrite directory".

@xinran, i guess post building impala, i will have to perform steps
mentioned by you.. correct me if i am wrong?



Regards,
Anup Tiwari

On Mon, Feb 5, 2018 at 11:14 PM, Xinran Yu Tinney <yuxinran8011@gmail.com>
wrote:

> Hi Anup,
>    Did you also source the config.sh? Run the following before
> impala-shell.sh:
>
> source ~/Impala/bin/impala-config.sh
>
> ${IMPALA_HOME}/buildall.sh -notests -build_shared_libs -start_minicluster
>
> ${IMPALA_HOME}/bin/start-impala-cluster.py
>
>
> 2018-02-05 10:07 GMT-06:00 Michael Brown <mikeb@cloudera.com>:
>
>> Hello,
>>
>> Please see:
>>
>> https://cwiki.apache.org/confluence/display/IMPALA/Bootstrap
>> ping+an+Impala+Development+Environment+From+Scratch
>> https://cwiki.apache.org/confluence/display/IMPALA/Building+Impala
>>
>>
>> On Mon, Feb 5, 2018 at 12:09 AM, Anup Tiwari <anupsdtiwari@gmail.com>
>> wrote:
>>
>>> Hi All,
>>>
>>> I am new to impala so i am getting errors while i am setting impala.
>>>
>>> I have downloaded latest impala release from "
>>> http://www.apache.org/dyn/closer.cgi?action=download&filena
>>> me=impala/2.11.0/apache-impala-2.11.0.tar.gz".
>>> I have extracted this in a folder and followed description mentioned in
>>> below link :-
>>>
>>> https://impala.apache.org/docs/build/html/topics/impala_proc
>>> esses.html#processes
>>>
>>> As mentioned in above link "*To start the Impala state store and Impala
>>> from the command line or a script, you can either use the service command
>>> or you can start the daemons directly through the impalad, statestored, and
>>> catalogd executables.*" So i searched for executable and found
>>> "start-impalad.sh"(which i think is correct one, let me know if i have
>>> missed this) but when i am executing this , i am getting below *errors*
>>> :-
>>>
>>> bin/start-impalad.sh: line 89: /admin: No such file or directory
>>> bin/start-impalad.sh: line 106: /opt/apache-s/apache-impala/ap
>>> ache-impala-2.11.0/be/build/latest/service/impalad: No such file or
>>> directory
>>>
>>> Also when i executed ./impala-config.sh then i got below *error* :-
>>>
>>> Unable to find the lsb_release command. Please ensure it is available in
>>> your PATH.
>>> ./impala-config.sh: line 265: return: can only `return' from a function
>>> or sourced script
>>> lsb_release command failed, output was: ./impala-config.sh: line 267:
>>> lsb_release: command not found
>>> ./impala-config.sh: line 270: return: can only `return' from a function
>>> or sourced script
>>>
>>>
>>> *Questions :-*
>>> 1. When we setup Hive/Hadoop/Drill etc then we have certain steps for
>>> setting HIVE_HOME/HADOOP_HOME/DRILL_HOME and also we specify certain
>>> setting in conf folder. Do we have similar documentation which can specify
>>> step by step setup.
>>>
>>>
>>> Regards,
>>> Anup Tiwari
>>>
>>> On Tue, Jan 23, 2018 at 8:56 PM, Jim Apple <jbapple@cloudera.com> wrote:
>>>
>>>> Ubuntu 14.04 and 16.04 are the OSes most Impala developers use, but
>>>> many Impala users use CentOS 7.
>>>>
>>>> Here is part of the docs on tuning:
>>>> https://impala.apache.org/docs/build/html/topics/impala_perf
>>>> ormance.html
>>>>
>>>> Here is some tuning info that was produced by Cloudera:
>>>> http://blog.cloudera.com/wp-content/uploads/2017/03/Impala-C
>>>> ookbook-01-20173.pdf
>>>>
>>>> On Tue, Jan 23, 2018 at 6:53 AM, Anup Tiwari <anupsdtiwari@gmail.com>
>>>> wrote:
>>>> > Hi Vincent,
>>>> >
>>>> > I found this link which says Supported Operating Systems are Ubuntu
>>>> 14.04,
>>>> > 16.04 so does this mean it won't work on centos 7.
>>>> >
>>>> > Also can you send some link which can help us in tuning as well.
>>>> >
>>>> > Regards,
>>>> > Anup Tiwari
>>>> >
>>>> > On Tue, Jan 23, 2018 at 7:26 PM, Vincent Tran <vttran@cloudera.com>
>>>> wrote:
>>>> >>
>>>> >> Hi Anup,
>>>> >>
>>>> >> Is this the link you are looking for?
>>>> >>
>>>> >> https://impala.apache.org/docs/build/html/topics/impala_install.html
>>>> >>
>>>> >> On Tue, Jan 23, 2018 at 7:52 AM, Anup Tiwari <anupsdtiwari@gmail.com
>>>> >
>>>> >> wrote:
>>>> >>>
>>>> >>> Hi All
>>>> >>>
>>>> >>> I want to install impala on my production environment(distributed)
>>>> :-
>>>> >>>
>>>> >>> 1. Os Details : CentOS Linux release 7.2.1511 (Core)
>>>> >>> 2. Apache Hadoop 2.8.0
>>>> >>> 3. Apache Hive 2.1.1
>>>> >>>
>>>> >>> I didn't found any link on mail, please suggest if it is possible
>>>> or not
>>>> >>> and if possible then please share some links.
>>>> >>>
>>>> >>> Thanks in advance!!
>>>> >>>
>>>> >>> Regards,
>>>> >>> Anup Tiwari
>>>> >>
>>>> >>
>>>> >>
>>>> >>
>>>> >> --
>>>> >> Vincent T. Tran
>>>> >> Customer Operations Engineer
>>>> >> Cloudera, Inc.
>>>> >
>>>> >
>>>>
>>>
>>>
>>
>

Mime
View raw message