incubator-bigtop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sridhar Iyer <sridhar.v.i...@gmail.com>
Subject Hadoop compilation woes..
Date Fri, 09 Dec 2011 07:36:45 GMT
Hi,

I'm running 64bit Ubuntu 11.10. I'm getting this error when trying to build
hadoop on my workspace:

$make hadoop-deb

exec] make all-am
[exec] make[2]: Entering directory
`/home/sridhar/bigtop/trunk/output/hadoop/hadoop-0.20.205.0/build/native/Linux-amd64-64'
[exec] if /bin/bash ./libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H
-I. -I/home/sridhar/bigtop/trunk/output/hadoop/hadoop-0.20.205.0/src/native
-I. -I/usr/lib/jvm/java-6-sun//include
-I/usr/lib/jvm/java-6-sun//include/linux
-I/home/sridhar/bigtop/trunk/output/hadoop/hadoop-0.20.205.0/src/native/src
-Isrc/org/apache/hadoop/io/compress/zlib
-Isrc/org/apache/hadoop/io/nativeio -Isrc/org/apache/hadoop/security -g
-Wall -fPIC -O2 -m64 -g -O2 -MT ZlibCompressor.lo -MD -MP -MF
".deps/ZlibCompressor.Tpo" -c -o ZlibCompressor.lo `test -f
'src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c' || echo
'/home/sridhar/bigtop/trunk/output/hadoop/hadoop-0.20.205.0/src/native/'`src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c;
\
[exec] then mv -f ".deps/ZlibCompressor.Tpo" ".deps/ZlibCompressor.Plo";
else rm -f ".deps/ZlibCompressor.Tpo"; exit 1; fi
[exec] mkdir .libs
[exec] gcc -DHAVE_CONFIG_H -I.
-I/home/sridhar/bigtop/trunk/output/hadoop/hadoop-0.20.205.0/src/native -I.
-I/usr/lib/jvm/java-6-sun//include -I/usr/lib/jvm/java-6-sun//include/linux
-I/home/sridhar/bigtop/trunk/output/hadoop/hadoop-0.20.205.0/src/native/src
-Isrc/org/apache/hadoop/io/compress/zlib
-Isrc/org/apache/hadoop/io/nativeio -Isrc/org/apache/hadoop/security -g
-Wall -fPIC -O2 -m64 -g -O2 -MT ZlibCompressor.lo -MD -MP -MF
.deps/ZlibCompressor.Tpo -c
/home/sridhar/bigtop/trunk/output/hadoop/hadoop-0.20.205.0/src/native/src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c
-fPIC -DPIC -o .libs/ZlibCompressor.o
[exec] make[2]: Leaving directory
`/home/sridhar/bigtop/trunk/output/hadoop/hadoop-0.20.205.0/build/native/Linux-amd64-64'
[exec] make[1]: Leaving directory
`/home/sridhar/bigtop/trunk/output/hadoop/hadoop-0.20.205.0/build/native/Linux-amd64-64'
[exec]
/home/sridhar/bigtop/trunk/output/hadoop/hadoop-0.20.205.0/src/native/src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:
In function
'Java_org_apache_hadoop_io_compress_zlib_ZlibCompressor_initIDs':
[exec]
/home/sridhar/bigtop/trunk/output/hadoop/hadoop-0.20.205.0/src/native/src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:71:41:
error: expected expression before ',' token
[exec] make[2]: *** [ZlibCompressor.lo] Error 1
[exec] make[1]: *** [all] Error 2



Looking at ZlibCompressor.c, I see the following line:
void *libz = dlopen(HADOOP_ZLIB_LIBRARY, RTLD_LAZY | RTLD_GLOBAL);

in linux-amd64-64/config.h:
#define HADOOP_ZLIB_LIBRARY

I noticed that the hadoop's configure was trying to compile a dummy file
with -lz option and trying to find libz (which I see exists in
/lib/x86_64-linux-gnu/libz.so.1, but I don't know if ubuntu 11.10 64bit is
doing something funky because ldd on the file manually didn't seem to print
libz.so.1), so I manually add the "ac_cv_libname_z=libz.so.1" in
output/.../hadoop../src/native/configure. And try invoking "make all-am"
from the build directory (else it will just erase my changes and extract
the whole thing again)..

Once I get past this error message, I see that JVM_DATA_MODEL is not
expanded.. so I wrote a java program to get me the value of the property
sun.arch.data.model and assign that value to JVM_DATA_MODEL..

This gets me past the earlier error message but gives me:
In file included from
/home/sridhar/bigtop/trunk/output/hadoop/hadoop-0.20.205.0/src/native/src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:47:0:
/home/sridhar/bigtop/trunk/output/hadoop/hadoop-0.20.205.0/src/native/src/org/apache/hadoop/io/compress/zlib/org_apache_hadoop_io_compress_zlib.h:56:31:
fatal error: org_apache_hadoop.h: No such file or directory
compilation terminated.


So at this point, I'm thinking that I'm doing something very wrong..
My system configs:
sridhar@adonix:~$ gcc --version
gcc (Ubuntu/Linaro 4.6.1-9ubuntu3) 4.6.1
sridhar@adonix:~$ uname -a
Linux adonix 3.0.0-14-generic #23-Ubuntu SMP Mon Nov 21 20:28:43 UTC 2011
x86_64 x86_64 x86_64 GNU/Linux

Is my configuration not supported?
Any pointers?

Thanks,
Sridhar





Regards,

Sridhar
http://sridharv.net

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message