Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of stan.ieugen@gmail.com
 designates 209.85.161.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <51BE77A7231E9E488E58380AFBD77272105235DA@mail1.impetus.co.in>
References: <51BE77A7231E9E488E58380AFBD77272105235DA@mail1.impetus.co.in>
Date: Thu, 9 Aug 2012 13:36:16 +0300
Message-ID: 
 <CAFvdMiCLqrcobeSF-yi9brw469qXZYzW_kn1GVZVgrnXVAePqw@mail.gmail.com>
Subject: Re: Apache Hadoop 0.23.1 Source Build Failing
From: Ioan Eugen Stan <stan.ieugen@gmail.com>
To: user@hadoop.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

It seems that /bin/ld dos not exist so the compiler cannot perform
linking. Looking at the Fedora docs it seems that ld is located in
/usr/bin/ld so you may have to create a symlink to it:

$ ln -s /usr/bin/ld /bin/ld

First check that you have ld installed with: $ which ld

The scripts should also use `which ld` to find the proper path to ld.
So maybe you could raise an issue on JIRA with this.

http://docs.fedoraproject.org/en-US/Fedora/13/html/Release_Notes/sect-Relea=
se_Notes-The_GCC_Compiler_Collection.html

Cheers,

On Thu, Aug 9, 2012 at 1:05 PM, Pankaj Misra <pankaj.misra@impetus.co.in> w=
rote:
> Dear All,
>
> I am building hadoop 0.23.1 release from source with native support. I ha=
ve already built/installed the following pre-requisites for native support
> 1. gcc-c++ 4.7.1
> 2. protoc 2.4.1
> 3. autotools chain
> 4. JDK 1.6.0_33
> 5. zlib 1.2.5-6
> 6. lzo 2.06-2
>
> I have also set the following variables and exported them
> export LD_LIBRARY_PATH=3D/usr/local/lib
>
> Other variables are also set as given below.
> export LD_LIBRARY_PATH=3D/usr/local/lib
> export JAVA_HOME=3D/usr/java/jdk1.6.0_33
> export ANT_HOME=3D/home/fedora/apache-ant-1.8.4
> export MAVEN_HOME=3D/home/fedora/apache-maven-3.0.4
> export PATH=3D$JAVA_HOME/bin:$ANT_HOME/bin:$MAVEN_HOME/bin:$PATH
> export HADOOP_COMMON_HOME=3D/home/fedora/hadoop/bin/release-0.23.1/hadoop=
-0.23.1
> export HADOOP_HDFS_HOME=3D$HADOOP_COMMON_HOME
> export YARN_HOME=3D$HADOOP_COMMON_HOME
> export HADOOP_MAPRED_HOME=3D$HADOOP_COMMON_HOME
> export HADOOP_CONF_DIR=3D$HADOOP_COMMON_HOME/etc/hadoop
>
>
> I am using the following to build the source with native support(using ro=
ot user access).
> mvn clean install -Pdist -Pnative -DskipTests=3Dtrue
>
> However, after building a number of sub-projects, the build fails at the =
nodemanager with the following error
> [INFO] Compiling 129 source files to /home/fedora/hadoop/src/release-0.23=
.1/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-serv=
er-nodemanager/target/classes
> [INFO]
> [INFO] --- make-maven-plugin:1.0-beta-1:autoreconf (compile) @ hadoop-yar=
n-server-nodemanager ---
> [INFO]
> [INFO] --- make-maven-plugin:1.0-beta-1:configure (compile) @ hadoop-yarn=
-server-nodemanager ---
> [INFO] checking for gcc... gcc
> [INFO] checking whether the C compiler works... no
> [INFO] configure: error: in `/home/fedora/hadoop/src/release-0.23.1/hadoo=
p-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodem=
anager/target/native/container-executor':
> [INFO] configure: error: C compiler cannot create executables
> [INFO] See `config.log' for more details
>
>
> The config.log mentions the following issues.
>
> configure:2562: checking whether the C compiler works
> configure:2584: gcc -DHADOOP_CONF_DIR=3D/etc/hadoop -m32   conftest.c  >&=
5
> /bin/ld: cannot find crt1.o: No such file or directory
> /bin/ld: cannot find crti.o: No such file or directory
> /bin/ld: skipping incompatible /usr/lib/gcc/x86_64-redhat-linux/4.7.0/lib=
gcc_s.so when searching for -lgcc_s
> /bin/ld: cannot find -lgcc_s
> /bin/ld: skipping incompatible /usr/lib64/libc.so when searching for -lc
> /bin/ld: cannot find -lc
> /bin/ld: skipping incompatible /usr/lib/gcc/x86_64-redhat-linux/4.7.0/lib=
gcc_s.so when searching for -lgcc_s
> /bin/ld: cannot find -lgcc_s
> /bin/ld: cannot find crtn.o: No such file or directory
> collect2: error: ld returned 1 exit status
> configure:2588: $? =3D 1
> configure:2626: result: no
> configure: failed program was:
> | /* confdefs.h */
> | #define PACKAGE_NAME "linux-container-executor"
> | #define PACKAGE_TARNAME "linux-container-executor"
> | #define PACKAGE_VERSION "1.0.0"
> | #define PACKAGE_STRING "linux-container-executor 1.0.0"
> | #define PACKAGE_BUGREPORT "mapreduce-dev@hadoop.apache.org"
> | #define PACKAGE_URL ""
> | /* end confdefs.h.  */
> |
> | int
> | main ()
> | {
> |
> |   ;
> |   return 0;
> | }
> configure:2631: error: in `/home/fedora/hadoop/src/release-0.23.1/hadoop-=
mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodeman=
ager/target/native/container-executor':
> configure:2633: error: C compiler cannot create executables
>
> Overall build summary is as given below
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Hadoop Main ................................ SUCCESS [7.920=
s]
> [INFO] Apache Hadoop Project POM ......................... SUCCESS [1.405=
s]
> [INFO] Apache Hadoop Annotations ......................... SUCCESS [6.452=
s]
> [INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.637=
s]
> [INFO] Apache Hadoop Project Dist POM .................... SUCCESS [3.236=
s]
> [INFO] Apache Hadoop Auth ................................ SUCCESS [8.805=
s]
> [INFO] Apache Hadoop Auth Examples ....................... SUCCESS [5.105=
s]
> [INFO] Apache Hadoop Common .............................. SUCCESS [1:55.=
833s]
> [INFO] Apache Hadoop Common Project ...................... SUCCESS [0.210=
s]
> [INFO] Apache Hadoop HDFS ................................ SUCCESS [1:24.=
218s]
> [INFO] Apache Hadoop HttpFS .............................. SUCCESS [20.99=
2s]
> [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [0.127=
s]
> [INFO] hadoop-yarn ....................................... SUCCESS [0.598=
s]
> [INFO] hadoop-yarn-api ................................... SUCCESS [57.28=
1s]
> [INFO] hadoop-yarn-common ................................ SUCCESS [1:01.=
264s]
> [INFO] hadoop-yarn-server ................................ SUCCESS [0.190=
s]
> [INFO] hadoop-yarn-server-common ......................... SUCCESS [19.28=
0s]
> [INFO] hadoop-yarn-server-nodemanager .................... FAILURE [17.01=
6s]
> [INFO] hadoop-yarn-server-web-proxy ...................... SKIPPED
> [INFO] hadoop-yarn-server-resourcemanager ................ SKIPPED
> [INFO] hadoop-yarn-server-tests .......................... SKIPPED
> [INFO] hadoop-mapreduce-client ........................... SKIPPED
> [INFO] hadoop-mapreduce-client-core ...................... SKIPPED
> [INFO] hadoop-yarn-applications .......................... SKIPPED
> [INFO] hadoop-yarn-applications-distributedshell ......... SKIPPED
> [INFO] hadoop-yarn-site .................................. SKIPPED
> [INFO] hadoop-mapreduce-client-common .................... SKIPPED
> [INFO] hadoop-mapreduce-client-shuffle ................... SKIPPED
> [INFO] hadoop-mapreduce-client-app ....................... SKIPPED
> [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
> [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
> [INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
> [INFO] hadoop-mapreduce .................................. SKIPPED
> [INFO] Apache Hadoop MapReduce Streaming ................. SKIPPED
> [INFO] Apache Hadoop Distributed Copy .................... SKIPPED
> [INFO] Apache Hadoop Archives ............................ SKIPPED
> [INFO] Apache Hadoop Rumen ............................... SKIPPED
> [INFO] Apache Hadoop Extras .............................. SKIPPED
> [INFO] Apache Hadoop Tools Dist .......................... SKIPPED
> [INFO] Apache Hadoop Tools ............................... SKIPPED
> [INFO] Apache Hadoop Distribution ........................ SKIPPED
> [INFO] Apache Hadoop Client .............................. SKIPPED
> [INFO] Apache Hadoop Mini-Cluster ........................ SKIPPED
> [INFO] ------------------------------------------------------------------=
----
>
> My doubts here are that is the if C compiler was not able to create the e=
xecutables, the other projects which were build before node manager should =
have also failed, since they are also using the auto tools chain. I am able=
 to build the entire source code if I build without native support, but I d=
o not want to skip the native support build and I am trying to build the en=
tire source code with native libraries support.
>
> My current OS is Fedora 17 64-bit and I have also got the same issue on C=
entOS 6.2 64-bit. I dont know if I am missing something for successful buil=
d with native libraries, and would request for the community's help for the=
 same.
>
>
>
> Thanks and Regards
> Pankaj Misra
>
> ________________________________
>
> Impetus webinar: Designing a Test Automation Framework for Interoperable =
Systems; July 25 (10:00am PT). http://lf1.me/0E/
>
> Follow us on www.twitter.com/impetustech
>
>
> NOTE: This message may contain information that is confidential, propriet=
ary, privileged or otherwise protected by law. The message is intended sole=
ly for the named addressee. If received in error, please destroy and notify=
 the sender. Any use of this email is prohibited when received in error. Im=
petus does not represent, warrant and/or guarantee, that the integrity of t=
his communication has been maintained nor that the communication is free of=
 errors, virus, interception or interference.


--=20
Ioan Eugen Stan / CTO / http://axemblr.com