Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EF3A9DEAB for ; Thu, 9 Aug 2012 10:45:34 +0000 (UTC) Received: (qmail 73885 invoked by uid 500); 9 Aug 2012 10:45:30 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 73230 invoked by uid 500); 9 Aug 2012 10:45:28 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 73207 invoked by uid 99); 9 Aug 2012 10:45:27 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Aug 2012 10:45:27 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FSL_RCVD_USER,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of stan.ieugen@gmail.com designates 209.85.160.176 as permitted sender) Received: from [209.85.160.176] (HELO mail-gh0-f176.google.com) (209.85.160.176) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Aug 2012 10:45:23 +0000 Received: by ghbz10 with SMTP id z10so278419ghb.35 for ; Thu, 09 Aug 2012 03:45:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; bh=ygCZ2zcw+4hNao4Sy1hO6Nz2h1GtPqipTiLx1SpyBqM=; b=pNa8XAZjffkae+1bfgksV3+1zXyvpkcdZn6r4kuwfT95va/t3YWqWRxI3kBshxaA5w nK5nPkprcX5cY7jBrF7Mu7V6XhuJX4D2p28WEMm3qpNQ7mkQWxhdmap4DZtggfjKdIiz WLlwx5VMFZURbf1GUmVlHNxsnOnNJ/qQ7T7jysrlHaBshkG5l1IbxvfTfTlJVL09LBxf U+wqTsPrLD5FDfFIMGdbD8DMaPKxTh7LGiXgE60/PtsIfrjIGRA2kFf5UUAm0B5XdHGo dJvvpJ56i3IKtJ4WZFZBX4wCiz7rBf+E1Oo92tkPVEt7F6NwiuHVZHEVczpVkX+Kby4u 8RZQ== MIME-Version: 1.0 Received: by 10.50.170.104 with SMTP id al8mr512207igc.47.1344509102468; Thu, 09 Aug 2012 03:45:02 -0700 (PDT) Received: by 10.64.32.225 with HTTP; Thu, 9 Aug 2012 03:45:02 -0700 (PDT) In-Reply-To: References: <51BE77A7231E9E488E58380AFBD77272105235DA@mail1.impetus.co.in> Date: Thu, 9 Aug 2012 13:45:02 +0300 Message-ID: Subject: Re: Apache Hadoop 0.23.1 Source Build Failing From: Ioan Eugen Stan To: user@hadoop.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Hello Pankaj, Sorry, I pressed send too fast. The linker can't find some libraries. Check to see if you have them installed (locate, find, rpm). If not install them and try again. If you have them installed and ld can't find them, add the paths to the proper environment variable (I think LD_LIBRARY_PATH). Check the ld man page ( $ man ld) for details. e.g. $ export LD_LIBRARY_PATH=3D$LD_LIBRARY_PATH:/path/to/lib http://linux.about.com/library/cmd/blcmdl1_ld.htm I hope this helps, On Thu, Aug 9, 2012 at 1:36 PM, Ioan Eugen Stan wro= te: > It seems that /bin/ld dos not exist so the compiler cannot perform > linking. Looking at the Fedora docs it seems that ld is located in > /usr/bin/ld so you may have to create a symlink to it: > > $ ln -s /usr/bin/ld /bin/ld > > First check that you have ld installed with: $ which ld > > The scripts should also use `which ld` to find the proper path to ld. > So maybe you could raise an issue on JIRA with this. > > http://docs.fedoraproject.org/en-US/Fedora/13/html/Release_Notes/sect-Rel= ease_Notes-The_GCC_Compiler_Collection.html > > Cheers, > > On Thu, Aug 9, 2012 at 1:05 PM, Pankaj Misra = wrote: >> Dear All, >> >> I am building hadoop 0.23.1 release from source with native support. I h= ave already built/installed the following pre-requisites for native support >> 1. gcc-c++ 4.7.1 >> 2. protoc 2.4.1 >> 3. autotools chain >> 4. JDK 1.6.0_33 >> 5. zlib 1.2.5-6 >> 6. lzo 2.06-2 >> >> I have also set the following variables and exported them >> export LD_LIBRARY_PATH=3D/usr/local/lib >> >> Other variables are also set as given below. >> export LD_LIBRARY_PATH=3D/usr/local/lib >> export JAVA_HOME=3D/usr/java/jdk1.6.0_33 >> export ANT_HOME=3D/home/fedora/apache-ant-1.8.4 >> export MAVEN_HOME=3D/home/fedora/apache-maven-3.0.4 >> export PATH=3D$JAVA_HOME/bin:$ANT_HOME/bin:$MAVEN_HOME/bin:$PATH >> export HADOOP_COMMON_HOME=3D/home/fedora/hadoop/bin/release-0.23.1/hadoo= p-0.23.1 >> export HADOOP_HDFS_HOME=3D$HADOOP_COMMON_HOME >> export YARN_HOME=3D$HADOOP_COMMON_HOME >> export HADOOP_MAPRED_HOME=3D$HADOOP_COMMON_HOME >> export HADOOP_CONF_DIR=3D$HADOOP_COMMON_HOME/etc/hadoop >> >> >> I am using the following to build the source with native support(using r= oot user access). >> mvn clean install -Pdist -Pnative -DskipTests=3Dtrue >> >> However, after building a number of sub-projects, the build fails at the= nodemanager with the following error >> [INFO] Compiling 129 source files to /home/fedora/hadoop/src/release-0.2= 3.1/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-ser= ver-nodemanager/target/classes >> [INFO] >> [INFO] --- make-maven-plugin:1.0-beta-1:autoreconf (compile) @ hadoop-ya= rn-server-nodemanager --- >> [INFO] >> [INFO] --- make-maven-plugin:1.0-beta-1:configure (compile) @ hadoop-yar= n-server-nodemanager --- >> [INFO] checking for gcc... gcc >> [INFO] checking whether the C compiler works... no >> [INFO] configure: error: in `/home/fedora/hadoop/src/release-0.23.1/hado= op-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-node= manager/target/native/container-executor': >> [INFO] configure: error: C compiler cannot create executables >> [INFO] See `config.log' for more details >> >> >> The config.log mentions the following issues. >> >> configure:2562: checking whether the C compiler works >> configure:2584: gcc -DHADOOP_CONF_DIR=3D/etc/hadoop -m32 conftest.c >= &5 >> /bin/ld: cannot find crt1.o: No such file or directory >> /bin/ld: cannot find crti.o: No such file or directory >> /bin/ld: skipping incompatible /usr/lib/gcc/x86_64-redhat-linux/4.7.0/li= bgcc_s.so when searching for -lgcc_s >> /bin/ld: cannot find -lgcc_s >> /bin/ld: skipping incompatible /usr/lib64/libc.so when searching for -lc >> /bin/ld: cannot find -lc >> /bin/ld: skipping incompatible /usr/lib/gcc/x86_64-redhat-linux/4.7.0/li= bgcc_s.so when searching for -lgcc_s >> /bin/ld: cannot find -lgcc_s >> /bin/ld: cannot find crtn.o: No such file or directory >> collect2: error: ld returned 1 exit status >> configure:2588: $? =3D 1 >> configure:2626: result: no >> configure: failed program was: >> | /* confdefs.h */ >> | #define PACKAGE_NAME "linux-container-executor" >> | #define PACKAGE_TARNAME "linux-container-executor" >> | #define PACKAGE_VERSION "1.0.0" >> | #define PACKAGE_STRING "linux-container-executor 1.0.0" >> | #define PACKAGE_BUGREPORT "mapreduce-dev@hadoop.apache.org" >> | #define PACKAGE_URL "" >> | /* end confdefs.h. */ >> | >> | int >> | main () >> | { >> | >> | ; >> | return 0; >> | } >> configure:2631: error: in `/home/fedora/hadoop/src/release-0.23.1/hadoop= -mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodema= nager/target/native/container-executor': >> configure:2633: error: C compiler cannot create executables >> >> Overall build summary is as given below >> [INFO] Reactor Summary: >> [INFO] >> [INFO] Apache Hadoop Main ................................ SUCCESS [7.92= 0s] >> [INFO] Apache Hadoop Project POM ......................... SUCCESS [1.40= 5s] >> [INFO] Apache Hadoop Annotations ......................... SUCCESS [6.45= 2s] >> [INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.63= 7s] >> [INFO] Apache Hadoop Project Dist POM .................... SUCCESS [3.23= 6s] >> [INFO] Apache Hadoop Auth ................................ SUCCESS [8.80= 5s] >> [INFO] Apache Hadoop Auth Examples ....................... SUCCESS [5.10= 5s] >> [INFO] Apache Hadoop Common .............................. SUCCESS [1:55= .833s] >> [INFO] Apache Hadoop Common Project ...................... SUCCESS [0.21= 0s] >> [INFO] Apache Hadoop HDFS ................................ SUCCESS [1:24= .218s] >> [INFO] Apache Hadoop HttpFS .............................. SUCCESS [20.9= 92s] >> [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [0.12= 7s] >> [INFO] hadoop-yarn ....................................... SUCCESS [0.59= 8s] >> [INFO] hadoop-yarn-api ................................... SUCCESS [57.2= 81s] >> [INFO] hadoop-yarn-common ................................ SUCCESS [1:01= .264s] >> [INFO] hadoop-yarn-server ................................ SUCCESS [0.19= 0s] >> [INFO] hadoop-yarn-server-common ......................... SUCCESS [19.2= 80s] >> [INFO] hadoop-yarn-server-nodemanager .................... FAILURE [17.0= 16s] >> [INFO] hadoop-yarn-server-web-proxy ...................... SKIPPED >> [INFO] hadoop-yarn-server-resourcemanager ................ SKIPPED >> [INFO] hadoop-yarn-server-tests .......................... SKIPPED >> [INFO] hadoop-mapreduce-client ........................... SKIPPED >> [INFO] hadoop-mapreduce-client-core ...................... SKIPPED >> [INFO] hadoop-yarn-applications .......................... SKIPPED >> [INFO] hadoop-yarn-applications-distributedshell ......... SKIPPED >> [INFO] hadoop-yarn-site .................................. SKIPPED >> [INFO] hadoop-mapreduce-client-common .................... SKIPPED >> [INFO] hadoop-mapreduce-client-shuffle ................... SKIPPED >> [INFO] hadoop-mapreduce-client-app ....................... SKIPPED >> [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED >> [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED >> [INFO] Apache Hadoop MapReduce Examples .................. SKIPPED >> [INFO] hadoop-mapreduce .................................. SKIPPED >> [INFO] Apache Hadoop MapReduce Streaming ................. SKIPPED >> [INFO] Apache Hadoop Distributed Copy .................... SKIPPED >> [INFO] Apache Hadoop Archives ............................ SKIPPED >> [INFO] Apache Hadoop Rumen ............................... SKIPPED >> [INFO] Apache Hadoop Extras .............................. SKIPPED >> [INFO] Apache Hadoop Tools Dist .......................... SKIPPED >> [INFO] Apache Hadoop Tools ............................... SKIPPED >> [INFO] Apache Hadoop Distribution ........................ SKIPPED >> [INFO] Apache Hadoop Client .............................. SKIPPED >> [INFO] Apache Hadoop Mini-Cluster ........................ SKIPPED >> [INFO] -----------------------------------------------------------------= ----- >> >> My doubts here are that is the if C compiler was not able to create the = executables, the other projects which were build before node manager should= have also failed, since they are also using the auto tools chain. I am abl= e to build the entire source code if I build without native support, but I = do not want to skip the native support build and I am trying to build the e= ntire source code with native libraries support. >> >> My current OS is Fedora 17 64-bit and I have also got the same issue on = CentOS 6.2 64-bit. I dont know if I am missing something for successful bui= ld with native libraries, and would request for the community's help for th= e same. >> >> >> >> Thanks and Regards >> Pankaj Misra >> >> ________________________________ >> >> Impetus webinar: Designing a Test Automation Framework for Interoperable= Systems; July 25 (10:00am PT). http://lf1.me/0E/ >> >> Follow us on www.twitter.com/impetustech >> >> >> NOTE: This message may contain information that is confidential, proprie= tary, privileged or otherwise protected by law. The message is intended sol= ely for the named addressee. If received in error, please destroy and notif= y the sender. Any use of this email is prohibited when received in error. I= mpetus does not represent, warrant and/or guarantee, that the integrity of = this communication has been maintained nor that the communication is free o= f errors, virus, interception or interference. > > > > -- > Ioan Eugen Stan / CTO / http://axemblr.com --=20 Ioan Eugen Stan / CTO / http://axemblr.com