Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6B16D10AB6 for ; Mon, 4 Nov 2013 13:20:52 +0000 (UTC) Received: (qmail 21281 invoked by uid 500); 4 Nov 2013 13:20:18 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 21180 invoked by uid 500); 4 Nov 2013 13:20:13 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 21170 invoked by uid 99); 4 Nov 2013 13:20:11 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Nov 2013 13:20:11 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [98.138.91.123] (HELO nm30-vm6.bullet.mail.ne1.yahoo.com) (98.138.91.123) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Nov 2013 13:20:04 +0000 Received: from [98.138.100.112] by nm30.bullet.mail.ne1.yahoo.com with NNFMP; 04 Nov 2013 13:19:42 -0000 Received: from [98.138.89.254] by tm103.bullet.mail.ne1.yahoo.com with NNFMP; 04 Nov 2013 13:19:42 -0000 Received: from [127.0.0.1] by omp1046.mail.ne1.yahoo.com with NNFMP; 04 Nov 2013 13:19:42 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 529144.50193.bm@omp1046.mail.ne1.yahoo.com Received: (qmail 66739 invoked by uid 60001); 4 Nov 2013 13:19:42 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1383571182; bh=VZ85Iz8UTLYWHzhJjITQCvZCi5+hrNRzlBV9wtSoCt4=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=YGYabl5fJdx38YZg745c2NILdjCW4u8ONxOk7FAJO+e+xHd8t4KBgPH0ZUun4Wbx5Gju7+lUjwwgcRtSHM+4S2JnZvbuIPa812p0fdpqUDrBI6X5Qgeb31e0Jaw4ZpNIz88mzgE7g+If3eEEeJ2l33kd9xjgS25dn/CziiHh7z0= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=A0jWuJigwOkytzwlrf9SWbf4LN3HujSjA7qRLq7Rm4DQhqy1sVkaNhwY4I6zRLcJmM3XQlUTWmEgaeTYSZm4UhzBi4G5TLtZAMpBTaLeqMwpyq4mu4hQaMLlMVdlJq4Ws6yZ2h6kJgSrZMXLgq6OZ9JNrJyw2+PEJaDrOPRcsSQ=; X-YMail-OSG: 7zPV4sgVM1kRYwmXb6QGVnnaIjnllwT9IQVzPrGnvIfm8y5 Uk3TF.oOd764B90jFj49V2N4XrEfFYI43oeWnrcCSvyp5khqg1Y5vt3_F88Y FEqcK4kFpMleoOoO666x8kL2jR34L67UcmIjs1T7DkU1XKoLDYrKIKPFXEpW nfZ0Cez4zwZ882XwVM3De4F1x7KETZ7Z.lWnxhBgn3BugMUbLcWRBs8hlb7l VPEmkdbyPXZ0CJJqg6nn17S59dtfIQw.Udb52.aTITFCoRls5q5U6.r2bycs mm2ue4H3nU_qIX5QY3jHO1U8Jkr6Mq6fs7mmmwcRmrON59FxnGV2fAAlvplw EQ1fssdBKGyl_UieTPq3CgV6SqYmHCNiNhntmSz_U298UXisDKLquB0k2jbP ATu4CqNXL8lxUFO.tBDB96j_f2kVZsFm15g52Pn2.AHh..2roMAG_l4n3l4H hQ9nyoiuHAmX9gyORH_WITUQkJJ9MAHj6NVZ_uC.Do.WL.Dqn.KySi_ijNhB y0bZ2GLyQnp9_F1EOiwTA3WsBD__P0nHxFfipTg2WFW6GM8S1lrcVTz5tkBv A17GnY43l62txqOnVO8ecMweUfRcGm1mKTLnjGXq3hoch_TMDf9YM7UO6U15 f309y.Gr4CoYQs600inRpaLi3f_kgjXG531yu9UB.QQPs9dAPjlLYd2jzAmb jDFfX_Y6RR1SKqa45IS8zi9m3f78RAHtJguyJ03u.JaOO8BE_6L9KWNmeDA4 aL7p0uWsaDhZJ7rCKALTugntgkoc- Received: from [24.63.85.190] by web120306.mail.ne1.yahoo.com via HTTP; Mon, 04 Nov 2013 05:19:42 PST X-Rocket-MIMEInfo: 002.001,SSB3aWxsIHN1Z2dlc3QgZ2V0dGluZyB0aGUgc291cmNlIGFuZCBjb21waWxpbmcgaW4geW91ciBtYWNoaW5lLiBJZiB5b3VyIG1hY2hpbmUgaXMgNjQgYml0cyB5b3Ugd2lsbCBnZXQgdGhlIDY0IGJpdHMgbmF0aXZlIGxpYnJhcmllcy4gVGhhdCB3aWxsIHNvbHZlIHRoZSBwcm9ibGVtIHlvdSBoYXZlIC5QbGVhc2UgZ2V0wqBoYWRvb3AtMi4yLjAtc3JjLnRhci5nei4KClRoYW5rc8KgCgpSZXlhbmUgT1VLUEVESk8gCgoKCk9uIE1vbmRheSwgTm92ZW1iZXIgNCwgMjAxMyA3OjU2IEFNLCBBbXIgU2hhaGluIDwBMAEBAQE- X-Mailer: YahooMailWebService/0.8.161.596 References: <31CE858D-E7A4-4338-B942-D50407DFBC84@it.uu.se> <8B8D3BAF-314C-4D40-80FA-312ACB19755B@it.uu.se> Message-ID: <1383571182.64074.YahooMailNeo@web120306.mail.ne1.yahoo.com> Date: Mon, 4 Nov 2013 05:19:42 -0800 (PST) From: REYANE OUKPEDJO Reply-To: REYANE OUKPEDJO Subject: Re: C++ example for hadoop-2.2.0 To: "user@hadoop.apache.org" In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="97335089-1530870969-1383571182=:64074" X-Virus-Checked: Checked by ClamAV on apache.org --97335089-1530870969-1383571182=:64074 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable I will suggest getting the source and compiling in your machine. If your ma= chine is 64 bits you will get the 64 bits native libraries. That will solve= the problem you have .Please get=A0hadoop-2.2.0-src.tar.gz.=0A=0AThanks=A0= =0A=0AReyane OUKPEDJO =0A=0A=0A=0AOn Monday, November 4, 2013 7:56 AM, Amr = Shahin wrote:=0A =0AWell, the 2 series isn't exactly = the "next version". It's a continuation of branch .2.=0AAlso, the error mes= sage from the gcc indicates that the library you're trying to link to isn't= compatible which made me suspicious. check the documentation to see if had= oop has 64 libraries, or otherwise compile against the 32 ones=0A=0A=0A=0AO= n Mon, Nov 4, 2013 at 4:51 PM, Salman Toor wrote:=0A= =0AHi,=A0=0A>=0A>=0A>Thanks for your answer!=A0=0A>=0A>=0A>But are you sure= about it? Actually Hadoop version 1.2 have both 32 and 64 bit libraries so= I believe the the next version should have both... But I am not sure just = a random guess :-(=0A>=0A>=0A>Regards..=0A>Salman.=A0=0A>=0A>=0A>Salman Too= r, PhD=0A>salman.toor@it.uu.se=0A>=0A>=0A>=0A>=0A>=0A>On Nov 4, 2013, at 1:= 38 PM, Amr Shahin wrote:=0A>=0A>I believe hadoop isn't compatible with 64 a= rchitecture. Try installing the 32 libraries and compile against them.=0A>>= This error (skipping incompatible /home/sztoor/hadoop-2.2.0/lib/native/libh= adooppipes.a when searching -lhadooppipes) indicates so=A0=0A>>=0A>>=0A>>= =0A>>On Mon, Nov 4, 2013 at 2:44 PM, Salman Toor wro= te:=0A>>=0A>>Hi,=A0=0A>>>=0A>>>=0A>>>Can someone give a pointer?=A0=0A>>>= =0A>>>=0A>>>=0A>>>=0A>>>Thanks in advance.=0A>>>=0A>>>=0A>>>Regards..=0A>>>= Salman.=A0=0A>>>=0A>>>=0A>>>=0A>>>=0A>>>Salman Toor, PhD=0A>>>salman.toor@i= t.uu.se=0A>>>=0A>>>=0A>>>=0A>>>=0A>>>=0A>>>On Nov 3, 2013, at 11:31 PM, Sal= man Toor wrote:=0A>>>=0A>>>Hi,=A0=0A>>>>=0A>>>>=0A>>>>I am quite new to the= Hadoop world, previously was running hadoop-1.2.0 stable version on my sma= ll cluster and encountered some strange problems like the local path to the= mapper =A0file didn't copy to the hdfs .... It works fine on the single no= de setup but on multiple node simple word-count python example didn't work.= .. =A0I read on the blog that it might be the problem in the version I am u= sing. So I thought to change the version and downloaded the Hadoop 2.2.0. T= his version has yarn together with many new features that I hope I will lea= rn in the future. Now simple wordcount example works without any problem on= the multi-node setup. I am using simple python example.=A0=0A>>>>=0A>>>>= =0A>>>>Now I would like to compile my C++ code. Since the directory structu= re together with other things have been changed. I have started to get the = following error:=A0=0A>>>>=0A>>>>=0A>>>>----------------=0A>>>>/urs/bin/ld:= =A0skipping incompatible /home/sztoor/hadoop-2.2.0/lib/native/libhadooputi= ls.a when searching -lhadooputils=0A>>>>cannot find -lhadooputils=0A>>>>=0A= >>>>=0A>>>>=A0/urs/bin/ld: =A0skipping incompatible /home/sztoor/hadoop-2.2= .0/lib/native/libhadooppipes.a when searching -lhadooppipes=0A>>>>cannot fi= nd -lhadooppipes=0A>>>>------------------=0A>>>>=0A>>>>=0A>>>>I have manage= d to run the c++ example successfully with the 1.2.0 version on single node= setup.=0A>>>>=0A>>>>=0A>>>>I am having 64bit Ubuntu machine. previously I = was using Linux-amd64-64=0A>>>>=0A>>>>=0A>>>>Now in new version, "lib" and = "include" directories are=A0in the hadoop-2.2.0 directory. No build.xml is = available...=A0=0A>>>>=0A>>>>=0A>>>>Can someone please give me an example o= f a makefile based on the version 2.2.0? Or suggest me which version I shou= ld go for? Or if there are some prerequisites that I should do before compi= ling my code?=A0=0A>>>>=0A>>>>=0A>>>>Thanks in advance.=A0=0A>>>>=0A>>>>=0A= >>>>Regards..=0A>>>>Salman.=A0=0A>>>>=0A>>>>=0A>>>>=0A>>>>=0A>>>>=A0=0A>>>>= Salman Toor, PhD=0A>>>>salman.toor@it.uu.se=0A>>>>=0A>>>>=0A>>>>=0A>>>>=0A>= >>=0A>>=0A> --97335089-1530870969-1383571182=:64074 Content-Type: text/html; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable
I will suggest getting the source and compiling in= your machine. If your machine is 64 bits you will get the 64 bits native l= ibraries. That will solve the problem you have .Please get hadoo= p-2.2.0-src.tar.gz.

Thanks 

<= div style=3D"color: rgb(0, 0, 0); font-size: 16px; font-family: 'Courier Ne= w'; background-color: transparent; font-style: normal;">Reyane OUKPEDJO=

<= br>
On Monday, November 4, 2013 7:56 AM, Amr Shahin <amrnablus@gmail.= com> wrote:
Well, the 2 series isn't exactl= y the "next version". It's a continuation of branch .2.
Also, the error= message from the gcc indicates that the library you're trying to link to i= sn't compatible which made me suspicious. check the documentation to see if= hadoop has 64 libraries, or otherwise compile against the 32 ones
=0A= =0A


On Mon, Nov 4, 2013 at 4:= 51 PM, Salman Toor <salman.toor@it.uu.se> wrote:
=0A=0A
Hi, 

Thanks for = your answer! 

But are you sure= about it? Actually Hadoop version 1.2 have both 32 and 64 bit libraries so= I believe the the next version should have both... But I am not sure just = a random guess :-(
=0A=0A

Regards..<= /div>
Salman. 

=0A
=0A=0ASalman Toor, PhD
=


=0A
=0A
On Nov 4,= 2013, at 1:38 PM, Amr Shahin wrote:

I believe hadoop isn't compatible with 64 arch= itecture. Try installing the 32 libraries and compile against them.
=0A= =0AThis error (skipping incompatible /home/sztoor/hadoop-2.2.0/lib/native/libhadooppipes= .a when searching -lhadooppipes) indicates so 
=0A=0A=0A= =0A


On Mon, Nov 4, 2013 at = 2:44 PM, Salman Toor <salman.toor@it.uu.se> wrote:
=0A=0A=0A=0A
Hi, 

C= an someone give a pointer? 

= =0A=0A

Thanks in advance.

Regards..
Salman. 


=0A
=0A=0A=0A=0ASalman Toor, PhD


=0A
=
=0A
On Nov 3, 2013, at 11:31 PM, Salm= an Toor wrote:

Hi, 

I am= quite new to the Hadoop world, previously was running hadoop-1.2.0 stable = version on my small cluster and encountered some strange problems like the = local path to the mapper  file didn't copy to the hdfs .... It works f= ine on the single node setup but on multiple node simple word-count python = example didn't work...  I read on the blog that it might be the proble= m in the version I am using. So I thought to change the version and downloa= ded the Hadoop 2.2.0. This version has yarn together with many new features= that I hope I will learn in the future. Now simple wordcount example works= without any problem on the multi-node setup. I am using simple python exam= ple. 
=0A=0A=0A=0A

Now I would = like to compile my C++ code. Since the directory structure together with ot= her things have been changed. I have started to get the following error:&nb= sp;

----------------
=0A=0A=0A= =0A
/urs/bin/ld:  skipping incompatible /home/sztoor/hadoop-2.2.0/= lib/native/libhadooputils.a when searching -lhadooputils
cannot f= ind -lhadooputils

 /urs/bin/ld= :  skipping incompatible /home/sztoor/hadoop-2.2.0/lib/native/libhadoo= ppipes.a when searching -lhadooppipes
=0A=0A=0A=0A
cannot find -lh= adooppipes
------------------

=
I have managed to run the c++ example successfully with the 1.2.0 vers= ion on single node setup.

I am havi= ng 64bit Ubuntu machine. previously I was using Linux-amd64-64
=0A=0A= =0A=0A

Now in new version, "lib" and "inc= lude" directories are in the hadoop-2.2.0 directory. No build.xml is a= vailable... 

Can someone pleas= e give me an example of a makefile based on the version 2.2.0? Or suggest m= e which version I should go for? Or if there are some prerequisites that I = should do before compiling my code? 
=0A=0A=0A=0A

Thanks in advance. 

=
Regards..
Salman. 

<= /div>

 
=0A
=0A=0A=0A=0ASalman Toor,= PhD


= =0A
=0A


= =0A




=
--97335089-1530870969-1383571182=:64074--