Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 415F610AE1 for ; Mon, 4 Nov 2013 13:30:18 +0000 (UTC) Received: (qmail 39592 invoked by uid 500); 4 Nov 2013 13:29:39 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 39444 invoked by uid 500); 4 Nov 2013 13:29:35 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 39433 invoked by uid 99); 4 Nov 2013 13:29:33 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Nov 2013 13:29:33 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [130.238.7.74] (HELO velox.its.uu.se) (130.238.7.74) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Nov 2013 13:29:28 +0000 X-Virus-Scanned: amavisd-new at uu.se X-DKIM: Sendmail DKIM Filter v2.8.3 velox.its.uu.se 626C336D5A DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=uu.se; s=centralsmtp; t=1383571746; i=@uu.se; bh=dOC+KJe7K88SgzhF+BtauyozaHpVmMMDG15uOu1T5u0=; h=From:Mime-Version:Content-Type:Subject:Date:In-Reply-To:To: References:Message-Id; b=YPt1nllID+9aX4mChBhCPYufrS0OETH3S2DfP2pAZeZm+T1NAJcdCEA46MZU7F4HY BOX2i0OzDmD+SL7cKD9V2Ose366z2e2bVVfUBGx8Y0mgwbnVpXQ6I5p5xKgolftyFt RMtUx/TrBfxZ0VTKDoRajN8uV1Arg1hlh59sK9GY= Received: from [192.168.0.14] (c83-253-249-32.bredband.comhem.se [83.253.249.32]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by velox.its.uu.se (Postfix) with ESMTPSA id 626C336D5A for ; Mon, 4 Nov 2013 14:29:04 +0100 (CET) From: Salman Toor Mime-Version: 1.0 (Apple Message framework v1283) Content-Type: multipart/alternative; boundary="Apple-Mail=_677AE62D-6E1E-4BBC-AC55-C55BAB4CE6C2" Subject: Re: C++ example for hadoop-2.2.0 Date: Mon, 4 Nov 2013 14:29:03 +0100 In-Reply-To: <1383571182.64074.YahooMailNeo@web120306.mail.ne1.yahoo.com> To: user@hadoop.apache.org References: <31CE858D-E7A4-4338-B942-D50407DFBC84@it.uu.se> <8B8D3BAF-314C-4D40-80FA-312ACB19755B@it.uu.se> <1383571182.64074.YahooMailNeo@web120306.mail.ne1.yahoo.com> Message-Id: <2329FFB4-4C98-46A0-8CAD-2D3C8C604F69@it.uu.se> X-Mailer: Apple Mail (2.1283) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_677AE62D-6E1E-4BBC-AC55-C55BAB4CE6C2 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=iso-8859-1 Hi,=20 Yes I will give a try and let everyone know. =20 /Salman.=20 Salman Toor, PhD salman.toor@it.uu.se On Nov 4, 2013, at 2:19 PM, REYANE OUKPEDJO wrote: > I will suggest getting the source and compiling in your machine. If = your machine is 64 bits you will get the 64 bits native libraries. That = will solve the problem you have .Please get hadoop-2.2.0-src.tar.gz. >=20 > Thanks=20 >=20 > Reyane OUKPEDJO=20 >=20 >=20 > On Monday, November 4, 2013 7:56 AM, Amr Shahin = wrote: > Well, the 2 series isn't exactly the "next version". It's a = continuation of branch .2. > Also, the error message from the gcc indicates that the library you're = trying to link to isn't compatible which made me suspicious. check the = documentation to see if hadoop has 64 libraries, or otherwise compile = against the 32 ones >=20 >=20 > On Mon, Nov 4, 2013 at 4:51 PM, Salman Toor = wrote: > Hi,=20 >=20 > Thanks for your answer!=20 >=20 > But are you sure about it? Actually Hadoop version 1.2 have both 32 = and 64 bit libraries so I believe the the next version should have = both... But I am not sure just a random guess :-( >=20 > Regards.. > Salman.=20 >=20 > Salman Toor, PhD > salman.toor@it.uu.se >=20 >=20 >=20 > On Nov 4, 2013, at 1:38 PM, Amr Shahin wrote: >=20 >> I believe hadoop isn't compatible with 64 architecture. Try = installing the 32 libraries and compile against them. >> This error (skipping incompatible = /home/sztoor/hadoop-2.2.0/lib/native/libhadooppipes.a when searching = -lhadooppipes) indicates so=20 >>=20 >>=20 >> On Mon, Nov 4, 2013 at 2:44 PM, Salman Toor = wrote: >> Hi,=20 >>=20 >> Can someone give a pointer?=20 >>=20 >>=20 >> Thanks in advance. >>=20 >> Regards.. >> Salman.=20 >>=20 >>=20 >> Salman Toor, PhD >> salman.toor@it.uu.se >>=20 >>=20 >>=20 >> On Nov 3, 2013, at 11:31 PM, Salman Toor wrote: >>=20 >>> Hi,=20 >>>=20 >>> I am quite new to the Hadoop world, previously was running = hadoop-1.2.0 stable version on my small cluster and encountered some = strange problems like the local path to the mapper file didn't copy to = the hdfs .... It works fine on the single node setup but on multiple = node simple word-count python example didn't work... I read on the blog = that it might be the problem in the version I am using. So I thought to = change the version and downloaded the Hadoop 2.2.0. This version has = yarn together with many new features that I hope I will learn in the = future. Now simple wordcount example works without any problem on the = multi-node setup. I am using simple python example.=20 >>>=20 >>> Now I would like to compile my C++ code. Since the directory = structure together with other things have been changed. I have started = to get the following error:=20 >>>=20 >>> ---------------- >>> /urs/bin/ld: skipping incompatible = /home/sztoor/hadoop-2.2.0/lib/native/libhadooputils.a when searching = -lhadooputils >>> cannot find -lhadooputils >>>=20 >>> /urs/bin/ld: skipping incompatible = /home/sztoor/hadoop-2.2.0/lib/native/libhadooppipes.a when searching = -lhadooppipes >>> cannot find -lhadooppipes >>> ------------------ >>>=20 >>> I have managed to run the c++ example successfully with the 1.2.0 = version on single node setup. >>>=20 >>> I am having 64bit Ubuntu machine. previously I was using = Linux-amd64-64 >>>=20 >>> Now in new version, "lib" and "include" directories are in the = hadoop-2.2.0 directory. No build.xml is available...=20 >>>=20 >>> Can someone please give me an example of a makefile based on the = version 2.2.0? Or suggest me which version I should go for? Or if there = are some prerequisites that I should do before compiling my code?=20 >>>=20 >>> Thanks in advance.=20 >>>=20 >>> Regards.. >>> Salman.=20 >>>=20 >>>=20 >>> =20 >>> Salman Toor, PhD >>> salman.toor@it.uu.se >>>=20 >>>=20 >>>=20 >>=20 >>=20 >=20 >=20 >=20 >=20 --Apple-Mail=_677AE62D-6E1E-4BBC-AC55-C55BAB4CE6C2 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=iso-8859-1
Salman = Toor, PhD


On Nov 4, 2013, at 2:19 PM, REYANE OUKPEDJO = wrote:

I will suggest getting the = source and compiling in your machine. If your machine is 64 bits you = will get the 64 bits native libraries. That will solve the problem you = have .Please get hadoop-2.2.0-src.tar.gz.

Thanks 

Reyane OUKPEDJO


On = Monday, November 4, 2013 7:56 AM, Amr Shahin <amrnablus@gmail.com> = wrote:
Well, the 2 series isn't = exactly the "next version". It's a continuation of branch .2.
Also, = the error message from the gcc indicates that the library you're trying = to link to isn't compatible which made me suspicious. check the = documentation to see if hadoop has 64 libraries, or otherwise compile = against the 32 ones


On Mon, Nov 4, 2013 at 4:51 PM, = Salman Toor <salman.toor@it.uu.se> = wrote:
Hi, 

Thanks for your answer! 

But are you sure about it? Actually Hadoop = version 1.2 have both 32 and 64 bit libraries so I believe the the next = version should have both... But I am not sure just a random guess = :-(

Regards..
Salman. 

Salman Toor, PhD


On Nov 4, 2013, at 1:38 PM, Amr Shahin = wrote:

I believe hadoop isn't compatible with 64 architecture. Try = installing the 32 libraries and compile against them.
This error (skipping incompatible = /home/sztoor/hadoop-2.2.0/lib/native/libhadooppipes.a when searching = -lhadooppipes) indicates so 


On Mon, Nov 4, = 2013 at 2:44 PM, Salman Toor <salman.toor@it.uu.se> = wrote:
Hi, 

Can someone give a = pointer? 


Thanks in advance.

Regards..
Salman. 


Salman Toor, PhD


On Nov 3, 2013, at 11:31 PM, Salman Toor = wrote:

Hi, 

I am quite new to the Hadoop world, previously = was running hadoop-1.2.0 stable version on my small cluster and = encountered some strange problems like the local path to the mapper =  file didn't copy to the hdfs .... It works fine on the single node = setup but on multiple node simple word-count python example didn't = work...  I read on the blog that it might be the problem in the = version I am using. So I thought to change the version and downloaded = the Hadoop 2.2.0. This version has yarn together with many new features = that I hope I will learn in the future. Now simple wordcount example = works without any problem on the multi-node setup. I am using simple = python example. 

Now I would like to compile my C++ = code. Since the directory structure together with other things have been = changed. I have started to get the following error: 

----------------
/urs/bin/ld:  skipping incompatible = /home/sztoor/hadoop-2.2.0/lib/native/libhadooputils.a when searching = -lhadooputils
cannot find -lhadooputils

 /urs/bin/ld:  skipping incompatible = /home/sztoor/hadoop-2.2.0/lib/native/libhadooppipes.a when searching = -lhadooppipes
cannot find = -lhadooppipes
------------------

I have managed to run the c++ example = successfully with the 1.2.0 version on single node setup.

I am having 64bit Ubuntu machine. previously I = was using Linux-amd64-64

Now in new version, "lib" and = "include" directories are in the hadoop-2.2.0 directory. No = build.xml is available... 

Can someone please give me an example of a = makefile based on the version 2.2.0? Or suggest me which version I = should go for? Or if there are some prerequisites that I should do = before compiling my code? 

Thanks in = advance. 

Regards..
Salman. 


 
Salman Toor, PhD








=

= --Apple-Mail=_677AE62D-6E1E-4BBC-AC55-C55BAB4CE6C2--