Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2696E10BE3 for ; Mon, 4 Nov 2013 13:59:05 +0000 (UTC) Received: (qmail 93295 invoked by uid 500); 4 Nov 2013 13:56:29 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 92918 invoked by uid 500); 4 Nov 2013 13:56:14 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 92826 invoked by uid 99); 4 Nov 2013 13:56:09 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Nov 2013 13:56:09 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of akelpe@concurrentinc.com designates 209.85.212.54 as permitted sender) Received: from [209.85.212.54] (HELO mail-vb0-f54.google.com) (209.85.212.54) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Nov 2013 13:56:05 +0000 Received: by mail-vb0-f54.google.com with SMTP id q12so1398234vbe.13 for ; Mon, 04 Nov 2013 05:55:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=concurrentinc.com; s=google; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; bh=7JP+bCZXEUazJLCSLlmq6is2L9BA6E51vnbMGvR72xE=; b=CZfmNLX2QKXC52znvNUQDIzSWxYA6zGe9jlZoguo/YsTU0/40DvKQO4Z5O6T4poY6f vp85qMb5912is29/zbdHf58QXvy0YkS82DVQgXN5y3zBv+TDNQZoJnGdXzN0DNNAOd4M DzQo4z3msjJCzr3H9B6mOb+808vIsdUWao1Is= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type:content-transfer-encoding; bh=7JP+bCZXEUazJLCSLlmq6is2L9BA6E51vnbMGvR72xE=; b=bGmKB4DfAzoSQeNyUgrJtV2q3U8cvPVb0eXR95D3w2oeo6Uqp0XM+HY/XIq4C430bz 1Bm12dmIYQfGj/+1SgP8tsgs9SwV53gML0UBYCA5KQSt+P5nJ++k2XmNNqIWXKMCa3mi zVwdDZ4tFnm5QhI4InTIxvBWb5synDGLibziTxo3ibvHy7IU+HOuoRtAX0tqsSWlJgBp Q9oqvhPpcVHJVLlW2BQFYqCW3kUNhujfOGtQ9xO8EUXWlQ0gImSaF2s7lfHJw3ZdF46M d3GbyNRDGZHc/teF+CkJWSY7K6EqKvJqrUdN/1/yX3+SsCJqvSp00x72/7HIQ0GzWtkd XHgg== X-Gm-Message-State: ALoCoQkpPYn6PBP7+VooawhjMMRCBnUJMaDaEEPaT5AtAUrbRghgoEdY/g7XTR0LTHfcFmoe+vNj MIME-Version: 1.0 X-Received: by 10.220.144.80 with SMTP id y16mr11581839vcu.4.1383573344524; Mon, 04 Nov 2013 05:55:44 -0800 (PST) Received: by 10.52.116.7 with HTTP; Mon, 4 Nov 2013 05:55:44 -0800 (PST) In-Reply-To: <65D4BF50-33D5-49B0-93A0-E7120E195972@it.uu.se> References: <31CE858D-E7A4-4338-B942-D50407DFBC84@it.uu.se> <8B8D3BAF-314C-4D40-80FA-312ACB19755B@it.uu.se> <65D4BF50-33D5-49B0-93A0-E7120E195972@it.uu.se> Date: Mon, 4 Nov 2013 14:55:44 +0100 Message-ID: Subject: Re: C++ example for hadoop-2.2.0 From: Andre Kelpe To: user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org I reported the 32bit/64bit problem a few weeks ago. There hasn't been much activity around it though: https://issues.apache.org/jira/browse/HADOOP-9911 - Andr=E9 On Mon, Nov 4, 2013 at 2:20 PM, Salman Toor wrote: > Hi, > > Ok so 2.x is not a new version its another branch. Good to know! Actually > 32bit will be difficult as the code I got have already some dependencies = on > 64 bit. > > Otherwise I will continue with 1.x version. Can you suggest some version > with 1.x series which is stable and work on the cluster environment? > especially with C++ ... > > Regards.. > Salman. > > Salman Toor, PhD > salman.toor@it.uu.se > > > > On Nov 4, 2013, at 1:54 PM, Amr Shahin wrote: > > Well, the 2 series isn't exactly the "next version". It's a continuation = of > branch .2. > Also, the error message from the gcc indicates that the library you're > trying to link to isn't compatible which made me suspicious. check the > documentation to see if hadoop has 64 libraries, or otherwise compile > against the 32 ones > > > On Mon, Nov 4, 2013 at 4:51 PM, Salman Toor wrote: >> >> Hi, >> >> Thanks for your answer! >> >> But are you sure about it? Actually Hadoop version 1.2 have both 32 and = 64 >> bit libraries so I believe the the next version should have both... But = I am >> not sure just a random guess :-( >> >> Regards.. >> Salman. >> >> Salman Toor, PhD >> salman.toor@it.uu.se >> >> >> >> On Nov 4, 2013, at 1:38 PM, Amr Shahin wrote: >> >> I believe hadoop isn't compatible with 64 architecture. Try installing t= he >> 32 libraries and compile against them. >> This error (skipping incompatible >> /home/sztoor/hadoop-2.2.0/lib/native/libhadooppipes.a when searching >> -lhadooppipes) indicates so >> >> >> On Mon, Nov 4, 2013 at 2:44 PM, Salman Toor wrote= : >>> >>> Hi, >>> >>> Can someone give a pointer? >>> >>> >>> Thanks in advance. >>> >>> Regards.. >>> Salman. >>> >>> >>> Salman Toor, PhD >>> salman.toor@it.uu.se >>> >>> >>> >>> On Nov 3, 2013, at 11:31 PM, Salman Toor wrote: >>> >>> Hi, >>> >>> I am quite new to the Hadoop world, previously was running hadoop-1.2.0 >>> stable version on my small cluster and encountered some strange problem= s >>> like the local path to the mapper file didn't copy to the hdfs .... It >>> works fine on the single node setup but on multiple node simple word-co= unt >>> python example didn't work... I read on the blog that it might be the >>> problem in the version I am using. So I thought to change the version a= nd >>> downloaded the Hadoop 2.2.0. This version has yarn together with many n= ew >>> features that I hope I will learn in the future. Now simple wordcount >>> example works without any problem on the multi-node setup. I am using s= imple >>> python example. >>> >>> Now I would like to compile my C++ code. Since the directory structure >>> together with other things have been changed. I have started to get the >>> following error: >>> >>> ---------------- >>> /urs/bin/ld: skipping incompatible >>> /home/sztoor/hadoop-2.2.0/lib/native/libhadooputils.a when searching >>> -lhadooputils >>> cannot find -lhadooputils >>> >>> /urs/bin/ld: skipping incompatible >>> /home/sztoor/hadoop-2.2.0/lib/native/libhadooppipes.a when searching >>> -lhadooppipes >>> cannot find -lhadooppipes >>> ------------------ >>> >>> I have managed to run the c++ example successfully with the 1.2.0 versi= on >>> on single node setup. >>> >>> I am having 64bit Ubuntu machine. previously I was using Linux-amd64-64 >>> >>> Now in new version, "lib" and "include" directories are in the >>> hadoop-2.2.0 directory. No build.xml is available... >>> >>> Can someone please give me an example of a makefile based on the versio= n >>> 2.2.0? Or suggest me which version I should go for? Or if there are som= e >>> prerequisites that I should do before compiling my code? >>> >>> Thanks in advance. >>> >>> Regards.. >>> Salman. >>> >>> >>> >>> Salman Toor, PhD >>> salman.toor@it.uu.se >>> >>> >>> >>> >> >> > > --=20 Andr=E9 Kelpe andre@concurrentinc.com http://concurrentinc.com