hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Azuryy Yu <azury...@gmail.com>
Subject Re: Hadoop-2.x native libraries
Date Tue, 26 Mar 2013 04:40:27 GMT
Its too complicated. because Hadoopv2 is wire compatable, so MRv1 should
keep old RPC protocol, you can compile only common and HDFS firstly from
hadoopv2, then add to MRv1 classpath, fix the issues for uncompatables.
On Mar 25, 2013 10:26 PM, "Mounir E. Bsaibes" <mb@linux.vnet.ibm.com> wrote:

> Hi Azurry,
> Do you have detail steps what did you do to make MRV1 work with HDFS2?
> Thanks,
> Mounir
> On Mon, 2013-03-25 at 13:39 +0800, Azuryy Yu wrote:
> > Thanks Harsh!
> > I used -Pnative got it.
> > I am compile src code. I made MRv1 work with HDFSv2 successfully.
> >
> >
> > On Mar 25, 2013 12:56 PM, "Harsh J" <harsh@cloudera.com> wrote:
> >         If you're using a tarball, you'll need to build a native-added
> >         tarball
> >         yourself with "mvn package -Pdist,native,docs -DskipTests
> >         -Dtar" and
> >         then use that.
> >
> >         Alternatively, if you're interested in packages, use the
> >         Apache
> >         Bigtop's scripts from http://bigtop.apache.org/ project's
> >         repository
> >         and generate the packages with native libs as well.
> >
> >         On Mon, Mar 25, 2013 at 9:27 AM, Azuryy Yu
> >         <azuryyyu@gmail.com> wrote:
> >         > Hi,
> >         > How to get hadoop-2.0.3-alpha native libraries, it was
> >         compiled under 32bits
> >         > OS in the released package currently.
> >         >
> >         >
> >
> >
> >
> >         --
> >         Harsh J
>
>
>

Mime
View raw message