Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-dev@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of tucu@cloudera.com designates
 209.85.212.48 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <FCA91A92EE52B041906A0358FC28FCC38F36E13804@FRE1EXCH02.hq.exar.com>
References: 
 <1083030537.25311.1319733752643.JavaMail.tomcat@hel.zones.apache.org>
 <1319871149.35904.YahooMailNeo@web83007.mail.mud.yahoo.com>
 <1320085483.38174.YahooMailNeo@web83006.mail.mud.yahoo.com>
 <CAJs-t7NnejC3KZMzzhO1mFa2pFw+=jvxHLAY1kdBScUq2JmQdg@mail.gmail.com>
 <FCA91A92EE52B041906A0358FC28FCC38F36E13802@FRE1EXCH02.hq.exar.com>
 <FCA91A92EE52B041906A0358FC28FCC38F36E13803@FRE1EXCH02.hq.exar.com>
 <CAJs-t7Nig7d9OkCwGbP2SNEx9=gfD74H9ynZTd=S91A2FL3rcA@mail.gmail.com>
 <FCA91A92EE52B041906A0358FC28FCC38F36E13804@FRE1EXCH02.hq.exar.com>
From: Alejandro Abdelnur <tucu@cloudera.com>
Date: Mon, 31 Oct 2011 16:39:01 -0700
Message-ID: 
 <CAJs-t7OfVPCi8swAemDKq3DDPPH+GqUuVVFspeAAfog2T8-L2w@mail.gmail.com>
Subject: Re: Example mvn cmd line to build snappy native lib?
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=20cf3071c6943cf62e04b0a0c020

--20cf3071c6943cf62e04b0a0c020
Content-Type: text/plain; charset=ISO-8859-1

correct

On Mon, Oct 31, 2011 at 4:33 PM, Tim Broberg <Tim.Broberg@exar.com> wrote:

> Download from google code?
>
> ________________________________________
> From: Alejandro Abdelnur [tucu@cloudera.com]
> Sent: Monday, October 31, 2011 3:34 PM
> To: common-dev@hadoop.apache.org
> Subject: Re: Example mvn cmd line to build snappy native lib?
>
> You still need to download//build/install snappy. I asume you are doing
> that.
>
> Yes, Hadoop snappy JNI goes in the libhadoop OS
>
> Thanks.
>
> Alejandro
>
> On Mon, Oct 31, 2011 at 2:56 PM, Tim Broberg <Tim.Broberg@exar.com> wrote:
>
> > Solved - In trunk, the snappy symbols are getting linked in with the rest
> > of the native stuff in libhadoop.so:
> >
> > [tbroberg@san-mothra trunk]$ nm -gC
> >
> hadoop-common-project/hadoop-common/target/hadoop-common-0.24.0-SNAPSHOT/lib/libhadoop.so
> > | grep -i snappy
> > 0000000000003c20 T
> >
> Java_org_apache_hadoop_io_compress_snappy_SnappyCompressor_compressBytesDirect
> > 00000000000039e0 T
> > Java_org_apache_hadoop_io_compress_snappy_SnappyCompressor_initIDs
> > 0000000000004200 T
> >
> Java_org_apache_hadoop_io_compress_snappy_SnappyDecompressor_decompressBytesDirect
> > 0000000000003fc0 T
> > Java_org_apache_hadoop_io_compress_snappy_SnappyDecompressor_initIDs
> >
> > So, this command line is sufficient:
> >
> > mvn install -Pdist,native -DskipTests
> >
> > Thanks again for answering, Alejandro.
> >
> >    - Tim.
> >
> > ________________________________________
> > From: Tim Broberg [Tim.Broberg@exar.com]
> > Sent: Monday, October 31, 2011 12:59 PM
> > To: common-dev@hadoop.apache.org
> > Subject: RE: Example mvn cmd line to build snappy native lib?
> >
> > Thanks, Alejandro, but perhaps this is the procedure for a previous
> > version?
> >
> > SVN trunk provides source in
> >
> trunk/hadoop-common-project/hadoop-common/target/native/src/org/apache/hadoop/io/compress/snappy,
> > but there is no config script or makefile.
> >
> > There is a fragment of documentation in trunk/BUILDING.txt - "  * Use
> > -Dsnappy.prefix=(/usr/local) & -Dbundle.snappy=(false) to compile
> >    Snappy JNI bindings and to bundle Snappy SO files" which suggests that
> > this is maven-able, and compilation / packaging succeed, but there is no
> > libsnappy.so at the end of the process.
> >
> > I'd really like not to switch to a different branch of the code yet
> again,
> > and surely *somebody* knows how to build snappy in the trunk...
> >
> >    - Tim.
> >
> > ________________________________________
> > From: Alejandro Abdelnur [tucu@cloudera.com]
> > Sent: Monday, October 31, 2011 12:45 PM
> > To: common-dev@hadoop.apache.org; Tim Broberg
> > Subject: Re: Example mvn cmd line to build snappy native lib?
> >
> > Tim,
> >
> >  You have to download it snappy from source tarball, run './configure'
> and
> > then 'make install'
> >
> > Thanks.
> >
> > Alejandro
> >
> > On Mon, Oct 31, 2011 at 11:24 AM, Tim Broberg <tbroberg@yahoo.com>
> wrote:
> >
> > > bump
> > >
> > > Does anybody know how to build the snappy native library?
> > >
> > >     - Tim.
> > >
> > >
> > > ________________________________
> > > From: Tim Broberg <tbroberg@yahoo.com>
> > > To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
> > > Sent: Friday, October 28, 2011 11:52 PM
> > > Subject: Example mvn cmd line to build snappy native lib?
> > >
> > > I'm trying to build the trunk from hadoop SVN including all the native
> > > libraries.
> > >
> > > The BUILDING.txt file has the following documentation on building the
> > > native libraries:
> > >
> > > "
> > >  Build options:
> > >
> > >   * Use -Pnative to compile/bundle native code
> > >   * Use -Dsnappy.prefix=(/usr/local) & -Dbundle.snappy=(false) to
> compile
> > >     Snappy JNI bindings and to bundle Snappy SO files
> > > "
> > >
> > > I tried the following, but never seem to get a libsnappy.so anywhere:
> > >
> > > mvn compile -Pnative
> > > mvn compile -Pnative -Dsnappy.prefix=/usr/local
> > >
> > > mvn compile -Pnative -Dsnappy.prefix=/usr/local -Dbundle.snappy=true
> > >
> > > mvn compile -Pnative -Dsnappy.prefix=/usr/local -Dbundle.snappy=false
> > >
> > > mvn compile -Pnative -Dsnappy.prefix=~tbroberg -Dbundle.snappy=true
> > >
> > >
> > > If I stick a #error statement in SnappyCompressor.c, I do see the first
> > of
> > > these fail, so it's doing *something* with snappy.
> > >
> > > Can anyone provide an example command line to build this?
> > >
> > > Thanks,
> > >     - Tim.
> >
> > The information and any attached documents contained in this message
> > may be confidential and/or legally privileged.  The message is
> > intended solely for the addressee(s).  If you are not the intended
> > recipient, you are hereby notified that any use, dissemination, or
> > reproduction is strictly prohibited and may be unlawful.  If you are
> > not the intended recipient, please contact the sender immediately by
> > return e-mail and destroy all copies of the original message.
> >
> > ________________________________
> > The information and any attached documents contained in this message
> > may be confidential and/or legally privileged. The message is
> > intended solely for the addressee(s). If you are not the intended
> > recipient, you are hereby notified that any use, dissemination, or
> > reproduction is strictly prohibited and may be unlawful. If you are
> > not the intended recipient, please contact the sender immediately by
> > return e-mail and destroy all copies of the original message.
> >
>
> The information and any attached documents contained in this message
> may be confidential and/or legally privileged.  The message is
> intended solely for the addressee(s).  If you are not the intended
> recipient, you are hereby notified that any use, dissemination, or
> reproduction is strictly prohibited and may be unlawful.  If you are
> not the intended recipient, please contact the sender immediately by
> return e-mail and destroy all copies of the original message.
>

--20cf3071c6943cf62e04b0a0c020--