hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Allen Wittenauer <awittena...@linkedin.com>
Subject Re: Native libraries on Mac
Date Thu, 11 Mar 2010 18:29:15 GMT


There is a bug with the bitness detection in general (it breaks horribly on
Solaris due to the java executable supporting both). I've started working on
a general patch (it a] asks Java what bitness it is and b] asks java which
JVM lib to link against), but got sidetracked by switching our scheduler
over from fair share to capacity.

I wouldn't be surprised if the issue you are seeing doesn't have the same
root cause.

On 3/11/10 10:11 AM, "Christopher Tubbs" <ctubbsii@gmail.com> wrote:

> Well, I finally figured it out.
> Apparently, the library being generated WAS i386 and not x86_64.
> So, you have to set CFLAGS="-arch x86_64" prior to running "ant
> compile-native"
> Think we can get patches into 0.20.3 to fix building on a Mac?
> Also, it would be nice if ivy could be preconfigured for grabbing
> dependencies from the lib directory of the tarball, instead of
> requiring them to be redownloaded.
> Please and thanks.
> On Tue, Mar 9, 2010 at 11:45 PM, Christopher Tubbs <ctubbsii@gmail.com> wrote:
>> I'm trying to build the native libraries for hadoop on Mac OS X
>> Leopard (10.5.8) for Hadoop 0.20.1
>> I tried the "ant compile-native" method, but I don't have access to
>> the internet. I do have a local repository though with all the
>> dependencies (not to mention they are in the $HADOOP_HOME/lib). I was
>> able to edit the build.xml file to point the repository to my local
>> one so I could download ivy, but now ivy can't find the dependencies,
>> and I can't figure out how to point ivy to my maven repository.
>> Since the first method didn't work, I tried applying the patch in
>> HADOOP-3659 (has that been included in 0.20.2?), and got things
>> working with a little messing with aclocal and friends, but when I run
>> make, I get a ZLibCompressor.lo, missing argument for "-m" error in
>> the build output before it quits.
>> Any help on building the native libs by either method would be greatly
>> appreciated (preferably the second method, as ivy seems way too
>> complicated and frustrating to deal with just for this little issue...
>> unless it's something simple).
>> Christopher

View raw message