hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Christopher Tubbs <ctubb...@gmail.com>
Subject Re: Native libraries on Mac
Date Thu, 11 Mar 2010 19:04:03 GMT
For now, I think it would be sufficient to apply HADOOP-3659 and
document the rest.
Later, the build.xml can be patched to set the environment correctly.
I'm not familiar with ivy to determine how to point to the local lib
directory, but I'm sure somebody savvy with ivy could do it
easily....or allow it to read ~/.m2/settings.xml to find the servers.

On Thu, Mar 11, 2010 at 1:29 PM, Allen Wittenauer
<awittenauer@linkedin.com> wrote:
> *nods*
> There is a bug with the bitness detection in general (it breaks horribly on
> Solaris due to the java executable supporting both). I've started working on
> a general patch (it a] asks Java what bitness it is and b] asks java which
> JVM lib to link against), but got sidetracked by switching our scheduler
> over from fair share to capacity.
> I wouldn't be surprised if the issue you are seeing doesn't have the same
> root cause.
> On 3/11/10 10:11 AM, "Christopher Tubbs" <ctubbsii@gmail.com> wrote:
>> Well, I finally figured it out.
>> Apparently, the library being generated WAS i386 and not x86_64.
>> So, you have to set CFLAGS="-arch x86_64" prior to running "ant
>> compile-native"
>> Think we can get patches into 0.20.3 to fix building on a Mac?
>> Also, it would be nice if ivy could be preconfigured for grabbing
>> dependencies from the lib directory of the tarball, instead of
>> requiring them to be redownloaded.
>> Please and thanks.
>> On Tue, Mar 9, 2010 at 11:45 PM, Christopher Tubbs <ctubbsii@gmail.com> wrote:
>>> I'm trying to build the native libraries for hadoop on Mac OS X
>>> Leopard (10.5.8) for Hadoop 0.20.1
>>> I tried the "ant compile-native" method, but I don't have access to
>>> the internet. I do have a local repository though with all the
>>> dependencies (not to mention they are in the $HADOOP_HOME/lib). I was
>>> able to edit the build.xml file to point the repository to my local
>>> one so I could download ivy, but now ivy can't find the dependencies,
>>> and I can't figure out how to point ivy to my maven repository.
>>> Since the first method didn't work, I tried applying the patch in
>>> HADOOP-3659 (has that been included in 0.20.2?), and got things
>>> working with a little messing with aclocal and friends, but when I run
>>> make, I get a ZLibCompressor.lo, missing argument for "-m" error in
>>> the build output before it quits.
>>> Any help on building the native libs by either method would be greatly
>>> appreciated (preferably the second method, as ivy seems way too
>>> complicated and frustrating to deal with just for this little issue...
>>> unless it's something simple).
>>> Christopher

View raw message