Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of
 gregor.willemsen@googlemail.com designates 209.85.212.48 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=googlemail.com; s=gamma;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :content-type:content-transfer-encoding;
        b=uASp7sA9v/gFQREtjfCWcRxXwh3/tJyZTNu6audYqcwIyL5VP40AAjcHdS+DKvJCJj
         KW1rv1f5s2ux951qzXWXicJKsA3zcwxnV69MAesETRHGbPzed6fVBlY5I6FU5Yhyapp/
         EAqgvZU9mW0XufLw7pZVsZg9ltO5TU9obWz0c=
MIME-Version: 1.0
In-Reply-To: <02C815DD-651C-46C5-B20E-C4B2847C3703@linkedin.com>
References: <AANLkTim2+AuiiG0zKMnwJzBK67gMcwOLec3qA_aUoyp_@mail.gmail.com>
 <02C815DD-651C-46C5-B20E-C4B2847C3703@linkedin.com>
From: Gregor Willemsen <gregor.willemsen@googlemail.com>
Date: Sun, 17 Oct 2010 12:18:33 +0200
Message-ID: <AANLkTi=kOsFRUTuF=kNvTjMvZZhS=0fpisVLJeot4_gC@mail.gmail.com>
Subject: Re: Hadoop - Solaris
To: common-user@hadoop.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

I have no recent experiences with Solaris nor with Hadoop on Solaris,
but there is an blog: http://blogs.sun.com/george/category/Hadoop with
three postings dedicated to Hadoop (although maybe a bit outdated). In
2007 or 2008 GNU and Solaris did not play together very well as things
as tar, gcc are concerned. But these issues should have gone now.

Sun Grid Engine might be a starting point to look for as Hadoop is built in=
.


2010/10/16 Allen Wittenauer <awittenauer@linkedin.com>:
>
> On Oct 16, 2010, at 1:08 PM, Bruce Williams wrote:
>> I am doing a student Independent Study =C2=A0Project and Harvery Mudd ha=
s given
>> me 13 Sun Netra X1 I can use as a dedicated Hadoop cluster. Right now th=
ey
>> are without an OS.
>>
>> If anyone with experience with Hadoop and Solaris can contact me off lis=
t,
>> even to just say I am doing it and it is OK it would be appreciated.
>
>
>
> =C2=A0 =C2=A0 =C2=A0 =C2=A0That's my cue! :)
>
> =C2=A0 =C2=A0 =C2=A0 =C2=A0We have a few grids that are running Solaris. =
It mostly works out of the box as long as you are aware of three things:
>
> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0- There are some s=
ettings in hadoop-env.sh and in the path that need to be dealt with. =C2=A0=
Rather than re-quote, these were added to the Hadoop FAQ a week or two ago =
so definitely take a look at that.
>
> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0- The native compr=
ession libraries will need to be compiled. =C2=A0Depending upon what you ar=
e doing/how performant the machines are, this may or may not make a big dif=
ference. =C2=A0Compiling under Solaris with gcc will work fine (but it is g=
cc... ugh!). =C2=A0Only a few minor changes are required to compile it with=
 SUNWspro. =C2=A0[I have patches laying around here somewhere if anyone wan=
ts to play with them.]
>
> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0- The Solaris JRE =
is a mixed-mode implementation. =C2=A0So keep in mind that -d32 and -d64 ha=
ve meaning and do work as advertised. =C2=A0You'll likely want to pick a bi=
tsize and use that for all your Hadoop daemons and tasks, especially if you=
 plan on using any JNI like the compression libraries.