Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of dsuiter@rdx.com designates
 209.85.212.175 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAORpBsiSvKSfSAboHMNQX35afEin2Y7vTZa1VaSWVBKO-4Vu=Q@mail.gmail.com>
References: <52683CC5.2020408@oracle.com>
	<CADPcvQ4O+mM1b7w+MoSOHUe3-3Ckk1bONd_mmrtn7cSv1VvDQA@mail.gmail.com>
	<CAORpBsiSvKSfSAboHMNQX35afEin2Y7vTZa1VaSWVBKO-4Vu=Q@mail.gmail.com>
Date: Thu, 24 Oct 2013 09:20:01 -0400
Message-ID: 
 <CAE_UNJWeez0Sj4JTZ=uwLdEOywc+5ScXDPZ=5vpZnv6gVC+2nw@mail.gmail.com>
Subject: Re: Documentation on installing Hadoop 2.2.0 on Microsoft Windows
From: DSuiter RDX <dsuiter@rdx.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a11c288a2b63d4e04e97c7d09

--001a11c288a2b63d4e04e97c7d09
Content-Type: text/plain; charset=ISO-8859-1

It was my understanding that HortonWorks depended on CygWin (UNIX emulation
on Windows) for most of the "Bigtop" family of tools - Hadoop core,
MapReduce, etc. - so, you will probably make all your configuration files
in Windows, since XML is agnostic, and can develop in Windows, since JARs
and other Java constructs are agnostic by design, but when things are
actually happening on your cluster, CygWin is in the middle. For a
framework like Hadoop, I question the wisdom of deciding to use a host
environment that uses more memory to begin with, then adding an emulation
layer that complicates things and takes still more memory (since most
Hadoop constraints are memory-based) simply for the convenience of being
able to use my mouse.

If you have a competent *NIX admin, you may consider the benefits of using
Hadoop in Linux/UNIX, and leveraging the many web-based management tools
(usually will come with a Hadoop distribution) and 3rd-party development
tools from Informatica or Pentaho (let you build MapReduce, Pig, etc jobs
in GUI) rather than going the Windows route - not only are you using
hardware resources better, you also don't need to worry about licensing,
and you won't need to reboot your cluster every Patch Tuesday. :-)

Thanks!

*Devin Suiter*
Jr. Data Solutions Software Engineer
100 Sandusky Street | 2nd Floor | Pittsburgh, PA 15212
Google Voice: 412-256-8556 | www.rdx.com


On Thu, Oct 24, 2013 at 8:49 AM, Nitin Pawar <nitinpawar432@gmail.com>wrote:

> Disclosure: I do not work for Hortonworks, I just use their product.
> please do not bash me up
> Angelo,
> thats not entirely correct now.
>
> Hortonworks has done tremendous amount of work to port hadoop to windows
> os as well.
> Here is there press release:
> http://hortonworks.com/about-us/news/hadoop-on-windows/
>
> Chris,
> I do remember seeing hadoop 2.x for windows (
> http://hortonworks.com/blog/announcing-beta-release-of-apache-hadoop-2/)
> I never tried it myself it on windows but you can reach out to their
> support forum and I am sure someone will be happy to help .
>
>
>
>
> On Thu, Oct 24, 2013 at 6:08 PM, Angelo Matarazzo <
> matarazzoangelo@gmail.com> wrote:
>
>> Hi,
>> I think that it is not useful trying to install hadoop on Windows because
>> hadoop is very integrated in Linux and there is no support for Windows
>>
>>
>> 2013/10/23 chris bidwell <chris.bidwell@oracle.com>
>>
>>> Is there any documentation or instructions on installing Hadoop 2.2.0 on
>>> Microsoft Windows?
>>> Thank you.
>>>
>>> -Chris
>>>
>>>
>>
>
>
> --
> Nitin Pawar
>

--001a11c288a2b63d4e04e97c7d09
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">It was my understanding that HortonWorks depended on CygWi=
n (UNIX emulation on Windows) for most of the &quot;Bigtop&quot; family of =
tools - Hadoop core, MapReduce, etc. - so, you will probably make all your =
configuration files in Windows, since XML is agnostic, and can develop in W=
indows, since JARs and other Java constructs are agnostic by design, but wh=
en things are actually happening on your cluster, CygWin is in the middle. =
For a framework like Hadoop, I question the wisdom of deciding to use a hos=
t environment that uses more memory to begin with, then adding an emulation=
 layer that complicates things and takes still more memory (since most Hado=
op constraints are memory-based) simply for the convenience of being able t=
o use my mouse.<div>
<br></div><div>If you have a competent *NIX admin, you may consider the ben=
efits of using Hadoop in Linux/UNIX, and leveraging the many web-based mana=
gement tools (usually will come with a Hadoop distribution) and 3rd-party d=
evelopment tools from Informatica or Pentaho (let you build MapReduce, Pig,=
 etc jobs in GUI) rather than going the Windows route - not only are you us=
ing hardware resources better, you also don&#39;t need to worry about licen=
sing, and you won&#39;t need to reboot your cluster every Patch Tuesday. :-=
)</div>
<div><br></div><div>Thanks!</div></div><div class=3D"gmail_extra"><br clear=
=3D"all"><div><div dir=3D"ltr"><b>Devin Suiter</b><div><div>Jr. Data Soluti=
ons Software Engineer</div><div><div><img src=3D"http://i76.servimg.com/u/f=
76/12/40/55/53/untitl10.png"></div>
<div>100 Sandusky Street | 2nd Floor | Pittsburgh, PA 15212<br>Google Voice=
: 412-256-8556 |=A0<a href=3D"http://www.rdx.com/" target=3D"_blank">www.rd=
x.com</a></div></div></div></div></div>
<br><br><div class=3D"gmail_quote">On Thu, Oct 24, 2013 at 8:49 AM, Nitin P=
awar <span dir=3D"ltr">&lt;<a href=3D"mailto:nitinpawar432@gmail.com" targe=
t=3D"_blank">nitinpawar432@gmail.com</a>&gt;</span> wrote:<br><blockquote c=
lass=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;=
padding-left:1ex">
<div dir=3D"ltr"><div>Disclosure: I do not work for Hortonworks, I just use=
 their product. please do not bash me up=A0</div>Angelo,=A0<div>thats not e=
ntirely correct now.=A0</div><div><br></div><div>Hortonworks has done treme=
ndous amount of work to port hadoop to windows os as well.=A0</div>

<div>Here is there press release:=A0<a href=3D"http://hortonworks.com/about=
-us/news/hadoop-on-windows/" target=3D"_blank">http://hortonworks.com/about=
-us/news/hadoop-on-windows/</a></div><div><br></div><div>Chris,=A0</div><di=
v>I do remember seeing hadoop 2.x for windows (<a href=3D"http://hortonwork=
s.com/blog/announcing-beta-release-of-apache-hadoop-2/" target=3D"_blank">h=
ttp://hortonworks.com/blog/announcing-beta-release-of-apache-hadoop-2/</a>)=
=A0</div>

<div>I never tried it myself it on windows but you can reach out to their s=
upport forum and I am sure someone will be happy to help .=A0</div><div><br=
></div><div><br></div></div><div class=3D"gmail_extra"><br><br><div class=
=3D"gmail_quote">

On Thu, Oct 24, 2013 at 6:08 PM, Angelo Matarazzo <span dir=3D"ltr">&lt;<a =
href=3D"mailto:matarazzoangelo@gmail.com" target=3D"_blank">matarazzoangelo=
@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" style=
=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">

<div dir=3D"ltr">Hi,<div>I think that it is not useful trying to install ha=
doop on Windows because hadoop is very integrated in Linux and there is no =
support for Windows</div></div><div><div><div class=3D"gmail_extra">
<br><br><div class=3D"gmail_quote">
2013/10/23 chris bidwell <span dir=3D"ltr">&lt;<a href=3D"mailto:chris.bidw=
ell@oracle.com" target=3D"_blank">chris.bidwell@oracle.com</a>&gt;</span><b=
r><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:=
1px #ccc solid;padding-left:1ex">


Is there any documentation or instructions on installing Hadoop 2.2.0 on Mi=
crosoft Windows?<br>
Thank you.<span><font color=3D"#888888"><br>
<br>
-Chris<br>
<br>
</font></span></blockquote></div><br></div><span class=3D"HOEnZb"><font col=
or=3D"#888888">
</font></span></div></div></blockquote></div><span class=3D"HOEnZb"><font c=
olor=3D"#888888"><br><br clear=3D"all"><div><br></div>-- <br>Nitin Pawar<br=
>
</font></span></div>
</blockquote></div><br></div>

--001a11c288a2b63d4e04e97c7d09--