hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From DSuiter RDX <dsui...@rdx.com>
Subject Re: Documentation on installing Hadoop 2.2.0 on Microsoft Windows
Date Thu, 24 Oct 2013 13:20:01 GMT
It was my understanding that HortonWorks depended on CygWin (UNIX emulation
on Windows) for most of the "Bigtop" family of tools - Hadoop core,
MapReduce, etc. - so, you will probably make all your configuration files
in Windows, since XML is agnostic, and can develop in Windows, since JARs
and other Java constructs are agnostic by design, but when things are
actually happening on your cluster, CygWin is in the middle. For a
framework like Hadoop, I question the wisdom of deciding to use a host
environment that uses more memory to begin with, then adding an emulation
layer that complicates things and takes still more memory (since most
Hadoop constraints are memory-based) simply for the convenience of being
able to use my mouse.

If you have a competent *NIX admin, you may consider the benefits of using
Hadoop in Linux/UNIX, and leveraging the many web-based management tools
(usually will come with a Hadoop distribution) and 3rd-party development
tools from Informatica or Pentaho (let you build MapReduce, Pig, etc jobs
in GUI) rather than going the Windows route - not only are you using
hardware resources better, you also don't need to worry about licensing,
and you won't need to reboot your cluster every Patch Tuesday. :-)


*Devin Suiter*
Jr. Data Solutions Software Engineer
100 Sandusky Street | 2nd Floor | Pittsburgh, PA 15212
Google Voice: 412-256-8556 | www.rdx.com

On Thu, Oct 24, 2013 at 8:49 AM, Nitin Pawar <nitinpawar432@gmail.com>wrote:

> Disclosure: I do not work for Hortonworks, I just use their product.
> please do not bash me up
> Angelo,
> thats not entirely correct now.
> Hortonworks has done tremendous amount of work to port hadoop to windows
> os as well.
> Here is there press release:
> http://hortonworks.com/about-us/news/hadoop-on-windows/
> Chris,
> I do remember seeing hadoop 2.x for windows (
> http://hortonworks.com/blog/announcing-beta-release-of-apache-hadoop-2/)
> I never tried it myself it on windows but you can reach out to their
> support forum and I am sure someone will be happy to help .
> On Thu, Oct 24, 2013 at 6:08 PM, Angelo Matarazzo <
> matarazzoangelo@gmail.com> wrote:
>> Hi,
>> I think that it is not useful trying to install hadoop on Windows because
>> hadoop is very integrated in Linux and there is no support for Windows
>> 2013/10/23 chris bidwell <chris.bidwell@oracle.com>
>>> Is there any documentation or instructions on installing Hadoop 2.2.0 on
>>> Microsoft Windows?
>>> Thank you.
>>> -Chris
> --
> Nitin Pawar

View raw message