Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 404CE1079A for ; Thu, 24 Oct 2013 15:42:02 +0000 (UTC) Received: (qmail 69557 invoked by uid 500); 24 Oct 2013 15:41:55 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 69250 invoked by uid 500); 24 Oct 2013 15:41:51 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 69243 invoked by uid 99); 24 Oct 2013 15:41:50 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Oct 2013 15:41:50 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_REMOTE_IMAGE X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of matarazzoangelo@gmail.com designates 209.85.217.171 as permitted sender) Received: from [209.85.217.171] (HELO mail-lb0-f171.google.com) (209.85.217.171) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Oct 2013 15:41:45 +0000 Received: by mail-lb0-f171.google.com with SMTP id x18so2069852lbi.2 for ; Thu, 24 Oct 2013 08:41:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=nJIdZahaN09tDyttZMjuBu/BStS6PIbX0519vvMihXg=; b=fxow7cdktkTgwntvrYmCUChcir/SDGrdSHfpIxk1XGJIcIr2zJEXhefFDVFm5F8UlP ww+nZeQBuYdMFiakRJDWvayBiPy2rJ2uUd1FOfu8L5ZieNTt5a65yqpNu01SM+M3B240 hYHKusIRd0fRrlhsvOSA4F2KechNrMUaTYI0/v4h9BGkR+qxQImDZtmIbWfKtL8XyWXe 3rPNmLhNwb41oHMGLbfCiTzEssqG/xtasbA9/e5iMJaYsgh/15xU3OQdkpRBEN9y3u3c 37pPnP6wyLqtWGRcscuodZBABO5COCZql2vK2SZpas4v10XIHm5fDMfX3ksaGtVlhzaX PnBQ== MIME-Version: 1.0 X-Received: by 10.112.51.227 with SMTP id n3mr1411391lbo.54.1382629284557; Thu, 24 Oct 2013 08:41:24 -0700 (PDT) Received: by 10.114.26.197 with HTTP; Thu, 24 Oct 2013 08:41:24 -0700 (PDT) In-Reply-To: References: <52683CC5.2020408@oracle.com> Date: Thu, 24 Oct 2013 17:41:24 +0200 Message-ID: Subject: Re: Documentation on installing Hadoop 2.2.0 on Microsoft Windows From: Angelo Matarazzo To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a1133c2d25cbb8804e97e776c X-Virus-Checked: Checked by ClamAV on apache.org --001a1133c2d25cbb8804e97e776c Content-Type: text/plain; charset=ISO-8859-1 Sorry for my ignorance... I don't bash up you Nitin..Eheh. Thank you very much for your post Adam. I 'm going to see your work. 2013/10/24 DSuiter RDX > Very cool Adam! Thanks for the clarification, and great work for you guys > porting it over to native running. > > *Devin Suiter* > Jr. Data Solutions Software Engineer > 100 Sandusky Street | 2nd Floor | Pittsburgh, PA 15212 > Google Voice: 412-256-8556 | www.rdx.com > > > On Thu, Oct 24, 2013 at 9:27 AM, Adam Diaz wrote: > >> No Cygwin is involved...We have the installation via MSI clearly >> documented on our site. Python, Visual C++, JDK and .Net framework. This >> work was done in conjunction with Microsoft who is not in the business of >> supporting Cygwin. Hadoop is Java and Java runs on windows. >> >> >> On Thu, Oct 24, 2013 at 9:20 AM, DSuiter RDX wrote: >> >>> It was my understanding that HortonWorks depended on CygWin (UNIX >>> emulation on Windows) for most of the "Bigtop" family of tools - Hadoop >>> core, MapReduce, etc. - so, you will probably make all your configuration >>> files in Windows, since XML is agnostic, and can develop in Windows, since >>> JARs and other Java constructs are agnostic by design, but when things are >>> actually happening on your cluster, CygWin is in the middle. For a >>> framework like Hadoop, I question the wisdom of deciding to use a host >>> environment that uses more memory to begin with, then adding an emulation >>> layer that complicates things and takes still more memory (since most >>> Hadoop constraints are memory-based) simply for the convenience of being >>> able to use my mouse. >>> >>> If you have a competent *NIX admin, you may consider the benefits of >>> using Hadoop in Linux/UNIX, and leveraging the many web-based management >>> tools (usually will come with a Hadoop distribution) and 3rd-party >>> development tools from Informatica or Pentaho (let you build MapReduce, >>> Pig, etc jobs in GUI) rather than going the Windows route - not only are >>> you using hardware resources better, you also don't need to worry about >>> licensing, and you won't need to reboot your cluster every Patch Tuesday. >>> :-) >>> >>> Thanks! >>> >>> *Devin Suiter* >>> Jr. Data Solutions Software Engineer >>> 100 Sandusky Street | 2nd Floor | Pittsburgh, PA 15212 >>> Google Voice: 412-256-8556 | www.rdx.com >>> >>> >>> On Thu, Oct 24, 2013 at 8:49 AM, Nitin Pawar wrote: >>> >>>> Disclosure: I do not work for Hortonworks, I just use their product. >>>> please do not bash me up >>>> Angelo, >>>> thats not entirely correct now. >>>> >>>> Hortonworks has done tremendous amount of work to port hadoop to >>>> windows os as well. >>>> Here is there press release: >>>> http://hortonworks.com/about-us/news/hadoop-on-windows/ >>>> >>>> Chris, >>>> I do remember seeing hadoop 2.x for windows ( >>>> http://hortonworks.com/blog/announcing-beta-release-of-apache-hadoop-2/ >>>> ) >>>> I never tried it myself it on windows but you can reach out to their >>>> support forum and I am sure someone will be happy to help . >>>> >>>> >>>> >>>> >>>> On Thu, Oct 24, 2013 at 6:08 PM, Angelo Matarazzo < >>>> matarazzoangelo@gmail.com> wrote: >>>> >>>>> Hi, >>>>> I think that it is not useful trying to install hadoop on Windows >>>>> because hadoop is very integrated in Linux and there is no support for >>>>> Windows >>>>> >>>>> >>>>> 2013/10/23 chris bidwell >>>>> >>>>>> Is there any documentation or instructions on installing Hadoop 2.2.0 >>>>>> on Microsoft Windows? >>>>>> Thank you. >>>>>> >>>>>> -Chris >>>>>> >>>>>> >>>>> >>>> >>>> >>>> -- >>>> Nitin Pawar >>>> >>> >>> >> >> >> -- >> * Adam Diaz * * * * * Solution Engineer - Big Data >> ------------------------------ >> >> Phone: 919 609 4842 >> Email: adiaz@hortonworks.com >> Website: http://www.hortonworks.com/ >> >> * Follow Us: * >> >> >> >> >> [image: photo] >> >> Latest From Our Blog: Strong Ecosystem Support for HDP 2.0, Enabling >> the Modern Data Architecture >> >> CONFIDENTIALITY NOTICE >> NOTICE: This message is intended for the use of the individual or entity >> to which it is addressed and may contain information that is confidential, >> privileged and exempt from disclosure under applicable law. If the reader >> of this message is not the intended recipient, you are hereby notified that >> any printing, copying, dissemination, distribution, disclosure or >> forwarding of this communication is strictly prohibited. If you have >> received this communication in error, please contact the sender immediately >> and delete it from your system. Thank You. > > > --001a1133c2d25cbb8804e97e776c Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Sorry for my ignorance... I don't bash up you Nitin..E= heh. Thank you very much for your post Adam.
I 'm going to see your= work.



2013/10/24 DSuiter RDX <dsuiter@rdx.com>
Very cool Adam! Thanks for the clarification, and great wo= rk for you guys porting it over to native running.

Devin = Suiter
Jr. Data Solutions Software Engineer
100 Sandusky Street | 2nd Floor | Pittsburgh, PA = 15212
Google Voice: 412-256-8556 |=A0www.rdx.com


On Thu, Oct= 24, 2013 at 9:27 AM, Adam Diaz <adiaz@hortonworks.com> = wrote:
No Cygwin is involved...We have the installation via MSI c= learly documented on our site. Python, Visual C++, JDK and .Net framework. = This work was done in conjunction with Microsoft who is not in the business= of supporting Cygwin. Hadoop is Java and Java runs on windows.


On Thu, Oct 2= 4, 2013 at 9:20 AM, DSuiter RDX <dsuiter@rdx.com> wrote:
It was my understanding that HortonWorks depended on CygWi= n (UNIX emulation on Windows) for most of the "Bigtop" family of = tools - Hadoop core, MapReduce, etc. - so, you will probably make all your = configuration files in Windows, since XML is agnostic, and can develop in W= indows, since JARs and other Java constructs are agnostic by design, but wh= en things are actually happening on your cluster, CygWin is in the middle. = For a framework like Hadoop, I question the wisdom of deciding to use a hos= t environment that uses more memory to begin with, then adding an emulation= layer that complicates things and takes still more memory (since most Hado= op constraints are memory-based) simply for the convenience of being able t= o use my mouse.

If you have a competent *NIX admin, you may consider the ben= efits of using Hadoop in Linux/UNIX, and leveraging the many web-based mana= gement tools (usually will come with a Hadoop distribution) and 3rd-party d= evelopment tools from Informatica or Pentaho (let you build MapReduce, Pig,= etc jobs in GUI) rather than going the Windows route - not only are you us= ing hardware resources better, you also don't need to worry about licen= sing, and you won't need to reboot your cluster every Patch Tuesday. :-= )

Thanks!

Devin Suiter
Jr. Data Soluti= ons Software Engineer
100 Sandusky Street | 2nd Floor | Pittsburgh, PA 15212
Google Voice= : 412= -256-8556 |=A0www.rdx= .com


On Thu, Oct 24, 2013 at 8:49 AM, Nitin P= awar <nitinpawar432@gmail.com> wrote:
Disclosure: I do not work for Hortonworks, I just use= their product. please do not bash me up=A0
Angelo,=A0
thats not e= ntirely correct now.=A0

Hortonworks has done treme= ndous amount of work to port hadoop to windows os as well.=A0

Chris,=A0
I do remember seeing hadoop 2.x for windows (h= ttp://hortonworks.com/blog/announcing-beta-release-of-apache-hadoop-2/)= =A0
I never tried it myself it on windows but you can reach out to their s= upport forum and I am sure someone will be happy to help .=A0



On Thu, Oct 24, 2013 at 6:08 PM, Angelo Matarazzo <matarazzoangelo= @gmail.com> wrote:
Hi,
I think that it is not useful trying to install ha= doop on Windows because hadoop is very integrated in Linux and there is no = support for Windows


2013/10/23 chris bidwell <chris.bidwell@oracle.com>
Is there any documentation or instructions on installing Hadoop 2.2.0 on Mi= crosoft Windows?
Thank you.

-Chris


=


--
Nitin Pawar




--
Adam Diaz =A0 Solution Engineer - Big Data
=A0
Phone: =A0 =A0 =A0 919 609 4842
Email:=A0 =A0 =A0 = adiaz@hortonworks.com
=A0
Follow Us:

3D"photo"


CONFIDENTIALITY NOTICE
NOTICE: This message is = intended for the use of the individual or entity to which it is addressed a= nd may contain information that is confidential, privileged and exempt from= disclosure under applicable law. If the reader of this message is not the = intended recipient, you are hereby notified that any printing, copying, dis= semination, distribution, disclosure or forwarding of this communication is= strictly prohibited. If you have received this communication in error, ple= ase contact the sender immediately and delete it from your system. Thank Yo= u.

--001a1133c2d25cbb8804e97e776c--