Return-Path: X-Original-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 925439FE4 for ; Mon, 12 Mar 2012 13:23:04 +0000 (UTC) Received: (qmail 18918 invoked by uid 500); 12 Mar 2012 13:23:04 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 18842 invoked by uid 500); 12 Mar 2012 13:23:04 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-issues@hadoop.apache.org Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 18566 invoked by uid 99); 12 Mar 2012 13:23:03 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 12 Mar 2012 13:23:03 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 12 Mar 2012 13:23:01 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 0D17D1CBFD for ; Mon, 12 Mar 2012 13:22:40 +0000 (UTC) Date: Mon, 12 Mar 2012 13:22:40 +0000 (UTC) From: "Steve Loughran (Commented) (JIRA)" To: common-issues@hadoop.apache.org Message-ID: <2041748635.2390.1331558560080.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <2100502807.44289.1329353940499.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HADOOP-8079) Proposal for enhancements to Hadoop for Windows Server and Windows Azure development and runtime environments MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13227506#comment-13227506 ] Steve Loughran commented on HADOOP-8079: ---------------------------------------- Another nice feature would be for Win32/64 versions of the native libraries to be available alongside the Hadoop releases (and an OS/X version too). Integrating this into the main release process would be tricky, but a Windows VM with optimising 32 and 64 bit compilers could be used to do a simultaneous release > Proposal for enhancements to Hadoop for Windows Server and Windows Azure development and runtime environments > ------------------------------------------------------------------------------------------------------------- > > Key: HADOOP-8079 > URL: https://issues.apache.org/jira/browse/HADOOP-8079 > Project: Hadoop Common > Issue Type: Improvement > Components: native > Affects Versions: 1.0.0 > Reporter: Alexander Stojanovic > Labels: hadoop > Attachments: azurenative.zip, general-utils-windows.patch, hadoop-8079.AzureBlobStore.patch, hadoop-8079.patch, hadoopcmdscripts.zip, mapred-tasks.patch, microsoft-windowsazure-api-0.1.2.jar, security.patch, windows-cmd-scripts.patch > > Original Estimate: 2,016h > Remaining Estimate: 2,016h > > This JIRA is intended to capture discussion around proposed work to enhance Apache Hadoop to run well on Windows. Apache Hadoop has worked on Microsoft Windows since its inception, but Windows support has never been a priority. Currently Windows works as a development and testing platform for Hadoop, but Hadoop is not natively integrated, full-featured or performance and scalability tuned for Windows Server or Windows Azure. We would like to change this and engage in a dialog with the broader community on the architectural design points for making Windows (enterprise and cloud) an excellent runtime and deployment environment for Hadoop. > > The Isotope team at Microsoft (names below) has developed an Apache Hadoop 1.0 patch set that addresses these performance, integration and feature gaps, allowing Apache Hadoop to be used with Azure and Windows Server without recourse to virtualization technologies such as Cygwin. We have significant interest in the deployment of Hadoop across many multi-tenant, PaaS and IaaS environments - which bring their own unique requirements. > Microsoft has recently completed a CCLA with Apache and would like to contribute these enhancements back to the Apache Hadoop community. > In the interest of improving Apache Hadoop so that it runs more smoothly on all platforms, including Windows, we propose first contributing this work to the Apache community by attaching it to this JIRA. From there we would like to work with the community to refine the patch set until it is ready to be merged into the Apache trunk. > Your feedback solicited, > > Alexander Stojanovic > Min Wei > David Lao > Lengning Liu > David Zhang > Asad Khan -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira