hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanjay Radia (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-8079) Proposal for enhancements to Hadoop for Windows Server and Windows Azure development and runtime environments
Date Thu, 01 Mar 2012 23:44:59 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220490#comment-13220490
] 

Sanjay Radia commented on HADOOP-8079:
--------------------------------------

While what you are suggesting helps, the code changes to 
{code}
 command( WINDOWS ? foo-windows : foo-bash)
{code}

Many (but not all) commands are inside Shell.java and fairly isolated from rest of code. An
example is 
{code}
  public static String[] getGroupsForUserCommand(final String user) {
    //'groups username' command return is non-consistent across different unixes
    return (WINDOWS)? new String[] {"cmd", "/c", "id -Gn " + user}:
        new String [] {"bash", "-c", "id -Gn " + user};
  }
{code}
                
> Proposal for enhancements to Hadoop for Windows Server and Windows Azure development
and runtime environments
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-8079
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8079
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: native
>    Affects Versions: 1.0.0
>            Reporter: Alexander Stojanovic
>              Labels: hadoop
>         Attachments: azurenative.zip, general-utils-windows.patch, hadoop-8079.AzureBlobStore.patch,
hadoop-8079.patch, hadoopcmdscripts.zip, mapred-tasks.patch, microsoft-windowsazure-api-0.1.2.jar,
security.patch, windows-cmd-scripts.patch
>
>   Original Estimate: 2,016h
>  Remaining Estimate: 2,016h
>
> This JIRA is intended to capture discussion around proposed work to enhance Apache Hadoop
to run well on Windows.  Apache Hadoop has worked on Microsoft Windows since its inception,
but Windows support has never been a priority. Currently Windows works as a development and
testing platform for Hadoop, but Hadoop is not natively integrated, full-featured or performance
and scalability tuned for Windows Server or Windows Azure.  We would like to change this and
engage in a dialog with the broader community on the architectural design points for making
Windows (enterprise and cloud) an excellent runtime and deployment environment for Hadoop.
 
>  
> The Isotope team at Microsoft (names below) has developed an Apache Hadoop 1.0 patch
set that addresses these performance, integration and feature gaps, allowing Apache Hadoop
to be used with Azure and Windows Server without recourse to virtualization technologies such
as Cygwin. We have significant interest in the deployment of Hadoop across many multi-tenant,
PaaS and IaaS environments - which bring their own unique requirements. 
> Microsoft has recently completed a CCLA with Apache and would like to contribute these
enhancements back to the Apache Hadoop community.
> In the interest of improving Apache Hadoop so that it runs more smoothly on all platforms,
including Windows, we propose first contributing this work to the Apache community by attaching
it to this JIRA.  From there we would like to work with the community to refine the patch
set until it is ready to be merged into the Apache trunk.
> Your feedback solicited,
>  
> Alexander Stojanovic
> Min Wei
> David Lao
> Lengning Liu
> David Zhang
> Asad Khan

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message