hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-11464) Reinstate support for launching Hadoop processes on Windows using Cygwin.
Date Wed, 07 Jan 2015 00:14:34 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-11464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Chris Nauroth updated HADOOP-11464:
    Attachment: HADOOP-11464.002.patch

bq. A question: do we care about daemons?

The use case I had in mind was end users running jobs and accessing their files through Cygwin,
so I wasn't considering the daemons in my earlier testing.  However, I see no reason not to
support launching the daemons through Cygwin too.

I tested launching NameNode, DataNode, ResourceManager and NodeManager through Cygwin.  That
revealed that my first patch wasn't sufficient for NodeManager.  It depends on the various
"*HOME" environment variables for setting up the classpath in launched containers, so I needed
to translate those individual variables too.  Also, there is a dependency that launched containers
will be able to find winutils.exe through HADOOP_HOME.  This required adding an export of
HADOOP_HOME, which is a bit unfortunate.  HADOOP-9422 tracks trying to remove this dependency
on HADOOP_HOME, but this is the current state of things.

I have uploaded patch v002 for both trunk and branch-2.

> Reinstate support for launching Hadoop processes on Windows using Cygwin.
> -------------------------------------------------------------------------
>                 Key: HADOOP-11464
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11464
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: bin
>            Reporter: Chris Nauroth
>            Assignee: Chris Nauroth
>         Attachments: HADOOP-11464-branch-2.001.patch, HADOOP-11464-branch-2.002.patch,
HADOOP-11464.001.patch, HADOOP-11464.002.patch
> The Windows compatibility work removed the dependency on Cygwin as a compatibility layer.
 However, some users may still wish to run Cygwin on a personal machine for running Hadoop
commands that interact with a cluster.  This issue proposes to reinstate support for launching
Hadoop processes on Windows using Cygwin to call the bash scripts.

This message was sent by Atlassian JIRA

View raw message