hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hitesh Shah <hit...@hortonworks.com>
Subject Re: Running Distributed shell in hadoop0.23
Date Wed, 14 Dec 2011 18:39:07 GMT
Assuming you have a non-secure cluster setup ( the code does not handle security properly yet
), the following command would run the ls command on 5 allocated containers.
$HADOOP_COMMON_HOME/bin/hadoop jar < path to hadoop-yarn-applications-distributedshell-0.24.0-SNAPSHOT.jar>
org.apache.hadoop.yarn.applications.distributedshell.Client --jar < path to hadoop-yarn-applications-distributedshell-0.24.0-SNAPSHOT.jar>
--shell_command ls --num_containers 5 --debug 

What the above does is upload the jar that contains the AppMaster class to hdfs, submits a
new application request to launch the distributed shell app master on a container which then
in turn runs the shell command on the no. of containers specified. 

-- Hitesh

On Dec 14, 2011, at 1:06 AM, sri ram wrote:

> Hi,
>      Can anyone give the procedure about how to run Distibuted shell example in hadoop
yarn.So that i try to understand how applicatin master really works.

View raw message