hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From raghavendhra rahul <raghavendhrara...@gmail.com>
Subject Re: Running Distributed shell in hadoop0.23
Date Thu, 15 Dec 2011 04:35:45 GMT
I get the following erroer by the given command to run distributed shell
hadoop1@master:~/hadoop/bin$ ./hadoop jar
../modules/hadoop-yarn-applications-distributedshell-0.23.0.jar
org.apache.hadoop.yarn.applications.distributedshell.Client --jar
../modules/hadoop-yarn-applications-distributedshell-0.23.0.jar
--shell_command ls --num_containers 5 --debug
2011-12-15 10:04:41,605 FATAL distributedshell.Client
(Client.java:main(190)) - Error running CLient
java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/ipc/YarnRPC
    at
org.apache.hadoop.yarn.applications.distributedshell.Client.<init>(Client.java:206)
    at
org.apache.hadoop.yarn.applications.distributedshell.Client.main(Client.java:182)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:616)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.yarn.ipc.YarnRPC
    at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
    ... 7 more


On Thu, Dec 15, 2011 at 12:09 AM, Hitesh Shah <hitesh@hortonworks.com>wrote:

> Assuming you have a non-secure cluster setup ( the code does not handle
> security properly yet ), the following command would run the ls command on
> 5 allocated containers.
>
> $HADOOP_COMMON_HOME/bin/hadoop jar < path to
> hadoop-yarn-applications-distributedshell-0.24.0-SNAPSHOT.jar>
> org.apache.hadoop.yarn.applications.distributedshell.Client --jar < path to
> hadoop-yarn-applications-distributedshell-0.24.0-SNAPSHOT.jar>
> --shell_command ls --num_containers 5 --debug
>
> What the above does is upload the jar that contains the AppMaster class to
> hdfs, submits a new application request to launch the distributed shell app
> master on a container which then in turn runs the shell command on the no.
> of containers specified.
>
> -- Hitesh
>
> On Dec 14, 2011, at 1:06 AM, sri ram wrote:
>
> > Hi,
> >      Can anyone give the procedure about how to run Distibuted shell
> example in hadoop yarn.So that i try to understand how applicatin master
> really works.
>
>

Mime
View raw message