hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matei Zaharia <ma...@eecs.berkeley.edu>
Subject Re: Can't find main class when run ResourceManager or NodeManager
Date Thu, 11 Aug 2011 23:11:41 GMT
It looks like the Avro 1.3.2 JAR was included in the tar ball built in the mapreduce project.
It's present in lib in the unzipped tarball. However, even if I remove it, the error still
happens.

Matei

On Aug 11, 2011, at 3:47 PM, Mahadev Konar wrote:

> Haoyuan,
> Thats an issue with having avro 1.3.2 jar in the classpath. Please
> see if you have that version of 1.3.2 jar in the classpath and remove
> it. We use 1.4 avro jar which isnt compatible with 1.3.2.
> 
> hope that helps!
> mahadev
> 
> On Thu, Aug 11, 2011 at 3:36 PM, Haoyuan Li <haoyuan.li@gmail.com> wrote:
>> I downloaded the latest version: r1156719. and then redid from the scratch.
>> Now, the nodemanager and run well. However, I got into the same state as
>> Matei when I tried to run ResourceManager.  Any help will be appreciated.
>> Best,
>> Haoyuan
>> The followings are output.
>> ============ The output from .out log file =================
>> Exception in thread "main" java.lang.IllegalStateException: For this
>> operation, current State must be STARTED instead of INITED
>>         at
>> org.apache.hadoop.yarn.service.AbstractService.ensureCurrentState(AbstractService.java:101)
>>         at
>> org.apache.hadoop.yarn.service.AbstractService.stop(AbstractService.java:69)
>>         at
>> org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher.stop(ApplicationMasterLauncher.java:90)
>>         at
>> org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:89)
>>         at
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.stop(ResourceManager.java:423)
>>         at
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:495)
>> =====================================================
>> =========== the output from .log log file ===================
>> 2011-08-11 15:25:38,357 INFO
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Resource
>> Manager is starting...
>> 2011-08-11 15:25:38,878 INFO org.apache.hadoop.yarn.event.AsyncDispatcher:
>> Registering class
>> org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType
>> for class
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
>> 2011-08-11 15:25:38,879 INFO org.apache.hadoop.yarn.event.AsyncDispatcher:
>> Registering class
>> org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher
>> 2011-08-11 15:25:38,880 INFO org.apache.hadoop.yarn.event.AsyncDispatcher:
>> Registering class
>> org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType
>> for class
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher
>> 2011-08-11 15:25:38,881 INFO org.apache.hadoop.yarn.event.AsyncDispatcher:
>> Registering class
>> org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for
>> class
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher
>> 2011-08-11 15:25:38,904 INFO org.apache.hadoop.yarn.event.AsyncDispatcher:
>> Registering class
>> org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType
>> for class
>> org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher
>> 2011-08-11 15:25:38,907 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:Dispatcher is inited.
>> 2011-08-11 15:25:38,907 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer
>> is inited.
>> 2011-08-11 15:25:38,935 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:AMLivelinessMonitor is inited.
>> 2011-08-11 15:25:38,936 INFO org.apache.hadoop.util.HostsFileReader:
>> Refreshing hosts (include/exclude) list
>> 2011-08-11 15:25:38,936 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:org.apache.hadoop.yarn.server.resourcemanager.NodesListManager is
>> inited.
>> 2011-08-11 15:25:38,936 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
>> is inited.
>> 2011-08-11 15:25:38,936 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:NMLivelinessMonitor is inited.
>> 2011-08-11 15:25:38,940 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService
>> is inited.
>> 2011-08-11 15:25:38,941 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService
>> is inited.
>> 2011-08-11 15:25:38,941 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:org.apache.hadoop.yarn.server.resourcemanager.ClientRMService is
>> inited.
>> 2011-08-11 15:25:38,941 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:org.apache.hadoop.yarn.server.resourcemanager.AdminService is
>> inited.
>> 2011-08-11 15:25:38,965 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher
>> is inited.
>> 2011-08-11 15:25:38,965 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:ResourceManager is inited.
>> 2011-08-11 15:25:39,057 INFO org.mortbay.log: Logging to
>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> org.mortbay.log.Slf4jLog
>> 2011-08-11 15:25:39,125 INFO org.apache.hadoop.http.HttpServer: Added global
>> filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>> 2011-08-11 15:25:39,128 INFO org.apache.hadoop.http.HttpServer: Added filter
>> static_user_filter
>> (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to
>> context WepAppsContext
>> 2011-08-11 15:25:39,128 INFO org.apache.hadoop.http.HttpServer: Added filter
>> static_user_filter
>> (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to
>> context static
>> 2011-08-11 15:25:39,128 INFO org.apache.hadoop.http.HttpServer: Added filter
>> static_user_filter
>> (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to
>> context logs
>> 2011-08-11 15:25:39,131 INFO org.apache.hadoop.http.HttpServer: Added global
>> filter 'guice' (class=com.google.inject.servlet.GuiceFilter)
>> 2011-08-11 15:25:39,131 INFO org.apache.hadoop.http.HttpServer: Port
>> returned by webServer.getConnectors()[0].getLocalPort() before open() is -1.
>> Opening the listener on 8088
>> 2011-08-11 15:25:39,136 INFO org.apache.hadoop.http.HttpServer:
>> listener.getLocalPort() returned 8088
>> webServer.getConnectors()[0].getLocalPort() returned 8088
>> 2011-08-11 15:25:39,136 INFO org.apache.hadoop.http.HttpServer: Jetty bound
>> to port 8088
>> 2011-08-11 15:25:39,136 INFO org.mortbay.log: jetty-6.1.26
>> 2011-08-11 15:25:39,160 INFO org.mortbay.log: Extract
>> jar:file:/home/haoyuan/hadoop/trunk/hadoop-mapreduce-1.0-SNAPSHOT/modules/yarn-common-1.0-SNAPSHOT.jar!/webapps/yarn
>> to /tmp/Jetty_0_0_0_0_8088_yarn____yzuv81/webapp
>> 2011-08-11 15:25:39,238 INFO org.mortbay.log: NO JSP Support for /, did not
>> find org.apache.jasper.servlet.JspServlet
>> 2011-08-11 15:25:39,319 INFO org.mortbay.log: Started
>> SelectChannelConnector@0.0.0.0:8088
>> 2011-08-11 15:25:39,320 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app
>> /yarn started at 8088
>> 2011-08-11 15:25:39,568 INFO org.apache.hadoop.yarn.webapp.WebApps:
>> Registered webapp guice modules
>> 2011-08-11 15:25:39,589 WARN org.apache.hadoop.metrics2.impl.MetricsConfig:
>> Cannot locate configuration: tried
>> hadoop-metrics2-resourcemanager.properties,hadoop-metrics2.properties
>> 2011-08-11 15:25:39,626 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
>> at 10 second(s).
>> 2011-08-11 15:25:39,626 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics
>> system started
>> 2011-08-11 15:25:39,627 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Registered source
>> QueueMetrics,q0=default
>> 2011-08-11 15:25:39,627 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Registered source
>> UgiMetrics
>> 2011-08-11 15:25:39,628 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:Dispatcher is started.
>> 2011-08-11 15:25:39,629 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer
>> is started.
>> 2011-08-11 15:25:39,629 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:AMLivelinessMonitor is started.
>> 2011-08-11 15:25:39,629 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:org.apache.hadoop.yarn.server.resourcemanager.NodesListManager is
>> started.
>> 2011-08-11 15:25:39,629 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
>> is started.
>> 2011-08-11 15:25:39,629 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:NMLivelinessMonitor is started.
>> 2011-08-11 15:25:39,629 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService
>> is started.
>> 2011-08-11 15:25:39,630 INFO org.apache.hadoop.yarn.ipc.YarnRPC: Creating
>> YarnRPC for null
>> 2011-08-11 15:25:39,631 INFO org.apache.hadoop.yarn.ipc.HadoopYarnRPC:
>> Creating a HadoopYarnProtoRpc server for protocol interface
>> org.apache.hadoop.yarn.server.api.ResourceTracker with 10 handlers
>> 2011-08-11 15:25:39,631 INFO org.apache.hadoop.yarn.ipc.HadoopYarnRPC:
>> Configured SecurityInfo class name is
>> org.apache.hadoop.yarn.server.RMNMSecurityInfoClass
>> 2011-08-11 15:25:44,651 INFO org.apache.hadoop.ipc.Server: Starting Socket
>> Reader #1 for port 8025
>> 2011-08-11 15:25:44,663 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Registered source
>> RpcActivityForPort8025
>> 2011-08-11 15:25:44,668 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Registered source
>> RpcDetailedActivityForPort8025
>> 2011-08-11 15:25:44,670 ERROR
>> org.apache.hadoop.yarn.service.CompositeService: Error starting services
>> ResourceManager
>> java.lang.NoSuchMethodError: org.apache.avro.ipc.Server.start()V
>> at
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService.start(ResourceTrackerService.java:128)
>> at
>> org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
>> at
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.start(ResourceManager.java:392)
>> at
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:491)
>> 2011-08-11 15:25:44,670 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:NMLivelinessMonitor is stopped.
>> 2011-08-11 15:25:44,671 INFO
>> org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: NMLivelinessMonitor
>> thread interrupted
>> 2011-08-11 15:25:44,671 ERROR
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Returning,
>> interrupted : java.lang.InterruptedException
>> 2011-08-11 15:25:44,671 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
>> is stopped.
>> 2011-08-11 15:25:44,671 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:org.apache.hadoop.yarn.server.resourcemanager.NodesListManager is
>> stopped.
>> 2011-08-11 15:25:44,671 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:AMLivelinessMonitor is stopped.
>> 2011-08-11 15:25:44,671 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer
>> is stopped.
>> 2011-08-11 15:25:44,671 INFO
>> org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: AMLivelinessMonitor
>> thread interrupted
>> 2011-08-11 15:25:44,671 INFO
>> org.apache.hadoop.yarn.util.AbstractLivelinessMonitor:
>> org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer
>> thread interrupted
>> 2011-08-11 15:25:44,671 INFO org.apache.hadoop.yarn.event.AsyncDispatcher:
>> AsyncDispatcher thread interrupted
>> java.lang.InterruptedException
>> at
>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:1961)
>> at
>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1996)
>> at
>> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
>> at
>> org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:69)
>> at java.lang.Thread.run(Thread.java:662)
>> 2011-08-11 15:25:44,672 INFO org.apache.hadoop.yarn.service.AbstractService:
>> Service:Dispatcher is stopped.
>> 2011-08-11 15:25:44,672 ERROR
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
>> starting RM
>> org.apache.hadoop.yarn.YarnException: Failed to Start ResourceManager
>> at
>> org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:80)
>> at
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.start(ResourceManager.java:392)
>> at
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:491)
>> Caused by: java.lang.NoSuchMethodError: org.apache.avro.ipc.Server.start()V
>> at
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService.start(ResourceTrackerService.java:128)
>> at
>> org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
>> ... 2 more
>> 2011-08-11 15:25:44,673 INFO org.mortbay.log: Stopped
>> SelectChannelConnector@0.0.0.0:8088
>> 2011-08-11 15:25:44,775 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping ResourceManager
>> metrics system...
>> 2011-08-11 15:25:44,776 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping metrics source
>> QueueMetrics,q0=default
>> 2011-08-11 15:25:44,776 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping metrics source
>> UgiMetrics
>> 2011-08-11 15:25:44,776 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping metrics source
>> RpcActivityForPort8025
>> 2011-08-11 15:25:44,776 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping metrics source
>> RpcDetailedActivityForPort8025
>> 2011-08-11 15:25:44,777 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics
>> system stopped.
>> 2011-08-11 15:25:44,777 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics
>> system shutdown complete.
>> =====================================================
>> On Thu, Aug 11, 2011 at 2:07 PM, Mahadev Konar <mahadev@hortonworks.com>
>> wrote:
>>> 
>>> Matei,
>>>  Are you sure you are using the latest common from trunk?  The ClientCache
>>> was recently added within the last few weeks.
>>>  Looks like its using some old version of hadoop common.
>>> 
>>>  Also the sl4j errors should be fixed in the latest MR-279 branch.
>>> 
>>> thanks
>>> mahadev
>>> 
>>> On Aug 11, 2011, at 1:52 PM, Matei Zaharia wrote:
>>> 
>>>> I get a similar error on Mac OS X. I've built YARN and extracted the
>>>> tarball to a directory, but when I run bin/yarn-daemon.sh start nodemanager,
>>>> it prints the following to its log (apologies for the long trace):
>>>> 
>>>> log4j:WARN No appenders could be found for logger
>>>> (org.apache.hadoop.metrics2.impl.MetricsSystemImpl).
>>>> log4j:WARN Please initialize the log4j system properly.
>>>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
>>>> more info.
>>>> Exception in thread "main" org.apache.hadoop.yarn.YarnException: Failed
>>>> to Start org.apache.hadoop.yarn.server.nodemanager.NodeManager
>>>>       at
>>>> org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:80)
>>>>       at
>>>> org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:146)
>>>>       at
>>>> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:191)
>>>> Caused by: org.apache.avro.AvroRuntimeException:
>>>> org.apache.hadoop.yarn.YarnException:
>>>> java.lang.reflect.InvocationTargetException
>>>>       at
>>>> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:140)
>>>>       at
>>>> org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
>>>>       ... 2 more
>>>> Caused by: org.apache.hadoop.yarn.YarnException:
>>>> java.lang.reflect.InvocationTargetException
>>>>       at
>>>> org.apache.hadoop.yarn.factories.impl.pb.RpcClientFactoryPBImpl.getClient(RpcClientFactoryPBImpl.java:70)
>>>>       at
>>>> org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC.getProxy(HadoopYarnProtoRPC.java:35)
>>>>       at
>>>> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.getRMClient(NodeStatusUpdaterImpl.java:158)
>>>>       at
>>>> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:163)
>>>>       at
>>>> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:136)
>>>>       ... 3 more
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>       at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
>>>> Method)
>>>>       at
>>>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
>>>>       at
>>>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
>>>>       at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
>>>>       at
>>>> org.apache.hadoop.yarn.factories.impl.pb.RpcClientFactoryPBImpl.getClient(RpcClientFactoryPBImpl.java:67)
>>>>       ... 7 more
>>>> Caused by: java.lang.NoClassDefFoundError:
>>>> org/apache/hadoop/ipc/ClientCache
>>>>       at
>>>> org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine.<clinit>(ProtoOverHadoopRpcEngine.java:63)
>>>>       at java.lang.Class.forName0(Native Method)
>>>>       at java.lang.Class.forName(Class.java:247)
>>>>       at
>>>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1108)
>>>>       at
>>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1160)
>>>>       at org.apache.hadoop.ipc.RPC.getProtocolEngine(RPC.java:94)
>>>>       at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:422)
>>>>       at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:368)
>>>>       at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:333)
>>>>       at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:461)
>>>>       at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:442)
>>>>       at
>>>> org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.<init>(ResourceTrackerPBClientImpl.java:32)
>>>>       ... 12 more
>>>> Caused by: java.lang.ClassNotFoundException:
>>>> org.apache.hadoop.ipc.ClientCache
>>>>       at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>>>>       at java.security.AccessController.doPrivileged(Native Method)
>>>>       at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>>>>       at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>>>>       at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>       at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>>>>       ... 24 more
>>>> 
>>>> In addition, if I try to start resourcemanager instead, it logs:
>>>> 
>>>> SLF4J: Class path contains multiple SLF4J bindings.
>>>> SLF4J: Found binding in
>>>> [jar:file:/Users/matei/workspace/MR-279/common/build/ivy/lib/Hadoop-Common/common/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>>> SLF4J: Found binding in
>>>> [jar:file:/Users/matei/workspace/MR-279-deploy/hadoop-mapreduce-1.0-SNAPSHOT/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
>>>> explanation.
>>>> log4j:WARN No appenders could be found for logger
>>>> (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
>>>> log4j:WARN Please initialize the log4j system properly.
>>>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
>>>> more info.
>>>> Exception in thread "main" java.lang.IllegalStateException: For this
>>>> operation, current State must be STARTED instead of INITED
>>>>        at
>>>> org.apache.hadoop.yarn.service.AbstractService.ensureCurrentState(AbstractService.java:101)
>>>>        at
>>>> org.apache.hadoop.yarn.service.AbstractService.stop(AbstractService.java:69)
>>>>        at
>>>> org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher.stop(ApplicationMasterLauncher.java:90)
>>>>        at
>>>> org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:89)
>>>>        at
>>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.stop(ResourceManager.java:423)
>>>>        at
>>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:493)
>>>> 
>>>> I don't know where the multiple SLF4J versions are coming from because I
>>>> checked out common, hdfs and mapreduce at the same time.
>>>> 
>>>> Matei
>>>> 
>>>> 
>>>> 
>>>> 
>>>> On Aug 11, 2011, at 2:01 AM, Vinod KV wrote:
>>>> 
>>>>> 
>>>>> 
>>>>> Report YARN_* and HADOOP_* variables that you've set before starting
>>>>> the daemons.
>>>>> 
>>>>> Also run 'bin/yarn classpath' and post the output of that command too.
>>>>> If the output doesn't contain yarn-server-resourcemanager-1.0-SNAPSHOT.jar,
>>>>> you are missing something.
>>>>> 
>>>>> +Vinod
>>>>> 
>>>>> 
>>>>> On Thursday 11 August 2011 01:57 AM, Haoyuan Li wrote:
>>>>>> Hi,
>>>>>> 
>>>>>> When I ran ResourceManager or NodeManager as steps here
>>>>>> 
>>>>>> http://svn.apache.org/repos/asf/hadoop/common/branches/MR-279/mapreduce/INSTALL
>>>>>> .
>>>>>> It has main class can't be found exception... I attached the shell
>>>>>> output
>>>>>> here. Any help will be appreciated!
>>>>>> 
>>>>>> Thanks,
>>>>>> 
>>>>>> Haoyuan
>>>>>> 
>>>>>> haoyuan@hya:~/hadoop/hadoop-mapreduce-1.0-SNAPSHOT$
>>>>>> ./bin/yarn-daemon.sh
>>>>>> start resourcemanager
>>>>>> starting resourcemanager, logging to
>>>>>> 
>>>>>> /home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../logs/yarn-haoyuan-resourcemanager-hya.out
>>>>>> /usr/lib/jvm/java-6-sun/bin/java -Dproc_resourcemanager -Xmx1000m
>>>>>> 
>>>>>> -Dhadoop.log.dir=/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../logs
>>>>>> 
>>>>>> -Dyarn.log.dir=/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../logs
>>>>>> -Dhadoop.log.file=yarn-haoyuan-resourcemanager-hya.log
>>>>>> -Dyarn.log.file=yarn-haoyuan-resourcemanager-hya.log -Dyarn.home.dir=
>>>>>> -Dyarn.id.str=haoyuan -Dhadoop.root.logger=INFO,DRFA
>>>>>> -Dyarn.root.logger=INFO,DRFA -Dyarn.policy.file=hadoop-policy.xml
>>>>>> 
>>>>>> -Dhadoop.log.dir=/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../logs
>>>>>> 
>>>>>> -Dyarn.log.dir=/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../logs
>>>>>> -Dhadoop.log.file=yarn-haoyuan-resourcemanager-hya.log
>>>>>> -Dyarn.log.file=yarn-haoyuan-resourcemanager-hya.log
>>>>>> 
>>>>>> -Dyarn.home.dir=/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/..
>>>>>> -Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -classpath
>>>>>> 
>>>>>> /home/haoyuan/hadoop/conf:/home/haoyuan/hadoop/conf:/usr/lib/jvm/java-6-sun/lib/tools.jar:/home/haoyuan/hadoop/trunk/common/hadoop-*.jar:/home/haoyuan/hadoop/trunk/common/lib/*.jar:/home/haoyuan/hadoop/trunk/common/share/hadoop/common/*.jar:/home/haoyuan/hadoop/trunk/common/share/hadoop/common/lib/*.jar:/home/haoyuan/hadoop/trunk/common/share/hadoop/hdfs/*.jar:/home/haoyuan/hadoop/trunk/hdfs/hadoop-*.jar:/home/haoyuan/hadoop/trunk/hdfs/lib/*.jar:/home/haoyuan/hadoop/trunk/hdfs/build/classes:/home/haoyuan/hadoop/trunk/hdfs/hadoop-*.jar:/home/haoyuan/hadoop/trunk/hdfs/lib/*.jar:/home/haoyuan/hadoop/trunk/mapreduce/build/classes:/home/haoyuan/hadoop/trunk/mapreduce/build:/home/haoyuan/hadoop/trunk/mapreduce/build/test/classes:/home/haoyuan/hadoop/trunk/mapreduce/build/tools:/home/haoyuan/hadoop/trunk/mapreduce/lib/*.jar:/home/haoyuan/hadoop/trunk/mapreduce/*.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/aopalliance-1.0.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/asm-3.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/aspectjrt-1.6.5.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/avro-1.3.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/avro-1.4.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/clover-3.0.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-beanutils-1.7.0.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-beanutils-core-1.8.0.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-cli-1.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-codec-1.4.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-collections-3.2.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-configuration-1.6.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-digester-1.8.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-httpclient-3.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-lang-2.5.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-logging-1.0.4.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-logging-api-1.0.4.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-math-2.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/commons-net-1.4.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/core-3.1.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/guava-r09.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/guice-2.0.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/guice-servlet-2.0.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/hadoop-annotations-0.23.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/jackson-core-asl-1.4.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/jackson-mapper-asl-1.4.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/jdiff-1.0.9.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/jets3t-0.6.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/jetty-6.1.26.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/jetty-util-6.1.26.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/jsp-api-2.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/junit-4.8.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/kfs-0.3.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/log4j-1.2.15.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/netty-3.2.3.Final.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/oro-2.0.8.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/paranamer-2.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/paranamer-ant-2.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/paranamer-generator-2.2.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/protobuf-java-2.4.0a.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/qdox-1.10.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/servlet-api-2.5.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/slf4j-api-1.6.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/slf4j-log4j12-1.6.1.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../lib/xmlenc-0.52.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/hadoop-mapreduce-client-app-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/hadoop-mapreduce-client-common-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/hadoop-mapreduce-client-core-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/hadoop-mapreduce-client-hs-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/hadoop-mapreduce-client-jobclient-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/hadoop-mapreduce-client-shuffle-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/yarn-api-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/yarn-common-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/yarn-server-common-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/yarn-server-nodemanager-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/hadoop-mapreduce-1.0-SNAPSHOT/bin/../modules/yarn-server-resourcemanager-1.0-SNAPSHOT.jar:/home/haoyuan/hadoop/conf/rm-config/log4j.properties
>>>>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager
>>>>>> Exception in thread "main" java.lang.NoClassDefFoundError:
>>>>>> org/apache/hadoop/conf/Configuration
>>>>>> Caused by: java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.conf.Configuration
>>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>>>>>> Could not find the main class:
>>>>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.
>>>>>>  Program will
>>>>>> exit.
>>>>>> 
>>>>> 
>>>>> 
>>>> 
>>> 
>> 
>> 


Mime
View raw message