hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Omkar Joshi <ojo...@hortonworks.com>
Subject Re: DefaultResourceCalculator ClassNotFoundException
Date Tue, 19 Nov 2013 01:43:00 GMT
  <property>

    <name>yarn.scheduler.capacity.resource-calculator</name>


<value>org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator</value>
    <description>

      The ResourceCalculator implementation to be used to compare

      Resources in the scheduler.

      The default i.e. DefaultResourceCalculator only uses Memory while

      DominantResourceCalculator uses dominant-resource to compare

      multi-dimensional resources such as Memory, CPU etc.

    </description>

  </property>


inside capacity-scheduler.xml

Thanks,
Omkar Joshi
*Hortonworks Inc.* <http://www.hortonworks.com>


On Mon, Nov 18, 2013 at 5:34 PM, YouPeng Yang <yypvsxf19870706@gmail.com>wrote:

> Hi
>    It does not work.
>    I do not find the yarn.scheduler.capacity.resource-calculator
> property in the
> hadoop-2.2.0/share/doc/hadoop/hadoop-yarn/hadoop-yarn-common/yarn-default.xml.
>    Is it the right  property?
>
>    Anyone could give me any suggestion about the exception?
>
>
> 2013/11/15 Rob Blah <tmp5330@gmail.com>
>
>> "Can you check the config entry for yarn.scheduler.capacity.resource-
>> calculator ?
>> It should point to org.apache.hadoop.yarn.util.resource.
>> DefaultResourceCalculator"
>>
>> Answer provided by Ted Yu in thread "DefaultResourceCalculator class not
>> found, ResourceManager fails to start."
>>
>> regards
>>
>>
>>
>> 2013/11/15 YouPeng Yang <yypvsxf19870706@gmail.com>
>>
>>>
>>> Hi all
>>>
>>>   It‘s wierd to failed to start my yarn resourcemanager with an
>>> exception[1].
>>>
>>>     I aslo do some google, someone also encountered this problem with no
>>> solved answer.
>>>     I check the src ,there is actually no the DefaultResourceCalculator
>>> in
>>> package :org.apache.hadoop.yarn.server.resourcemanager.resource,however
>>> I found the DefaultResourceCalculator  in
>>> org.apache.hadoop.yarn.util.resource
>>>
>>>     why we miss the class?
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> [1]-------------------------------------------------------------------------------------------------------------
>>> 2013-11-15 17:41:46,755 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>> hadoop-metrics2.properties
>>> 2013-11-15 17:41:46,876 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> period at 10 second(s).
>>> 2013-11-15 17:41:46,877 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics
>>> system started
>>> 2013-11-15 17:41:47,013 INFO org.apache.hadoop.service.AbstractService:
>>> Service ResourceManager failed in state INITED; cause:
>>> java.lang.RuntimeException: java.lang.RuntimeException:
>>> java.lang.ClassNotFoundException: Class
>>> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator
>>> not found
>>> java.lang.RuntimeException: java.lang.RuntimeException:
>>> java.lang.ClassNotFoundException: Class
>>> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator
>>> not found
>>>     at
>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1752)
>>>     at
>>> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration.getResourceCalculator(CapacitySchedulerConfiguration.java:333)
>>>     at
>>> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:263)
>>>     at
>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:249)
>>>     at
>>> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>>>     at
>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:871)
>>> Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException:
>>> Class
>>> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator
>>> not found
>>>     at
>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1720)
>>>     at
>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1744)
>>>     ... 5 more
>>> Caused by: java.lang.ClassNotFoundException: Class
>>> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator
>>> not found
>>>     at
>>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1626)
>>>     at
>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1718)
>>>     ... 6 more
>>> 2013-11-15 17:41:47,030 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping ResourceManager
>>> metrics system...
>>> 2013-11-15 17:41:47,032 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics
>>> system stopped.
>>> 2013-11-15 17:41:47,032 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics
>>> system shutdown complete.
>>> 2013-11-15 17:41:47,034 FATAL
>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
>>> starting ResourceManager
>>> java.lang.RuntimeException: java.lang.RuntimeException:
>>> java.lang.ClassNotFoundException: Class
>>> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator
>>> not found
>>>     at
>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1752)
>>>     at
>>> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration.getResourceCalculator(CapacitySchedulerConfiguration.java:333)
>>>     at
>>> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:263)
>>>     at
>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:249)
>>>     at
>>> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>>>     at
>>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:871)
>>> Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException:
>>> Class
>>> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator
>>> not found
>>>     at
>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1720)
>>>     at
>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1744)
>>>     ... 5 more
>>> Caused by: java.lang.ClassNotFoundException: Class
>>> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator
>>> not found
>>>     at
>>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1626)
>>>     at
>>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1718)
>>>     ... 6 more
>>>
>>
>>
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Mime
View raw message