hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Krishna Kishore Bonagiri <write2kish...@gmail.com>
Subject Re: Requesting containers on a specific host
Date Fri, 05 Jul 2013 14:07:46 GMT
Hi Devaraj,

   Thanks for pointing me to this RC. I am trying this out, and getting
this error for NM to get started. My RM is running fine, but NM is failing
and saying that it is disallowed by RM and received a SHUTDOWN message.
Please give me clue to resolve this.

2013-07-05 09:49:20,043 ERROR
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Unexpected
error starting NodeStatusUpdater
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
signal from Resourcemanager ,Registration of NodeManager failed, Message
from ResourceManager: Disallowed NodeManager from  isredeng.swg.usma.ibm.com,
Sending SHUTDOWN signal to the NodeManager.
        at
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:290)
        at
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:156)
        at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
        at
org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:101)
        at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:213)
        at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
        at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:401)
        at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:447)

Thanks,
Kishore

On Fri, Jul 5, 2013 at 8:52 AM, Devaraj k <devaraj.k@huawei.com> wrote:

>  Hi Kishore,****
>
> ** **
>
> hadoop-2.1.0 beta release is in voting process now.****
>
> ** **
>
> You can try out from hadoop-2.1.0 beta RC
> http://people.apache.org/~acmurthy/hadoop-2.1.0-beta-rc0/ or you could
> check the same with trunk build.****
>
> ** **
>
> Thanks****
>
> Devaraj k****
>
> ** **
>
> *From:* Krishna Kishore Bonagiri [mailto:write2kishore@gmail.com]
> *Sent:* 04 July 2013 21:33
>
> *To:* user@hadoop.apache.org
> *Subject:* Re: Requesting containers on a specific host****
>
>  ** **
>
> Thanks Arun, it seems to be available with 2.1.0-beta, when will that be
> released? Or if I want it now, could I get from the trunk?****
>
> ** **
>
> -Kishore****
>
> ** **
>
> On Thu, Jul 4, 2013 at 5:58 PM, Arun C Murthy <acm@hortonworks.com> wrote:
> ****
>
> To guarantee nodes on a specific container you need to use the whitelist
> feature we added recently:****
>
> https://issues.apache.org/jira/browse/YARN-398****
>
>  Arun****
>
> ** **
>
> On Jul 4, 2013, at 3:14 AM, Krishna Kishore Bonagiri <
> write2kishore@gmail.com> wrote:****
>
>
>
> ****
>
> I could get containers on specific nodes using addContainerRequest() on
> AMRMClient. But there are issues with it. I have two nodes, node1 and node2
> in my cluster. And, my Application Master is trying to get 3 containers on
> node1, and 3 containers on node2 in that order. ****
>
> ** **
>
> While trying to request on node1, it sometimes gives me those on node2,
> and vice verse. When I get a container on a different node than the one I
> need, I release it and make a fresh request. I am having to do like that
> forever to get a container on the node I need. ****
>
> ** **
>
>  Though the node I am requesting has enough resources, why does it keep
> giving me containers on the other node? How can I make sure I get a
> container on the node I want? ****
>
> ** **
>
> Note: I am using the default scheduler, i.e. Capacity Scheduler.****
>
> ** **
>
> Thanks,****
>
> Kishore****
>
> ** **
>
> On Fri, Jun 21, 2013 at 7:25 PM, Arun C Murthy <acm@hortonworks.com>
> wrote:****
>
> Check if the hostname you are setting is the same in the RM logsā€¦****
>
> ** **
>
> On Jun 21, 2013, at 2:15 AM, Krishna Kishore Bonagiri <
> write2kishore@gmail.com> wrote:****
>
>
>
> ****
>
> Hi,****
>
>   I am trying to get container on a specific host, using setHostName(0
> call on ResourceRequest, but could not get allocated anything forever,
> which just works fine when I change the node name to "*". I am working on a
> single node cluster, and I am giving the name of the single node I have in
> my cluster. ****
>
> ** **
>
>   Is there any specific format that I need to give for setHostName(), why
> is it not working...****
>
> ** **
>
> Thanks,****
>
> Kishore****
>
> ** **
>
> --****
>
> Arun C. Murthy****
>
> Hortonworks Inc.
> http://hortonworks.com/****
>
> ** **
>
> ** **
>
> ** **
>
> --****
>
> Arun C. Murthy****
>
> Hortonworks Inc.
> http://hortonworks.com/****
>
> ** **
>
> ** **
>

Mime
View raw message