hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bikas Saha (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1443) blacklist is not propagated from AM to RM
Date Mon, 25 Nov 2013 23:20:38 GMT

    [ https://issues.apache.org/jira/browse/YARN-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13832052#comment-13832052

Bikas Saha commented on YARN-1443:

Are you using AMRMClient/AMRMClientAsync or writing against the protocol API's directly? If
its the later, then can you please try using the AMRMClient libraries. If the issue does not
repro with the client libraries then it could be a bug in your code.

> blacklist is not propagated from AM to RM
> -----------------------------------------
>                 Key: YARN-1443
>                 URL: https://issues.apache.org/jira/browse/YARN-1443
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: api, client
>            Reporter: Robert Grandl
>            Priority: Minor
> I was trying to blacklist some nodes. I added a set of hosts as strings into blacklistAdditions
list and propagated into RMContainerRequestor#makeRemoteRequest to the RM. 
> However the blacklist is received empty at RM. I logged the path for blacklist in AM
and I found that in ApplicationMasterProtocolPBClientImpl#allocate, this list is lost. 
> I print request.getResourceBlacklistRequest().getBlacklistAdditions().toString() at the
beginning of ApplicationMasterProtocolPBClientImpl#allocate and the blacklisted additions
are there. 
> After AllocateRequestProto requestProto is created based on this request, and I print
again requestProto.getBlacklistRequest().getBlacklistAdditionsList().toString(), the blacklist
additions is empty now.
> I looked even further and log what happened. At some point in yarn-api, I was lost with
my logging as that code was regenerated every time I recompiled yarn-api. 
> Thanks,
> robert

This message was sent by Atlassian JIRA

View raw message