hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bibin A Chundatt (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-4925) ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression
Date Wed, 06 Apr 2016 02:12:25 GMT

     [ https://issues.apache.org/jira/browse/YARN-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Bibin A Chundatt updated YARN-4925:
-----------------------------------
    Description: 
Currently with nodelabel AMRMClient will not be able to specify nodelabels with Node/Rack
requests.For application like spark NODE_LOCAL requests cannot be asked with label expression.
As per the check in  {{AMRMClientImpl#checkNodeLabelExpression}}

{noformat}
    // Don't allow specify node label against ANY request
    if ((containerRequest.getRacks() != null && 
        (!containerRequest.getRacks().isEmpty()))
        || 
        (containerRequest.getNodes() != null && 
        (!containerRequest.getNodes().isEmpty()))) {
      throw new InvalidContainerRequestException(
          "Cannot specify node label with rack and node");
    }
{noformat}

{{AppSchedulingInfo#updateResourceRequests}} we do reset of labels to that of OFF-SWITCH.


The above check is not required for ContainerRequest ask /cc [~wangda] thank you for confirming

  was:
Currently with nodelabel AMRMClient will not be able to specify nodelabels with Node/Rack
requests.For application like spark NODE_LOCAL requests cannot be asked with label expression.

{noformat}
    // Don't allow specify node label against ANY request
    if ((containerRequest.getRacks() != null && 
        (!containerRequest.getRacks().isEmpty()))
        || 
        (containerRequest.getNodes() != null && 
        (!containerRequest.getNodes().isEmpty()))) {
      throw new InvalidContainerRequestException(
          "Cannot specify node label with rack and node");
    }
{noformat}

{{AppSchedulingInfo#updateResourceRequests}} we do reset of labels to that of OFF-SWITCH.


The above check is not required for ContainerRequest ask /cc [~wangda] thank you for confirming


> ContainerRequest in AMRMClient, application should be able to specify nodes/racks together
with nodeLabelExpression
> -------------------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-4925
>                 URL: https://issues.apache.org/jira/browse/YARN-4925
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Bibin A Chundatt
>            Assignee: Bibin A Chundatt
>
> Currently with nodelabel AMRMClient will not be able to specify nodelabels with Node/Rack
requests.For application like spark NODE_LOCAL requests cannot be asked with label expression.
> As per the check in  {{AMRMClientImpl#checkNodeLabelExpression}}
> {noformat}
>     // Don't allow specify node label against ANY request
>     if ((containerRequest.getRacks() != null && 
>         (!containerRequest.getRacks().isEmpty()))
>         || 
>         (containerRequest.getNodes() != null && 
>         (!containerRequest.getNodes().isEmpty()))) {
>       throw new InvalidContainerRequestException(
>           "Cannot specify node label with rack and node");
>     }
> {noformat}
> {{AppSchedulingInfo#updateResourceRequests}} we do reset of labels to that of OFF-SWITCH.

> The above check is not required for ContainerRequest ask /cc [~wangda] thank you for
confirming



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message