spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-13232) YARN executor node label expressions
Date Tue, 09 Feb 2016 06:54:18 GMT

    [ https://issues.apache.org/jira/browse/SPARK-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138438#comment-15138438
] 

Apache Spark commented on SPARK-13232:
--------------------------------------

User 'AtkinsChang' has created a pull request for this issue:
https://github.com/apache/spark/pull/11129

> YARN executor node label expressions
> ------------------------------------
>
>                 Key: SPARK-13232
>                 URL: https://issues.apache.org/jira/browse/SPARK-13232
>             Project: Spark
>          Issue Type: Improvement
>          Components: YARN
>         Environment: Scala 2.11.7,  Hadoop 2.7.2, Spark 1.6.0
>            Reporter: Atkins
>            Priority: Minor
>
> Using node label expression for executor failed to request container request and throws
*InvalidContainerRequestException*.
> The code
> {code:title=AMRMClientImpl.java}
>   /**
>    * Valid if a node label expression specified on container request is valid or
>    * not
>    * 
>    * @param containerRequest
>    */
>   private void checkNodeLabelExpression(T containerRequest) {
>     String exp = containerRequest.getNodeLabelExpression();
>     
>     if (null == exp || exp.isEmpty()) {
>       return;
>     }
>     // Don't support specifying >= 2 node labels in a node label expression now
>     if (exp.contains("&&") || exp.contains("||")) {
>       throw new InvalidContainerRequestException(
>           "Cannot specify more than two node labels"
>               + " in a single node label expression");
>     }
>     
>     // Don't allow specify node label against ANY request
>     if ((containerRequest.getRacks() != null && 
>         (!containerRequest.getRacks().isEmpty()))
>         || 
>         (containerRequest.getNodes() != null && 
>         (!containerRequest.getNodes().isEmpty()))) {
>       throw new InvalidContainerRequestException(
>           "Cannot specify node label with rack and node");
>     }
>   }
> {code}
> doesn't allow node label with rack and node.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message