reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Markus Weimer (JIRA)" <>
Subject [jira] [Commented] (REEF-1820) Allow specify node names when requesting evaluators
Date Wed, 05 Jul 2017 22:18:00 GMT


Markus Weimer commented on REEF-1820:

Node labels are a YARN specific feature. Hence, it would be better to move support for them
into a new, YARN-specific resource request API. That is how we solved this in REEF/Java.

> Allow specify node names when requesting evaluators
> ---------------------------------------------------
>                 Key: REEF-1820
>                 URL:
>             Project: REEF
>          Issue Type: Task
>          Components: REEF, REEF Bridge
>            Reporter: Julia
>            Priority: Minor
> Currently, when clients request for evaluators, .Net REEF doesn't not expose node names
in IEvaluatorRequest. It default to null node names therefore it is up to YARN to assign available
> Some of the REEF clients would like to specify node names when requesting for evaluators.
We should allow the preferred node names to be specified through IEvaluatorRequest and pass
it to Java EvaluatorRequestorBridge. 
> As resources requested may not be available for various reasons, we should also allow
the client to specify RelaxLocality in the IEvaluatorRequest. Setting RelaxLocality to true
would allow YARN to return another container if the specified one is not available. 

This message was sent by Atlassian JIRA

View raw message