reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Markus Weimer <mar...@weimo.de>
Subject Re: Map EvaluatorRequest to AllocatedEvaluator
Date Mon, 21 Mar 2016 23:26:01 GMT
Hi,

this is one of the most common feature requests. Sadly, we cannot
really solve it in the REEF layer: YARN doesn't allow us to associate
a tag with a request. Once that is possible, it is easy to add the
support in REEF.

Markus

On Mon, Mar 21, 2016 at 4:18 PM, Ashvin A <aas.ojj@gmail.com> wrote:
> Hi,
>
> I am wondering if there is a way I could assign an identifier while
> submitting a EvaluatorRequest and get the identifier back when
> AllocatedEvaluator associated to the original request is created.
>
> I am trying to use REEF to deploy a YARN app. The driver is submitting
> heterogenous container requests based on core and memory requirements. Each
> request corresponds to a specific task. For eg, say two containers are
> requested:
> 1) Task T1 -> Req1 (1 core, 1GB)
> 2) Task T2 -> Req2 (1 core, 5 GB)
>
> Assume REEF creates evaluator E1 for Req1 and E2 for Req2. Now I would like
> to launch task T1 on E1 and T2 on E2. So I need a way to map Evaluator to
> requests. I am not sure what is the best way to to do this. While creating
> the request, I can only set memory and number of cores. There is no setter
> for ID. Any suggestions?
>
> Thanks,
> Ashvin

Mime
View raw message