reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yingda Chen (JIRA)" <>
Subject [jira] [Commented] (REEF-6) Improve allocation performance
Date Thu, 30 Oct 2014 20:18:33 GMT


Yingda Chen commented on REEF-6:

Yes. we use EvaluatorRequestorBridge to request evaluators. Feel free to edit it and update
this PR. I have some other things on my plate now, will try to test this tomorrow. If you
will have a new PR by then it would be great.

> Improve allocation performance
> ------------------------------
>                 Key: REEF-6
>                 URL:
>             Project: REEF
>          Issue Type: Improvement
>          Components: REEF-Runtime-YARN
>            Reporter: Markus Weimer
>            Assignee: Yingda Chen
>            Priority: Critical
>         Attachments: driver.stderr, empty-rack-driver.stderr
> REEF today uses a very conservative protocol when interacting with YARN, which only allows
for one allocation request to be in flight at a time. 
> We can improve upon this by allowing one kind of allocation request to be in flight at
a time without giving up the safety of the current approach.

This message was sent by Atlassian JIRA

View raw message