reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yingda Chen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (REEF-6) Improve allocation performance
Date Thu, 30 Oct 2014 20:18:33 GMT

    [ https://issues.apache.org/jira/browse/REEF-6?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190745#comment-14190745
] 

Yingda Chen commented on REEF-6:
--------------------------------

Yes. we use EvaluatorRequestorBridge to request evaluators. Feel free to edit it and update
this PR. I have some other things on my plate now, will try to test this tomorrow. If you
will have a new PR by then it would be great.

> Improve allocation performance
> ------------------------------
>
>                 Key: REEF-6
>                 URL: https://issues.apache.org/jira/browse/REEF-6
>             Project: REEF
>          Issue Type: Improvement
>          Components: REEF-Runtime-YARN
>            Reporter: Markus Weimer
>            Assignee: Yingda Chen
>            Priority: Critical
>         Attachments: driver.stderr, empty-rack-driver.stderr
>
>
> REEF today uses a very conservative protocol when interacting with YARN, which only allows
for one allocation request to be in flight at a time. 
> We can improve upon this by allowing one kind of allocation request to be in flight at
a time without giving up the safety of the current approach.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message