reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yingda Chen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (REEF-6) Improve allocation performance
Date Wed, 29 Oct 2014 16:58:33 GMT

     [ https://issues.apache.org/jira/browse/REEF-6?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Yingda Chen updated REEF-6:
---------------------------
    Attachment: empty-rack-driver.stderr

This is the driver stderr from a run that use empty string as rack preference, it still hangs.

> Improve allocation performance
> ------------------------------
>
>                 Key: REEF-6
>                 URL: https://issues.apache.org/jira/browse/REEF-6
>             Project: REEF
>          Issue Type: Improvement
>          Components: REEF-Runtime-YARN
>            Reporter: Markus Weimer
>            Assignee: Yingda Chen
>            Priority: Critical
>         Attachments: driver.stderr, empty-rack-driver.stderr
>
>
> REEF today uses a very conservative protocol when interacting with YARN, which only allows
for one allocation request to be in flight at a time. 
> We can improve upon this by allowing one kind of allocation request to be in flight at
a time without giving up the safety of the current approach.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message