reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Julia (JIRA)" <>
Subject [jira] [Updated] (REEF-1669) Removing YarnClient from YarnContainerManager
Date Wed, 16 Nov 2016 02:41:59 GMT


Julia updated REEF-1669:
    Component/s: REEF

> Removing YarnClient from YarnContainerManager
> ---------------------------------------------
>                 Key: REEF-1669
>                 URL:
>             Project: REEF
>          Issue Type: Bug
>          Components: REEF
>            Reporter: Julia
>            Assignee: Julia
> Currently we have both YarnClient and resourceManager (AMRMClientAsync) in YarnContainerManager.
We call init() and start() for both of them. But inside driver, we are not able to get correct
YarnConfiguration for YarnClient, that makes yarnClient.getNodeReports() fail to connect to
> In YarnContainerManager, we already have onNodesUpdated() which gives the list of the
NodeReports on the fly.  yarnClient.getNodeReports() was called at beginning and it only gives
a static list. So looks like we don't need to call it anyway. 
> Based on RM folks, REEF should not use YarnClient at driver side. So the proposal it
to to remove YarnClient from YarnContainerManager. 

This message was sent by Atlassian JIRA

View raw message