reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Julia (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (REEF-1776) Use YARN proxy user to register REEF Driver in Unmanaged AM mode
Date Mon, 17 Apr 2017 22:32:41 GMT

     [ https://issues.apache.org/jira/browse/REEF-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Julia resolved REEF-1776.
-------------------------
       Resolution: Fixed
    Fix Version/s: 0.16

Resolve via https://github.com/apache/reef/pull/1290#pullrequestreview-33093015

> Use YARN proxy user to register REEF Driver in Unmanaged AM mode
> ----------------------------------------------------------------
>
>                 Key: REEF-1776
>                 URL: https://issues.apache.org/jira/browse/REEF-1776
>             Project: REEF
>          Issue Type: Bug
>          Components: REEF Client, REEF Driver, REEF-Runtime-YARN
>            Reporter: Sergiy Matusevych
>            Assignee: Sergiy Matusevych
>              Labels: yarn, yarn-client
>             Fix For: 0.16
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> When launching REEF application in Unmanaged AM mode from another YARN application, two
Drivers access the same global object {{UserGroupInformation}} from YARN API. That issue prevents
us from running REEF applications on YARN in REEF-on-REEF or REEF-on-Spark settings. We have
to implement a mechanism to create proxy YARN users and register Unmanaged AM Drivers in that
proxy user context and update the API so that REEF client can pass the user credentials into
the driver setup.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message