hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2571) RM to support YARN registry
Date Tue, 25 Aug 2015 17:01:46 GMT

    [ https://issues.apache.org/jira/browse/YARN-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711631#comment-14711631
] 

Steve Loughran commented on YARN-2571:
--------------------------------------

All the registry code is there (slider uses it), except two bits of the RM side
# create the base user path on app launch (in case the app needs it). This needs to be done
by a process with the right permissions on ZK; it also makes sure that the user path is created
with the perms to allow the RM/admin to delete it
# purge entries on container/AM failure

There was push-back from the YARN team on #2; not for the RM. I do still think #2 is needed.
Irrespective of that, there is a main() entry point in the 2.7+ code which offers a CLI to
create the reg; its just without docs or tests. Email me direct if you want to start using
the code & I'll help you

> RM to support YARN registry 
> ----------------------------
>
>                 Key: YARN-2571
>                 URL: https://issues.apache.org/jira/browse/YARN-2571
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager
>    Affects Versions: 2.6.0
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>              Labels: BB2015-05-TBR
>         Attachments: YARN-2571-001.patch, YARN-2571-002.patch, YARN-2571-003.patch, YARN-2571-005.patch,
YARN-2571-007.patch, YARN-2571-008.patch, YARN-2571-009.patch, YARN-2571-010.patch
>
>
> The RM needs to (optionally) integrate with the YARN registry:
> # startup: create the /services and /users paths with system ACLs (yarn, hdfs principals)
> # app-launch: create the user directory /users/$username with the relevant permissions
(CRD) for them to create subnodes.
> # attempt, container, app completion: remove service records with the matching persistence
and ID



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message