hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Billie Rinaldi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7540) Convert yarn app cli to call yarn api services
Date Wed, 06 Dec 2017 19:48:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280786#comment-16280786

Billie Rinaldi commented on YARN-7540:

Regarding enableFastLaunch, I think we need to keep the command because we shouldn't require
the RM to be restarted to update the dependency tarball in HDFS. It would be okay to make
the RM do the upload automatically on start, but the command is still needed. If you add the
following after instantiating the ServiceClient in ApiServiceClient, that should fix the issue.

> Convert yarn app cli to call yarn api services
> ----------------------------------------------
>                 Key: YARN-7540
>                 URL: https://issues.apache.org/jira/browse/YARN-7540
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>             Fix For: yarn-native-services
>         Attachments: YARN-7540.001.patch, YARN-7540.002.patch
> For YARN docker application to launch through CLI, it works differently from launching
through REST API.  All application launched through REST API is currently stored in yarn user
HDFS home directory.  Application managed through CLI are stored into individual user's HDFS
home directory.  For consistency, we want to have yarn app cli to interact with API service
to manage applications.  For performance reason, it is easier to implement list all applications
from one user's home directory instead of crawling all user's home directories.  For security
reason, it is safer to access only one user home directory instead of all users.  Given the
reasons above, the proposal is to change how {{yarn app -launch}}, {{yarn app -list}} and
{{yarn app -destroy}} work.  Instead of calling HDFS API and RM API to launch containers,
CLI will be converted to call API service REST API resides in RM.  RM perform the persist
and operations to launch the actual application.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message