hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7540) Convert yarn app cli to call yarn api services
Date Tue, 05 Dec 2017 23:44:01 GMT

    [ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279389#comment-16279389

Eric Yang commented on YARN-7540:

# I will reduce config object.
# I will reuse RMHAUtils.getRMHAWebappAddress.
# EnableFastLaunch seems to be a problem because Rest API server doesn't have this functionality.
 I am more inclined to fix this issue by start up of Resource Manager to check if the required
libraries are uploaded to hdfs, and remove the enableFastLaunch option.  Thoughts?
# I will fix the conflict introduced via YARN-6669.
# I agree that NATIVE_TYPE is confusing, and we need this special type for unit tests.  Therefore,
I am inclined to rename NATIVE_TYPE to "unit-test" type for correctness.  

> Convert yarn app cli to call yarn api services
> ----------------------------------------------
>                 Key: YARN-7540
>                 URL: https://issues.apache.org/jira/browse/YARN-7540
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>             Fix For: yarn-native-services
>         Attachments: YARN-7540.001.patch, YARN-7540.002.patch
> For YARN docker application to launch through CLI, it works differently from launching
through REST API.  All application launched through REST API is currently stored in yarn user
HDFS home directory.  Application managed through CLI are stored into individual user's HDFS
home directory.  For consistency, we want to have yarn app cli to interact with API service
to manage applications.  For performance reason, it is easier to implement list all applications
from one user's home directory instead of crawling all user's home directories.  For security
reason, it is safer to access only one user home directory instead of all users.  Given the
reasons above, the proposal is to change how {{yarn app -launch}}, {{yarn app -list}} and
{{yarn app -destroy}} work.  Instead of calling HDFS API and RM API to launch containers,
CLI will be converted to call API service REST API resides in RM.  RM perform the persist
and operations to launch the actual application.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message