hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7215) REST API to list all deployed services by the same user
Date Wed, 20 Sep 2017 02:07:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-7215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16172617#comment-16172617
] 

Eric Yang commented on YARN-7215:
---------------------------------

Data stored in ZooKeeper can not exceed 1MB per node.  It is possible for large scale application
to exceed that limit when the hostnames and config key/value pairs are stored in the state
or spec file.  Application state maybe fine, but I can't recommend to use ZooKeeper as low
latency storage for application configuration.  Ambari version 0.0 (HMS) had implemented similar
use case, and it quickly hits z-node size limitation.

> REST API to list all deployed services by the same user
> -------------------------------------------------------
>
>                 Key: YARN-7215
>                 URL: https://issues.apache.org/jira/browse/YARN-7215
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: api, applications
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>
> In Slider, it is possible to list deployed applications from the same user by using:
> {code}
> slider list
> {code}
> This API can help UI to display application and services deployed by the same user.
> Apiserver does not have ability to list all applications/services at this time.  This
API requires fast response to list all applications because it is a common UI operation. 
ApiServer deployed applications persist configuration in HDFS similar to slider, but using
directory listing to display deployed application might cost too much overhead to namenode.
 We may want to use alternative storage mechanism to cache deployed application configuration
to accelerate the response time of list deployed applications.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message