Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Wed, 20 Sep 2017 02:07:00 +0000 (UTC)
From: "Eric Yang (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.13103319.1505846803000.152808.1505873220370@Atlassian.JIRA>
In-Reply-To: <JIRA.13103319.1505846803000@Atlassian.JIRA>
References: <JIRA.13103319.1505846803000@Atlassian.JIRA> <JIRA.13103319.1505846803830@jira-lw-us.apache.org>
Subject: [jira] [Commented] (YARN-7215) REST API to list all deployed
 services by the same user
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Wed, 20 Sep 2017 02:07:10 -0000


    [ https://issues.apache.org/jira/browse/YARN-7215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16172617#comment-16172617 ] 

Eric Yang commented on YARN-7215:
---------------------------------

Data stored in ZooKeeper can not exceed 1MB per node.  It is possible for large scale application to exceed that limit when the hostnames and config key/value pairs are stored in the state or spec file.  Application state maybe fine, but I can't recommend to use ZooKeeper as low latency storage for application configuration.  Ambari version 0.0 (HMS) had implemented similar use case, and it quickly hits z-node size limitation.

> REST API to list all deployed services by the same user
> -------------------------------------------------------
>
>                 Key: YARN-7215
>                 URL: https://issues.apache.org/jira/browse/YARN-7215
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: api, applications
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>
> In Slider, it is possible to list deployed applications from the same user by using:
> {code}
> slider list
> {code}
> This API can help UI to display application and services deployed by the same user.
> Apiserver does not have ability to list all applications/services at this time.  This API requires fast response to list all applications because it is a common UI operation.  ApiServer deployed applications persist configuration in HDFS similar to slider, but using directory listing to display deployed application might cost too much overhead to namenode.  We may want to use alternative storage mechanism to cache deployed application configuration to accelerate the response time of list deployed applications.


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org