Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: yarn-issues@hadoop.apache.org
Date: Wed, 2 Mar 2016 14:33:18 +0000 (UTC)
From: "Sunil G (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.12946106.1456912945000.194571.1456929198163@Atlassian.JIRA>
In-Reply-To: <JIRA.12946106.1456912945000@Atlassian.JIRA>
References: <JIRA.12946106.1456912945000@Atlassian.JIRA>
 <JIRA.12946106.1456912945001@arcas>
Subject: [jira] [Commented] (YARN-4755) Optimize sending appACLsUpdated
 event to TimelineServer while recovering completed applications
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/YARN-4755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15175666#comment-15175666 ] 

Sunil G commented on YARN-4755:
-------------------------------

Hi [~Naganarasimha Garla]
Does this mean that, event will be raised to timeline only once for a completed app as AppFinished event? Is that the idea.?

> Optimize sending appACLsUpdated event to TimelineServer while recovering completed applications
> -----------------------------------------------------------------------------------------------
>
>                 Key: YARN-4755
>                 URL: https://issues.apache.org/jira/browse/YARN-4755
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Rohith Sharma K S
>            Assignee: Naganarasimha G R
>
> In method {{RMAppManager#createAndPopulateNewRMApp}}, appACLsUpdated is sent to timelineserver for every application that get created. 
> {code}
>  private RMAppImpl createAndPopulateNewRMApp(
>       ApplicationSubmissionContext submissionContext, long submitTime,
>       String user, boolean isRecovery) throws YarnException {
> 		//
>                 //
>     String appViewACLs = submissionContext.getAMContainerSpec()
>         .getApplicationACLs().get(ApplicationAccessType.VIEW_APP);
>     rmContext.getSystemMetricsPublisher().appACLsUpdated(
>         application, appViewACLs, System.currentTimeMillis());
>     return application;
>   }
> {code}
> Say if we have 10K completed applications to recover, 30K events will be generated i.e app_created, app_finished and app_acl_updated. For completed applications, I think need not to send app-acl-updated event with which gradually reduce load on the dispatcher. 
> Eventhough MultiDispatcher is used to publish timeline events, it is bottle neck when max-completed is configured very high value may be 100K.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)