Return-Path: 
 <yarn-issues-return-8760-apmail-hadoop-yarn-issues-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 1178B10BCC
	for <apmail-hadoop-yarn-issues-archive@minotaur.apache.org>;
 Thu,  6 Jun 2013 12:40:26 +0000 (UTC)
Received: (qmail 57552 invoked by uid 500); 6 Jun 2013 12:40:26 -0000
Delivered-To: apmail-hadoop-yarn-issues-archive@hadoop.apache.org
Received: (qmail 57418 invoked by uid 500); 6 Jun 2013 12:40:22 -0000
Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:yarn-issues-help@hadoop.apache.org>
List-Unsubscribe: <mailto:yarn-issues-unsubscribe@hadoop.apache.org>
List-Post: <mailto:yarn-issues@hadoop.apache.org>
List-Id: <yarn-issues.hadoop.apache.org>
Reply-To: yarn-issues@hadoop.apache.org
Delivered-To: mailing list yarn-issues@hadoop.apache.org
Received: (qmail 57407 invoked by uid 99); 6 Jun 2013 12:40:21 -0000
Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Jun 2013 12:40:21 +0000
Date: Thu, 6 Jun 2013 12:40:21 +0000 (UTC)
From: "Hudson (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.12650380.1370024835573.77745.1370522421246@arcas>
In-Reply-To: <JIRA.12650380.1370024835573@arcas>
References: <JIRA.12650380.1370024835573@arcas>
Subject: [jira] [Commented] (YARN-742) Log aggregation causes a lot of
 redundant setPermission calls
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394


    [ https://issues.apache.org/jira/browse/YARN-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13676968#comment-13676968 ] 

Hudson commented on YARN-742:
-----------------------------

Integrated in Hadoop-Hdfs-0.23-Build #630 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/630/])
    YARN-742. Log aggregation causes a lot of redundant setPermission calls. Contributed by Jason Lowe. (Revision 1489981)

     Result = SUCCESS
kihwal : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1489981
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-yarn-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/logaggregation/LogAggregationService.java
* /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/logaggregation/TestLogAggregationService.java

                
> Log aggregation causes a lot of redundant setPermission calls
> -------------------------------------------------------------
>
>                 Key: YARN-742
>                 URL: https://issues.apache.org/jira/browse/YARN-742
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 0.23.7, 2.0.4-alpha
>            Reporter: Kihwal Lee
>            Assignee: Jason Lowe
>             Fix For: 3.0.0, 2.1.0-beta, 0.23.9
>
>         Attachments: YARN-742-1.branch-0.23.patch, YARN-742-1.patch, YARN-742.patch
>
>
> In one of our clusters, namenode RPC is spending 45% of its time on serving setPermission calls. Further investigation has revealed that most calls are redundantly made on /mapred/logs/<user>/logs. Also mkdirs calls are made before this.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira