Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id EA52F200B66 for ; Thu, 18 Aug 2016 10:17:22 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id E71C2160AAE; Thu, 18 Aug 2016 08:17:22 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 9118F160AAB for ; Thu, 18 Aug 2016 10:17:21 +0200 (CEST) Received: (qmail 33270 invoked by uid 500); 18 Aug 2016 08:17:20 -0000 Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list yarn-issues@hadoop.apache.org Received: (qmail 33259 invoked by uid 99); 18 Aug 2016 08:17:20 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Aug 2016 08:17:20 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 7306B2C02A1 for ; Thu, 18 Aug 2016 08:17:20 +0000 (UTC) Date: Thu, 18 Aug 2016 08:17:20 +0000 (UTC) From: "tangshangwen (JIRA)" To: yarn-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (YARN-5535) Remove RMDelegationToken make resourcemanager recovery very slow MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 18 Aug 2016 08:17:23 -0000 [ https://issues.apache.org/jira/browse/YARN-5535?page=3Dcom.atlassian= .jira.plugin.system.issuetabpanels:all-tabpanel ] tangshangwen updated YARN-5535: ------------------------------- Description:=20 In our cluster, I found that when restart RM, RM recovery is very slow=EF= =BC=8C this is my log {noformat} [2016-08-12T19:43:21.478+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737879 [2016-08-12T19:43:21.478+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.486+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737878 [2016-08-12T19:43:21.486+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.494+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737877 [2016-08-12T19:43:21.494+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.503+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737876 [2016-08-12T19:43:21.503+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.519+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737875 [2016-08-12T19:43:21.519+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.533+08:00] [INFO] security.authorize.ServiceAuthorizat= ionManager.authorize(ServiceAuthorizationManager.java:148) [Socket Reader #= 1 for port 8031] : Authorization successful for yarn (auth:SIMPLE) for prot= ocol=3Dinterface org.apache.hadoop.yarn.server.api.ResourceTrackerPB [2016-08-12T19:43:21.536+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737874 [2016-08-12T19:43:21.536+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.553+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737873 [2016-08-12T19:43:21.553+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.568+08:00] [INFO] yarn.util.RackResolver.coreResolve(R= ackResolver.java:109) [IPC Server handler 0 on 8031] : Resolved xxxx-7056.h= adoop.xxx.local to /rack/rack5118 [2016-08-12T19:43:21.569+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737872 [2016-08-12T19:43:21.569+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.570+08:00] [INFO] server.resourcemanager.ResourceTrack= erService.registerNodeManager(ResourceTrackerService.java:343) [IPC Server = handler 0 on 8031] : NodeManager from node xxxxx-7056.hadoop.xxx.local(cmPo= rt: 50086 httpPort: 8042) registered with capability: , assigned nodeId xxxxxx-7056.hadoop.xxx.local:50086 [2016-08-12T19:43:21.572+08:00] [INFO] resourcemanager.rmnode.RMNodeImpl.ha= ndle(RMNodeImpl.java:424) [AsyncDispatcher event handler] : xxxxxx-7056.had= oop.xxx.local:50086 Node Transitioned from NEW to RUNNING [2016-08-12T19:43:21.576+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 1000 [2016-08-12T19:43:21.577+08:00] [INFO] scheduler.fair.FairScheduler.addNode= (FairScheduler.java:840) [ResourceManager Event Processor] : Added node xxx= xxxx-7056.hadoop.xxx.local:50086 cluster capacity: [2016-08-12T19:43:21.577+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 2000 [2016-08-12T19:43:21.578+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737870 [2016-08-12T19:43:21.578+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.579+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 3000 [2016-08-12T19:43:21.580+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 4000 [2016-08-12T19:43:21.582+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 5000 [2016-08-12T19:43:21.583+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 6000 [2016-08-12T19:43:21.585+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 7000 [2016-08-12T19:43:21.586+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 8000 [2016-08-12T19:43:21.586+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737871 [2016-08-12T19:43:21.587+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.587+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 9000 [2016-08-12T19:43:21.589+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 10000 [2016-08-12T19:43:21.595+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737868 [2016-08-12T19:43:21.595+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber {noformat} was: In our cluster, I found that when restart RM, RM recovery is very slow=EF= =BC=8C this is my log {noformat} [2016-08-12T19:43:21.478+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737879 [2016-08-12T19:43:21.478+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.486+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737878 [2016-08-12T19:43:21.486+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.494+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737877 [2016-08-12T19:43:21.494+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.503+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737876 [2016-08-12T19:43:21.503+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.519+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737875 [2016-08-12T19:43:21.519+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.533+08:00] [INFO] security.authorize.ServiceAuthorizat= ionManager.authorize(ServiceAuthorizationManager.java:148) [Socket Reader #= 1 for port 8031] : Authorization successful for yarn (auth:SIMPLE) for prot= ocol=3Dinterface org.apache.hadoop.yarn.server.api.ResourceTrackerPB [2016-08-12T19:43:21.536+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737874 [2016-08-12T19:43:21.536+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.553+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737873 [2016-08-12T19:43:21.553+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.568+08:00] [INFO] yarn.util.RackResolver.coreResolve(R= ackResolver.java:109) [IPC Server handler 0 on 8031] : Resolved xxxx-7056.h= adoop.jd.local to /rack/rack5118 [2016-08-12T19:43:21.569+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737872 [2016-08-12T19:43:21.569+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.570+08:00] [INFO] server.resourcemanager.ResourceTrack= erService.registerNodeManager(ResourceTrackerService.java:343) [IPC Server = handler 0 on 8031] : NodeManager from node xxxxx-7056.hadoop.jd.local(cmPor= t: 50086 httpPort: 8042) registered with capability: , assigned nodeId xxxxxx-7056.hadoop.jd.local:50086 [2016-08-12T19:43:21.572+08:00] [INFO] resourcemanager.rmnode.RMNodeImpl.ha= ndle(RMNodeImpl.java:424) [AsyncDispatcher event handler] : xxxxxx-7056.had= oop.jd.local:50086 Node Transitioned from NEW to RUNNING [2016-08-12T19:43:21.576+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 1000 [2016-08-12T19:43:21.577+08:00] [INFO] scheduler.fair.FairScheduler.addNode= (FairScheduler.java:840) [ResourceManager Event Processor] : Added node xxx= xxxx-7056.hadoop.jd.local:50086 cluster capacity: [2016-08-12T19:43:21.577+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 2000 [2016-08-12T19:43:21.578+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737870 [2016-08-12T19:43:21.578+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.579+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 3000 [2016-08-12T19:43:21.580+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 4000 [2016-08-12T19:43:21.582+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 5000 [2016-08-12T19:43:21.583+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 6000 [2016-08-12T19:43:21.585+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 7000 [2016-08-12T19:43:21.586+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 8000 [2016-08-12T19:43:21.586+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737871 [2016-08-12T19:43:21.587+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber [2016-08-12T19:43:21.587+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 9000 [2016-08-12T19:43:21.589+08:00] [INFO] yarn.event.AsyncDispatcher.handle(As= yncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-que= ue is 10000 [2016-08-12T19:43:21.595+08:00] [INFO] resourcemanager.security.RMDelegatio= nTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java:1= 36) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequence = number: 737868 [2016-08-12T19:43:21.595+08:00] [INFO] resourcemanager.recovery.RMStateStor= e.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing R= MDelegationToken and SequenceNumber {noformat} > Remove RMDelegationToken make resourcemanager recovery very slow > ---------------------------------------------------------------- > > Key: YARN-5535 > URL: https://issues.apache.org/jira/browse/YARN-5535 > Project: Hadoop YARN > Issue Type: Bug > Affects Versions: 2.7.1 > Reporter: tangshangwen > Assignee: tangshangwen > > In our cluster, I found that when restart RM, RM recovery is very slow=EF= =BC=8C this is my log > {noformat} > [2016-08-12T19:43:21.478+08:00] [INFO] resourcemanager.security.RMDelegat= ionTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java= :136) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequenc= e number: 737879 > [2016-08-12T19:43:21.478+08:00] [INFO] resourcemanager.recovery.RMStateSt= ore.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing= RMDelegationToken and SequenceNumber > [2016-08-12T19:43:21.486+08:00] [INFO] resourcemanager.security.RMDelegat= ionTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java= :136) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequenc= e number: 737878 > [2016-08-12T19:43:21.486+08:00] [INFO] resourcemanager.recovery.RMStateSt= ore.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing= RMDelegationToken and SequenceNumber > [2016-08-12T19:43:21.494+08:00] [INFO] resourcemanager.security.RMDelegat= ionTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java= :136) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequenc= e number: 737877 > [2016-08-12T19:43:21.494+08:00] [INFO] resourcemanager.recovery.RMStateSt= ore.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing= RMDelegationToken and SequenceNumber > [2016-08-12T19:43:21.503+08:00] [INFO] resourcemanager.security.RMDelegat= ionTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java= :136) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequenc= e number: 737876 > [2016-08-12T19:43:21.503+08:00] [INFO] resourcemanager.recovery.RMStateSt= ore.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing= RMDelegationToken and SequenceNumber > [2016-08-12T19:43:21.519+08:00] [INFO] resourcemanager.security.RMDelegat= ionTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java= :136) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequenc= e number: 737875 > [2016-08-12T19:43:21.519+08:00] [INFO] resourcemanager.recovery.RMStateSt= ore.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing= RMDelegationToken and SequenceNumber > [2016-08-12T19:43:21.533+08:00] [INFO] security.authorize.ServiceAuthoriz= ationManager.authorize(ServiceAuthorizationManager.java:148) [Socket Reader= #1 for port 8031] : Authorization successful for yarn (auth:SIMPLE) for pr= otocol=3Dinterface org.apache.hadoop.yarn.server.api.ResourceTrackerPB > [2016-08-12T19:43:21.536+08:00] [INFO] resourcemanager.security.RMDelegat= ionTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java= :136) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequenc= e number: 737874 > [2016-08-12T19:43:21.536+08:00] [INFO] resourcemanager.recovery.RMStateSt= ore.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing= RMDelegationToken and SequenceNumber > [2016-08-12T19:43:21.553+08:00] [INFO] resourcemanager.security.RMDelegat= ionTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java= :136) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequenc= e number: 737873 > [2016-08-12T19:43:21.553+08:00] [INFO] resourcemanager.recovery.RMStateSt= ore.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing= RMDelegationToken and SequenceNumber > [2016-08-12T19:43:21.568+08:00] [INFO] yarn.util.RackResolver.coreResolve= (RackResolver.java:109) [IPC Server handler 0 on 8031] : Resolved xxxx-7056= .hadoop.xxx.local to /rack/rack5118 > [2016-08-12T19:43:21.569+08:00] [INFO] resourcemanager.security.RMDelegat= ionTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java= :136) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequenc= e number: 737872 > [2016-08-12T19:43:21.569+08:00] [INFO] resourcemanager.recovery.RMStateSt= ore.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing= RMDelegationToken and SequenceNumber > [2016-08-12T19:43:21.570+08:00] [INFO] server.resourcemanager.ResourceTra= ckerService.registerNodeManager(ResourceTrackerService.java:343) [IPC Serve= r handler 0 on 8031] : NodeManager from node xxxxx-7056.hadoop.xxx.local(cm= Port: 50086 httpPort: 8042) registered with capability: , assigned nodeId xxxxxx-7056.hadoop.xxx.local:50086 > [2016-08-12T19:43:21.572+08:00] [INFO] resourcemanager.rmnode.RMNodeImpl.= handle(RMNodeImpl.java:424) [AsyncDispatcher event handler] : xxxxxx-7056.h= adoop.xxx.local:50086 Node Transitioned from NEW to RUNNING > [2016-08-12T19:43:21.576+08:00] [INFO] yarn.event.AsyncDispatcher.handle(= AsyncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-q= ueue is 1000 > [2016-08-12T19:43:21.577+08:00] [INFO] scheduler.fair.FairScheduler.addNo= de(FairScheduler.java:840) [ResourceManager Event Processor] : Added node x= xxxxxx-7056.hadoop.xxx.local:50086 cluster capacity: > [2016-08-12T19:43:21.577+08:00] [INFO] yarn.event.AsyncDispatcher.handle(= AsyncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-q= ueue is 2000 > [2016-08-12T19:43:21.578+08:00] [INFO] resourcemanager.security.RMDelegat= ionTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java= :136) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequenc= e number: 737870 > [2016-08-12T19:43:21.578+08:00] [INFO] resourcemanager.recovery.RMStateSt= ore.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing= RMDelegationToken and SequenceNumber > [2016-08-12T19:43:21.579+08:00] [INFO] yarn.event.AsyncDispatcher.handle(= AsyncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-q= ueue is 3000 > [2016-08-12T19:43:21.580+08:00] [INFO] yarn.event.AsyncDispatcher.handle(= AsyncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-q= ueue is 4000 > [2016-08-12T19:43:21.582+08:00] [INFO] yarn.event.AsyncDispatcher.handle(= AsyncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-q= ueue is 5000 > [2016-08-12T19:43:21.583+08:00] [INFO] yarn.event.AsyncDispatcher.handle(= AsyncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-q= ueue is 6000 > [2016-08-12T19:43:21.585+08:00] [INFO] yarn.event.AsyncDispatcher.handle(= AsyncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-q= ueue is 7000 > [2016-08-12T19:43:21.586+08:00] [INFO] yarn.event.AsyncDispatcher.handle(= AsyncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-q= ueue is 8000 > [2016-08-12T19:43:21.586+08:00] [INFO] resourcemanager.security.RMDelegat= ionTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java= :136) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequenc= e number: 737871 > [2016-08-12T19:43:21.587+08:00] [INFO] resourcemanager.recovery.RMStateSt= ore.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing= RMDelegationToken and SequenceNumber > [2016-08-12T19:43:21.587+08:00] [INFO] yarn.event.AsyncDispatcher.handle(= AsyncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-q= ueue is 9000 > [2016-08-12T19:43:21.589+08:00] [INFO] yarn.event.AsyncDispatcher.handle(= AsyncDispatcher.java:235) [AsyncDispatcher event handler] : Size of event-q= ueue is 10000 > [2016-08-12T19:43:21.595+08:00] [INFO] resourcemanager.security.RMDelegat= ionTokenSecretManager.removeStoredToken(RMDelegationTokenSecretManager.java= :136) [Thread[Thread-26,5,main]] : removing RMDelegation token with sequenc= e number: 737868 > [2016-08-12T19:43:21.595+08:00] [INFO] resourcemanager.recovery.RMStateSt= ore.transition(RMStateStore.java:320) [Thread[Thread-26,5,main]] : Removing= RMDelegationToken and SequenceNumber > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: yarn-issues-help@hadoop.apache.org