Return-Path: X-Original-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E56F511B1C for ; Wed, 21 May 2014 21:54:39 +0000 (UTC) Received: (qmail 61886 invoked by uid 500); 21 May 2014 21:54:39 -0000 Delivered-To: apmail-hadoop-yarn-issues-archive@hadoop.apache.org Received: (qmail 61798 invoked by uid 500); 21 May 2014 21:54:39 -0000 Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: yarn-issues@hadoop.apache.org Delivered-To: mailing list yarn-issues@hadoop.apache.org Received: (qmail 61701 invoked by uid 99); 21 May 2014 21:54:39 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 May 2014 21:54:39 +0000 Date: Wed, 21 May 2014 21:54:39 +0000 (UTC) From: "Jon Bringhurst (JIRA)" To: yarn-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (YARN-2093) Fair Scheduler IllegalStateException after upgrade from 2.2.0 to 2.4.1-SNAP MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/YARN-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jon Bringhurst updated YARN-2093: --------------------------------- Description: After upgrading from 2.2.0 to 2.4.1-SNAP, I ran into the following on startup: {noformat} 21:19:34,308 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0003_000009 State change from SUBMITTED to SCHEDULED 21:19:34,309 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0004_000008 State change from SUBMITTED to SCHEDULED 21:19:34,310 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0003_000010 State change from SUBMITTED to SCHEDULED 21:19:34,310 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0003_000011 State change from SUBMITTED to SCHEDULED 21:19:34,317 INFO FairScheduler:673 - Added Application Attempt appattempt_1400092144371_0004_000009 to scheduler from user: samza-perf-playground 21:19:34,318 INFO FairScheduler:673 - Added Application Attempt appattempt_1400092144371_0004_000010 to scheduler from user: samza-perf-playground 21:19:34,318 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0004_000009 State change from SUBMITTED to SCHEDULED 21:19:34,318 INFO FairScheduler:733 - Application appattempt_1400092144371_0003_000005 is done. finalState=FAILED 21:19:34,319 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0004_000010 State change from SUBMITTED to SCHEDULED 21:19:34,319 INFO AppSchedulingInfo:108 - Application application_1400092144371_0003 requests cleared 21:19:34,319 INFO FairScheduler:673 - Added Application Attempt appattempt_1400092144371_0004_000011 to scheduler from user: samza-perf-playground 21:19:34,320 INFO FairScheduler:733 - Application appattempt_1400092144371_0003_000006 is done. finalState=FAILED 21:19:34,320 INFO AppSchedulingInfo:108 - Application application_1400092144371_0003 requests cleared 21:19:34,320 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0004_000011 State change from SUBMITTED to SCHEDULED 21:19:34,323 FATAL ResourceManager:600 - Error in handling event type APP_ATTEMPT_REMOVED to the scheduler java.lang.IllegalStateException: Given app to remove org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSSchedulerApp@429f809d does not exist in queue [root.samza-perf-playground, demand=, running=, share=, w=] at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSLeafQueue.removeApp(FSLeafQueue.java:93) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.removeApplicationAttempt(FairScheduler.java:774) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:1201) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:122) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:591) at java.lang.Thread.run(Thread.java:744) 21:19:34,330 INFO ResourceManager:604 - Exiting, bbye.. 21:19:34,335 INFO log:67 - Stopped SelectChannelConnector@xxxx:8088 21:19:34,437 INFO Server:2398 - Stopping server on 8033 21:19:34,438 INFO Server:694 - Stopping IPC Server listener on 8033 {noformat} Last commit message for this build is (branch-2.4 on github.com/apache/hadoop-common): {noformat} commit 09e24d5519187c0db67aacc1992be5d43829aa1e Author: Arpit Agarwal Date: Tue May 20 20:18:46 2014 +0000 HADOOP-10562. Fix CHANGES.txt entry again git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2.4@1596389 13f79535-47bb-0310-9956-ffa450edef68 {noformat} was: After upgrading from 2.2.0 to 2.4.1-SNAP, I ran into the following on startup: {noformat} 21:19:34,308 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0003_000009 State change from SUBMITTED to SCHEDULED 21:19:34,309 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0004_000008 State change from SUBMITTED to SCHEDULED 21:19:34,310 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0003_000010 State change from SUBMITTED to SCHEDULED 21:19:34,310 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0003_000011 State change from SUBMITTED to SCHEDULED 21:19:34,317 INFO FairScheduler:673 - Added Application Attempt appattempt_1400092144371_0004_000009 to scheduler from user: samza-perf-playground 21:19:34,318 INFO FairScheduler:673 - Added Application Attempt appattempt_1400092144371_0004_000010 to scheduler from user: samza-perf-playground 21:19:34,318 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0004_000009 State change from SUBMITTED to SCHEDULED 21:19:34,318 INFO FairScheduler:733 - Application appattempt_1400092144371_0003_000005 is done. finalState=FAILED 21:19:34,319 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0004_000010 State change from SUBMITTED to SCHEDULED 21:19:34,319 INFO AppSchedulingInfo:108 - Application application_1400092144371_0003 requests cleared 21:19:34,319 INFO FairScheduler:673 - Added Application Attempt appattempt_1400092144371_0004_000011 to scheduler from user: samza-perf-playground 21:19:34,320 INFO FairScheduler:733 - Application appattempt_1400092144371_0003_000006 is done. finalState=FAILED 21:19:34,320 INFO AppSchedulingInfo:108 - Application application_1400092144371_0003 requests cleared 21:19:34,320 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0004_000011 State change from SUBMITTED to SCHEDULED 21:19:34,323 FATAL ResourceManager:600 - Error in handling event type APP_ATTEMPT_REMOVED to the scheduler java.lang.IllegalStateException: Given app to remove org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSSchedulerApp@429f809d does not exist in queue [root.samza-perf-playground, demand=, running=, share=, w=] at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSLeafQueue.removeApp(FSLeafQueue.java:93) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.removeApplicationAttempt(FairScheduler.java:774) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:1201) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:122) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:591) at java.lang.Thread.run(Thread.java:744) 21:19:34,330 INFO ResourceManager:604 - Exiting, bbye.. 21:19:34,335 INFO log:67 - Stopped SelectChannelConnector@xxxx:8088 21:19:34,437 INFO Server:2398 - Stopping server on 8033 21:19:34,438 INFO Server:694 - Stopping IPC Server listener on 8033 {noformat} Last commit message is (branch-2.4 on github.com/apache/hadoop-common): {noformat} commit 09e24d5519187c0db67aacc1992be5d43829aa1e Author: Arpit Agarwal Date: Tue May 20 20:18:46 2014 +0000 HADOOP-10562. Fix CHANGES.txt entry again git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2.4@1596389 13f79535-47bb-0310-9956-ffa450edef68 {noformat} > Fair Scheduler IllegalStateException after upgrade from 2.2.0 to 2.4.1-SNAP > --------------------------------------------------------------------------- > > Key: YARN-2093 > URL: https://issues.apache.org/jira/browse/YARN-2093 > Project: Hadoop YARN > Issue Type: Bug > Affects Versions: 2.4.1 > Reporter: Jon Bringhurst > > After upgrading from 2.2.0 to 2.4.1-SNAP, I ran into the following on startup: > {noformat} > 21:19:34,308 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0003_000009 State change from SUBMITTED to SCHEDULED > 21:19:34,309 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0004_000008 State change from SUBMITTED to SCHEDULED > 21:19:34,310 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0003_000010 State change from SUBMITTED to SCHEDULED > 21:19:34,310 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0003_000011 State change from SUBMITTED to SCHEDULED > 21:19:34,317 INFO FairScheduler:673 - Added Application Attempt appattempt_1400092144371_0004_000009 to scheduler from user: samza-perf-playground > 21:19:34,318 INFO FairScheduler:673 - Added Application Attempt appattempt_1400092144371_0004_000010 to scheduler from user: samza-perf-playground > 21:19:34,318 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0004_000009 State change from SUBMITTED to SCHEDULED > 21:19:34,318 INFO FairScheduler:733 - Application appattempt_1400092144371_0003_000005 is done. finalState=FAILED > 21:19:34,319 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0004_000010 State change from SUBMITTED to SCHEDULED > 21:19:34,319 INFO AppSchedulingInfo:108 - Application application_1400092144371_0003 requests cleared > 21:19:34,319 INFO FairScheduler:673 - Added Application Attempt appattempt_1400092144371_0004_000011 to scheduler from user: samza-perf-playground > 21:19:34,320 INFO FairScheduler:733 - Application appattempt_1400092144371_0003_000006 is done. finalState=FAILED > 21:19:34,320 INFO AppSchedulingInfo:108 - Application application_1400092144371_0003 requests cleared > 21:19:34,320 INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0004_000011 State change from SUBMITTED to SCHEDULED > 21:19:34,323 FATAL ResourceManager:600 - Error in handling event type APP_ATTEMPT_REMOVED to the scheduler > java.lang.IllegalStateException: Given app to remove org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSSchedulerApp@429f809d does not exist in queue [root.samza-perf-playground, demand=, running=, share=, w=] > at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSLeafQueue.removeApp(FSLeafQueue.java:93) > at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.removeApplicationAttempt(FairScheduler.java:774) > at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:1201) > at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:122) > at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:591) > at java.lang.Thread.run(Thread.java:744) > 21:19:34,330 INFO ResourceManager:604 - Exiting, bbye.. > 21:19:34,335 INFO log:67 - Stopped SelectChannelConnector@xxxx:8088 > 21:19:34,437 INFO Server:2398 - Stopping server on 8033 > 21:19:34,438 INFO Server:694 - Stopping IPC Server listener on 8033 > {noformat} > Last commit message for this build is (branch-2.4 on github.com/apache/hadoop-common): > {noformat} > commit 09e24d5519187c0db67aacc1992be5d43829aa1e > Author: Arpit Agarwal > Date: Tue May 20 20:18:46 2014 +0000 > HADOOP-10562. Fix CHANGES.txt entry again > > git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2.4@1596389 13f79535-47bb-0310-9956-ffa450edef68 > {noformat} -- This message was sent by Atlassian JIRA (v6.2#6252)