Return-Path: X-Original-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7FD3F11089 for ; Tue, 23 Sep 2014 14:55:33 +0000 (UTC) Received: (qmail 19552 invoked by uid 500); 23 Sep 2014 14:28:55 -0000 Delivered-To: apmail-hadoop-yarn-issues-archive@hadoop.apache.org Received: (qmail 10292 invoked by uid 500); 23 Sep 2014 14:28:50 -0000 Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: yarn-issues@hadoop.apache.org Delivered-To: mailing list yarn-issues@hadoop.apache.org Received: (qmail 99813 invoked by uid 99); 23 Sep 2014 13:46:40 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 23 Sep 2014 13:46:40 +0000 Date: Tue, 23 Sep 2014 13:46:40 +0000 (UTC) From: "Hudson (JIRA)" To: yarn-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (YARN-1372) Ensure all completed containers are reported to the AMs across RM restart MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/YARN-1372?page=3Dcom.atlassian.= jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D14144= 800#comment-14144800 ]=20 Hudson commented on YARN-1372: ------------------------------ FAILURE: Integrated in Hadoop-Mapreduce-trunk #1905 (See [https://builds.ap= ache.org/job/Hadoop-Mapreduce-trunk/1905/]) YARN-1372. Ensure all completed containers are reported to the AMs across R= M restart. Contributed by Anubhav Dhoot (jianhe: rev 0a641496c706fc175e7bf6= 6d69ebf71c7d078e84) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-res= ourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rm= app/attempt/TestRMAppAttemptTransitions.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-res= ourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rm= node/RMNodeImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-com= mon/src/main/proto/yarn_server_common_service_protos.proto * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nod= emanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManage= r.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nod= emanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeSt= atusUpdater.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-res= ourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/ap= plicationsmanager/TestAMRestart.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-com= mon/src/main/java/org/apache/hadoop/yarn/server/api/protocolrecords/impl/pb= /NodeHeartbeatResponsePBImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-res= ourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/Te= stResourceTrackerService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-res= ourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rm= container/RMContainerImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-res= ourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/Re= sourceTrackerService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-res= ourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rm= node/RMNodeEventType.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-res= ourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rm= app/attempt/event/RMAppAttemptContainerFinishedEvent.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-res= ourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rm= app/attempt/RMAppAttempt.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-res= ourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rm= app/attempt/RMAppAttemptImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-res= ourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rm= app/RMAppImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nod= emanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatus= UpdaterImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-res= ourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rm= node/RMNodeFinishedContainersPulledByAMEvent.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-com= mon/src/main/java/org/apache/hadoop/yarn/server/api/protocolrecords/NodeHea= rtbeatResponse.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-res= ourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/se= curity/TestAMRMTokens.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nod= emanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeMa= nagerResync.java > Ensure all completed containers are reported to the AMs across RM restart > ------------------------------------------------------------------------- > > Key: YARN-1372 > URL: https://issues.apache.org/jira/browse/YARN-1372 > Project: Hadoop YARN > Issue Type: Sub-task > Components: resourcemanager > Reporter: Bikas Saha > Assignee: Anubhav Dhoot > Fix For: 2.6.0 > > Attachments: YARN-1372.001.patch, YARN-1372.001.patch, YARN-1372.= 002_NMHandlesCompletedApp.patch, YARN-1372.002_RMHandlesCompletedApp.patch,= YARN-1372.002_RMHandlesCompletedApp.patch, YARN-1372.003.patch, YARN-1372.= 004.patch, YARN-1372.005.patch, YARN-1372.005.patch, YARN-1372.006.patch, Y= ARN-1372.007.patch, YARN-1372.008.patch, YARN-1372.009.patch, YARN-1372.009= .patch, YARN-1372.010.patch, YARN-1372.prelim.patch, YARN-1372.prelim2.patc= h > > > Currently the NM informs the RM about completed containers and then remov= es those containers from the RM notification list. The RM passes on that co= mpleted container information to the AM and the AM pulls this data. If the = RM dies before the AM pulls this data then the AM may not be able to get th= is information again. To fix this, NM should maintain a separate list of su= ch completed container notifications sent to the RM. After the AM has pulle= d the containers from the RM then the RM will inform the NM about it and th= e NM can remove the completed container from the new list. Upon re-register= with the RM (after RM restart) the NM should send the entire list of compl= eted containers to the RM along with any other containers that completed wh= ile the RM was dead. This ensures that the RM can inform the AM's about all= completed containers. Some container completions may be reported more than= once since the AM may have pulled the container but the RM may die before = notifying the NM about the pull. -- This message was sent by Atlassian JIRA (v6.3.4#6332)