Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7C75B72F9 for ; Thu, 13 Oct 2011 01:17:35 +0000 (UTC) Received: (qmail 86399 invoked by uid 500); 13 Oct 2011 01:17:35 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 86367 invoked by uid 500); 13 Oct 2011 01:17:35 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 86359 invoked by uid 99); 13 Oct 2011 01:17:35 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 13 Oct 2011 01:17:35 +0000 X-ASF-Spam-Status: No, hits=-2000.5 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 13 Oct 2011 01:17:32 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id D9909305E2C for ; Thu, 13 Oct 2011 01:17:11 +0000 (UTC) Date: Thu, 13 Oct 2011 01:17:11 +0000 (UTC) From: "Jonathan Eagles (Commented) (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: <1072814156.7568.1318468631892.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1798068554.12358.1310157976821.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (MAPREDUCE-2666) MR-279: Need to retrieve shuffle port number on ApplicationMaster restart MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/MAPREDUCE-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13126283#comment-13126283 ] Jonathan Eagles commented on MAPREDUCE-2666: -------------------------------------------- Thanks to Bobby, Vinod, and Arun for helping to get this in. bq. I just committed this. Thanks Jonathan! bq. Thanks to Bobby and Vinod for reviews. > MR-279: Need to retrieve shuffle port number on ApplicationMaster restart > ------------------------------------------------------------------------- > > Key: MAPREDUCE-2666 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2666 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2 > Affects Versions: 0.23.0 > Reporter: Robert Joseph Evans > Assignee: Jonathan Eagles > Priority: Blocker > Fix For: 0.23.0 > > Attachments: MAPREDUCE-2666.patch, MAPREDUCE-2666.patch > > > MAPREDUCE-2652 allows ShuffleHandler to return the port it is operating on. In the case of an ApplicationMaster crash where it needs to be restarted that information is lost. We either need to re-query it from each of the NodeManagers or to persist it to the JobHistory logs and retrieve it again. The job history logs is probably the simpler solution. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira