Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6E323174AA for ; Mon, 1 Jun 2015 19:27:15 +0000 (UTC) Received: (qmail 29821 invoked by uid 500); 1 Jun 2015 19:27:10 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 29718 invoked by uid 500); 1 Jun 2015 19:27:10 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Delivered-To: moderator for user@hadoop.apache.org Received: (qmail 16333 invoked by uid 99); 30 May 2015 05:57:51 -0000 X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.869 X-Spam-Level: ** X-Spam-Status: No, score=2.869 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1432965458; bh=Ewwi2FcFwwJLvGqmh8XVpTEw3kOLMZU1cnb9izAsC0Q=; h=Date:From:Reply-To:To:Subject:From:Subject; b=fxq4K0+xL4M9md01a1mE1zMJY3x2qpK4zfG47GQ5clGzpn8ExndvwjSnsHOgNGPjnVFS5M/bTIhUngpBbftMEZw/sJpiEbGI4g7m9x/vJ1nQARwZcJx4ujSQDr+pQLFjgGR9b3Js6t7f9LploVR6sIS8hOurOawv4Kjp0vFRiGhzsSFllRqOWuS3ulhH84jvfCPDK2Sm1lve03LEgppNrNCKaWRJFBzoQ9sXcTPSbTIiwtE+pyCj5vXSf231Itj/l2GrvovzIcQE30CwcJ/JUa/ue2RA3YP583cxJhUxd5VpGH6C+ETHYHNjVGVQtmITLo1OxbDgYPchXI58nVr28A== X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 246881.17868.bm@omp1026.mail.bf1.yahoo.com X-YMail-OSG: z_fOLKUVM1njHIOUBZzSHb5LoEPMmIeLyTQijSF8Lv3f1ubYm9SE70HLQN8RERN 6YxKK.LJnVMR4NmLB6bzoRJwHopCmUk8XZX56l4vDFVyfDZRcIJa0cIgHis.2I2c1RkryJW4P3Jj CRaKIyuy_GmIrm57CrOSiYlW74i5K9P2.Y3Tv1Fhsjm1KL3mHxjd6AaBrlCDhnRLyHvUeU50ThKS AU0QbcD4ee5wKb4Wrx0fT3fa4TC6CicgxD_t964yQr4LXtBT5N_fSd2BqEn_rtGV2c3iRmfZMUV2 D2ZZWl3SKSbf1jSL6P2Bt5ziRGQta4H37bamAmBSvEbPtSmUlnG3rQmqfIHiksosfF0Y.41hkOXC qQajxIFncO2yVgIEeMtLGCvF37DU9cyagu.JM7RFL3MKWiimnG.OL02cDWxi83PkZkUVWfs7.7K1 483ervIuYlNE3KqT0Fpk9x7CV5_uY.QoEAXCzPqhaf7hMJRqsiMr3zonMbRqvWqw0kDEVUg_hoCB Uh1.cPyjlaPuNZ3tmiy.wvbU- Date: Sat, 30 May 2015 05:57:37 +0000 (UTC) From: Grandl Robert Reply-To: Grandl Robert To: HDP Mailing List Message-ID: <906921377.1934429.1432965457422.JavaMail.yahoo@mail.yahoo.com> Subject: reduce finished container statuses not present at AM MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_1934428_1480555658.1432965457419" ------=_Part_1934428_1480555658.1432965457419 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Hi guys, I was running a simple Terasort job with 4 mappers and 2 reducers using Hadoop 3.0.0-Snapshot(trunk). I was analyzing the finished containers reported to AM in RMContainerAllocator.java -> getResources(), but I realized that none of the finished containers for reducers are sent back to AM. Is this a bug or as designed ? I remember I did a similar analysis for Hadoop 2.3 and I got finished containers statuses both for mappers and reducers. Could someone explain me what is the case ? Thank you,Robert ------=_Part_1934428_1480555658.1432965457419 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

Hi guys,

I was running a si= mple Terasort job with 4 mappers and 2 reducers using Hadoop 3.0.0-Snapshot= (trunk).

I was analyzing the finish= ed containers reported to AM in RMContainerAllocator.java -> getResource= s(), but I realized that none of the finished containers for reducers are sent back to AM. Is this a bug or as designed ?

I remember I did a similar analysis for= Hadoop 2.3 and I got finished containers statuses both for mappers and red= ucers.

Could someo= ne explain me what is the case ?

Thank you,

Robert

------=_Part_1934428_1480555658.1432965457419--