Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E24A71007C for ; Thu, 5 Sep 2013 08:03:04 +0000 (UTC) Received: (qmail 56972 invoked by uid 500); 5 Sep 2013 08:02:59 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 56715 invoked by uid 500); 5 Sep 2013 08:02:58 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 56707 invoked by uid 99); 5 Sep 2013 08:02:58 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Sep 2013 08:02:58 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of ravikiranmagham@gmail.com designates 209.85.212.52 as permitted sender) Received: from [209.85.212.52] (HELO mail-vb0-f52.google.com) (209.85.212.52) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Sep 2013 08:02:52 +0000 Received: by mail-vb0-f52.google.com with SMTP id f12so907858vbg.11 for ; Thu, 05 Sep 2013 01:02:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=zNiqYWNwBjVUEaccTTWi1YfvMwip/JoKRPVvp5+sycQ=; b=ZbSZ1Kd7cSLr3TAGXaWJggu/yGSU2j/2Dhco7hmn4NPouu4klUHKgbV0oa8xL0b50H HXcvllfqNY41/W+GxK35rKUp7qEDdsbvpJEj3Iz9G2Twf9xXHT8OdrEGOnDlmQknOD38 IMYUkfZsYFsbh0zilHALsns1NnsMoS51mUKFScKFvA76vXHY4CDRQBLhABFio2ZK/Yyz DeQcTCskLYOyPslWI9hVeKMjm1nlpbfDwis87oSZZVtOsBuYaIr/I1PBGMQHwGCYiMSl sv/ocrrGTcLvky8tGc0Xh0LxfkD93UnhIbQNdFPhAzE0pG1CvBx1phpGiFT6v1TN57Kq TZ1w== MIME-Version: 1.0 X-Received: by 10.58.155.68 with SMTP id vu4mr6634333veb.21.1378368151108; Thu, 05 Sep 2013 01:02:31 -0700 (PDT) Received: by 10.58.37.199 with HTTP; Thu, 5 Sep 2013 01:02:31 -0700 (PDT) In-Reply-To: References: Date: Thu, 5 Sep 2013 13:32:31 +0530 Message-ID: Subject: Re: how to observe spill operation during shuffle in mapreduce? From: Ravi Kiran To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7b604d0204425204e59e582c X-Virus-Checked: Checked by ClamAV on apache.org --047d7b604d0204425204e59e582c Content-Type: text/plain; charset=ISO-8859-1 Hi , You can look at the job metrics from your jobtracker Web UI . The "Spilled Record" Counter under the group "Map Reduce Framework" displays the number of records spilled in both map and reduce tasks. Regards Ravi Magham. On Thu, Sep 5, 2013 at 12:23 PM, ch huang wrote: > hi,all: > is there any MR spill count metric? > --047d7b604d0204425204e59e582c Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi ,

=A0 =A0You can look at the job metrics f= rom your jobtracker Web UI . =A0The "Spilled Record" Counter unde= r the group "Map Reduce Framework" displays the number of records= spilled in both map and reduce tasks.

Regards
Ravi Magham.


On Thu, Sep 5, 2013 = at 12:23 PM, ch huang <justlooks@gmail.com> wrote:
hi,all:
=A0=A0=A0=A0=A0=A0=A0is there any MR spill count metric?

--047d7b604d0204425204e59e582c--