Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 40153 invoked from network); 11 Jul 2008 20:56:17 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 11 Jul 2008 20:56:17 -0000 Received: (qmail 74583 invoked by uid 500); 11 Jul 2008 20:56:14 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 74546 invoked by uid 500); 11 Jul 2008 20:56:14 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 74535 invoked by uid 99); 11 Jul 2008 20:56:14 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Jul 2008 13:56:14 -0700 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [216.145.54.171] (HELO mrout1.yahoo.com) (216.145.54.171) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Jul 2008 20:55:18 +0000 Received: from [10.72.104.13] (walkduty-lm.corp.yahoo.com [10.72.104.13]) by mrout1.yahoo.com (8.13.6/8.13.6/y.out) with ESMTP id m6BKrEv7081547 for ; Fri, 11 Jul 2008 13:53:14 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns; h=mime-version:in-reply-to:references:content-type:message-id: content-transfer-encoding:from:subject:date:to:x-mailer; b=S1hGjDI9mhXxVNLLY8M4ypz5G0SMatYCC3gYoeGpCMXHvD1cOj+G/qzGMexpHEDH Mime-Version: 1.0 (Apple Message framework v753.1) In-Reply-To: References: Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: <0651A87B-C798-4451-8088-67C50C30913E@yahoo-inc.com> Content-Transfer-Encoding: 7bit From: Arun C Murthy Subject: Re: question on tasktracker status Date: Fri, 11 Jul 2008 13:53:49 -0700 To: core-user@hadoop.apache.org X-Mailer: Apple Mail (2.753.1) X-Virus-Checked: Checked by ClamAV on apache.org On Jul 11, 2008, at 1:35 PM, Mori Bellamy wrote: > hey all, > what dictates the "% complete" bars for maptasks and reduce tasks? > i ask because, for one of my map jobs, the tasks hang at 0% for a > long time until they jump to 100%. > Maps -> amount of input consumed (this is the normal case when you are processing data on HDFS) Reduces -> Shuffle is 0-33% (shuffle is the phase where you copy output of the maps), Merge is 33-66% (here sorted map-outputs are being merged), rest is reduce (where user's Reducer.reduce methods are being invoked). Arun