Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 43267 invoked from network); 10 Dec 2009 16:13:01 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 10 Dec 2009 16:13:01 -0000 Received: (qmail 77508 invoked by uid 500); 10 Dec 2009 16:12:59 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 77433 invoked by uid 500); 10 Dec 2009 16:12:58 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 77423 invoked by uid 99); 10 Dec 2009 16:12:58 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Dec 2009 16:12:58 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of dachuy@gmail.com designates 209.85.160.50 as permitted sender) Received: from [209.85.160.50] (HELO mail-pw0-f50.google.com) (209.85.160.50) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Dec 2009 16:12:49 +0000 Received: by pwi20 with SMTP id 20so3638611pwi.29 for ; Thu, 10 Dec 2009 08:12:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from :user-agent:mime-version:to:subject:references:in-reply-to :content-type:content-transfer-encoding; bh=jJar4e0sWKtbz9C904zgAomD3XS8aVFZAjmD2Xmu5l4=; b=dMw9Auh1y70ijwRsXylfntdcsKSFQSlY3R2KaKZtHp0SGiIB7WxeAWyn5IeJPeQjmP i8ue+3uHFjdaoNmkmVF47naeGtTfUg29cxc8waw6T646Iq6Xc+SlyIr92rmw+0of+E5P ZFy6Z9mQ3lq9TrU9oDsvoNSJRmDg3SwGhctf0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding; b=RNEf/gOQBq/uzyYkgkyKL6EYWXA8DTGxo+6VFZeGkSPS1cAFcbEmuQpZK6LwhE0luD DjoYDal1F53TAyMtpymBPg5vQpLcx7FmH8FFkVDKhVnFWOwD7Xx2dV/w+4AIqI3/EE+o wrstwYKjN4ol5dIIIqRGLxZFcNDXuENE2XaHs= Received: by 10.141.105.16 with SMTP id h16mr66466rvm.150.1260461548341; Thu, 10 Dec 2009 08:12:28 -0800 (PST) Received: from ?192.168.11.100? ([115.75.28.37]) by mx.google.com with ESMTPS id 21sm1017623pzk.3.2009.12.10.08.12.27 (version=SSLv3 cipher=RC4-MD5); Thu, 10 Dec 2009 08:12:27 -0800 (PST) Message-ID: <4B211DF5.2060800@gmail.com> Date: Thu, 10 Dec 2009 23:12:37 +0700 From: Huy Phan User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.5) Gecko/20091204 Thunderbird/3.0 MIME-Version: 1.0 To: common-user@hadoop.apache.org Subject: Re: map output not euqal to reduce input References: <978134.23376.qm@web15905.mail.cnb.yahoo.com> In-Reply-To: <978134.23376.qm@web15905.mail.cnb.yahoo.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Virus-Checked: Checked by ClamAV on apache.org Do you have any combiner implemented in your job ? On 12/10/2009 09:11 PM, Gang Luo wrote: > Hi all, > after finish one mapreduce job, the statistics shows that the number of records map generated is not equal to the number of records that reduce input. It says: > > Map output records=150000 > Reduce input records=93282 > > I think it is abnormal. Please give me some ideas how this happen and how to fix it. Thanks. > > > -Gang > > > ___________________________________________________________ > ºÃÍæºØ¿¨µÈÄã·¢£¬ÓÊÏäºØ¿¨È«ÐÂÉÏÏߣ¡ > http://card.mail.cn.yahoo.com/ > >