Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 9168 invoked from network); 14 Nov 2009 16:06:14 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 14 Nov 2009 16:06:14 -0000 Received: (qmail 40346 invoked by uid 500); 14 Nov 2009 16:06:12 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 40259 invoked by uid 500); 14 Nov 2009 16:06:12 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 40249 invoked by uid 99); 14 Nov 2009 16:06:11 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 14 Nov 2009 16:06:11 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [206.190.39.248] (HELO web54206.mail.re2.yahoo.com) (206.190.39.248) by apache.org (qpsmtpd/0.29) with SMTP; Sat, 14 Nov 2009 16:06:02 +0000 Received: (qmail 37791 invoked by uid 60001); 14 Nov 2009 16:05:40 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1258214740; bh=CskUQXBtqK8ODnI5zXOMBOG5EsH/MsyUJePTqhogskE=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=U84yvCWw+CagDZOfosVniSguUe4fkW7DfVCJNWO/Md3/oxjySR96vNAUAQPPbmFD9IsgLK9Pd/0erMe3/vIAUUzTuYjfhL8ppxqMjDt7ZzyaOXikYRaE36iyqX0UtkG6RLiTp47lq1zRmxcSc2rpCONeHrsagLLmR8vPcE+gqH0= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=XLOYl3aPgGy2NNsmkf8bPYcEAgAbTYAKnWGQ2SL9SHSK4S9qZkzXe+yx448pQJ7yrejkXRZHEMYxhSLEwN4q7NHtUkNx6Gl7PG2qgCKWWeEZKPGhwroM1FleTTML/BZtJ+avHEbv4UUPoOSsaiTn9MOOnS+CJJ4eKP55UrlmH88=; Message-ID: <80049.37097.qm@web54206.mail.re2.yahoo.com> X-YMail-OSG: WAN2BhsVM1l1iSqBOQkIaTzssS87QD2Ak2QKYxsBVQqb8d6Us2K1iEc2l4DJ_V1BJ_1L02ojxwBq_wQxA7spm_Ttt..VhJWDUnM2RvSw2A7H..tzsjGtstIERpUNdoJOILVQieH7Izo5JgT1td0Mfo7gOz._wTP8nQZ5wlwOE1thgp12RGK.hhUFw9PEQ5PgGJKksMFLlfjuGdjPjsmb7JozdSUMm88Ai3XNXEmIOE5kD8mUZnw3tOcwwURkPSFVqFImzEOPa5i9T_6TAv7v4FyRoXusUdFNvUlKRQdRcLaV2HP1na3Q0j3qfg-- Received: from [67.81.13.101] by web54206.mail.re2.yahoo.com via HTTP; Sat, 14 Nov 2009 08:05:39 PST X-Mailer: YahooMailClassic/8.1.6 YahooMailWebService/0.7.361.4 Date: Sat, 14 Nov 2009 08:05:39 -0800 (PST) From: Raymond Jennings III Subject: I thought map and reduce could not overlap? To: common-user@hadoop.apache.org In-Reply-To: <016d01ca655c$4ed7e9d0$ec87bd70$@com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Virus-Checked: Checked by ClamAV on apache.org I thought there was a barrier that ensured the map phase would finish before the reduce phase started but I see on the sample hadoop word count app: 09/11/14 10:58:50 INFO mapred.JobClient: map 79% reduce 18% 09/11/14 10:58:54 INFO mapred.JobClient: map 79% reduce 19% 09/11/14 10:58:55 INFO mapred.JobClient: map 80% reduce 19% 09/11/14 10:58:58 INFO mapred.JobClient: map 80% reduce 20% 09/11/14 10:59:00 INFO mapred.JobClient: map 81% reduce 20% 09/11/14 10:59:04 INFO mapred.JobClient: map 82% reduce 20% 09/11/14 10:59:05 INFO mapred.JobClient: map 82% reduce 21% 09/11/14 10:59:08 INFO mapred.JobClient: map 82% reduce 22% That looks loke they are overlapping?