Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 16290 invoked from network); 7 Aug 2008 23:24:39 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 7 Aug 2008 23:24:39 -0000 Received: (qmail 14785 invoked by uid 500); 7 Aug 2008 23:24:32 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 14745 invoked by uid 500); 7 Aug 2008 23:24:32 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 14734 invoked by uid 99); 7 Aug 2008 23:24:32 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 07 Aug 2008 16:24:32 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [207.138.32.144] (HELO ironport1-corp-sfi.liveops.com) (207.138.32.144) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 07 Aug 2008 23:23:36 +0000 X-IronPort-AV: E=Sophos;i="4.31,323,1215414000"; d="java'?scan'208";a="4589243" Received: from maila-pai.liveops.com (HELO mail.liveops.com) ([192.168.152.15]) by ironport1-corp-sfi.liveops.com with ESMTP; 07 Aug 2008 16:24:01 -0700 Received: from exchange07.liveops.com ([192.168.152.28]) by mail.liveops.com with Microsoft SMTPSVC(6.0.3790.3959); Thu, 7 Aug 2008 16:24:01 -0700 Received: from IMAP-SC.liveops.com (192.168.152.66) by exchange07.liveops.com (192.168.152.28) with Microsoft SMTP Server (TLS) id 8.1.291.1; Thu, 7 Aug 2008 16:24:00 -0700 Received: from IMAP-SC.liveops.com ([::1]) by IMAP-SC.liveops.com ([::1]) with mapi; Thu, 7 Aug 2008 16:24:00 -0700 From: Michael Andrews To: "core-user@hadoop.apache.org" Date: Thu, 7 Aug 2008 16:23:56 -0700 Subject: Re: Passing TupleWritable between map and reduce Thread-Topic: Passing TupleWritable between map and reduce Thread-Index: Acj449jhys3ScDHIl0uQYSwx+u5J6AAANCe8 Message-ID: In-Reply-To: Accept-Language: en-US Content-Language: en X-MS-Has-Attach: yes X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: multipart/mixed; boundary="_002_C4C0D21E61mandrewsliveopscom_" MIME-Version: 1.0 X-OriginalArrivalTime: 07 Aug 2008 23:24:01.0001 (UTC) FILETIME=[AC7AA590:01C8F8E4] X-Virus-Checked: Checked by ClamAV on apache.org --_002_C4C0D21E61mandrewsliveopscom_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Sorry about the massive code chunk, I am not used to this mail client, I at= tached the file instead. On 8/7/08 4:18 PM, "Michael Andrews" wrote: Hi, I am a new hadoop developer and am struggling to understand why I cannot pa= ss TupleWritable between a map and reduce function. I have modified the wo= rdcount example to demonstrate the issue. Also I am using hadoop 0.17.1. Is properly constructing the desired tuple. I am not sure if it is being o= utputed correctly by output.collect as I cannot find the field in the Outpu= tCollector data structure. When I check in the reduce method the values ar= e always empty tuples. I have a feeling it has something to do with this l= ine in the JavaDoc: TupleWritable(Writable[] vals) Initialize tuple with storage; unknown whether any of them contai= n "written" values. Thanks in advance for any all help, Michael --_002_C4C0D21E61mandrewsliveopscom_--