Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 01A2D9AFB for ; Fri, 18 Nov 2011 20:53:48 +0000 (UTC) Received: (qmail 52233 invoked by uid 500); 18 Nov 2011 20:53:46 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 52202 invoked by uid 500); 18 Nov 2011 20:53:46 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 52194 invoked by uid 99); 18 Nov 2011 20:53:46 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Nov 2011 20:53:46 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of kim@reflectivedevelopment.com designates 69.56.150.9 as permitted sender) Received: from [69.56.150.9] (HELO gateway.websitewelcome.com) (69.56.150.9) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Nov 2011 20:53:39 +0000 Received: by gateway.websitewelcome.com (Postfix, from userid 5007) id 63368CF61E0F6; Fri, 18 Nov 2011 14:52:13 -0600 (CST) Received: from gator1767.hostgator.com (gator1767.hostgator.com [50.97.101.202]) by gateway.websitewelcome.com (Postfix) with ESMTP id 546A0CF61E0CB for ; Fri, 18 Nov 2011 14:52:13 -0600 (CST) Received: from [199.192.164.75] (port=50295 helo=[10.0.2.15]) by gator1767.hostgator.com with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69) (envelope-from ) id 1RRVPw-0003Ie-SG for mapreduce-user@hadoop.apache.org; Fri, 18 Nov 2011 14:52:13 -0600 Message-ID: <4EC6C57B.60306@reflectivedevelopment.com> Date: Fri, 18 Nov 2011 13:52:11 -0700 From: Kim Ebert User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.13) Gecko/20101217 Thunderbird/3.1.7 MIME-Version: 1.0 To: mapreduce-user@hadoop.apache.org Subject: Re: context.write in cleanup? References: <4EC6AE6B.50208@reflectivedevelopment.com> <86FA7143-41FF-4840-94E5-FC6283208104@cloudera.com> In-Reply-To: <86FA7143-41FF-4840-94E5-FC6283208104@cloudera.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - gator1767.hostgator.com X-AntiAbuse: Original Domain - hadoop.apache.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - reflectivedevelopment.com X-BWhitelist: no X-Source: X-Source-Args: X-Source-Dir: X-Source-Sender: ([10.0.2.15]) [199.192.164.75]:50295 X-Source-Auth: kim@reflectivedevelopment.com X-Email-Count: 1 X-Source-Cap: cmVmbGVjdGk7cmVmbGVjdGk7Z2F0b3IxNzY3Lmhvc3RnYXRvci5jb20= Thanks for your help Harsh. Kim On 11/18/2011 12:18 PM, Harsh J wrote: > Kim, > > Yes. > > See the discussion at http://search-hadoop.com/m/jzO0k18XoNW1 > > On 19-Nov-2011, at 12:43 AM, Kim Ebert wrote: > >> I was wondering if a context.write is possible in the cleanup of a Mapper. >> >> For example, if the map function queues the item in an external process, and then in the cleanup phase all the results from the external process are mapped. >> >> From looking at how the map reduce process works, I would think this is possible. >> >> Thanks, >> >> Kim >