Return-Path: X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 586B07447 for ; Wed, 28 Dec 2011 01:47:25 +0000 (UTC) Received: (qmail 14326 invoked by uid 500); 28 Dec 2011 01:47:23 -0000 Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org Received: (qmail 14278 invoked by uid 500); 28 Dec 2011 01:47:23 -0000 Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-dev@hadoop.apache.org Delivered-To: mailing list common-dev@hadoop.apache.org Received: (qmail 14270 invoked by uid 99); 28 Dec 2011 01:47:23 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Dec 2011 01:47:23 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=5.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of devaraj.k@huawei.com designates 119.145.14.66 as permitted sender) Received: from [119.145.14.66] (HELO szxga03-in.huawei.com) (119.145.14.66) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Dec 2011 01:47:16 +0000 Received: from huawei.com (szxga03-in [172.24.2.9]) by szxga03-in.huawei.com (iPlanet Messaging Server 5.2 HotFix 2.14 (built Aug 8 2006)) with ESMTP id <0LWW00D1X4UE93@szxga03-in.huawei.com> for common-dev@hadoop.apache.org; Wed, 28 Dec 2011 09:44:38 +0800 (CST) Received: from szxrg01-dlp.huawei.com ([172.24.2.119]) by szxga03-in.huawei.com (iPlanet Messaging Server 5.2 HotFix 2.14 (built Aug 8 2006)) with ESMTP id <0LWW00B184UEAK@szxga03-in.huawei.com> for common-dev@hadoop.apache.org; Wed, 28 Dec 2011 09:44:38 +0800 (CST) Received: from szxeml208-edg.china.huawei.com ([172.24.2.119]) by szxrg01-dlp.huawei.com (MOS 4.1.9-GA) with ESMTP id AGB24612; Wed, 28 Dec 2011 09:44:38 +0800 Received: from SZXEML409-HUB.china.huawei.com (10.82.67.136) by szxeml208-edg.china.huawei.com (172.24.2.60) with Microsoft SMTP Server (TLS) id 14.1.323.3; Wed, 28 Dec 2011 09:44:35 +0800 Received: from blrnshtipl5nc (10.18.1.35) by szxeml409-hub.china.huawei.com (10.82.67.136) with Microsoft SMTP Server id 14.1.323.3; Wed, 28 Dec 2011 09:44:34 +0800 Date: Wed, 28 Dec 2011 07:14:37 +0530 From: Devaraj K Subject: RE: Writing output in multiple files in Hadoop In-reply-to: X-Originating-IP: [10.18.1.35] To: common-dev@hadoop.apache.org Reply-to: devaraj.k@huawei.com Message-id: <7E263079FBAF452F890BB3FB8E33388A@china.huawei.com> Organization: Htipl MIME-version: 1.0 X-MIMEOLE: Produced By Microsoft MimeOLE V6.00.3790.4862 X-Mailer: Microsoft Office Outlook 11 Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT Thread-index: AczEt2INJwkK/uytQUi7uCqM06bYBQASpkwg X-CFilter-Loop: Reflected X-Virus-Checked: Checked by ClamAV on apache.org Can you check the MultipleOutputs class. http://hadoop.apache.org/common/docs/r0.20.205.0/api/org/apache/hadoop/mapre d/lib/MultipleOutputs.html Devaraj K -----Original Message----- From: Bhavesh Shah [mailto:bhavesh25shah@gmail.com] Sent: Tuesday, December 27, 2011 3:29 PM To: hadoop-dev@lucene.apache.org Subject: Writing output in multiple files in Hadoop Hello all, I want to write the files according to months using map-reduce in hadoop. If data is from January month then the data should be wriiten in jan-file and likewise for each month there should be seperate file. How Can I create such file in hadoop mapredude. I am trying for recursive map-reduce but not getting how to implement it? Pls suggest me some solution. Thanks. -- Regards, Bhavesh Shah