Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 28A3AC20B for ; Sun, 16 Jun 2013 15:17:16 +0000 (UTC) Received: (qmail 80233 invoked by uid 500); 16 Jun 2013 15:17:11 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 80100 invoked by uid 500); 16 Jun 2013 15:17:11 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Delivered-To: moderator for user@hadoop.apache.org Received: (qmail 68840 invoked by uid 99); 12 Jun 2013 15:46:06 -0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,UNPARSEABLE_RELAY X-Spam-Check-By: apache.org Received-SPF: unknown (athena.apache.org: error in processing during lookup of myabandeh@qf.org.qa) X-Env-Sender: myabandeh@qf.org.qa X-Msg-Ref: server-7.tower-39.messagelabs.com!1371051932!16353868!1 X-Originating-IP: [86.36.49.93] X-StarScan-Received: X-StarScan-Version: 6.9.6; banners=qf.org.qa,-,- X-VirusChecked: Checked From: Maysam Hossein Yabandeh To: "user@hadoop.apache.org" CC: Maysam Hossein Yabandeh Subject: Assigning the same partition number to the mapper output Thread-Topic: Assigning the same partition number to the mapper output Thread-Index: Ac5ngxH31VIO7CjUSIeszuidZ2DwaQ== Date: Wed, 12 Jun 2013 15:45:30 +0000 Message-ID: <6EBE7A7ADE401949BCCE1EAC18422BAA0114E5B2@QFM00003.qf.org.qa> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.153.232.23] Content-Type: multipart/alternative; boundary="_000_6EBE7A7ADE401949BCCE1EAC18422BAA0114E5B2QFM00003qforgqa_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_6EBE7A7ADE401949BCCE1EAC18422BAA0114E5B2QFM00003qforgqa_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi, I was wondering if it is possible in hadoop to assign the same partition n= umbers to the map outputs. I am running a map-only job (with zero reducers= ) and hadoop shuffles the partitions in the output: i.e. input/part-m-0000= X is processed by task number Y and hence generates output/part-m-0000Y (w= here X !=3D Y). Thanks Maysam CONFIDENTIALITY NOTICE: This email and any attachments transmitted with it are confidential and in= tended for the use of individual or entity to which it is addressed. If yo= u have received this email in error, please delete it immediately and info= rm the sender. Unless you are the intended recipient, you may not use, dis= close, copy or distribute this email or any attachments included. The cont= ents of the emails including any attachments may be subjected to copyright= s law, In such case the contents may not be copied, adapted, distributed o= r transmitted without the consent of the copyright owner. --_000_6EBE7A7ADE401949BCCE1EAC18422BAA0114E5B2QFM00003qforgqa_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi,

 

I was wondering if it is possible in hadoop to assi= gn the same partition numbers to the map outputs. I am running a map-only = job (with zero reducers) and hadoop shuffles the partitions in the output:= i.e. input/part-m-0000X is processed by task number Y and hence generates output/part-m-0000Y (where X !=3D Y)= .

 

Thanks

Maysam


CONFIDENTIALITY NOTICE:
This email and any attachments transmitted with it are confidential and in= tended for the use of individual or entity to which it is addressed. If yo= u have received this email in error, please delete it immediately and info= rm the sender. Unless you are the intended recipient, you may not use, dis= close, copy or distribute this email or any attachments included. The cont= ents of the emails including any attachments may be subjected to copyright= s law, In such case the contents may not be copied, adapted, distributed o= r transmitted without the consent of the copyright owner.
--_000_6EBE7A7ADE401949BCCE1EAC18422BAA0114E5B2QFM00003qforgqa_--