hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maysam Hossein Yabandeh <myaban...@qf.org.qa>
Subject Assigning the same partition number to the mapper output
Date Wed, 12 Jun 2013 15:45:30 GMT

I was wondering if it is possible in hadoop to assign the same partition numbers to the map
outputs. I am running a map-only job (with zero reducers) and hadoop shuffles the partitions
in the output: i.e. input/part-m-0000X is processed by task number Y and hence generates output/part-m-0000Y
(where X != Y).


This email and any attachments transmitted with it are confidential and intended for the use
of individual or entity to which it is addressed. If you have received this email in error,
please delete it immediately and inform the sender. Unless you are the intended recipient,
you may not use, disclose, copy or distribute this email or any attachments included. The
contents of the emails including any attachments may be subjected to copyrights law, In such
case the contents may not be copied, adapted, distributed or transmitted without the consent
of the copyright owner.
View raw message