hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maysam Yabandeh <m.yaban...@gmail.com>
Subject Assigning the same partition number to the mapper output
Date Thu, 13 Jun 2013 03:03:56 GMT
Hi,

I was wondering if it is possible in hadoop to assign the same partition
numbers to the map outputs. I am running a map-only job (with zero
reducers) and hadoop shuffles the partitions in the output: i.e.
input/part-m-0000X is processed by task number Y and hence generates
output/part-m-0000Y (where X != Y).

Thanks

Maysam

Mime
View raw message