hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liu, Keyan (NSN - CN/Beijing)" <keyan....@nsn.com>
Subject How to use the reduce result in next code part
Date Mon, 28 May 2012 14:49:21 GMT
Hi All,

I am using Mapreduce to scan HBase region to get the rowkey_list that
related with one query.
In Map period, the mapper outputs partial rowkey_list. In reduce period,
the reducer will collect and sort all rowkey.
If I need to use rowkey_list result of reduce, how can transport the
rowkey_list outside reduce?

I have tried to write one reduce output to HDFS "/part-r-00000", but I
found the efficiency is too low.
How can I use the reduce result in next code part? Is there one API or
example that can be used? 
Thanks.

Regards,
William Liu

Mime
View raw message