hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sonal Goyal <sonalgoy...@gmail.com>
Subject Re: Sending data to all reducers
Date Thu, 23 Aug 2012 13:37:16 GMT

I would recommend taking a relook at your current algorithm and making sure
you are utilizing the MR framework to its strengths. You can evaluate
having multiple passes for your map reduce program, or doing a map side
join. You mention runtime is important for your system, so make sure you
preserve data locality in the generated tasks.


Best Regards,
Crux: Reporting for HBase <https://github.com/sonalgoyal/crux>
Nube Technologies <http://www.nubetech.co>


On Thu, Aug 23, 2012 at 6:50 PM, Hamid Oliaei <oliaei@gmail.com> wrote:

> Hi,
> I take a look to that, hope it can be useful for my purpose.
> Thank you so much.
> Hamid

View raw message