hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sonal Goyal <sonalgoy...@gmail.com>
Subject Re: Sending data to all reducers
Date Thu, 23 Aug 2012 13:37:16 GMT
Hamid,

I would recommend taking a relook at your current algorithm and making sure
you are utilizing the MR framework to its strengths. You can evaluate
having multiple passes for your map reduce program, or doing a map side
join. You mention runtime is important for your system, so make sure you
preserve data locality in the generated tasks.

HTH.

Best Regards,
Sonal
Crux: Reporting for HBase <https://github.com/sonalgoyal/crux>
Nube Technologies <http://www.nubetech.co>

<http://in.linkedin.com/in/sonalgoyal>





On Thu, Aug 23, 2012 at 6:50 PM, Hamid Oliaei <oliaei@gmail.com> wrote:

> Hi,
>
> I take a look to that, hope it can be useful for my purpose.
>
> Thank you so much.
>
> Hamid
>
>
>

Mime
View raw message