Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of sonalgoyal4@gmail.com
 designates 74.125.82.48 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAJpSRtQ7a2V4ON8VMkBXMswyNt-CCYx97aZULMdEfmg-s_f5tQ@mail.gmail.com>
References: 
 <CAJpSRtRQHBEok5kam_xYwSdZXt+aAuUBaQvywXDi108psmejfw@mail.gmail.com>
	<CAMsy_Ni-mXdPeREw2EoyNSyoYj2xPZL+1cP0TdHbuo8R9WT99w@mail.gmail.com>
	<CAJpSRtTAtC5J_PLaYujMEfo_Cu+EXx_s1kLK=1BdZBW2DD+MUQ@mail.gmail.com>
	<CAMsy_NiUCoR0QfLT9JZCyyYK8g9T-1gZWS8b5otTc=2B5G2gyA@mail.gmail.com>
	<CAJpSRtQnATVkwxEYHx+qR1Oh9X0bMxt19+BMoPmU+QJX7WGYOQ@mail.gmail.com>
	<CAMsy_NiWYEw3XctnMc=3XbOD9mVTw538eYJPSkbfgA_vtX-zSw@mail.gmail.com>
	<CAJpSRtQ7a2V4ON8VMkBXMswyNt-CCYx97aZULMdEfmg-s_f5tQ@mail.gmail.com>
Date: Thu, 23 Aug 2012 19:07:16 +0530
Message-ID: 
 <CAKTawbKuCZowxfPO5ZQ_TDqJLH=bEbi7dL+-b6YfxLsMKXvC=g@mail.gmail.com>
Subject: Re: Sending data to all reducers
From: Sonal Goyal <sonalgoyal4@gmail.com>
To: mapreduce-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=f46d0442806636b63704c7eef553

--f46d0442806636b63704c7eef553
Content-Type: text/plain; charset=ISO-8859-1

Hamid,

I would recommend taking a relook at your current algorithm and making sure
you are utilizing the MR framework to its strengths. You can evaluate
having multiple passes for your map reduce program, or doing a map side
join. You mention runtime is important for your system, so make sure you
preserve data locality in the generated tasks.

HTH.

Best Regards,
Sonal
Crux: Reporting for HBase <https://github.com/sonalgoyal/crux>
Nube Technologies <http://www.nubetech.co>

<http://in.linkedin.com/in/sonalgoyal>


On Thu, Aug 23, 2012 at 6:50 PM, Hamid Oliaei <oliaei@gmail.com> wrote:

> Hi,
>
> I take a look to that, hope it can be useful for my purpose.
>
> Thank you so much.
>
> Hamid
>
>
>

--f46d0442806636b63704c7eef553
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hamid,<div><br></div><div>I would recommend taking a relook at your current=
 algorithm and making sure you are utilizing the MR framework to its streng=
ths. You can evaluate having multiple passes for your map reduce program, o=
r doing a map side join. You mention runtime is important for your system, =
so make sure you preserve data locality in the generated tasks.=A0</div>
<div><br></div><div>HTH.</div><div><br clear=3D"all">Best Regards,<br>Sonal=
<br><font color=3D"#888888"></font><font color=3D"#888888"></font><a href=
=3D"https://github.com/sonalgoyal/crux" target=3D"_blank">Crux: Reporting f=
or HBase</a><br>
<font color=3D"#888888"><span></span></font><font color=3D"#888888"><a href=
=3D"http://www.nubetech.co" target=3D"_blank">Nube Technologies</a> <br><br=
><a href=3D"http://in.linkedin.com/in/sonalgoyal" target=3D"_blank"></a></f=
ont><br>
<br><br><br>
<br><br><div class=3D"gmail_quote">On Thu, Aug 23, 2012 at 6:50 PM, Hamid O=
liaei <span dir=3D"ltr">&lt;<a href=3D"mailto:oliaei@gmail.com" target=3D"_=
blank">oliaei@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail=
_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:=
1ex">
<div>Hi,</div><div><br></div>I take a look to that, hope it can be useful f=
or my purpose.<div><br></div><div>Thank you so much.</div><span class=3D"HO=
EnZb"><font color=3D"#888888"><div><br></div><div>Hamid<br>
<div><br></div><div><br></div></div>
</font></span></blockquote></div><br></div>

--f46d0442806636b63704c7eef553--