hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alberto Luengo Cabanillas <cabi...@gmail.com>
Subject Re: QUESTION ABOUT PARTITIONERS
Date Sun, 10 Jan 2010 23:22:32 GMT
Hi Abrishek. Thanks for the quick reply. I´ve already read twice your paper
and I find it fantastic. I´m working on a similar project for my final work
at studies and your work gave me a bunch of ideas. I´ll try your approach
and feedback results.

2010/1/9 Abhishek Verma <vermaabhishekp@gmail.com>

> Hi Alberto,
>
> You should be able to override the default partitioner class in pseudo
> distributed and the fully distributed mode. I used the same technique for
> the paper "Scaling Genetic Algorithms using MapReduce" [
> http://verma7.com/wp/wp-content/uploads/2009/10/ISDA09_MR_GA.pdf] that you
> might find useful.
>
> -Abhishek.
>
> On Fri, Jan 8, 2010 at 5:24 PM, Alberto Luengo Cabanillas <
> cabiwan@gmail.com
> > wrote:
>
> > Hi everyone! First of all, happy new year to all community!. I´m actually
> > developing an Map-Reduce approach to genetic algorithms, and I was
> > questioning the use and effectivity of Partitioners in the Map-Reduce
> flow.
> > I´ve been working in pseudo-distributed mode and didn´t find any example
> of
> > usage of Partitioner classes. Does this mean that using another
> Partitioner
> > -not the default one- have sense only on a Fully Distributed environment?
> > Which Partitioner should I implement  with my GA approach?
> > Thanks a lot in advance!
> >
> > --
> > Alberto
> >
>



-- 
Alberto

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message