hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gauthier, Alexander" <Alex.Gauth...@Teradata.com>
Subject RE: new join algorithm using mapreduce
Date Sat, 19 Jan 2013 19:59:44 GMT
http://www.theserverside.com/discussions/thread.tss?thread_id=62376

Hope this helps.

From: Vikas Jadhav [mailto:vikascjadhav87@gmail.com]
Sent: Saturday, January 19, 2013 9:29 AM
To: user@hadoop.apache.org
Subject: new join algorithm using mapreduce

I am writing new join algorithm using hadoop
and want to do multi way join in single mapreduce job

map --> processes all dataset
reduce-->  join of all dataset
                + aggregate operation
second mapreduce job
will collect result from multple reducer files of first job
I am pretty clear about map phase but dnt have idea how to process
all dataset in single reduce.
So how i should proceed and
do i need to modify code of mapreduce

Thanks



--


Thanx and Regards
 Vikas Jadhav

Mime
View raw message