hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bejoy KS" <bejoy.had...@gmail.com>
Subject Re: Need logical help
Date Tue, 12 Jun 2012 13:04:33 GMT
Hi Girish

You can achice this using reduce side joins. Use MultipleInputFormat for parsing two different
sets of log files.

Bejoy KS

Sent from handheld, please excuse typos.

-----Original Message-----
From: Girish Ravi <girishr@srmtech.com>
Date: Tue, 12 Jun 2012 12:59:32 
To: mapreduce-user@hadoop.apache.org<mapreduce-user@hadoop.apache.org>
Reply-To: mapreduce-user@hadoop.apache.org
Subject: Need logical help

Hi All,

I am thinking of a condition where the data in two log files are to be compared, can I use
Map-Reduce to do this?

I have one log file (LOG1) which has user ID and dept ID and another log file (LOG2) has some
rows which has user ID and dept ID and other data.
Can I compare the data where LOG1.userID = LOG2.userID and LOG1.deptID = LOG2.deptID?

If so any suggestion to implement the mapper for this?

Ph: +91-9916212114

View raw message