hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From abhay ratnaparkhi <abhay.ratnapar...@gmail.com>
Subject distribute objects prior to launching MR
Date Sat, 23 Apr 2011 06:02:03 GMT
Hello,

I'm writing one MR task where I need to pass a common set of data to all Map
task.
The data required by all the MR is present in relational database.

Is it possible to get data from database before launching job and then pass
the object to all Maps?
I know we can use DistributedCache to distribute files. But is there any
facility to distribute objects?

Abhay.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message