hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ioan Eugen Stan <stan.ieu...@gmail.com>
Subject Re: Broadcasting some data to all nodes
Date Mon, 30 Jan 2012 12:17:22 GMT
Pe 30.01.2012 14:10, Hamid Oliaei a scris:
> Hi,
>
> I want to send some data and messages to all nodes after  I run a MR job.
> then begin another job.
> Is there any straight way to broadcast data under hadoop framework?
>

See if DistributedCahche [1] can do what you need. It makes application 
specific files easy to distribute.

http://hadoop.apache.org/common/docs/r0.20.2/mapred_tutorial.html#DistributedCache

-- 
Ioan Eugen Stan
http://ieugen.blogspot.com

Mime
View raw message