hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Allen Wittenauer <awittena...@linkedin.com>
Subject Re: Passing messages
Date Mon, 20 Dec 2010 00:01:06 GMT

On Dec 19, 2010, at 10:21 AM, Eric wrote:

> I don't know if there is such a thing in Hadoop, I'm guessing not since MapReduce is
designed to have independent mappers and reducers.

	Yup. 

> I'm just suggesting something here: you could write a small server yourself. Say you
start your jobs from a work node that has only light load. On that node, you also create something
that works like memcache. (maybe you can even use memcache?)

	Or just use ZooKeeper.



Mime
View raw message