hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeff Hammerbacher <ham...@cloudera.com>
Subject Re: Is continuous map reduce supported
Date Fri, 03 Sep 2010 05:13:46 GMT
> That isn't true. We are actively adding new features. However, there
> is certainly a focus on doing MapReduce well rather than trying to
> implement all potential distributed computation paradigms. I suspect
> that the right solution is doing two levels like Mesos:
> http://www.eecs.berkeley.edu/Pubs/TechRpts/2010/EECS-2010-87.html
> Where MapReduce is one framework running on the cluster. That way you
> can keep the framework stable, support MapReduce well, and let other
> users explore other idioms.

I completely agree. I think it's a good thing that Hadoop MapReduce is
focused on doing MapReduce well and leaving experimentation to alternative
frameworks which could run on the same cluster as MapReduce via a system
like Mesos.

View raw message