incubator-ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ahmed Fathalla <afatha...@gmail.com>
Subject Re: Branch 0.0 or Trunk
Date Fri, 18 Nov 2011 14:06:20 GMT
On Thu, Nov 17, 2011 at 7:03 AM, Owen O'Malley <owen@hortonworks.com> wrote:

> >The MapReduce JobTracker, which has a similar architecture to trunk, can
> >handle 4,500 machines and 30,000 concurrent tasks and the MapReduce
> >heartbeats are much more complicated than Ambari's. Both branches store
> >their data in Zookeeper, thus they don't have a single point of data loss
> >and can be extended to have automatic failover.
>
>    But with the explosive growth of Hadoop, don't you think that we may be
hitting this 4,500 machine limit soon? Shouldn't we design for scalability
from the beginning? Eric mentioned that the data could be lost if
controller crashes, how does trunk's architecture handle this case?

> -- Owen
>



-- 
Ahmed Fathalla

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message