incubator-s4-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From JiHyoun Park <>
Subject S4 integration with resource manager
Date Thu, 11 Oct 2012 01:51:06 GMT

I looked at the java codes ( to
integrate S4 with Hadoop YARN.
I have a couple of questions.

1. Does YARN AppMaster replace what now ZooKeeper does for S4 (load
balancing, fault-tolerance, etc)?
2. If not (since the source code looks still trying to create a znode in
the YARN container, while having an external ZK server), doesn't it
duplicate the cluster management functionality in the whole architecture?
Since AppMaster also monitors the health status of containers and restart
them when failure, for what use do we have the ZK server-nodes architecture
and the AppMaster-container architecture at the same time?
Would S4 create multiple nodes in one YARN container? (Maybe this is the
reason? But is it possible?)

Best Regards
Jihyoun Park

View raw message