incubator-cvs mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <>
Subject [Incubator Wiki] Update of "HMSProposal" by EricYang
Date Tue, 14 Jun 2011 21:47:11 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Incubator Wiki" for change notification.

The "HMSProposal" page has been changed by EricYang:

New page:
= HMS Proposal =

== Abstract ==

HMS is a software deployment system for Hadoop Ecosystem.

== Proposal ==

HMS will develop a open source deployment system for large distributed system.  The primary
goal of HMS is to build a community around management and deployment of Hadoop related projects.
 This includes software installation, configuration, application orchestration and deployment

== Background ==

HMS was developed by Yahoo Inc headed By Jagane Sunder, Sunnyvale in 2011.  HMS was designed
as a reference implementation for automating Hadoop cluster deployment.

== Rationale ==

The maintainers and developers of HMS are interested in joining the Apache Software Foundation
top level project for several reasons:

 * Apache provide a great community for open source software development environment.
 * It might open the door for sharing ideas or cooperation with other Apache projects, such
as Hadoop and HBase.
 * HMS would like to benefit from Apache's development infrastructure.

== Initial Goals ==

Though the bulk of HMS initial development is complete and the framework is running stable,
there are still some large areas for future development. Some area we hope to focus on in

 * Implement dynamic discover of HMS Zookeeper location using zeroconf
 * Refine server failure recovery

== Current Status ==

HMS is currently a reference implementation of deploy Hadoop on large scale clusters.  Th
majority of the team was employed in Yahoo.  One major contributor has moved to IBM.

This change does not immediately affect HMS because the people who were in Yahoo still remain
active contributors to HMS.  The project continues to be supported and actively enhanced.
 There is now the opportunity to become an open source project without a single large organization

=== Meritocracy ===

The initial developers are very familiar with meritocratic open source development, both at
Apache and elsewhere. Apache was chosen specifically because the initial developers want to
encourage this style of development for the project.

=== Community ===

HMS is used in Yahoo Lab for deploy test clusters.  The HMS community encourages suggestions
and contributions from any potential user and developer.

=== Core Developers ===

The initial set of HMS committers includes folks from the Hadoop and Chukwa communities. We
have varying degrees of experience with Apache-style open source development.

=== Alignment ===

HMS is a deployment system designed for Apache Hadoop. This is why Apache Hadoop is the most
important dependency for HMS. And HMS is also a particularly good fit for Apache due to integration
potential with other projects specifically Apache HBase and Apache Pig.

== Known Risks ==

=== Orphaned products & Reliance on Salaried Developers ===

HMS is in use by companies we work for so the companies have an interest in its continued

=== Inexperience with Open Source ===

Most of the committers have experience working on open source projects and there are also
at least one developer which has experience as committer on other Apache projects.

=== Relationships with Other Apache Products ===

HMS uses Zookeeper, and design to improve Hadoop ecosystem deployment.

As mentioned above, the current list of committers includes developers from at least two different
companies plus many independent volunteers.

=== A Excessive Fascination with the Apache Brand ===

Apache offers us a clear licensing framework and support infrastructure which would reassure
the many users of HMS who exploit it in commercial environments as well as those in other
open source projects.

== Documentation ==

The existing project page could be found here:

HMS Architecture:

== Initial Source ==

== Source and Intellectual Property Submission Plan ==

The complete HMS code is under Apache Software License 2. The complete codebase is already
hosted in ASF Repository.

== External Dependencies ==

The dependencies all have Apache compatible licenses. These include BSD, MIT licensed dependencies.

== Cryptography ==


== Required Resources ==

== Mailing lists ==

dev AT hms DOT apache DOT org
commits AT hms DOT apache DOT org
user AT hms DOT apache DOT org
private AT hms DOT apache DOT org

== Subversion Directory ==

== Issue Tracking ==


== Initial Committers ==

 * Jagane Sunder (jboulon AT apache DOT org)
 * Eric Yang (eyang AT apache DOT org)
 * Kan Zhang (kanzhangmail AT yahoo DOT com)

== Affiliations ==

 * Jagane Sunder (Yahoo)
 * Kan Zhang (IBM)
 * Eric Yang (Yahoo)

== Sponsors ==

== Champion ==

=== Nominated Mentors ===

=== Sponsoring Entity ===

Incubator PMC

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message