incubator-cvs mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Incubator Wiki] Update of "MRUnitProposal" by ChrisMattmann
Date Sun, 20 Feb 2011 02:51:53 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Incubator Wiki" for change notification.

The "MRUnitProposal" page has been changed by ChrisMattmann.
http://wiki.apache.org/incubator/MRUnitProposal?action=diff&rev1=7&rev2=8

--------------------------------------------------

  
  == Current Status ==
  === Meritocracy ===
+ TBD
+ 
+ === Community ===
+ TBD
+ 
+ === Core developers ===
  MRUnit was originally created by Aaron Kimball, and have had some contributions from members
of the Hadoop community. By becoming its own project, significant contributors to MRUnit would
become committers, and allow the project to grow.
  
- === Community ===
- The community interested in cloud service infrastructure is currently spread across many
smaller projects, and one of the main goals of this project is to build a vibrant community
to share best practices and build common infrastructure. For example, this project would provide
a home to facilitate collaboration between the groups of Hadoop and HBase developers who are
building cloud services.
- 
- === Core developers ===
- Tom White wrote most of the original code and is familiar with open source and Apache-style
development, being a Hadoop committer and an ASF member. There have been a number of contributors
who have provided patches to these scripts over time. Andrew Purtell who created the HBase
cloud scripts is a HBase committer. Johan Oskarsson (Hadoop and Cassandra committer) ported
the scripts to Cassandra.
- 
  === Alignment ===
- Whirr complements libcloud, currently in the Incubator. Libcloud provides multi-cloud provider
support, while Whirr will provide multi-service support in the cloud. Whirr will build cloud
components for several Apache projects, such as Hadoop, HBase, !ZooKeeper, Cassandra, and
hopefully more.
+ MRUnit aligns with Hadoop as it aims to be a testing harness and framework for the Hadoop
MapReduce framework.
  
  == Known Risks ==
  === Orphaned products ===
- There is a risk that Whirr will not gain adoption. However, the current Hadoop scripts seem
to be fairly widely used. The small number of initial committers is also a risk, although
by starting the project it is expected that new contributors will quickly be attracted to
the project and help it grow.
+ All members of the team are committed to making MRUnit a success.
  
  === Inexperience with Open Source ===
- The initial code comes from Hadoop where it was developed in an open-source, collaborative
way. All the initial committers are committers on other Apache projects, and are experienced
in working with new contributors.
+ The initial code comes from Hadoop where it was developed in an open-source, collaborative
way. All the initial committers are committers on other Apache projects (with the exception
of Eric who is experienced with open source development at Github and other communities),
and are experienced in working with new contributors.
  
  === Homogenous Developers ===
  The initial set of committers is from a diverse set of organizations, and geographic locations.
They are all experienced with developing in a distributed environment.
  
  === Reliance on Salaried Developers ===
- It is expected that Whirr will be developed on salaried and volunteer time, although all
of the initial developers will work on it mainly on salaried time.
+ It is expected that MRUnit will be developed on a combination of volunteer and salaried
time.
  
  === Relationships with Other Apache Products ===
- Whirr will depend on many other Apache Projects as already mentioned above (e.g. Hadoop,
!ZooKeeper). If the project develops some common infrastructure then it is possible that it
becomes a dependency on a project that wishes to use that infrastructure for running in the
cloud.
+ MRUnit will depend on many other Apache Projects as already mentioned above (e.g. Hadoop).

  
  === A Excessive Fascination with the Apache Brand ===
- We think that Whirr will benefit from the community sharing ideas and best practices for
running cloud services. The ASF does a great job at building communities, which is why we
want to build Whirr at Apache.
+ We think that MRUnit will benefit from The Apache Incubator. There was discussion about
moving this project entirely out of Apache Hadoop and into e.g., Github (as a fork), but after
Chris Mattmann prompted some discussions on the Hadoop general list to stick around in the
Incubator, many of the MRUnit enthusiasts (Eric, Patrick, Nige, etc.) thought it would be
a great idea to stick around in Apache. All of us have an excessive fascination with the Apache
brand.
  
  == Documentation ==
  Information on the current scripts and general background can be found at
+  * TBD
-  * http://wiki.apache.org/hadoop/AmazonEC2
-  * http://archive.cloudera.com/docs/ec2.html
-  * http://hbase.s3.amazonaws.com/hbase/HBase-EC2-HUG9.pdf
-  * http://www.slideshare.net/steve_l/new-roles-for-the-cloud
  
  == Initial Source ==
-  * http://svn.apache.org/viewvc/hadoop/common/trunk/src/contrib/cloud/
+  * http://svn.apache.org/viewvc/hadoop/mapreduce/trunk/src/contrib/mrunit/
-  * http://github.com/tomwhite/whirr
+  * https://github.com/esammer/mrunit
  
  == Source and Intellectual Property Submission Plan ==
  The initial source is already in an Apache project's SVN repository (Hadoop), so there should
be no action required here.
  
  == External Dependencies ==
- The existing external dependencies all have Apache compatible licenses: boto (MIT), libcloud
(Apache 2.0), simplejson (MIT). Jclouds is not a dependency of the current source, but it
is Apache 2.0 licensed, so it will be possible to use it in the future if required. 
+ The existing external dependencies all have Apache compatible licenses.
  
  == Cryptography ==
- Whirr uses standard APIs and tools for SSH and SSL.
+ MRUnit code likely does not fall into this area.
  
  == Required Resources ==
  === Mailing lists ===
@@ -99, +96 @@

  
  == Initial Committers ==
   * First Last (user at apache dot org)
+  * Eric Sammer
+  * 
  
  == Affiliations ==
-  * First Last, Company
+  * Eric Sammer, Cloudera
+  * Nigel Daley, TBD
+  * Patrick Hunt, Cloudera
+  * Chris A. Mattmann, NASA Jet Propulsion Laboratory/University of Southern California
  
  == Sponsors ==
  === Champion ===
-  * Eric Sammer
+  * TBD
  
  === Nominated Mentors ===
   * Nigel Daley

---------------------------------------------------------------------
To unsubscribe, e-mail: cvs-unsubscribe@incubator.apache.org
For additional commands, e-mail: cvs-help@incubator.apache.org


Mime
View raw message