incubator-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brock Noland <br...@cloudera.com>
Subject Re: [VOTE][PROPOSAL] Hadoop Development Tools
Date Tue, 06 Nov 2012 17:09:10 GMT
+1 (non-binding)

On Tue, Nov 6, 2012 at 11:08 AM, Franklin, Matthew B.
<mfranklin@mitre.org> wrote:
> +1 (binding)
>
> On 11/6/12 10:57 AM, "Adam Berry" <amberry@yahoo-inc.com> wrote:
>
>>Hello,
>>
>>This proposal has been open for discussion for a a few weeks, so now
>>submitting for a vote for this project to be accepted into the incubator.
>>
>>Cheers,
>>Adam Berry
>>
>>= HDT (Hadoop Development Tools) =
>>
>>== Abstract ==
>>Tools to support developing applications that use Apache Hadoop from
>>within Eclipse.
>>
>>== Proposal ==
>>Hadoop Development Tools are a set of extensions to Eclipse providing
>>support for creating, launching and debugging distributed applications,
>>as well as interacting with HDFS filesystems. This work will build on the
>>existing Map Reduce Tools present in the Apache Hadoop project.
>>
>>== Background ==
>>Map Reduce Tools have existed as part of contrib for Apache Hadoop.
>>Unfortunately they are source tied to a single version of Hadoop, and
>>development has stalled, with little movement past the Hadoop 0.20 line.
>>
>>== Rationale ==
>>Support for newer versions of Hadoop from within Eclipse is regularly
>>raised on the Hadoop mailing lists, so there is a clear need to drive
>>these tools forward. Development tools generally are worked on separate
>>from the target tools/platform, separating the tools out will allow for
>>supporting multiple versions, so a developer could work with a
>>heterogeneous environment.
>>
>>== Initial Goals ==
>> * Give the tools project a home of its own.
>> * Port current MapReduce tools feature set to all current release lines
>>of Hadoop in a single Eclipse install.
>> * Documentation and tutorials for all features.
>> * Publish Eclipse update site, and join Eclipse marketplace listing.
>> * Establish release cycle that combines support for Hadoop and Eclipse
>>release cycles.
>> * Look to build support for YARN, MRUnit and possibly other
>>Hadoop-related projects.
>>
>>== Current Status ==
>>The source for the current MapReduceTools lives in the contrib section of
>>the Hadoop source. In its current implementation it is tied to the
>>version of Hadoop against which it is compiled. The layout and API that
>>it was developed with means that it can only be used with the 0.20 or 1.0
>>Hadoop releases, the new layout and YARN api introduced with the 0.23 and
>>2.0 lines are not supported.
>>
>>
>>=== Meritocracy ===
>>Several people and companies have already expressed an interest in
>>contributing to this project, and we hope to attract additional interest
>>during the proposal discussion. We plan to invest and support a
>>meritocracy that attracts, invites, and supports newcomers to build a
>>vibrant and  diverse community.
>>
>>=== Community ===
>>The target community is developers who are working developing Map/Reduce
>>applications against Hadoop. Given the success of Hadoop the target group
>>is likely to be quite large. Separation from the Hadoop community would
>>make it easier to support multiple versions of hadoop, as well as merging
>>the release cycles of Hadoop and Eclipse to provide predictable iteration
>>and improvement in the toolset.
>>
>>=== Core Developers ===
>>The initial list of developers includes people experienced with Hadoop
>>and developing against the Eclipse platform.
>> * Adam Berry (amberry at yahoo-inc dot com)
>> * Jeffrey Zemerick (jeffrrey at mtnfog dot com)
>> * Evert Lammerts (Evert dot Lammerts at sara dot nl)
>> * Simone Gianni (simoneg at apache dot org)
>>
>>=== Alignment ===
>>Hadoop Development Tools aligns with both Hadoop and Eclipse. Hadoop as
>>the platform for the development target, and Eclipse as the IDE platform
>>used as the base for the tools.
>>
>>== Known Risks ==
>>
>>=== Orphaned Products ===
>>
>>=== Inexperience with Open Source ===
>>The committers have experience with Apache and Eclipse open source
>>development.
>>
>>=== Reliance on Salaried Developers ===
>>Hadoop Development Tools will be developed with a mix of salaried and
>>volunteer time.
>>
>>=== Relationships with Other Apache Projects ===
>>Hadoop Development Tools is closely related to Apache Hadoop.
>>
>>=== An Excessive Fascination with the Apache Brand ===
>>Given the success of Hadoop and associated projects, Apache is the
>>natural place for the Hadoop Development Tools. Chris Mattman suggested
>>the Apache Incubator as appropriate on the Hadoop general mailing list
>>following the success that MRUnit had taking the path from Hadoop contrib
>>to an Apache top level project.
>>
>>== Documentation ==
>>Documentation for the current tools can be found at
>>http://wiki.apache.org/hadoop/EclipsePlugIn
>>
>>== Initial Source ==
>>http://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-mapreduce-proje
>>ct/src/contrib/eclipse-plugin/
>>
>>==  Source and Intellectual Property Submission Plan ==
>>The source, and any suggested initial patches, are already hosted either
>>in ApacheĀ¹s Subversion or JIRA.
>>
>>==  External Dependencies ==
>>Eclipse Platform
>>Eclipse Java Development Tools
>>
>>==  Cryptography ==
>>Hadoop Development Tools likely does not fall into this area.
>>
>>==  Required Resources ==
>>=== Mailing lists ===
>> * hdt-dev
>> * hdt-commits
>> * hdt-user
>>
>>=== Git Repository ===
>> * git://git.apache.org/incubator-hdt.git
>>
>>=== Issue Tracking ===
>> * JIRA Hadoop Development Tools (HDT)
>>
>>=== Other Resources ===
>> * Jenkins/Hudson for builds and test running.
>>
>>== Initial Committers ==
>> * Adam Berry (amberry at yahoo-inc dot com)
>> * Jeffrey Zemerick (jeffrrey at mtnfog dot com)
>> * Evert Lammerts (Evert dot Lammerts at sara dot nl)
>> * Simone Gianni (simoneg at apache dot org)
>>
>>== Affiliations ==
>> * Adam Berry - Yahoo!
>> * Jeffrey Zemerick - Mountain Fog
>> * Evert Lammerts - SARA
>> * Simone Gianni - n/a
>>
>>== Sponsors ==
>>=== Champion ===
>> * Roman Shaposhnik
>>
>>=== Nominated Mentors ===
>> * Chris Douglas
>> * Chris Mattman
>> * Roman Shaposhnik
>>
>>=== Sponsoring Entity ===
>>Incubator PMC
>>
>>
>>---------------------------------------------------------------------
>>To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
>>For additional commands, e-mail: general-help@incubator.apache.org
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>



-- 
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/

---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org


Mime
View raw message