From general-return-5619-apmail-hadoop-general-archive=hadoop.apache.org@hadoop.apache.org Tue Oct 2 17:21:51 2012 Return-Path: X-Original-To: apmail-hadoop-general-archive@minotaur.apache.org Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 00964D504 for ; Tue, 2 Oct 2012 17:21:51 +0000 (UTC) Received: (qmail 13249 invoked by uid 500); 2 Oct 2012 17:21:49 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 13156 invoked by uid 500); 2 Oct 2012 17:21:49 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Delivered-To: moderator for general@hadoop.apache.org Received: (qmail 96531 invoked by uid 99); 2 Oct 2012 16:13:29 -0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-originating-ip:in-reply-to:references:date :message-id:subject:from:to:content-type:x-gm-message-state; bh=RYRYqM+PjZOe1yiG5G4m6u7bNrNHniJawxDKbJXcnEk=; b=RFN6Pa6RzAGMGjevk1PqpDvDyW+p9L2P/SvkN8kaAWIBxsdZUrHJ889CuKDA3FWjIU QmLGyztL9vUPjJ1FR6oXNX7IBeE2IDTeSMLXarDUdue9nKNkcjtVR09Wk2OHsL3rhp9/ K3tgiTR7/SmbB9kXX6QoUh0XGAkcCWon1lESiAwgSoXmaoaDTp+kC4TZTOFCGCnB23Mk f1/VkXy9qog7Vqs3FEfa973Oe5bYYPChkUeVUX9cZvhXaZ7efyFWQZlni4zntAyc6aT4 LbTratZ9q3Aobe+QwWJHz4Z5Rs/dUFeHXEDz6PmemqgHTuRlWYK9Ihtg+ijVmXgpNlke KH0A== MIME-Version: 1.0 X-Originating-IP: [153.31.113.27] In-Reply-To: References: <85E3BFC7-25CE-4019-80D2-182D0E1E5813@yahoo-inc.com> <26719A07-3AD4-4917-A46C-0F737F98645F@hortonworks.com> Date: Tue, 2 Oct 2012 12:13:01 -0400 Message-ID: Subject: Re: Spinning out Hadoop Eclipse Tools From: Jeffrey Zemerick To: general@hadoop.apache.org Content-Type: multipart/alternative; boundary=bcaec5186906d7d94504cb15cbb0 X-Gm-Message-State: ALoCoQkEEb4hA1prDVBdHI0sl/Dzj3/PSDzKQX3oQkFDbMOQWSDXVX/w9OBYTlm1Ge2UM93pAerI --bcaec5186906d7d94504cb15cbb0 Content-Type: text/plain; charset=ISO-8859-1 +1 Good idea! I'm interested in helping to commit more to the project. Jeff On Tue, Sep 18, 2012 at 1:17 PM, Adam Berry wrote: > > The positive feedback is really encouraging, so thanks everyone! > > @Chris, thanks for the links, I will make a start on going through that > material and preparing the proposal. Thank you for the offer of help, I'll > be taking you up on that. > > Is there anyone else who is also interested in committing to this? > > Cheers, > Adam > > On Sep 18, 2012, at 1:03 AM, Eric Baldeschwieler wrote: > > > +1 to spinning it out and +1 for just starting to work with incubator as > chris outlines. > > > > Once that is up and the code here can be removed as redundant. Folks > might object to that, but I highly doubt it given this thread. > > > > > > On Sep 17, 2012, at 6:46 PM, "Mattmann, Chris A (388J)" < > chris.a.mattmann@jpl.nasa.gov> wrote: > > > >> Hi Adam, > >> > >> +1 this seems like a great idea! > >> > >> Here's a guide to creating an Apache Incubator proposal: > >> > >> http://incubator.apache.org/guides/proposal.html > >> > >> You'll need 3 ASF members to be your mentors, 1 of which whom > >> is willing to be your Champion (the person that takes leadership > >> of shepherding you guys through the Incubator). > >> > >> I'm happy to help out in this effort however I can. I had a great > experience > >> mentoring the MRUnit folks and they have done a great job! > >> > >> Cheers, > >> Chris > >> > >> On Sep 17, 2012, at 12:42 PM, Eli Collins wrote: > >> > >>> Hey Adam, > >>> > >>> That would be awesome. +1 > >>> > >>> We've discussed moving the various contrib projects out of Hadoop in > >>> the past, and think it make sense for all the reasons you mention. A > >>> good example of how we've done this was done previously is MRUnit, > >>> now hosted at http://mrunit.apache.org. > >>> > >>> Next steps, if others agree then you can draft a proposal to vote on. > >>> See this thread and jira for an example: > >>> > http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C77405974-6771-4604-926B-976240743F3C@mac.com%3E > >>> https://issues.apache.org/jira/browse/MAPREDUCE-2430 > >>> > >>> Thanks, > >>> Eli > >>> > >>> On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry > wrote: > >>>> Hello all, > >>>> > >>>> I'm proposing spinning out the eclipse plugin from the main hadoop > source into a separate incubating project. I'm willing to commit to this > effort. > >>>> > >>>> With a separate project, that isn't tied (source wise) to the Hadoop > source we could make dev tools that could support multiple versions of > Hadoop from within a single IDE, which would be very helpful when migrating > jobs or dealing with clusters running different versions. > >>>> > >>>> The current tools seem to support the 0.20 line, and help with > developing MR jobs, and also have some HDFS tools included. So the early > work would be to ensure that these features were supported across the > version space of Hadoop. > >>>> > >>>> Down the line we could also add support for additional tools such as > MRUnit and other products in the Hadoop ecosystem, to eventually yield a > one stop project for all dev tools around this space. > >>>> > >>>> If there is agreement on this, how do we go about getting it done? > >>>> > >>>> Thanks, > >>>> > >>>> Adam Berry > >> > >> > >> > >> > >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > >> Chris Mattmann, Ph.D. > >> Senior Computer Scientist > >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA > >> Office: 171-266B, Mailstop: 171-246 > >> Email: chris.a.mattmann@nasa.gov > >> WWW: http://sunset.usc.edu/~mattmann/ > >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > >> Adjunct Assistant Professor, Computer Science Department > >> University of Southern California, Los Angeles, CA 90089 USA > >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > >> > > > > --bcaec5186906d7d94504cb15cbb0--