Return-Path: X-Original-To: apmail-hadoop-general-archive@minotaur.apache.org Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A0BB3DA91 for ; Mon, 17 Sep 2012 20:02:51 +0000 (UTC) Received: (qmail 16550 invoked by uid 500); 17 Sep 2012 20:02:49 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 16473 invoked by uid 500); 17 Sep 2012 20:02:49 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 16463 invoked by uid 99); 17 Sep 2012 20:02:49 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Sep 2012 20:02:49 +0000 X-ASF-Spam-Status: No, hits=0.4 required=5.0 tests=NO_RDNS_DOTCOM_HELO,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: 216.145.54.172 is neither permitted nor denied by domain of evans@yahoo-inc.com) Received: from [216.145.54.172] (HELO mrout2.yahoo.com) (216.145.54.172) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Sep 2012 20:02:43 +0000 Received: from SP1-EX07CAS04.ds.corp.yahoo.com (sp1-ex07cas04.corp.sp1.yahoo.com [216.252.116.155]) by mrout2.yahoo.com (8.14.4/8.14.4/y.out) with ESMTP id q8HK1utQ066287 for ; Mon, 17 Sep 2012 13:01:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=yahoo-inc.com; s=cobra; t=1347912117; bh=Zwle2HuAngU1VrD7vncaMCt51Ozh21UzoN3xiV57sMY=; h=From:To:Date:Subject:Message-ID:In-Reply-To:Content-Type: Content-Transfer-Encoding:MIME-Version; b=THQ68LLGH2JFjB2hxXa/TsGFy1rHqmiE58D9FyIfqkwYwqQeXkXP4MBK23b0VciLa DlohRVUKcNXNga0mxrUmx5fp1FWCPLd+VjiohQ4b1CDjkB3v7wZdwPDWeme3TD7bNO jlpH98p39XCg626rP6PvXiTpxK0kkJSxLgg5vNwk= Received: from SP1-EX07VS02.ds.corp.yahoo.com ([216.252.116.135]) by SP1-EX07CAS04.ds.corp.yahoo.com ([216.252.116.158]) with mapi; Mon, 17 Sep 2012 13:01:56 -0700 From: Robert Evans To: "general@hadoop.apache.org" Date: Mon, 17 Sep 2012 13:01:53 -0700 Subject: Re: Spinning out Hadoop Eclipse Tools Thread-Topic: Spinning out Hadoop Eclipse Tools Thread-Index: Ac2VD0mpz5CBLZVITFySSYohaRkd7A== Message-ID: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.2.3.120616 acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Milter-Version: master.31+4-gbc07cd5+ X-CLX-ID: 912117001 X-Virus-Checked: Checked by ClamAV on apache.org I am +1 on this too. I would love to see better tool support for Hadoop. --Bobby On 9/17/12 2:42 PM, "Eli Collins" wrote: >Hey Adam, > >That would be awesome. +1 > >We've discussed moving the various contrib projects out of Hadoop in >the past, and think it make sense for all the reasons you mention. A >good example of how we've done this was done previously is MRUnit, >now hosted at http://mrunit.apache.org. > >Next steps, if others agree then you can draft a proposal to vote on. >See this thread and jira for an example: >http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C774 >05974-6771-4604-926B-976240743F3C@mac.com%3E >https://issues.apache.org/jira/browse/MAPREDUCE-2430 > >Thanks, >Eli > >On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry >wrote: >> Hello all, >> >> I'm proposing spinning out the eclipse plugin from the main hadoop >>source into a separate incubating project. I'm willing to commit to this >>effort. >> >> With a separate project, that isn't tied (source wise) to the Hadoop >>source we could make dev tools that could support multiple versions of >>Hadoop from within a single IDE, which would be very helpful when >>migrating jobs or dealing with clusters running different versions. >> >> The current tools seem to support the 0.20 line, and help with >>developing MR jobs, and also have some HDFS tools included. So the early >>work would be to ensure that these features were supported across the >>version space of Hadoop. >> >> Down the line we could also add support for additional tools such as >>MRUnit and other products in the Hadoop ecosystem, to eventually yield a >>one stop project for all dev tools around this space. >> >> If there is agreement on this, how do we go about getting it done? >> >> Thanks, >> >> Adam Berry