Return-Path: Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: (qmail 67555 invoked from network); 31 Jan 2011 05:38:34 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 31 Jan 2011 05:38:34 -0000 Received: (qmail 87375 invoked by uid 500); 31 Jan 2011 05:38:33 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 86939 invoked by uid 500); 31 Jan 2011 05:38:30 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 86924 invoked by uid 99); 31 Jan 2011 05:38:29 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 31 Jan 2011 05:38:29 +0000 X-ASF-Spam-Status: No, hits=0.7 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [216.145.54.172] (HELO mrout2.yahoo.com) (216.145.54.172) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 31 Jan 2011 05:38:23 +0000 Received: from SP2-EX07CAS01.ds.corp.yahoo.com (sp2-ex07cas01.corp.sp2.yahoo.com [98.137.59.37]) by mrout2.yahoo.com (8.14.4/8.14.4/y.out) with ESMTP id p0V5bqaV071764 for ; Sun, 30 Jan 2011 21:37:52 -0800 (PST) Received: from [10.0.1.4] (10.72.168.149) by SP2-EX07CAS01.ds.corp.yahoo.com (98.137.59.4) with Microsoft SMTP Server (TLS) id 8.3.137.0; Sun, 30 Jan 2011 21:37:51 -0800 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 (Apple Message framework v1082) Subject: Re: [DISCUSS] Move common, hdfs, mapreduce contrib components to apache-extras.org or elsewhere From: Eric Baldeschwieler In-Reply-To: Date: Sun, 30 Jan 2011 21:37:48 -0800 Content-Transfer-Encoding: quoted-printable Message-ID: <1FA5AC45-7586-4F4C-9EF6-7A8F41199E2A@yahoo-inc.com> References: To: "general@hadoop.apache.org" X-Mailer: Apple Mail (2.1082) +1 - A really good idea to clean up the builds and ownership issues. I think it is good to have a default location for related projects and = apache-extras.org does seem like a logical place. We should also probably add a prominent wiki section to support use of = apache-extras.org and to provide links to projects that want to host = elsewhere. On Jan 30, 2011, at 7:42 PM, Nigel Daley wrote: > Folks, >=20 > Now that http://apache-extras.org is launched = (https://blogs.apache.org/foundation/entry/the_apache_software_foundation_= launches) I'd like to start a discussion on moving contrib components = out of common, mapreduce, and hdfs. =20 >=20 > These contrib components complicate the builds, cause test failures = that nobody seems to care about, have releases that are tied to Hadoop's = long release cycles, etc. Most folks I've talked with agree that these = contrib components would be better served by being pulled out of Hadoop = and hosted elsewhere. The new apache-extras code hosting site seems like = a natural *default* location for migrating these contrib projects. = Perhaps some should graduate from contrib to src (ie from contrib to = core of the project they're included in). If folks agree, we'll need to = come up with a mapping of contrib component to it's final destination = and file a jira. >=20 > Here are the contrib components by project (hopefully I didn't miss = any). >=20 > Common Contrib: > failmon > hod > test >=20 >=20 > MapReduce Contrib: > capacity-scheduler -- move to MR core? > data_join > dynamic-scheduler > eclipse-plugin > fairscheduler -- move to MR core? > gridmix > index > mrunit > mumak > raid > sqoop > streaming -- move to MR core? > vaidya > vertica >=20 >=20 > HDFS Contrib: > fuse-dfs > hdfsproxy > thriftfs >=20 >=20 > Cheers, > Nige