Return-Path: Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: (qmail 71853 invoked from network); 31 Jan 2011 06:02:58 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 31 Jan 2011 06:02:58 -0000 Received: (qmail 97607 invoked by uid 500); 31 Jan 2011 06:02:57 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 97082 invoked by uid 500); 31 Jan 2011 06:02:53 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 97074 invoked by uid 99); 31 Jan 2011 06:02:52 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 31 Jan 2011 06:02:52 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of eli@cloudera.com designates 209.85.216.48 as permitted sender) Received: from [209.85.216.48] (HELO mail-qw0-f48.google.com) (209.85.216.48) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 31 Jan 2011 06:02:47 +0000 Received: by qwe4 with SMTP id 4so5285139qwe.35 for ; Sun, 30 Jan 2011 22:02:26 -0800 (PST) MIME-Version: 1.0 Received: by 10.229.247.68 with SMTP id mb4mr5448590qcb.294.1296453744900; Sun, 30 Jan 2011 22:02:24 -0800 (PST) Received: by 10.229.215.2 with HTTP; Sun, 30 Jan 2011 22:02:24 -0800 (PST) In-Reply-To: References: Date: Sun, 30 Jan 2011 22:02:24 -0800 Message-ID: Subject: Re: [DISCUSS] Move common, hdfs, mapreduce contrib components to apache-extras.org or elsewhere From: Eli Collins To: general@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable +1 Agree w Eric's comments around defaults and documenting them. How about setting a date where the projects are created on apache extras and removed from contrib unless someone volunteers to maintain them? I agree apache extras should be the default unless the person volunteering to maintain the project wants to host it elsewhere. Btw I think raid should also probably move to core, it's actively worked on= . I'll volunteer to create a project for fuse-dfs. Thanks, Eli On Sun, Jan 30, 2011 at 7:42 PM, Nigel Daley wrote: > Folks, > > Now that http://apache-extras.org is launched (https://blogs.apache.org/f= oundation/entry/the_apache_software_foundation_launches) I'd like to start = a discussion on moving contrib components out of common, mapreduce, and hdf= s. > > These contrib components complicate the builds, cause test failures that = nobody seems to care about, have releases that are tied to Hadoop's long re= lease cycles, etc. =A0Most folks I've talked with agree that these contrib = components would be better served by being pulled out of Hadoop and hosted = elsewhere. The new apache-extras code hosting site seems like a natural *de= fault* location for migrating these contrib projects. =A0Perhaps some shoul= d graduate from contrib to src (ie from contrib to core of the project they= 're included in). =A0If folks agree, we'll need to come up with a mapping o= f contrib component to it's final destination and file a jira. > > Here are the contrib components by project (hopefully I didn't miss any). > > Common Contrib: > =A0failmon > =A0hod > =A0test > > > MapReduce Contrib: > =A0capacity-scheduler -- move to MR core? > =A0data_join > =A0dynamic-scheduler > =A0eclipse-plugin > =A0fairscheduler -- move to MR core? > =A0gridmix > =A0index > =A0mrunit > =A0mumak > =A0raid > =A0sqoop > =A0streaming -- move to MR core? > =A0vaidya > =A0vertica > > > HDFS Contrib: > =A0fuse-dfs > =A0hdfsproxy > =A0thriftfs > > > Cheers, > Nige >