Return-Path: Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: (qmail 27479 invoked from network); 31 Jan 2011 04:23:04 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 31 Jan 2011 04:23:04 -0000 Received: (qmail 44368 invoked by uid 500); 31 Jan 2011 04:23:02 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 43869 invoked by uid 500); 31 Jan 2011 04:22:58 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 43861 invoked by uid 99); 31 Jan 2011 04:22:57 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 31 Jan 2011 04:22:57 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of esammer@cloudera.com designates 209.85.210.176 as permitted sender) Received: from [209.85.210.176] (HELO mail-iy0-f176.google.com) (209.85.210.176) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 31 Jan 2011 04:22:53 +0000 Received: by iyb26 with SMTP id 26so5052025iyb.35 for ; Sun, 30 Jan 2011 20:22:32 -0800 (PST) MIME-Version: 1.0 Received: by 10.42.222.9 with SMTP id ie9mr7247496icb.417.1296447752128; Sun, 30 Jan 2011 20:22:32 -0800 (PST) Received: by 10.42.220.70 with HTTP; Sun, 30 Jan 2011 20:22:32 -0800 (PST) In-Reply-To: References: Date: Sun, 30 Jan 2011 23:22:32 -0500 Message-ID: Subject: Re: [DISCUSS] Move common, hdfs, mapreduce contrib components to apache-extras.org or elsewhere From: Eric Sammer To: general@hadoop.apache.org Content-Type: multipart/alternative; boundary=20cf3054a033bc47ee049b1cc36b --20cf3054a033bc47ee049b1cc36b Content-Type: text/plain; charset=ISO-8859-1 Huge +1. Sqoop has continued development at https://github.com/cloudera/sqoop MRUnit is at https://github.com/esammer/mrunit I think the former can be easily removed. The latter, per my previous email, I think could be removed as well. On Sun, Jan 30, 2011 at 10:42 PM, Nigel Daley wrote: > Folks, > > Now that http://apache-extras.org is launched ( > https://blogs.apache.org/foundation/entry/the_apache_software_foundation_launches) > I'd like to start a discussion on moving contrib components out of common, > mapreduce, and hdfs. > > These contrib components complicate the builds, cause test failures that > nobody seems to care about, have releases that are tied to Hadoop's long > release cycles, etc. Most folks I've talked with agree that these contrib > components would be better served by being pulled out of Hadoop and hosted > elsewhere. The new apache-extras code hosting site seems like a natural > *default* location for migrating these contrib projects. Perhaps some > should graduate from contrib to src (ie from contrib to core of the project > they're included in). If folks agree, we'll need to come up with a mapping > of contrib component to it's final destination and file a jira. > > Here are the contrib components by project (hopefully I didn't miss any). > > Common Contrib: > failmon > hod > test > > > MapReduce Contrib: > capacity-scheduler -- move to MR core? > data_join > dynamic-scheduler > eclipse-plugin > fairscheduler -- move to MR core? > gridmix > index > mrunit > mumak > raid > sqoop > streaming -- move to MR core? > vaidya > vertica > > > HDFS Contrib: > fuse-dfs > hdfsproxy > thriftfs > > > Cheers, > Nige > -- Eric Sammer twitter: esammer data: www.cloudera.com --20cf3054a033bc47ee049b1cc36b--