From general-return-3053-apmail-hadoop-general-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 16 18:23:15 2011 Return-Path: Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: (qmail 26431 invoked from network); 16 Feb 2011 18:23:14 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 16 Feb 2011 18:23:14 -0000 Received: (qmail 31664 invoked by uid 500); 16 Feb 2011 18:23:13 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 31307 invoked by uid 500); 16 Feb 2011 18:23:10 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 31299 invoked by uid 99); 16 Feb 2011 18:23:09 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Feb 2011 18:23:09 +0000 X-ASF-Spam-Status: No, hits=-5.0 required=5.0 tests=RCVD_IN_DNSWL_HI X-Spam-Check-By: apache.org Received-SPF: unknown (nike.apache.org: error in processing during lookup of jrottinghuis@ebay.com) Received: from [216.33.244.7] (HELO rhv-mipot-002.corp.ebay.com) (216.33.244.7) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Feb 2011 18:23:04 +0000 DomainKey-Signature: s=corp; d=ebay.com; c=nofws; q=dns; h=X-EBay-Corp:X-IronPort-AV:Received:Received:From:To:Date: Subject:Thread-Topic:Thread-Index:Message-ID:References: In-Reply-To:Accept-Language:Content-Language: X-MS-Has-Attach:X-MS-TNEF-Correlator:acceptlanguage: x-ems-proccessed:x-ems-stamp:Content-Type: Content-Transfer-Encoding:MIME-Version:X-CFilter; b=StNSjyu6ELnBkcjrMLMQd38rERqj2t4w6/Oh7FJkMJCJd1QS91Fkx54K Hb1D+VbjWwA6EQtoKPxaaHD4i1nic1iYJXv6uMu7xmFr1vYnvGphNNVr8 n70Ldn3MwEwAnFP; DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=ebay.com; i=jrottinghuis@ebay.com; q=dns/txt; s=corp; t=1297880584; x=1329416584; h=from:to:date:subject:message-id:references:in-reply-to: content-transfer-encoding:mime-version; z=From:=20"Rottinghuis,=20Joep"=20 |To:=20"general@hadoop.apache.org"=20|Date:=20Wed,=2016=20Feb=202011=2010:19:21=20-0800 |Subject:=20RE:=20Hadoop=20testing=20project=20[Was:=20[V OTE]=20Abandon=20mrunit=20MapReduce=0D=0A=20contrib] |Message-ID:=20|References:=20 |In-Reply-To:=20|Content-Transfer-Encoding:=20quot ed-printable|MIME-Version:=201.0; bh=mZkHYMGK7qbymBEooUn22UIP4L0uo/poC5xHSEm7kJQ=; b=3XsCcNsuuQuL2X5a4zWRbtBcDHMxnJ+CXhY9ViJjDrb1Q43qdnQ31+8E EIWYFrH0hBfAgmTjbhnKk9QFHZ9cRjfIjVgHpw183n0hRRPXoHklVoSTP JBH37Ei0Z2qLwiO; X-EBay-Corp: Yes X-IronPort-AV: E=Sophos;i="4.60,480,1291622400"; d="scan'208";a="8310883" Received: from rhv-vtenf-001.corp.ebay.com (HELO RHV-MEXHT-001.corp.ebay.com) ([10.112.113.52]) by rhv-mipot-002.corp.ebay.com with ESMTP; 16 Feb 2011 10:22:40 -0800 Received: from RHV-MEXMS-002.corp.ebay.com ([10.245.17.114]) by RHV-MEXHT-001.corp.ebay.com ([10.245.24.100]) with mapi; Wed, 16 Feb 2011 10:22:39 -0800 From: "Rottinghuis, Joep" To: "general@hadoop.apache.org" Date: Wed, 16 Feb 2011 10:19:21 -0800 Subject: RE: Hadoop testing project [Was: [VOTE] Abandon mrunit MapReduce contrib] Thread-Topic: Hadoop testing project [Was: [VOTE] Abandon mrunit MapReduce contrib] Thread-Index: AcvNW5f4MNkIM+lgQ+aUgeRxC0GldQAqnCE5 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US x-ems-proccessed: 10SqDH0iR7ekR7SRpKqm5A== x-ems-stamp: qp9wncopcho0EvOFWQ9ePw== Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-CFilter: Scanned X-Virus-Checked: Checked by ClamAV on apache.org +1 Having a coherent approach for system level testing increases confidence in= the various Hadoop releases and and will reduce the effort to take any (se= t of ) changes from development into production. The more automated and formalized system testing, the better! Thanks, Joep ________________________________________ From: cos@boudnik.org [cos@boudnik.org] On Behalf Of Konstantin Boudnik [co= s@apache.org] Sent: Tuesday, February 15, 2011 1:58 PM To: general@hadoop.apache.org Subject: Hadoop testing project [Was: [VOTE] Abandon mrunit MapReduce contr= ib] While MrUnit discussion draws to its natural conclusion I would like to bring up another point which might be well aligned with that discussion. Patrick Hunt has brought up this idea earlier today and I believe it has to be elaborated further. A number of testing projects both for Hadoop and Hadoop-related component were brought to life over last year or two. Among those are MRUnit, PigUnit, YCSB, Herriot, and perhaps a few more. They all focusing on more or less the same problem e.g. validation of Hadoop or on-top-of-Hadoop components, or application level testing for Hadoop. However, the fact that they all are spread across a wide variety of projects seems to confuse/mislead Hadoop users. How about incubating a bigger Hadoop (Pig, Oozie, HBase) testing project which will take care about development and support of common (where's possible) tools, frameworks and the like? Please feel free to share your thoughts :) -- Take care, Konstantin (Cos) Boudnik On Tue, Feb 15, 2011 at 10:44, Eric Sammer wrote: > I've started the wiki page proposal for Incubator for mrunit. I'll ping > people off list for mentoring. Much appreciated for all the help! > > On Tue, Feb 15, 2011 at 1:36 PM, Nigel Daley wrote: > >> I'm happy to help mentor as well. >> >> Cheers, >> Nige >> >> On Feb 11, 2011, at 11:52 AM, Patrick Hunt wrote: >> >> > On Fri, Feb 11, 2011 at 9:44 AM, Mattmann, Chris A (388J) >> > wrote: >> >> Guys, BTW, if you need help or a mentor in Apache Incubator-ville for >> MRUnit, I would be happy to help. >> > >> > I was going to suggest the same thing (mrunit to incubator). I would >> > also be happy to be a mentor. >> > >> > Patrick=