Return-Path: Delivered-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Received: (qmail 31395 invoked from network); 29 Sep 2009 19:35:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 29 Sep 2009 19:35:32 -0000 Received: (qmail 59828 invoked by uid 500); 29 Sep 2009 19:35:32 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 59749 invoked by uid 500); 29 Sep 2009 19:35:32 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-issues@hadoop.apache.org Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 59732 invoked by uid 99); 29 Sep 2009 19:35:31 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Sep 2009 19:35:31 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Sep 2009 19:35:29 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id D4C76234C004 for ; Tue, 29 Sep 2009 12:35:07 -0700 (PDT) Message-ID: <727744220.1254252907855.JavaMail.jira@brutus> Date: Tue, 29 Sep 2009 12:35:07 -0700 (PDT) From: "Robert Chansler (JIRA)" To: common-issues@hadoop.apache.org Subject: [jira] Updated: (HADOOP-5518) MRUnit unit test library MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-5518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HADOOP-5518: ------------------------------------ Release Note: New contribution MRUnit helps authors of map-reduce programs write unit tests with JUnit. (was: MRUnit is a tool to help authors of MapReduce programs write unit tests. It allows easy testing of Mapper and Reducer implementations using JUnit.) Editorial pass over all release notes prior to publication of 0.21. > MRUnit unit test library > ------------------------ > > Key: HADOOP-5518 > URL: https://issues.apache.org/jira/browse/HADOOP-5518 > Project: Hadoop Common > Issue Type: New Feature > Reporter: Aaron Kimball > Assignee: Aaron Kimball > Fix For: 0.21.0 > > Attachments: HADOOP-5518-2.patch, HADOOP-5518-3.patch, HADOOP-5518-branch18.patch, mrunit.patch, overview.html > > > MRUnit is a tool to help authors of MapReduce programs write unit tests. > Testing map() and reduce() methods requires some repeated work to mock the inputs and outputs of a Mapper or Reducer class, and ensure that the correct values are emitted to the OutputCollector based on inputs. Also, testing a mapper and reducer together requires running them with the sorted ordering guarantees made by the shuffle process. > This library provides the above functionality to authors of maps and reduces; it allows you to test maps, reduces, and map-reduce pairs without needing to perform all the setup and teardown work associated with running a job. > I believe this tool may be useful to the broader Hadoop community, so I have cleaned it up and would like to see it become a "contrib" module. My current environment is based on Hadoop 0.18, so this is the format it expects to use. It does not have support for the new Context-based interfaces for mappers/reducers. > I have attached the overview.html file for its javadoc, which provides more synopsis and an example of usage; I am also providing the current source code so that you can evaluate its structure. > Ideally with some feedback from the community this will move toward supporting the current trunk interface soon. > This currently works with JUnit 4; the supplied patch changes Ivy's libraries.properties file to use JUnit 4.5. I'm marking HADOOP-4901 as a dependency for this reason. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.