Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; c=nofws; d=darose.net; h=message-id:date
	:from:mime-version:to:subject:references:in-reply-to
	:content-type:content-transfer-encoding; q=dns; s=darose.net; b=
	kVbH5MJ/ZsbTDd7PL3a+id+J/V7q/RcuUiyUhOBqYVg7892I45BiRAFRjxUwUPnf
	icZHhOPny5x32S3sRC2uMZnEWQxJ2PorLdFribZ+T4RfpIykgcsdySkVUYfV9oRm
	cUlCMHE5shTEHalUItDJDD6kQiDCr1vq13+fQEP3E/A=
Message-ID: <4C635B40.5040003@darose.net>
Date: Wed, 11 Aug 2010 22:24:00 -0400
From: David Rosenstrauch <darose@darose.net>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
 rv:1.9.2.8) Gecko/20100806 Lanikai/3.1.2
MIME-Version: 1.0
To: mapreduce-user@hadoop.apache.org
Subject: Re: mrunit question
References: <4C61B57D.6010509@darose.net> <4C61BC9C.1080301@darose.net>
 	<4C620EA3.5030303@darose.net>
 <AANLkTik+qXjp5MhvG7Myt4F8rgErDBUz4bW_yO01Rz1-@mail.gmail.com>
In-Reply-To: <AANLkTik+qXjp5MhvG7Myt4F8rgErDBUz4bW_yO01Rz1-@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

On 08/11/2010 08:14 PM, Aaron Kimball wrote:
> David,
>
> Since you are directly instantiating the Mapper and Reducer (not using
> ReflectionUtils), you are free to call setConf() yourself before you run the
> test.

Sort of.  What would wind up happening is that setConf would get called 
twice:  once by the mrunit framework with the empty config (for which 
I'd need to add special coding in to my reducer object to make it ignore 
it) and then a second time when I explicitly call it myself in my JUnit 
test.  It's not really ideal for me to have to add special code into my 
reducer to avoid this issue.


> If you're using the new API, there already is setConfiguration() and
> withConfiguration(), which will set the Configuration being passed into
> Context sent to your Mapper/Reducer's run() method.
> See https://issues.apache.org/jira/browse/mapreduce-1569 where this was
> introduced.
>
>
> - Aaron

Yes, just looked at that, and it looks like it exactly solves this 
issue.  Unfortunately, though, it says that fix is effective in v0.21. 
As we're running the stable CDH version (CDH2, which uses Hadoop v0.20) 
I can't take advantage of that fix yet.

Going to wind up forgoing unit tests on this M/R code for right now I think.

Thanks,

DR