Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of swatt@us.ibm.com designates
 32.97.182.142 as permitted sender)
In-Reply-To: <t2p17d2d1291004011038g8863775cu4c21d1aa074d42dc@mail.gmail.com>
References: <17d2d1291003302123y330d2f7fhaf2201dfb716fec6@mail.gmail.com>
	 <z2g47535041003310015i215d47d5jf7629f9fe398f061@mail.gmail.com>
	 <i2u17d2d1291003310604l72bd7ecfi626acc63794c539f@mail.gmail.com>
	 <y2j47535041003310635k46c3fa61s2d6737bfe3c3ed4a@mail.gmail.com>
	 <x2m17d2d1291003310940j12661cb5s758685edb5131c2d@mail.gmail.com>
 <t2p17d2d1291004011038g8863775cu4c21d1aa074d42dc@mail.gmail.com>
To: mapreduce-user@hadoop.apache.org
MIME-Version: 1.0
Subject: TotalOrderPartitioner Functional Test - testmemcmp - Failing
Message-ID: 
 <OF3D2D6E42.DB136D75-ON862576F8.006CE751-862576F8.006E273A@us.ibm.com>
From: Stephen Watt <swatt@us.ibm.com>
Date: Thu, 1 Apr 2010 15:03:10 -0500
Content-Type: multipart/alternative;
 boundary="=_alternative 006E2739862576F8_="

This is a multipart message in MIME format.
--=_alternative 006E2739862576F8_=
Content-Type: text/plain; charset="US-ASCII"

Hi Folks

The Hadoop Functional Tests (hadoop-*-test.jar) that ship with it and can 
be run as part of the build, has a TestTotalOrderPartitioner JUNIT test 
cases in it. One of the assert's in the test case, "testmemcmp" passes 
with Sun Java but fails with IBM Java. The test iterates through a number 
of Text objects called splitStrings and writes them serially to a 
sequential file. The test case then iterates through a DIFFERENT Text 
array called testStrings and passes in the text value to the getPartition 
method to retrieve which partition the "key" is in. 

It fails on the assert when it tries to get the partition for the key "z" 
in which exists in the testStrings array but not in the splitStrings array 
(the values written in the sequential file).  The assert is expecting a 9 
value for the partition but it is getting a 0. They don't match, thus the 
assert fails.

To me, it seems, there is a bug in this test case. I have no idea why Sun 
Java returns a partition for this non-existent key. I'm new to partitions, 
so I wanted to run this by the list before I open a bug.

Kind regards
Steve Watt

--=_alternative 006E2739862576F8_=
Content-Type: text/html; charset="US-ASCII"

<font size=2 face="sans-serif">Hi Folks</font>
<br>
<br><font size=2 face="sans-serif">The Hadoop Functional Tests (hadoop-*-test.jar)
that ship with it and can be run as part of the build, has a TestTotalOrderPartitioner
JUNIT test cases in it. One of the assert's in the test case, &quot;testmemcmp&quot;
passes with Sun Java but fails with IBM Java. The test iterates through
a number of Text objects called splitStrings and writes them serially to
a sequential file. The test case then iterates through a DIFFERENT Text
array called testStrings and passes in the text value to the getPartition
method to retrieve which partition the &quot;key&quot; is in. &nbsp;</font>
<br>
<br><font size=2 face="sans-serif">It fails on the assert when it tries
to get the partition for the key &quot;z&quot; in which exists in the testStrings
array but not in the splitStrings array (the values written in the sequential
file). &nbsp;The assert is expecting a 9 value for the partition but it
is getting a 0. They don't match, thus the assert fails.</font>
<br>
<br><font size=2 face="sans-serif">To me, it seems, there is a bug in this
test case. I have no idea why Sun Java returns a partition for this non-existent
key. I'm new to partitions, so I wanted to run this by the list before
I open a bug.</font>
<br>
<br><font size=2 face="sans-serif">Kind regards<br>
Steve Watt<br>
</font>
--=_alternative 006E2739862576F8_=--