Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-dev@hadoop.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <F277A750452DA047BDF282E4A45F93650649F42D0C@MAILCCR.us.syncsort.com>
References: <4FD10B4F.7020406@syncsort.com>
	<CACO5Y4z3mDAFPi7GA1vVOqqsfsbyzRFR-GE+fFMB0iPH+NsP4Q@mail.gmail.com>
	<F277A750452DA047BDF282E4A45F93650649F42D0C@MAILCCR.us.syncsort.com>
Date: Thu, 7 Jun 2012 20:16:03 -0700
Message-ID: 
 <CACO5Y4y8oaNitFodbxr=SEhBTeuWivyX0wo7nu55w+wBKjt7gQ@mail.gmail.com>
Subject: Re: Randomly failing test
From: Chris Douglas <cdouglas@apache.org>
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

It would be surprising if the test became flakier with those
modifications if the changes did not also change the semantics. From
the test output, the patch is causing an assertion to fail: more
records are hitting disk than expected. -C

On Thu, Jun 7, 2012 at 7:07 PM, Asokan, M <masokan@syncsort.com> wrote:
> Hi Chris,
> =A0 Thanks for your reply. =A0I submitted a patch for MAPREDUCE-2454. =A0=
I got this failing test error and I am blocked on this. =A0Can you please a=
dvise me how I proceed submitting the patch? =A0I can spend some time inves=
tigating how to make the test more deterministic if that is possible(either=
 tuning some of the parameters or increasing child JVM memory?)
>
> Thanks
> -- Asokan
> ________________________________________
> From: Chris Douglas [cdouglas@apache.org]
> Sent: Thursday, June 07, 2012 9:02 PM
> To: common-dev@hadoop.apache.org
> Subject: Re: Randomly failing test
>
> The output on MAPREDUCE-4094 is no longer available, but a failed job
> during an integration test could be traced to nondeterminism anywhere
> in that chain. The "flakiness" you observe is common to many Hadoop
> integration tests.
>
> The purpose of the test is to verify that 1) the merge works when some
> segments are retained in memory during the reduce 2) the tuning
> parameters for the reduce have the expected effect. -C
>
> On Thu, Jun 7, 2012 at 1:13 PM, Asokan, M <masokan@syncsort.com> wrote:
>> Can someone guide me in making the test org.apache.hadoop.mapred.TestRed=
uceFetchFromPartialMem less flaky? =A0I see test failures mentioned in MAPR=
EDUCE-4094 and MAPREDUCE-4096 but no fix is available so far.
>>
>> Thanks.
>>
>> -- Asokan
>>
>>
>> ________________________________
>
>
>
> ATTENTION: -----
>
> The information contained in this message (including any files transmitte=
d with this message) may contain proprietary, trade secret or other =A0conf=
idential and/or legally privileged information. Any pricing information con=
tained in this message or in any files transmitted with this message is alw=
ays confidential and cannot be shared with any third parties without prior =
written approval from Syncsort. This message is intended to be read only by=
 the individual or entity to whom it is addressed or by their designee. If =
the reader of this message is not the intended recipient, you are on notice=
 that any use, disclosure, copying or distribution of this message, in any =
form, is strictly prohibited. If you have received this message in error, p=
lease immediately notify the sender and/or Syncsort and destroy all copies =
of this message in your possession, custody or control.