Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-dev@hadoop.apache.org
MIME-Version: 1.0
In-Reply-To: <4FD10B4F.7020406@syncsort.com>
References: <4FD10B4F.7020406@syncsort.com>
Date: Thu, 7 Jun 2012 18:02:15 -0700
Message-ID: 
 <CACO5Y4z3mDAFPi7GA1vVOqqsfsbyzRFR-GE+fFMB0iPH+NsP4Q@mail.gmail.com>
Subject: Re: Randomly failing test
From: Chris Douglas <cdouglas@apache.org>
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

The output on MAPREDUCE-4094 is no longer available, but a failed job
during an integration test could be traced to nondeterminism anywhere
in that chain. The "flakiness" you observe is common to many Hadoop
integration tests.

The purpose of the test is to verify that 1) the merge works when some
segments are retained in memory during the reduce 2) the tuning
parameters for the reduce have the expected effect. -C

On Thu, Jun 7, 2012 at 1:13 PM, Asokan, M <masokan@syncsort.com> wrote:
> Can someone guide me in making the test org.apache.hadoop.mapred.TestRedu=
ceFetchFromPartialMem less flaky? =A0I see test failures mentioned in MAPRE=
DUCE-4094 and MAPREDUCE-4096 but no fix is available so far.
>
> Thanks.
>
> -- Asokan
>
>
> ________________________________
>
>
> ATTENTION: -----
>
> The information contained in this message (including any files transmitte=
d with this message) may contain proprietary, trade secret or other confide=
ntial and/or legally privileged information. Any pricing information contai=
ned in this message or in any files transmitted with this message is always=
 confidential and cannot be shared with any third parties without prior wri=
tten approval from Syncsort. This message is intended to be read only by th=
e individual or entity to whom it is addressed or by their designee. If the=
 reader of this message is not the intended recipient, you are on notice th=
at any use, disclosure, copying or distribution of this message, in any for=
m, is strictly prohibited. If you have received this message in error, plea=
se immediately notify the sender and/or Syncsort and destroy all copies of =
this message in your possession, custody or control.