Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of sudhakara.st@gmail.com
 designates 209.85.214.182 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAPb7cFYLMvKB6Za-0EfwqfoDz+=+RC4s1CLL4fM5yrp7o7uQtQ@mail.gmail.com>
References: 
 <CAPb7cFYLMvKB6Za-0EfwqfoDz+=+RC4s1CLL4fM5yrp7o7uQtQ@mail.gmail.com>
Date: Fri, 16 May 2014 23:15:30 +0530
Message-ID: 
 <CAPE0OngH11aE8xCUhYRfNxK-1zNDqArRXh0H1xQJwBQ9jBfp5w@mail.gmail.com>
Subject: Re: the default value for param
 "mapreduce.reduce.shuffle.input.buffer.percent"
From: sudhakara st <sudhakara.st@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=089e011603f4cb4d3b04f987fa41

--089e011603f4cb4d3b04f987fa41
Content-Type: text/plain; charset=UTF-8

"mapreduce.reduce.shuffle.input.buffer.percent"  paramenter value is going
go sets by reading the mapred-site.xml, if you not specified value in
mapred-site.xml it reads value from mapred-default.xml. Its value in
mapred-default.xml is 0.7. So default value is 0.7. For various reason
mapreduce.reduce.shuffle.input.buffer.percent is null then it will reads
hard coded value from the fuction MergeManagerImpl.java as 0.9. I think
this case never arises, MR always set parameters values by reading
mapred-default.xml.

Regards,
Sudhakara


On Fri, May 16, 2014 at 8:45 AM, wzc <wzc1989@gmail.com> wrote:

> Hi,
>    I find the defualt value for
> "mapreduce.reduce.shuffle.input.buffer.percent" is 0.7
> in mapred-default.xml but  0.9 in MergeManagerImpl.java. I wonder which
> default value should I choose ? I think 0.9 maybe too high ?
> Any help is appreciated.
>
> Thanks.
>
>


-- 

Regards,
...sudhakara

--089e011603f4cb4d3b04f987fa41
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div>&quot;mapreduce.reduce.shuffle.input.buffer.perc=
ent&quot;=C2=A0 paramenter value is going go sets by reading the mapred-sit=
e.xml, if you not specified value in mapred-site.xml it reads value from ma=
pred-default.xml. Its value in mapred-default.xml is 0.7. So default value =
is 0.7. For various reason mapreduce.reduce.shuffle.input.buffer.percent is=
 null then it will reads hard coded value from the fuction  MergeManagerImp=
l.java as 0.9. I think this case never arises, MR always set parameters val=
ues by reading mapred-default.xml.<br>
<br></div>Regards,<br></div>Sudhakara<br></div><div class=3D"gmail_extra"><=
br><br><div class=3D"gmail_quote">On Fri, May 16, 2014 at 8:45 AM, wzc <spa=
n dir=3D"ltr">&lt;<a href=3D"mailto:wzc1989@gmail.com" target=3D"_blank">wz=
c1989@gmail.com</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi,<div>=C2=A0 =C2=A0I find=
 the defualt value for &quot;mapreduce.reduce.shuffle.input.buffer.percent&=
quot; is 0.7 in=C2=A0mapred-default.xml but =C2=A00.9 in MergeManagerImpl.j=
ava. I wonder which default value should I choose ? I think 0.9 maybe too h=
igh ?</div>

<div>Any help is appreciated.<br></div><div><br></div><div>Thanks.</div><di=
v><br></div></div>
</blockquote></div><br><br clear=3D"all"><br>-- <br><div dir=3D"ltr">=C2=A0=
 =C2=A0 =C2=A0=C2=A0 <br><span style=3D"color:rgb(11,83,148)">Regards,</spa=
n><br style=3D"color:rgb(11,83,148)"><span style=3D"color:rgb(11,83,148)"><=
span style=3D"color:rgb(255,0,255)">...</span>sudhakara</span><br>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0=C2=A0 <br></div>
</div>

--089e011603f4cb4d3b04f987fa41--