Mailing-List: contact user-help@impala.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@impala.incubator.apache.org
From: Alexander Shoshin <Alexander_Shoshin@epam.com>
To: "user@impala.incubator.apache.org" <user@impala.incubator.apache.org>
CC: Special SBER-BPOC Team <SpecialSBER-BPOCTeam@epam.com>
Subject: Impala daemon memory
Thread-Topic: Impala daemon memory
Thread-Index: AdMXPwLgclQNWimISxmSCkmoG1C9GA==
Date: Thu, 17 Aug 2017 09:56:49 +0000
Message-ID: <AM5PR03MB29321CE4AB6E2844934D4E93F7830@AM5PR03MB2932.eurprd03.prod.outlook.com>
Accept-Language: ru-RU, en-US
Content-Language: en-US
received-spf: None (protection.outlook.com: epam.com does not designate
 permitted sender hosts)
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: multipart/alternative;
	boundary="_000_AM5PR03MB29321CE4AB6E2844934D4E93F7830AM5PR03MB2932eurp_"
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-originalarrivaltime: 17 Aug 2017 09:56:49.9625
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: b41b72d0-4e9f-4c26-8a69-f949f367c91d
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM5PR03MB2882
archived-at: Thu, 17 Aug 2017 09:57:04 -0000

--_000_AM5PR03MB29321CE4AB6E2844934D4E93F7830AM5PR03MB2932eurp_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Hi, team!

I have an issue working with impala. Maybe you could help me?

My data is stored in parquet files. I am running queries to the data on Imp=
ala through JMeter. I have 6 Impala daemons and JMeter sends queries random=
ly to each of them.
The problem is that only 3 of 6 Impala daemons use all available memory. Ot=
hers 3 Impala daemons use 3-4 times less memory.

These 3 daemons each time are different, but there are always 3 of them. Wh=
en I tried to disable 2 daemons I saw the same picture: 3 daemons used all =
available memory and 1 daemon not. All Impala daemons have the same mem_lim=
it setting.

Have you ever had such strange behavior? Why not all Impala daemons use all=
 available memory?

Regards,
Alexander Shoshin


--_000_AM5PR03MB29321CE4AB6E2844934D4E93F7830AM5PR03MB2932eurp_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:=
//www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
>
<meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:#0563C1;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:#954F72;
	text-decoration:underline;}
span.EmailStyle17
	{mso-style-type:personal-compose;
	font-family:"Calibri",sans-serif;
	color:windowtext;}
.MsoChpDefault
	{mso-style-type:export-only;
	font-family:"Calibri",sans-serif;}
@page WordSection1
	{size:8.5in 11.0in;
	margin:56.7pt 42.5pt 56.7pt 85.05pt;}
div.WordSection1
	{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=3D"EN-US" link=3D"#0563C1" vlink=3D"#954F72">
<div class=3D"WordSection1">
<p class=3D"MsoNormal">Hi, team!<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
<p class=3D"MsoNormal">I have an issue working with impala. Maybe you could=
 help me?<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
<p class=3D"MsoNormal">My data is stored in parquet files. I am running que=
ries to the data on Impala through JMeter. I have 6 Impala daemons and JMet=
er sends queries randomly to each of them.<o:p></o:p></p>
<p class=3D"MsoNormal">The problem is that only 3 of 6 Impala daemons use a=
ll available memory. Others 3 Impala daemons use 3-4 times less memory.<o:p=
></o:p></p>
<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
<p class=3D"MsoNormal">These 3 daemons each time are different, but there a=
re always 3 of them. When I tried to disable 2 daemons I saw the same pictu=
re: 3 daemons used all available memory and 1 daemon not. All Impala daemon=
s have the same mem_limit setting.<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
<p class=3D"MsoNormal">Have you ever had such strange behavior? Why not all=
 Impala daemons use all available memory?<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p>&nbsp;</o:p></p>
<p class=3D"MsoNormal">Regards,<o:p></o:p></p>
<p class=3D"MsoNormal">Alexander Shoshin<span style=3D"font-size:12.0pt;fon=
t-family:&quot;Times New Roman&quot;,serif"><o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:12.0pt;font-family:&quot;Ti=
mes New Roman&quot;,serif"><o:p>&nbsp;</o:p></span></p>
</div>
</body>
</html>

--_000_AM5PR03MB29321CE4AB6E2844934D4E93F7830AM5PR03MB2932eurp_--