Mailing-List: contact user-help@impala.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@impala.incubator.apache.org
Message-ID: <5926f8da.c299df0a.54477.6206@mx.google.com>
From: "Evo Eftimov" <evo.eftimov@isecc.com>
To: <user@impala.incubator.apache.org>
Subject: SendersBlockedTimer
Date: Thu, 25 May 2017 16:31:36 +0100
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_NextPart_000_007C_01D2D574.61CFD9E0"
Thread-Index: AdLVa/83OgHPG7eXQNSWqVAIPsjMiQ==
Content-Language: en-us
archived-at: Thu, 25 May 2017 15:31:45 -0000

This is a multi-part message in MIME format.

------=_NextPart_000_007C_01D2D574.61CFD9E0
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: 7bit

What is the purpose of SendersBlockedTimer attribute in the EXCHANGE_NODE
section of the Coordinator Fragment - part of the PROFILE of SQL statement
executed by Impala

 
I have reviewed the Impala source code and know that the Exchange Node uses
a Blocking Queue as part of "Stream Manager" module which it instantiates 

 
In the specific context I am interested in, the Exchange Node returns the
row from a result set to a JDBC driver client. The result set is produced by
a simple full table scan only query of the type "select * from table"

 
The "Sender" Parallel Threads (presumably with the Exchange Node) publish
rows to the Blocking Queue also in the Exchange Node and the JDBC client
reads rows from the same queue via remote JDBC session / connection over
TCP/IP - is that a correct description of how the Exchange Node mediates
between JDBC client on the one hand and ImpalaD workers on the other? Btw
the Exchange Node is part of the Coordinator Node in terms of terminology -
right?

 
My specific question is what is the purpose/meaning  of
SendersBlockedTimer - e.g. does it mean that the Sender Threads WITHIN the
Exchange Node have been in a blocked state for the time shown in the value
of the attribute. And if this is correct then does that mean that they have
been blocked because the JDBC Client couldn't not keep up with draining the
Blocking Queue during the aggregated time duration in SendersBlockedTimer?

 
------=_NextPart_000_007C_01D2D574.61CFD9E0
Content-Type: text/html;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" =
xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta =
http-equiv=3DContent-Type content=3D"text/html; =
charset=3Dus-ascii"><meta name=3DGenerator content=3D"Microsoft Word 12 =
(filtered medium)"><style><!--
/* Font Definitions */
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:purple;
	text-decoration:underline;}
span.EmailStyle17
	{mso-style-type:personal-compose;
	font-family:"Calibri","sans-serif";
	color:windowtext;}
.MsoChpDefault
	{mso-style-type:export-only;}
@page WordSection1
	{size:8.5in 11.0in;
	margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
	{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]--></head><body lang=3DEN-US link=3Dblue =
vlink=3Dpurple><div class=3DWordSection1><p class=3DMsoNormal>What is =
the purpose of SendersBlockedTimer attribute in the EXCHANGE_NODE =
section of the Coordinator Fragment &#8211; part of the PROFILE of SQL =
statement executed by Impala<o:p></o:p></p><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMsoNormal>I have =
reviewed the Impala source code and know that the Exchange Node uses a =
Blocking Queue as part of &#8220;Stream Manager&#8221; module which it =
instantiates <o:p></o:p></p><p class=3DMsoNormal><o:p>&nbsp;</o:p></p><p =
class=3DMsoNormal>In the specific context I am interested in, the =
Exchange Node returns the row from a result set to a JDBC driver client. =
The result set is produced by a simple full table scan only query of the =
type &#8220;select * from table&#8221;<o:p></o:p></p><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMsoNormal>The =
&#8220;Sender&#8221; Parallel Threads (presumably with the Exchange =
Node) publish rows to the Blocking Queue also in the Exchange Node and =
the JDBC client reads rows from the same queue via remote JDBC session / =
connection over TCP/IP &#8211; is that a correct description of how the =
Exchange Node mediates between JDBC client on the one hand and ImpalaD =
workers on the other? Btw the Exchange Node is part of the Coordinator =
Node in terms of terminology &#8211; right?<o:p></o:p></p><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMsoNormal>My specific =
question is what is the purpose/meaning &nbsp;of =
&nbsp;&nbsp;SendersBlockedTimer &#8211; e.g. does it mean that the =
Sender Threads WITHIN the Exchange Node have been in a blocked state for =
the time shown in the value of the attribute. And if this is correct =
then does that mean that they have been blocked because the JDBC Client =
couldn&#8217;t not keep up with draining the Blocking Queue during the =
aggregated time duration in SendersBlockedTimer?<o:p></o:p></p><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p></div></body></html>
------=_NextPart_000_007C_01D2D574.61CFD9E0--