Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 3DD1D200D20 for ; Tue, 3 Oct 2017 01:17:27 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 3C69A160BCB; Mon, 2 Oct 2017 23:17:27 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 81A431609EF for ; Tue, 3 Oct 2017 01:17:26 +0200 (CEST) Received: (qmail 85699 invoked by uid 500); 2 Oct 2017 23:17:25 -0000 Mailing-List: contact reviews-help@impala.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list reviews@impala.incubator.apache.org Received: (qmail 85688 invoked by uid 99); 2 Oct 2017 23:17:25 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Oct 2017 23:17:25 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id B4C351A1C47 for ; Mon, 2 Oct 2017 23:17:24 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.362 X-Spam-Level: ** X-Spam-Status: No, score=2.362 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=2, RDNS_DYNAMIC=0.363, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id 7P9r5MreR_6O for ; Mon, 2 Oct 2017 23:17:22 +0000 (UTC) Received: from ip-10-146-233-104.ec2.internal (ec2-75-101-130-251.compute-1.amazonaws.com [75.101.130.251]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 315E15F522 for ; Mon, 2 Oct 2017 23:17:22 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by ip-10-146-233-104.ec2.internal (8.14.4/8.14.4) with ESMTP id v92NHJxH021502; Mon, 2 Oct 2017 23:17:19 GMT Message-Id: <201710022317.v92NHJxH021502@ip-10-146-233-104.ec2.internal> X-Gerrit-PatchSet: 9 Date: Mon, 2 Oct 2017 23:17:19 +0000 From: "John Sherman (Code Review)" To: Henry Robinson , Matthew Jacobs , Sailesh Mukil , impala-cr@cloudera.com, reviews@impala.incubator.apache.org X-Gerrit-MessageType: newpatchset Subject: =?UTF-8?Q?=5BImpala-ASF-CR=5D_IMPALA-5394=3A_Change_ThriftServer=28=29_to_always_use_TAcceptQueueServer=0A?= X-Gerrit-Change-Id: I56a5f3d9cf931cff14eae7f236fea018236a6255 X-Gerrit-Change-Number: 7061 X-Gerrit-ChangeURL: X-Gerrit-Commit: b829c49c9a16e83d3f0d878f33cb37f564507f16 In-Reply-To: References: Reply-To: jfs@arcadiadata.com, impala-cr@cloudera.com, sailesh@cloudera.com, marcelk@gmail.com, henry@cloudera.com, reviews@impala.incubator.apache.org, mjacobs@apache.org, dhecht@cloudera.com MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Disposition: inline User-Agent: Gerrit/2.14.2 Content-Type: multipart/alternative; boundary="x/g5ClOoGMs="; charset=UTF-8 archived-at: Mon, 02 Oct 2017 23:17:27 -0000 --x/g5ClOoGMs= Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hello Henry Robinson, Matthew Jacobs, Sailesh Mukil, Dan Hecht, I'd like = you to reexamine a change=2E Please visit http://gerrit=2Ecloudera=2Eo= rg:8080/7061 to look at the new patch set (#9)=2E Change subject: IMPALA-= 5394: Change ThriftServer() to always use TAcceptQueueServer =2E=2E=2E=2E= =2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E= =2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E= =2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E IMPALA-5394: Change Thrif= tServer() to always use TAcceptQueueServer - Previously TThreadPoolServer = called getTransport() on a client from the Server thread (the thread that= did the accepts)=2E - TSaslServerTransport->getTransport() called TSaslT= ransport->open() - TSaslServerTransport->open() tried to negotiate SASL w= hich calls read/write - If read/write blocks indefinitely, the TThr= eadPoolServer could not accept connections until tcp_keepalive kicked= in=2E - Set the underlying TSocket's recvTimeout and sendTimeout before th= e TSaslServerTransport->open() and reset them to 0 after open() complet= es=2E - Added sasl_connect_tcp_timeout_ms flag that defaults to 300000 mi= lliseconds (5 minutes) - Add the ability for TAcceptQueueServer to limit th= e maximum number of concurrent tasks - Added a test case to thrift-server= -test to test max_concurrent_connections enforcement - Changed the remain= ing Thrift servers to use TAcceptQueueServer=2E (hs2/beeswax/network-perf= -benchmark) - The timeout is still needed in TAcceptQueueServer since = SetupConnection follows a similar pattern that TThreadPoolServer does= =2E - Removed support for TThreadPool from ThriftServer() since it is no = longer used anywhere=2E ThriftServer() now always uses TAcceptQueueServer= =2E - Deprecated enable_accept_queue_server flag and removed supporting c= ode=2E Change-Id: I56a5f3d9cf931cff14eae7f236fea018236a6255 --- M be/src/b= enchmarks/network-perf-benchmark=2Ecc M be/src/common/global-flags=2Ecc M b= e/src/rpc/TAcceptQueueServer=2Ecpp M be/src/rpc/TAcceptQueueServer=2Eh M be= /src/rpc/thrift-server-test=2Ecc M be/src/rpc/thrift-server=2Ecc M be/src/r= pc/thrift-server=2Eh M be/src/service/impala-server=2Ecc M be/src/transport= /TSaslServerTransport=2Ecpp M common/thrift/metrics=2Ejson 10 files changed= , 159 insertions(+), 112 deletions(-) git pull ssh://gerrit=2Ecloudera= =2Eorg:29418/Impala-ASF refs/changes/61/7061/9 -- To view, visit http://ge= rrit=2Ecloudera=2Eorg:8080/7061 To unsubscribe, visit http://gerrit=2Ecloud= era=2Eorg:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master G= errit-MessageType: newpatchset Gerrit-Change-Id: I56a5f3d9cf931cff14eae7f23= 6fea018236a6255 Gerrit-Change-Number: 7061 Gerrit-PatchSet: 9 Gerrit-Owner:= John Sherman Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Henry Robinson Gerrit= -Reviewer: John Sherman Gerrit-Reviewer: Matthew Ja= cobs Gerrit-Reviewer: Sailesh Mukil --x/g5ClOoGMs=--