Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 940FC200BE0 for ; Sat, 3 Dec 2016 00:26:18 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 92C9B160B27; Fri, 2 Dec 2016 23:26:18 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id DCF66160B24 for ; Sat, 3 Dec 2016 00:26:17 +0100 (CET) Received: (qmail 14140 invoked by uid 500); 2 Dec 2016 23:26:17 -0000 Mailing-List: contact reviews-help@impala.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list reviews@impala.incubator.apache.org Received: (qmail 14117 invoked by uid 99); 2 Dec 2016 23:26:16 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Dec 2016 23:26:16 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 7A300180554 for ; Fri, 2 Dec 2016 23:26:16 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.362 X-Spam-Level: X-Spam-Status: No, score=0.362 tagged_above=-999 required=6.31 tests=[RDNS_DYNAMIC=0.363, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id g3_vODG_zNwR for ; Fri, 2 Dec 2016 23:26:14 +0000 (UTC) Received: from ip-10-146-233-104.ec2.internal (ec2-75-101-130-251.compute-1.amazonaws.com [75.101.130.251]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 7A35A5F27D for ; Fri, 2 Dec 2016 23:26:14 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by ip-10-146-233-104.ec2.internal (8.14.4/8.14.4) with ESMTP id uB2NQ0lA010013; Fri, 2 Dec 2016 23:26:00 GMT Date: Fri, 2 Dec 2016 23:26:00 +0000 From: "Thomas Tauber-Marshall (Code Review)" To: impala-cr@cloudera.com, reviews@impala.incubator.apache.org Message-ID: Reply-To: tmarshall@cloudera.com X-Gerrit-MessageType: newchange Subject: =?UTF-8?Q?=5BImpala-ASF-CR=5D_IMPALA-4566=3A_Kudu_client_glog_contention_can_cause_timeouts=0A?= X-Gerrit-Change-Id: Ie535d89ec2525232d4f6a29dd44f51cd6e18a0d2 X-Gerrit-ChangeURL: X-Gerrit-Commit: 3fe39693915f83e5bede37e2f5b79651146f9721 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Content-Disposition: inline User-Agent: Gerrit/2.12.2 archived-at: Fri, 02 Dec 2016 23:26:18 -0000 Thomas Tauber-Marshall has uploaded a new change for review. http://gerrit.cloudera.org:8080/5334 Change subject: IMPALA-4566: Kudu client glog contention can cause timeouts ...................................................................... IMPALA-4566: Kudu client glog contention can cause timeouts Under stressful workloads, there appears to be significant contention in glog resulting from Kudu logging, causing timeouts and failed queries. An easy solution for now is to downgrade Kudu WARNINGs to INFOs as WARNINGs grab a lock to flush the log. Testing: Manually verified that the patch redirects Kudu WARNINGs to the INFO log. Not tested under stress to verify if this actually solves the contention problem. Change-Id: Ie535d89ec2525232d4f6a29dd44f51cd6e18a0d2 --- M be/src/exec/kudu-util.cc 1 file changed, 3 insertions(+), 1 deletion(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/34/5334/1 -- To view, visit http://gerrit.cloudera.org:8080/5334 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ie535d89ec2525232d4f6a29dd44f51cd6e18a0d2 Gerrit-PatchSet: 1 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Thomas Tauber-Marshall