Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id AAC09200D34 for ; Fri, 3 Nov 2017 21:12:48 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id A9271160BFB; Fri, 3 Nov 2017 20:12:48 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 02B58160BDE for ; Fri, 3 Nov 2017 21:12:47 +0100 (CET) Received: (qmail 30433 invoked by uid 500); 3 Nov 2017 20:12:47 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 30422 invoked by uid 99); 3 Nov 2017 20:12:46 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Nov 2017 20:12:46 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id E6A911A5E2C; Fri, 3 Nov 2017 20:12:45 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3 X-Spam-Level: *** X-Spam-Status: No, score=3 tagged_above=-999 required=6.31 tests=[HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=2, KAM_LAZY_DOMAIN_SECURITY=1, RP_MATCHES_RCVD=-0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id Id8n0FQAjbst; Fri, 3 Nov 2017 20:12:44 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 6E9155F566; Fri, 3 Nov 2017 20:12:44 +0000 (UTC) Received: from reviews.apache.org (unknown [10.41.0.12]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 07B1EE0617; Fri, 3 Nov 2017 20:12:44 +0000 (UTC) Received: from reviews-vm2.apache.org (localhost [IPv6:::1]) by reviews.apache.org (ASF Mail Server at reviews-vm2.apache.org) with ESMTP id 157A2C406FB; Fri, 3 Nov 2017 20:12:42 +0000 (UTC) Content-Type: multipart/alternative; boundary="===============7784658675527674271==" MIME-Version: 1.0 Subject: Re: Review Request 63319: HIVE-17908: LLAP External client not correctly handling killTask for pending requests From: Sergey Shelukhin To: Siddharth Seth Cc: Sergey Shelukhin , hive , Jason Dere Date: Fri, 03 Nov 2017 20:12:41 -0000 Message-ID: <20171103201241.24300.3865@reviews-vm2.apache.org> X-ReviewBoard-URL: https://reviews.apache.org/ Auto-Submitted: auto-generated Sender: Sergey Shelukhin X-ReviewGroup: hive X-Auto-Response-Suppress: DR, RN, OOF, AutoReply X-ReviewRequest-URL: https://reviews.apache.org/r/63319/ X-Sender: Sergey Shelukhin References: <20171026024226.2646.7504@reviews-vm2.apache.org> In-Reply-To: <20171026024226.2646.7504@reviews-vm2.apache.org> Reply-To: Sergey Shelukhin X-ReviewRequest-Repository: hive-git archived-at: Fri, 03 Nov 2017 20:12:48 -0000 --===============7784658675527674271== MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/63319/#review190055 ----------------------------------------------------------- llap-client/src/java/org/apache/hadoop/hive/llap/ext/LlapTaskUmbilicalExternalClient.java Lines 82 (patched) random is not thread safe llap-client/src/java/org/apache/hadoop/hive/llap/ext/LlapTaskUmbilicalExternalClient.java Lines 370 (patched) nit: save in ctor/init? llap-client/src/java/org/apache/hadoop/hive/llap/ext/LlapTaskUmbilicalExternalClient.java Lines 550 (patched) I don't quite understand the logic around semaphore. For now it's try-acquired on send and released on response, so it seems like for retries after the response (in the callback) it's unneeded, and out of bounds retries like this won't work because it's still acquired while the response is still pending, so tryacquire would return false. Perhaps a comment would be helpful on the field about the lifecycle for acquire/release - Sergey Shelukhin On Oct. 26, 2017, 2:42 a.m., Jason Dere wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/63319/ > ----------------------------------------------------------- > > (Updated Oct. 26, 2017, 2:42 a.m.) > > > Review request for hive and Siddharth Seth. > > > Bugs: HIVE-17908 > https://issues.apache.org/jira/browse/HIVE-17908 > > > Repository: hive-git > > > Description > ------- > > - Pending requests should retry if killTask received > - Change retry delay to use exponential backoff > > > Diffs > ----- > > llap-client/src/java/org/apache/hadoop/hive/llap/ext/LlapTaskUmbilicalExternalClient.java aa94e54 > > > Diff: https://reviews.apache.org/r/63319/diff/1/ > > > Testing > ------- > > > Thanks, > > Jason Dere > > --===============7784658675527674271==--