From dev-return-150469-archive-asf-public=cust-asf.ponee.io@hive.apache.org Mon Oct 15 19:43:23 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 97092180647 for ; Mon, 15 Oct 2018 19:43:22 +0200 (CEST) Received: (qmail 20043 invoked by uid 500); 15 Oct 2018 17:43:21 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 20032 invoked by uid 99); 15 Oct 2018 17:43:20 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 Oct 2018 17:43:20 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 73ACA18229A; Mon, 15 Oct 2018 17:43:20 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.701 X-Spam-Level: X-Spam-Status: No, score=0.701 tagged_above=-999 required=6.31 tests=[HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=2, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_MED=-2.3] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id jAqUsgUDRFAm; Mon, 15 Oct 2018 17:43:17 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 962AF5F3D0; Mon, 15 Oct 2018 17:43:17 +0000 (UTC) Received: from reviews.apache.org (unknown [10.41.0.12]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 4B2E7E0177; Mon, 15 Oct 2018 17:43:17 +0000 (UTC) Received: from reviews-vm2.apache.org (localhost [IPv6:::1]) by reviews.apache.org (ASF Mail Server at reviews-vm2.apache.org) with ESMTP id 1EA79C40546; Mon, 15 Oct 2018 17:43:17 +0000 (UTC) Content-Type: multipart/alternative; boundary="===============3123461360496201197==" MIME-Version: 1.0 Subject: Re: Review Request 69018: Follow up on review comments remove unwanted extra columns kerberos fix From: Slim Bouguerra To: Ashutosh Chauhan , Vineet Garg , Gopal V Cc: Slim Bouguerra , hive Date: Mon, 15 Oct 2018 17:43:16 -0000 Message-ID: <20181015174316.33137.80942@reviews-vm2.apache.org> X-ReviewBoard-URL: https://reviews.apache.org/ Auto-Submitted: auto-generated Sender: Slim Bouguerra X-ReviewGroup: hive X-Auto-Response-Suppress: DR, RN, OOF, AutoReply X-ReviewRequest-URL: https://reviews.apache.org/r/69018/ X-Sender: Slim Bouguerra References: <20181015004734.50684.35971@reviews-vm2.apache.org> In-Reply-To: <20181015004734.50684.35971@reviews-vm2.apache.org> Reply-To: Slim Bouguerra X-ReviewRequest-Repository: hive-git --===============3123461360496201197== MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit > On Oct. 15, 2018, 12:47 a.m., Ashutosh Chauhan wrote: > > kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaOutputFormat.java > > Line 52 (original), 52 (patched) > > > > > > This boolean is not used anywhere, can be removed alongwith associated property. As of now i have kept the path for task level commit, as a hidden feature, that maybe we want to bring it in the future. What you think? > On Oct. 15, 2018, 12:47 a.m., Ashutosh Chauhan wrote: > > kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaUtils.java > > Lines 284 (patched) > > > > > > Its better to use a single principal (and its keytab) to avoid dependency on both. Is that not possible? If not add comments. we do not depend on both, but in case HS2 credentienals not present will use the LLAP ones. I am not sure how ambari drop and distribute the keys, it is safer to have this check. I have added the comment already. - Slim ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/69018/#review209529 ----------------------------------------------------------- On Oct. 15, 2018, 12:07 a.m., Slim Bouguerra wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/69018/ > ----------------------------------------------------------- > > (Updated Oct. 15, 2018, 12:07 a.m.) > > > Review request for hive, Ashutosh Chauhan, Gopal V, and Vineet Garg. > > > Bugs: HIVE-20735 > https://issues.apache.org/jira/browse/HIVE-20735 > > > Repository: hive-git > > > Description > ------- > > As part of the review comments we agreed to: > > remove start and end offsets columns > remove the best effort mode > make the 2pc as default protocol for EOS > Also this patch will include an additional enhancement to add kerberos support. > > > Diffs > ----- > > kafka-handler/README.md 706c77ae25 > kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaOutputFormat.java 950f7315c2 > kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaRecordReader.java 746de61273 > kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaSerDe.java 51cfa24929 > kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaStorageHandler.java 0d64cd9c9c > kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaTableProperties.java 2e1f6faf1f > kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaUtils.java 6ae9c8d276 > kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaWritable.java 681b666fdf > kafka-handler/src/java/org/apache/hadoop/hive/kafka/MetadataColumn.java 60e1aea55d > kafka-handler/src/java/org/apache/hadoop/hive/kafka/SimpleKafkaWriter.java c95bdb02de > kafka-handler/src/test/org/apache/hadoop/hive/kafka/KafkaRecordIteratorTest.java 3d3f598bc0 > kafka-handler/src/test/org/apache/hadoop/hive/kafka/KafkaUtilsTest.java 8aebb9254e > kafka-handler/src/test/org/apache/hadoop/hive/kafka/KafkaWritableTest.java 45bf7912c4 > kafka-handler/src/test/org/apache/hadoop/hive/kafka/SimpleKafkaWriterTest.java d8168e02a0 > ql/src/test/queries/clientpositive/kafka_storage_handler.q 595f0320b6 > ql/src/test/results/clientpositive/druid/kafka_storage_handler.q.out 73f0f293d9 > > > Diff: https://reviews.apache.org/r/69018/diff/1/ > > > Testing > ------- > > > Thanks, > > Slim Bouguerra > > --===============3123461360496201197==--