Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id DB3BF200C67 for ; Mon, 15 May 2017 10:19:41 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id D9B87160BC2; Mon, 15 May 2017 08:19:41 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 2BFF1160BC1 for ; Mon, 15 May 2017 10:19:41 +0200 (CEST) Received: (qmail 64770 invoked by uid 500); 15 May 2017 08:19:35 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 64704 invoked by uid 99); 15 May 2017 08:19:34 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 May 2017 08:19:34 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 69CCDC220D; Mon, 15 May 2017 08:19:34 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3 X-Spam-Level: *** X-Spam-Status: No, score=3 tagged_above=-999 required=6.31 tests=[HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=2, KAM_LAZY_DOMAIN_SECURITY=1, RP_MATCHES_RCVD=-0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id acW9QToenFxa; Mon, 15 May 2017 08:19:33 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id B90775FDFD; Mon, 15 May 2017 08:19:32 +0000 (UTC) Received: from reviews.apache.org (unknown [10.41.0.12]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 19C2EE026E; Mon, 15 May 2017 08:19:32 +0000 (UTC) Received: from reviews-vm2.apache.org (localhost [IPv6:::1]) by reviews.apache.org (ASF Mail Server at reviews-vm2.apache.org) with ESMTP id E97C2C402D5; Mon, 15 May 2017 08:19:31 +0000 (UTC) Content-Type: multipart/alternative; boundary="===============1734771032669297061==" MIME-Version: 1.0 Subject: Re: Review Request 59205: HIVE-16579: CachedStore: improvements to partition col stats caching and cache column stats for unpartitioned table From: Thejas Nair To: Thejas Nair , Daniel Dai Cc: Vaibhav Gumashta , hive Date: Mon, 15 May 2017 08:19:31 -0000 Message-ID: <20170515081931.55748.90715@reviews-vm2.apache.org> X-ReviewBoard-URL: https://reviews.apache.org/ Auto-Submitted: auto-generated Sender: Thejas Nair X-ReviewGroup: hive X-Auto-Response-Suppress: DR, RN, OOF, AutoReply X-ReviewRequest-URL: https://reviews.apache.org/r/59205/ X-Sender: Thejas Nair References: <20170515075922.55748.66093@reviews-vm2.apache.org> In-Reply-To: <20170515075922.55748.66093@reviews-vm2.apache.org> Reply-To: Thejas Nair X-ReviewRequest-Repository: hive-git archived-at: Mon, 15 May 2017 08:19:42 -0000 --===============1734771032669297061== MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/59205/#review174936 ----------------------------------------------------------- metastore/src/java/org/apache/hadoop/hive/metastore/cache/CachedStore.java Line 281 (original), 284 (patched) This needs to be TimeUnit.MILLISECONDS, as you want it converted to MILLISECONDS metastore/src/java/org/apache/hadoop/hive/metastore/cache/CachedStore.java Line 512 (original), 526 (patched) isDatabaseCacheDirty.set(true); - this needs to be set after obtaining the lock Otherwise, you can have case where it gets reset by background thread before actual update. (Same with this call in other places) - Thejas Nair On May 15, 2017, 7:59 a.m., Vaibhav Gumashta wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/59205/ > ----------------------------------------------------------- > > (Updated May 15, 2017, 7:59 a.m.) > > > Review request for hive, Daniel Dai and Thejas Nair. > > > Bugs: HIVE-16579 > https://issues.apache.org/jira/browse/HIVE-16579 > > > Repository: hive-git > > > Description > ------- > > https://issues.apache.org/jira/browse/HIVE-16579 > > > Diffs > ----- > > common/src/java/org/apache/hadoop/hive/conf/HiveConf.java d6a80ae > itests/hcatalog-unit/src/test/java/org/apache/hive/hcatalog/listener/DummyRawStoreFailEvent.java 91a3a38 > itests/util/src/main/java/org/apache/hadoop/hive/ql/QTestUtil.java b897ffa > metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreDirectSql.java b96c27e > metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java 870896c > metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java ed19f42 > metastore/src/java/org/apache/hadoop/hive/metastore/RawStore.java c1af690 > metastore/src/java/org/apache/hadoop/hive/metastore/cache/CacheUtils.java 668499b > metastore/src/java/org/apache/hadoop/hive/metastore/cache/CachedStore.java 5a187d8 > metastore/src/java/org/apache/hadoop/hive/metastore/cache/SharedCache.java 7beee42 > metastore/src/java/org/apache/hadoop/hive/metastore/hbase/HBaseStore.java 0c7d8bb > metastore/src/test/org/apache/hadoop/hive/metastore/DummyRawStoreControlledCommit.java f613c30 > metastore/src/test/org/apache/hadoop/hive/metastore/DummyRawStoreForJdoConnection.java 1720e37 > metastore/src/test/org/apache/hadoop/hive/metastore/cache/TestCachedStore.java 0ab20d6 > > > Diff: https://reviews.apache.org/r/59205/diff/5/ > > > Testing > ------- > > > Thanks, > > Vaibhav Gumashta > > --===============1734771032669297061==--