Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 3C7BC200C88 for ; Fri, 2 Jun 2017 09:22:09 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 3AE4E160BE4; Fri, 2 Jun 2017 07:22:09 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 89E56160BD1 for ; Fri, 2 Jun 2017 09:22:08 +0200 (CEST) Received: (qmail 44244 invoked by uid 500); 2 Jun 2017 07:22:07 -0000 Mailing-List: contact dev-help@phoenix.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@phoenix.apache.org Delivered-To: mailing list dev@phoenix.apache.org Received: (qmail 44226 invoked by uid 99); 2 Jun 2017 07:22:07 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Jun 2017 07:22:07 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 90296C192B for ; Fri, 2 Jun 2017 07:22:06 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id bVc2tRiD2j1r for ; Fri, 2 Jun 2017 07:22:06 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 4C9445FD83 for ; Fri, 2 Jun 2017 07:22:05 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 9131EE0630 for ; Fri, 2 Jun 2017 07:22:04 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 335F72193C for ; Fri, 2 Jun 2017 07:22:04 +0000 (UTC) Date: Fri, 2 Jun 2017 07:22:04 +0000 (UTC) From: "Maddineni Sukumar (JIRA)" To: dev@phoenix.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (PHOENIX-3823) Force cache update on MetaDataEntityNotFoundException MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 02 Jun 2017 07:22:09 -0000 [ https://issues.apache.org/jira/browse/PHOENIX-3823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maddineni Sukumar updated PHOENIX-3823: --------------------------------------- Attachment: PHOENIX-3823.v10.patch Did all suggestions made by [~jamestaylor] except moving DROP_METADATA atrrib to individual test level as that did not work properly i.e. setting that property at driver level is working but not working If I set at individual connection level. > Force cache update on MetaDataEntityNotFoundException > ------------------------------------------------------ > > Key: PHOENIX-3823 > URL: https://issues.apache.org/jira/browse/PHOENIX-3823 > Project: Phoenix > Issue Type: Sub-task > Affects Versions: 4.10.0 > Reporter: James Taylor > Assignee: Maddineni Sukumar > Fix For: 4.11.0 > > Attachments: PHOENIX-3823.patch, PHOENIX-3823.v10.patch, PHOENIX-3823.v2.patch, PHOENIX-3823.v3.patch, PHOENIX-3823.v4.patch, PHOENIX-3823.v5.patch, PHOENIX-3823.v6.patch, PHOENIX-3823.v7.patch, PHOENIX-3823.v8.patch, PHOENIX-3823.v9.patch > > > When UPDATE_CACHE_FREQUENCY is used, clients will cache metadata for a period of time which may cause the schema being used to become stale. If another client adds a column or a new table or view, other clients won't see it. As a result, the client will get a MetaDataEntityNotFoundException. Instead of bubbling this up, we should retry after forcing a cache update on the tables involved in the query. > The above works well for references to entities that don't yet exist. However, we cannot detect when some entities are referred to which no longer exists until the cache expires. An exception is if a physical table is dropped which would be detected immediately, however we would allow queries and updates to columns which have been dropped until the cache entry expires (which seems like a reasonable tradeoff IMHO. In addition, we won't start using indexes on tables until the cache expires. -- This message was sent by Atlassian JIRA (v6.3.15#6346)