Return-Path: X-Original-To: apmail-drill-dev-archive@www.apache.org Delivered-To: apmail-drill-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 02D5517EB1 for ; Thu, 24 Sep 2015 17:33:09 +0000 (UTC) Received: (qmail 44747 invoked by uid 500); 24 Sep 2015 17:33:06 -0000 Delivered-To: apmail-drill-dev-archive@drill.apache.org Received: (qmail 44665 invoked by uid 500); 24 Sep 2015 17:33:06 -0000 Mailing-List: contact dev-help@drill.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.apache.org Delivered-To: mailing list dev@drill.apache.org Received: (qmail 44488 invoked by uid 99); 24 Sep 2015 17:33:06 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Sep 2015 17:33:06 +0000 Date: Thu, 24 Sep 2015 17:33:06 +0000 (UTC) From: "Rahul Challapalli (JIRA)" To: dev@drill.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (DRILL-3835) Metadata Caching : Running a query should update the cache incrementally when data gets modified MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Rahul Challapalli created DRILL-3835: ---------------------------------------- Summary: Metadata Caching : Running a query should update the cache incrementally when data gets modified Key: DRILL-3835 URL: https://issues.apache.org/jira/browse/DRILL-3835 Project: Apache Drill Issue Type: Bug Components: Metadata Reporter: Rahul Challapalli Fix For: 1.2.0 git.commit.id.abbrev=240a455 Looking at the below numbers, it looks like we are not doing an incremental update to the cache when the first query is executed after the data has been modified. {code} refresh table metadata 1st time : ~45 seconds select count(*) from lineitem : ~32 seconds Add a new file to the lineitem folder select count(*) from lineitem: ~79 seconds {code} Query : {code} {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)