Return-Path: X-Original-To: apmail-drill-issues-archive@minotaur.apache.org Delivered-To: apmail-drill-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6EDB218CF3 for ; Tue, 3 Nov 2015 01:13:28 +0000 (UTC) Received: (qmail 37036 invoked by uid 500); 3 Nov 2015 01:13:28 -0000 Delivered-To: apmail-drill-issues-archive@drill.apache.org Received: (qmail 37008 invoked by uid 500); 3 Nov 2015 01:13:27 -0000 Mailing-List: contact issues-help@drill.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.apache.org Delivered-To: mailing list issues@drill.apache.org Received: (qmail 36984 invoked by uid 99); 3 Nov 2015 01:13:27 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Nov 2015 01:13:27 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id C785F2C1F51 for ; Tue, 3 Nov 2015 01:13:27 +0000 (UTC) Date: Tue, 3 Nov 2015 01:13:27 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: issues@drill.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (DRILL-3941) Add timing instrumentation around Partition Pruning MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/DRILL-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986432#comment-14986432 ] ASF GitHub Bot commented on DRILL-3941: --------------------------------------- Github user mehant commented on a diff in the pull request: https://github.com/apache/drill/pull/230#discussion_r43706628 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/Metadata.java --- @@ -163,7 +163,9 @@ private ParquetTableMetadata_v1 getParquetTableMetadata(String path) throws IOEx watch.start(); List fileStatuses = getFileStatuses(fileStatus); logger.info("Took {} ms to get file statuses", watch.elapsed(TimeUnit.MILLISECONDS)); - return getParquetTableMetadata(fileStatuses); + ParquetTableMetadata_v1 metadata_v1 = getParquetTableMetadata(fileStatuses); + logger.info("Took {} ms to read file metadata", watch.elapsed(TimeUnit.MILLISECONDS)); --- End diff -- I will modify this to exclude the getFileStatuses(). > Add timing instrumentation around Partition Pruning > --------------------------------------------------- > > Key: DRILL-3941 > URL: https://issues.apache.org/jira/browse/DRILL-3941 > Project: Apache Drill > Issue Type: Bug > Reporter: Mehant Baid > Assignee: Aman Sinha > > We seem to spending a chunk time doing partition pruning, it would be good to log timing information to indicate the amount of time we spend doing pruning. A little more granularity to indicate the time taken to build the filter tree and in the interpreter would also be good. -- This message was sent by Atlassian JIRA (v6.3.4#6332)