drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-4152) Add additional logging and metrics to the Parquet reader
Date Fri, 11 Dec 2015 21:13:46 GMT

    [ https://issues.apache.org/jira/browse/DRILL-4152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053566#comment-15053566
] 

ASF GitHub Bot commented on DRILL-4152:
---------------------------------------

GitHub user parthchandra opened a pull request:

    https://github.com/apache/drill/pull/298

    DRILL-4152: Add trace logging to  Parquet reader for performance tuning.

    Added trace level logging to track time taken by the Parquet reader.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/parthchandra/incubator-drill DRILL-4152

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/drill/pull/298.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #298
    
----
commit edb772e4e7c1a1af325c2ae3da659dbf0b0c26a4
Author: Parth Chandra <parthc@apache.org>
Date:   2015-12-03T22:32:30Z

    DRILL-4152: Add trace logging to  Parquet reader for performance tuning.

----


> Add additional logging and metrics to the Parquet reader
> --------------------------------------------------------
>
>                 Key: DRILL-4152
>                 URL: https://issues.apache.org/jira/browse/DRILL-4152
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Parquet
>            Reporter: Parth Chandra
>            Assignee: Parth Chandra
>
> In some cases, we see the Parquet reader as the bottleneck in reading from the file system.
RWSpeedTest is able to read 10x faster than the Parquet reader so reading from disk is not
the issue. This issue is to add more instrumentation to the Parquet reader so speed bottlenecks
can be better diagnosed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message