drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sudheesh Katkam (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-4911) SimpleParallelizer should avoid plan serialization for logging purpose when debug logging is not enabled.
Date Tue, 25 Oct 2016 01:12:58 GMT

    [ https://issues.apache.org/jira/browse/DRILL-4911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15603800#comment-15603800
] 

Sudheesh Katkam commented on DRILL-4911:
----------------------------------------

Fixed in [4edabe7|https://github.com/apache/drill/commit/4edabe7a392f38b0f7a9c8af51a74bf6932a821d]

> SimpleParallelizer should avoid plan serialization for logging purpose when debug logging
is not enabled.
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: DRILL-4911
>                 URL: https://issues.apache.org/jira/browse/DRILL-4911
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Query Planning & Optimization
>            Reporter: Jinfeng Ni
>            Assignee: Jinfeng Ni
>            Priority: Minor
>             Fix For: 1.9.0
>
>
> SimpleParallelizer and subclass have code to put serialized plan in debug log. However,
in case when the physical plan fragment is very large (table is huge with large # of partitions,
files, etc), the overhead of serialization is not negligible. The code seems to always do
serialization, regardless whether the debug flag is turned on. 
> To reduce the overhead, SimpleParallelizer and subclass should only do plan serialization
for logging purpose when debug logging is turned on.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message