drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rahul Challapalli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-2175) Provide an option to not display the list of files in the physical plan
Date Wed, 28 Oct 2015 17:18:27 GMT

    [ https://issues.apache.org/jira/browse/DRILL-2175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14978793#comment-14978793

Rahul Challapalli commented on DRILL-2175:

We are currently using the text plan in the extended tests for testing partition pruning.
Whenever the order of files change, we might run into test failures and some effort is needed
to fix the tests. So getting rid of the files scanned will be helpful. We should also make
sure that this applies across all Scan's (Json, Parquet, Hive etc)

Also the HiveScan currently does not display the "numFiles" attribute in the scan. Without
this attribute we cannot test the hive partition pruning if we end up getting rid of the list
of scanned files/partitions 


> Provide an option to not display the list of files in the physical plan
> -----------------------------------------------------------------------
>                 Key: DRILL-2175
>                 URL: https://issues.apache.org/jira/browse/DRILL-2175
>             Project: Apache Drill
>          Issue Type: Improvement
>          Components: Query Planning & Optimization
>            Reporter: Aman Sinha
>             Fix For: Future
> The physical plan shown through explain (both the text and json version) shows all the
files to be read by the Scan node.   This creates a problem when the number of files is large
(e.g hundreds) - I am unable to see the entire plan even after raising the sqlline maxwidth
to 500K (default of 10K is too small).   This is a usability issue.  
> We could provide an option - either through another version of Explain or through a session
option - to not display the entire list of files.  Another option is to show the parent directory
and the number of files it contains.  The  total number of files is shown already. 

This message was sent by Atlassian JIRA

View raw message