drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jinfeng Ni (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-4715) Java compilation error for a query with large number of expressions
Date Tue, 14 Jun 2016 01:08:57 GMT

    [ https://issues.apache.org/jira/browse/DRILL-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15328745#comment-15328745

Jinfeng Ni commented on DRILL-4715:

[~jnadeau], do you know how to run the unit test in https://github.com/apache/drill/blob/master/exec/java-exec/src/test/java/org/apache/drill/exec/compile/TestLargeFileCompilation.java?
I can manually run those testcases in IDE, but I'm wondering if there is a switch to make
mvn surefire run those testcase as well.


> Java compilation error for a query with large number of expressions
> -------------------------------------------------------------------
>                 Key: DRILL-4715
>                 URL: https://issues.apache.org/jira/browse/DRILL-4715
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Codegen
>            Reporter: Jinfeng Ni
> The following query would hit compilation error, when Drill generates and compiles the
run-time code. 
> Q1 :
> {code}
> select  expr1, expr2, expr3, ...., exprN
> from table
> {code} 
> In Q1, expr1, expr2, ..., exprN are non-trivial expression (in stead of simply column
reference), and N is big enough, then the run-time generated code may have a method which
goes beyond the 64k limit imposed by JVM. 
> This seems to be a regression from DRILL-3912 (Common subexpression elimination). CSE
tries to put as many expressions in one block as possible, to detect and eliminate as many
CSE as possible. However, this implies we may end up with big method with compilation error.

This message was sent by Atlassian JIRA

View raw message