drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aditya Kishore (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-1095) Add support for large number of columns in queries
Date Tue, 22 Jul 2014 11:02:47 GMT

     [ https://issues.apache.org/jira/browse/DRILL-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Aditya Kishore updated DRILL-1095:
----------------------------------

    Description: 
git.commit.id.abbrev=a1a6144
Build#  26246

The 'create table as' statement starts to break when the column count is somewhere around
125-150. I attached the error log. Let me know if you have any questions.

The root cause of this (and similar failures) is that when a Drill operator needs to process
(evaluate/copy/spool) a large number of expressions (columns), the resultant runtime generated
code can exceed the [64 KB byte code limit|http://docs.oracle.com/javase/specs/jvms/se7/html/jvms-4.html#jvms-4.9.1-110-B]
imposed on the size of a function by Java class file specifications, resulting in compilation
failure.

This umbrella JIRA will serve as a container for various sub-tasks to address this issue.

  was:
git.commit.id.abbrev=a1a6144
Build#  26246

The 'create table as' statement starts to break when the column count is somewhere around
125-150. I attached the error log. Let me know if you have any questions.





        Summary: Add support for large number of columns in queries  (was: Drill Parquet Writer
fails when we have more than 150 columns)

Updating JIRA summary and description to reflect the root cause.

> Add support for large number of columns in queries
> --------------------------------------------------
>
>                 Key: DRILL-1095
>                 URL: https://issues.apache.org/jira/browse/DRILL-1095
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Codegen, Metadata, Storage - Writer
>            Reporter: Rahul Challapalli
>            Assignee: Aditya Kishore
>            Priority: Blocker
>         Attachments: error.log
>
>
> git.commit.id.abbrev=a1a6144
> Build#  26246
> The 'create table as' statement starts to break when the column count is somewhere around
125-150. I attached the error log. Let me know if you have any questions.
> The root cause of this (and similar failures) is that when a Drill operator needs to
process (evaluate/copy/spool) a large number of expressions (columns), the resultant runtime
generated code can exceed the [64 KB byte code limit|http://docs.oracle.com/javase/specs/jvms/se7/html/jvms-4.html#jvms-4.9.1-110-B]
imposed on the size of a function by Java class file specifications, resulting in compilation
failure.
> This umbrella JIRA will serve as a container for various sub-tasks to address this issue.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message