drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rahul Challapalli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-1095) Drill Parquet Writer fails when we have more than 150 columns
Date Wed, 16 Jul 2014 22:29:05 GMT

    [ https://issues.apache.org/jira/browse/DRILL-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064253#comment-14064253
] 

Rahul Challapalli commented on DRILL-1095:
------------------------------------------

Well looks like this is independent of the Parquet Writer and is dependent on the size of
the runtime generated code. The below query also results in a similar error. It fails around
135 columns in the group by. Each column in this case is an integer with value similar to
"39867"

select count(*) from `200columns` group by col0, col1, col2, col3, col4, col5, col6, col7,
col8, col9, col10, col11, col12, col13, col14, col15, col16, col17, col18, col19, col20, col21,
col22, col23, col24, col25, col26, col27, col28, col29, col30, col31, col32, col33, col34,
col35, col36, col37, col38, col39, col40, col41, col42, col43, col44, col45, col46, col47,
col48, col49, col50, col51, col52, col53, col54, col55, col56, col57, col58, col59, col60,
col61, col62, col63, col64, col65, col66, col67, col68, col69, col70, col71, col72, col73,
col74, col75, col76, col77, col78, col79, col80, col81, col82, col83, col84, col85, col86,
col87, col88, col89, col90, col91, col92, col93, col94, col95, col96, col97, col98, col99,
col100, col101, col102, col103, col104, col105, col106, col107, col108, col109, col110, col111,
col112, col113, col114, col115, col116, col117, col118, col119, col120, col121, col122, col123,
col124, col125, col126, col127, col128, col129, col130, col131, col132, col133, col134, col135,
col136, col137, col138, col139, col140, col141, col142, col143, col144, col145, col146, col147,
col148, col149;

> Drill Parquet Writer fails when we have more than 150 columns
> -------------------------------------------------------------
>
>                 Key: DRILL-1095
>                 URL: https://issues.apache.org/jira/browse/DRILL-1095
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Codegen, Metadata, Storage - Writer
>            Reporter: Rahul Challapalli
>            Assignee: Aditya Kishore
>            Priority: Blocker
>         Attachments: error.log
>
>
> git.commit.id.abbrev=a1a6144
> Build#  26246
> The 'create table as' statement starts to break when the column count is somewhere around
125-150. I attached the error log. Let me know if you have any questions.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message