drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Altekruse (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-419) parquet files created using dictionary encoding cannot be read in drill
Date Wed, 23 Jul 2014 01:16:39 GMT

    [ https://issues.apache.org/jira/browse/DRILL-419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14071228#comment-14071228
] 

Jason Altekruse commented on DRILL-419:
---------------------------------------

The remaining issues with this should be solved in a large patch to the parquet reader posted
here for review. https://reviews.apache.org/r/23681/

> parquet files created using dictionary encoding cannot be read in drill
> -----------------------------------------------------------------------
>
>                 Key: DRILL-419
>                 URL: https://issues.apache.org/jira/browse/DRILL-419
>             Project: Apache Drill
>          Issue Type: Bug
>            Reporter: Ramana Inukonda Nagaraj
>         Attachments: 0002-Drill-419-enable-dictionary-encoding-in-parquet-read.patch
>
>
> 0: jdbc:drill:> select * from dfs.home.`customer_drill.dict.parquet`;
> Query failed: org.apache.drill.exec.rpc.RpcException: Remote failure while running query.[error_id:
"a01e5572-8587-4aa8-a352-ac64674f58c4"
> endpoint {
>   address: "perfnode166.perf.lab"
>   user_port: 31010
>   control_port: 31011
>   data_port: 31012
> }
> error_type: 0
> message: "Failure while running fragment. < NullPointerException"
> ]
> Error: exception while executing query (state=,code=0)
> From logs:
> 11:24:07.681 [WorkManager-4] DEBUG o.a.d.e.w.fragment.FragmentExecutor - Caught exception
while running fragment
> java.lang.NullPointerException: null
>         at org.apache.drill.exec.store.parquet.PageReadStatus.next(PageReadStatus.java:89)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
>         at org.apache.drill.exec.store.parquet.VarLenBinaryReader.readFields(VarLenBinaryReader.java:113)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
>         at org.apache.drill.exec.store.parquet.ParquetRecordReader.next(ParquetRecordReader.java:368)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
>         at org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:94) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
>         at org.apache.drill.exec.record.AbstractSingleRecordBatch.next(AbstractSingleRecordBatch.java:42)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
>         at org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.next(ScreenCreator.java:80)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
>         at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:83)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_45]
>         at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> 11:24:07.682 [WorkManager-4] ERROR o.a.d.e.w.f.AbstractStatusReporter - Error a01e5572-8587-4aa8-a352-ac64674f58c4:
Failure while running fragment.
> java.lang.NullPointerException: null
>         at org.apache.drill.exec.store.parquet.PageReadStatus.next(PageReadStatus.java:89)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
>         at org.apache.drill.exec.store.parquet.VarLenBinaryReader.readFields(VarLenBinaryReader.java:113)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
>         at org.apache.drill.exec.store.parquet.ParquetRecordReader.next(ParquetRecordReader.java:368)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
>         at org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:94) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
>         at org.apache.drill.exec.record.AbstractSingleRecordBatch.next(AbstractSingleRecordBatch.java:42)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
>         at org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.next(ScreenCreator.java:80)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
>         at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:83)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_45]
>         at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> 11:24:07.683 [WorkManager-4] DEBUG o.a.d.exec.work.foreman.QueryManager - New fragment
status was provided to Foreman of memory_use: 450020
> batches_completed: 0
> records_completed: 0
> state: FAILED



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message