drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Altekruse (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-1304) Failure in parquet reader when projecting selected columns from Lineitem table
Date Sat, 16 Aug 2014 00:12:18 GMT

    [ https://issues.apache.org/jira/browse/DRILL-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099375#comment-14099375
] 

Jason Altekruse commented on DRILL-1304:
----------------------------------------

I have a patch that includes a fix for this issue and DRILL-1307. I am avoiding posting the
patch for review until the DirectMemory based reading is merged into master. This has been
rebased repeatedly on top of some changes to the old byte array based version of the reader,
and it would be simpler to make the new changes on top of it.

> Failure in parquet reader when projecting selected columns from Lineitem table
> ------------------------------------------------------------------------------
>
>                 Key: DRILL-1304
>                 URL: https://issues.apache.org/jira/browse/DRILL-1304
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Parquet
>    Affects Versions: 0.4.0
>            Reporter: Aman Sinha
>            Assignee: Jason Altekruse
>            Priority: Critical
>             Fix For: 0.5.0
>
>
> See query and stack trace below. 
> Make sure you are using TPCH  SF1 (or higher) scale factor.  
> 0: jdbc:drill:zk=local> select l.l_partkey from lineitem l order by l.l_partkey limit
1;
> Query failed: Failure while running fragment. minWritableBytes: -487112 (expected: >=
0) [eb48980b-5966-4aef-95f0-c990649e4e9c]
> Error: exception while executing query: Failure while trying to get next result batch.
(state=,code=0)
> java.lang.IllegalArgumentException: minWritableBytes: -487112 (expected: >= 0)
>         io.netty.buffer.AbstractByteBuf.ensureWritable(AbstractByteBuf.java:233) ~[netty-buffer-4.0.20.Final.jar:4.0.20.Final]
>         io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:818) ~[netty-buffer-4.0.20.Final.jar:4.0.20.Final]
>         io.netty.buffer.WrappedByteBuf.writeBytes(WrappedByteBuf.java:624) ~[netty-buffer-4.0.20.Final.jar:4.0.20.Final]
>         io.netty.buffer.AccountingByteBuf.writeBytes(AccountingByteBuf.java:671) ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:4.0.20.Final]
>         org.apache.drill.exec.store.parquet.columnreaders.FixedByteAlignedReader.writeData(FixedByteAlignedReader.java:63)
~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>         org.apache.drill.exec.store.parquet.columnreaders.FixedByteAlignedReader.readField(FixedByteAlignedReader.java:59)
~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>         org.apache.drill.exec.store.parquet.columnreaders.ColumnReader.readValues(ColumnReader.java:116)
~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>         org.apache.drill.exec.store.parquet.columnreaders.ColumnReader.processPageData(ColumnReader.java:163)
~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>         org.apache.drill.exec.store.parquet.columnreaders.ColumnReader.determineSize(ColumnReader.java:142)
~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>         org.apache.drill.exec.store.parquet.columnreaders.ColumnReader.processPages(ColumnReader.java:104)
~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>         org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.readAllFixedFields(ParquetRecordReader.java:302)
~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>         org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next(ParquetRecordReader.java:337)
~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>         org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:148) ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>         org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:59) ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>         org.apache.drill.exec.physical.impl.partitionsender.PartitionSenderRootExec.innerNext(PartitionSenderRootExec.java:122)
~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>         org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:49) ~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]
>         org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:105)
~[drill-java-exec-0.5.0-incubating-SNAPSHOT-rebuffed.jar:0.5.0-incubating-SNAPSHOT]



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message