incubator-drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Daniel Haviv <danielru...@gmail.com>
Subject Re: Aggregation sum() fails on parquet file
Date Fri, 31 Oct 2014 05:14:43 GMT
Hi,
Any clue on that? I'm facing a similar problem

Thanks,
Daniel

> On 30 באוק׳ 2014, at 21:28, Tridib Samanta <tridib.samanta@live.com> wrote:
> 
> Hello,
> I am running a query like: select sum(amount) from myhdfs.parquet.`claim.parquet`;
> This fails with the following error at sqlline:
> 
> Query failed: Failure while running fragment. Schema is currently null.  You must call
buildSchema(SelectionVectorMode) before this container can return a schema. [00314ea1-342a-4322-ac00-f8307c554733]
> Error: exception while executing query: Failure while trying to get next result batch.
(state=,code=0)
> 
> 
> Here is the stack trace from drillbits.log:
> 
> 2014-10-30 15:12:05,865 [3fb04943-c0e5-4801-a907-2bc3462a2997:frag:2:10] WARN  o.a.d.e.w.fragment.FragmentExecutor
- Failure while closing out resources.
> java.lang.IllegalStateException: Failure while trying to close child allocator: Child
level allocators not closed. Fragment 2:10. Stack trace:
>                org.apache.drill.exec.ops.OperatorContext.<init>(OperatorContext.java:41)
>                org.apache.drill.exec.physical.impl.ScanBatch.<init>(ScanBatch.java:90)
>                org.apache.drill.exec.store.parquet.ParquetScanBatchCreator.getBatch(ParquetScanBatchCreator.java:148)
>                org.apache.drill.exec.store.parquet.ParquetScanBatchCreator.getBatch(ParquetScanBatchCreator.java:54)
>                org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
>                org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>                org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSubScan(AbstractPhysicalVisitor.java:113)
>                org.apache.drill.exec.store.parquet.ParquetRowGroupScan.accept(ParquetRowGroupScan.java:107)
>                org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
>                org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
>                org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>                org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:196)
>                org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
>                org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
>                org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
>                org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>                org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitHashAggregate(AbstractPhysicalVisitor.java:93)
>                org.apache.drill.exec.physical.config.HashAggregate.accept(HashAggregate.java:62)
>                org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
>                org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
>                org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>                org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:196)
>                org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
>                org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
>                org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:59)
>                org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>                org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSender(AbstractPhysicalVisitor.java:98)
>                org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitHashPartitionSender(AbstractPhysicalVisitor.java:141)
>                org.apache.drill.exec.physical.config.HashPartitionSender.accept(HashPartitionSender.java:66)
>                org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:87)
>                org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:94)
>                org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250)
>                java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>                java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>                java.lang.Thread.run(Thread.java:745)
>        at org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:215)
~[drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>        at org.apache.drill.exec.ops.FragmentContext.close(FragmentContext.java:271) ~[drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>        at org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources(FragmentExecutor.java:139)
[drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>        at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:107)
[drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>        at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250)
[drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_67]
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_67]
> 
> Any help is greatly appreciated.
> 
> Thanks & Regards
> Tridib
>                         

Mime
  • Unnamed multipart/alternative (inline, 7-Bit, 0 bytes)
View raw message