incubator-drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Daniel Haviv <danielru...@gmail.com>
Subject Re: Aggregation sum() fails on parquet file
Date Fri, 31 Oct 2014 07:12:55 GMT
I'm using 0.5

Daniel

> On 31 באוק׳ 2014, at 08:14, Timothy Chen <tnachen@gmail.com> wrote:
> 
> Hi there,
> 
> Are you running the latest master?
> 
> Tim
> 
> On Thu, Oct 30, 2014 at 10:57 PM, Tridib Samanta
> <tridib.samanta@live.com> wrote:
>> No clue. :(. Now I am struggling to run distinct on parquet file.
>> 
>>> From: danielrulez@gmail.com
>>> Subject: Re: Aggregation sum() fails on parquet file
>>> Date: Fri, 31 Oct 2014 07:14:43 +0200
>>> To: drill-user@incubator.apache.org
>>> 
>>> Hi,
>>> Any clue on that? I'm facing a similar problem
>>> 
>>> Thanks,
>>> Daniel
>>> 
>>>> On 30 באוק׳ 2014, at 21:28, Tridib Samanta <tridib.samanta@live.com>
wrote:
>>>> 
>>>> Hello,
>>>> I am running a query like: select sum(amount) from myhdfs.parquet.`claim.parquet`;
>>>> This fails with the following error at sqlline:
>>>> 
>>>> Query failed: Failure while running fragment. Schema is currently null. 
You must call buildSchema(SelectionVectorMode) before this container can return a schema.
[00314ea1-342a-4322-ac00-f8307c554733]
>>>> Error: exception while executing query: Failure while trying to get next
result batch. (state=,code=0)
>>>> 
>>>> 
>>>> Here is the stack trace from drillbits.log:
>>>> 
>>>> 2014-10-30 15:12:05,865 [3fb04943-c0e5-4801-a907-2bc3462a2997:frag:2:10]
WARN  o.a.d.e.w.fragment.FragmentExecutor - Failure while closing out resources.
>>>> java.lang.IllegalStateException: Failure while trying to close child allocator:
Child level allocators not closed. Fragment 2:10. Stack trace:
>>>>               org.apache.drill.exec.ops.OperatorContext.<init>(OperatorContext.java:41)
>>>>               org.apache.drill.exec.physical.impl.ScanBatch.<init>(ScanBatch.java:90)
>>>>               org.apache.drill.exec.store.parquet.ParquetScanBatchCreator.getBatch(ParquetScanBatchCreator.java:148)
>>>>               org.apache.drill.exec.store.parquet.ParquetScanBatchCreator.getBatch(ParquetScanBatchCreator.java:54)
>>>>               org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
>>>>               org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>>>>               org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSubScan(AbstractPhysicalVisitor.java:113)
>>>>               org.apache.drill.exec.store.parquet.ParquetRowGroupScan.accept(ParquetRowGroupScan.java:107)
>>>>               org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
>>>>               org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
>>>>               org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>>>>               org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:196)
>>>>               org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
>>>>               org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
>>>>               org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
>>>>               org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>>>>               org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitHashAggregate(AbstractPhysicalVisitor.java:93)
>>>>               org.apache.drill.exec.physical.config.HashAggregate.accept(HashAggregate.java:62)
>>>>               org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
>>>>               org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
>>>>               org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>>>>               org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:196)
>>>>               org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
>>>>               org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
>>>>               org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:59)
>>>>               org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>>>>               org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSender(AbstractPhysicalVisitor.java:98)
>>>>               org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitHashPartitionSender(AbstractPhysicalVisitor.java:141)
>>>>               org.apache.drill.exec.physical.config.HashPartitionSender.accept(HashPartitionSender.java:66)
>>>>               org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:87)
>>>>               org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:94)
>>>>               org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250)
>>>>               java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>>>               java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>>               java.lang.Thread.run(Thread.java:745)
>>>>       at org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:215)
~[drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>>>>       at org.apache.drill.exec.ops.FragmentContext.close(FragmentContext.java:271)
~[drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>>>>       at org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources(FragmentExecutor.java:139)
[drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>>>>       at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:107)
[drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>>>>       at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250)
[drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>>>>       at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_67]
>>>>       at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_67]
>>>> 
>>>> Any help is greatly appreciated.
>>>> 
>>>> Thanks & Regards
>>>> Tridib
>> 

Mime
  • Unnamed multipart/alternative (inline, 7-Bit, 0 bytes)
View raw message