Return-Path: X-Original-To: apmail-incubator-drill-user-archive@minotaur.apache.org Delivered-To: apmail-incubator-drill-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AB975179AB for ; Fri, 31 Oct 2014 07:14:59 +0000 (UTC) Received: (qmail 69038 invoked by uid 500); 31 Oct 2014 07:14:59 -0000 Delivered-To: apmail-incubator-drill-user-archive@incubator.apache.org Received: (qmail 68973 invoked by uid 500); 31 Oct 2014 07:14:59 -0000 Mailing-List: contact drill-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: drill-user@incubator.apache.org Delivered-To: mailing list drill-user@incubator.apache.org Received: (qmail 68960 invoked by uid 99); 31 Oct 2014 07:14:58 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 31 Oct 2014 07:14:58 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,MIME_QP_LONG_LINE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of danielrulez@gmail.com designates 209.85.212.175 as permitted sender) Received: from [209.85.212.175] (HELO mail-wi0-f175.google.com) (209.85.212.175) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 31 Oct 2014 07:14:31 +0000 Received: by mail-wi0-f175.google.com with SMTP id ex7so490124wid.14 for ; Fri, 31 Oct 2014 00:13:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:content-transfer-encoding:mime-version:subject :message-id:date:references:in-reply-to:to; bh=5t6gyxkXmTaAT386kGzzSR3S5P5UtRoj+LUHnFq08zM=; b=dOdtF0BAtH3olG2CtvHN7m9e1REa6pFXCSzGIZtlw7iRepwxoBaGFNM9tpuZDGC597 UUftLK1mrozx5E7jXc09Wr13hJMlTloC4XnQ5GlXBF8IY8pfev2s3mvlMqqx97oJxeW3 O7gQmmKVcH40LroGLZtOM9orKsD1StbJElEdYNGguFxOaUs52V0S5l6EqjZb9DEsnsuM Ew+QFeW8EqznRFRC7S8HGvdHlMNOl9MQuOzK95A1Wgt1B/ye6Pd3yGOYluwD2SFUbDpP p2NCyHpAOrhHru+dQ3zWk4QaB15xdh9oY1YB3SFpaExYaZOum9YW+Tfm+CaI0I6XPp5Q upPw== X-Received: by 10.194.9.1 with SMTP id v1mr346745wja.124.1414739581051; Fri, 31 Oct 2014 00:13:01 -0700 (PDT) Received: from [10.195.11.227] ([2.54.136.58]) by mx.google.com with ESMTPSA id fa16sm24597839wid.5.2014.10.31.00.12.59 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 31 Oct 2014 00:12:59 -0700 (PDT) From: Daniel Haviv Content-Type: multipart/alternative; boundary=Apple-Mail-9008D06C-6DBB-470D-8899-880C1D69C5E5 Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (1.0) Subject: Re: Aggregation sum() fails on parquet file Message-Id: Date: Fri, 31 Oct 2014 09:12:55 +0200 References: In-Reply-To: To: "drill-user@incubator.apache.org" X-Mailer: iPhone Mail (12B411) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail-9008D06C-6DBB-470D-8899-880C1D69C5E5 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable I'm using 0.5 Daniel > On 31 =D7=91=D7=90=D7=95=D7=A7=D7=B3 2014, at 08:14, Timothy Chen wrote: >=20 > Hi there, >=20 > Are you running the latest master? >=20 > Tim >=20 > On Thu, Oct 30, 2014 at 10:57 PM, Tridib Samanta > wrote: >> No clue. :(. Now I am struggling to run distinct on parquet file. >>=20 >>> From: danielrulez@gmail.com >>> Subject: Re: Aggregation sum() fails on parquet file >>> Date: Fri, 31 Oct 2014 07:14:43 +0200 >>> To: drill-user@incubator.apache.org >>>=20 >>> Hi, >>> Any clue on that? I'm facing a similar problem >>>=20 >>> Thanks, >>> Daniel >>>=20 >>>> On 30 =D7=91=D7=90=D7=95=D7=A7=D7=B3 2014, at 21:28, Tridib Samanta wrote: >>>>=20 >>>> Hello, >>>> I am running a query like: select sum(amount) from myhdfs.parquet.`clai= m.parquet`; >>>> This fails with the following error at sqlline: >>>>=20 >>>> Query failed: Failure while running fragment. Schema is currently null.= You must call buildSchema(SelectionVectorMode) before this container can r= eturn a schema. [00314ea1-342a-4322-ac00-f8307c554733] >>>> Error: exception while executing query: Failure while trying to get nex= t result batch. (state=3D,code=3D0) >>>>=20 >>>>=20 >>>> Here is the stack trace from drillbits.log: >>>>=20 >>>> 2014-10-30 15:12:05,865 [3fb04943-c0e5-4801-a907-2bc3462a2997:frag:2:10= ] WARN o.a.d.e.w.fragment.FragmentExecutor - Failure while closing out reso= urces. >>>> java.lang.IllegalStateException: Failure while trying to close child al= locator: Child level allocators not closed. Fragment 2:10. Stack trace: >>>> org.apache.drill.exec.ops.OperatorContext.(Operator= Context.java:41) >>>> org.apache.drill.exec.physical.impl.ScanBatch.(Scan= Batch.java:90) >>>> org.apache.drill.exec.store.parquet.ParquetScanBatchCreat= or.getBatch(ParquetScanBatchCreator.java:148) >>>> org.apache.drill.exec.store.parquet.ParquetScanBatchCreat= or.getBatch(ParquetScanBatchCreator.java:54) >>>> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(I= mplCreator.java:62) >>>> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(I= mplCreator.java:39) >>>> org.apache.drill.exec.physical.base.AbstractPhysicalVisit= or.visitSubScan(AbstractPhysicalVisitor.java:113) >>>> org.apache.drill.exec.store.parquet.ParquetRowGroupScan.a= ccept(ParquetRowGroupScan.java:107) >>>> org.apache.drill.exec.physical.impl.ImplCreator.getChildr= en(ImplCreator.java:74) >>>> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(I= mplCreator.java:62) >>>> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(I= mplCreator.java:39) >>>> org.apache.drill.exec.physical.base.AbstractPhysicalVisit= or.visitIteratorValidator(AbstractPhysicalVisitor.java:196) >>>> org.apache.drill.exec.physical.config.IteratorValidator.a= ccept(IteratorValidator.java:34) >>>> org.apache.drill.exec.physical.impl.ImplCreator.getChildr= en(ImplCreator.java:74) >>>> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(I= mplCreator.java:62) >>>> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(I= mplCreator.java:39) >>>> org.apache.drill.exec.physical.base.AbstractPhysicalVisit= or.visitHashAggregate(AbstractPhysicalVisitor.java:93) >>>> org.apache.drill.exec.physical.config.HashAggregate.accep= t(HashAggregate.java:62) >>>> org.apache.drill.exec.physical.impl.ImplCreator.getChildr= en(ImplCreator.java:74) >>>> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(I= mplCreator.java:62) >>>> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(I= mplCreator.java:39) >>>> org.apache.drill.exec.physical.base.AbstractPhysicalVisit= or.visitIteratorValidator(AbstractPhysicalVisitor.java:196) >>>> org.apache.drill.exec.physical.config.IteratorValidator.a= ccept(IteratorValidator.java:34) >>>> org.apache.drill.exec.physical.impl.ImplCreator.getChildr= en(ImplCreator.java:74) >>>> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(I= mplCreator.java:59) >>>> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(I= mplCreator.java:39) >>>> org.apache.drill.exec.physical.base.AbstractPhysicalVisit= or.visitSender(AbstractPhysicalVisitor.java:98) >>>> org.apache.drill.exec.physical.base.AbstractPhysicalVisit= or.visitHashPartitionSender(AbstractPhysicalVisitor.java:141) >>>> org.apache.drill.exec.physical.config.HashPartitionSender= .accept(HashPartitionSender.java:66) >>>> org.apache.drill.exec.physical.impl.ImplCreator.getExec(I= mplCreator.java:87) >>>> org.apache.drill.exec.work.fragment.FragmentExecutor.run(= FragmentExecutor.java:94) >>>> org.apache.drill.exec.work.WorkManager$RunnableWrapper.ru= n(WorkManager.java:250) >>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadP= oolExecutor.java:1145) >>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(Thread= PoolExecutor.java:615) >>>> java.lang.Thread.run(Thread.java:745) >>>> at org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.= close(TopLevelAllocator.java:215) ~[drill-java-exec-0.5.0-incubating-rebuffe= d.jar:0.5.0-incubating] >>>> at org.apache.drill.exec.ops.FragmentContext.close(FragmentContex= t.java:271) ~[drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating= ] >>>> at org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutR= esources(FragmentExecutor.java:139) [drill-java-exec-0.5.0-incubating-rebuff= ed.jar:0.5.0-incubating] >>>> at org.apache.drill.exec.work.fragment.FragmentExecutor.run(Fragm= entExecutor.java:107) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-i= ncubating] >>>> at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(Wor= kManager.java:250) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incu= bating] >>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1145) [na:1.7.0_67] >>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:615) [na:1.7.0_67] >>>>=20 >>>> Any help is greatly appreciated. >>>>=20 >>>> Thanks & Regards >>>> Tridib >>=20 --Apple-Mail-9008D06C-6DBB-470D-8899-880C1D69C5E5--