Return-Path: X-Original-To: apmail-drill-issues-archive@minotaur.apache.org Delivered-To: apmail-drill-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 65BE218C9B for ; Mon, 4 May 2015 22:49:06 +0000 (UTC) Received: (qmail 13277 invoked by uid 500); 4 May 2015 22:49:06 -0000 Delivered-To: apmail-drill-issues-archive@drill.apache.org Received: (qmail 13248 invoked by uid 500); 4 May 2015 22:49:06 -0000 Mailing-List: contact issues-help@drill.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.apache.org Delivered-To: mailing list issues@drill.apache.org Received: (qmail 13238 invoked by uid 99); 4 May 2015 22:49:06 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 May 2015 22:49:06 +0000 Date: Mon, 4 May 2015 22:49:06 +0000 (UTC) From: "Steven Phillips (JIRA)" To: issues@drill.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (DRILL-2804) IOB Exception : Project non-existent column from compressed CSV file (.tgz) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/DRILL-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527505#comment-14527505 ] Steven Phillips commented on DRILL-2804: ---------------------------------------- I am unable to reproduce this. [~khfaraaz] can you please try with latest master and if you are able to reproduce, let me know so I can figure out what is different. > IOB Exception : Project non-existent column from compressed CSV file (.tgz) > --------------------------------------------------------------------------- > > Key: DRILL-2804 > URL: https://issues.apache.org/jira/browse/DRILL-2804 > Project: Apache Drill > Issue Type: Bug > Components: Storage - Text & CSV > Affects Versions: 0.9.0 > Environment: 9d92b8e319f2d46e8659d903d355450e15946533 | DRILL-2580: Exit early from HashJoinBatch if build side is empty | 26.03.2015 @ 16:13:53 EDT > Reporter: Khurram Faraaz > Assignee: Steven Phillips > Priority: Critical > Fix For: 1.0.0 > > > Query that projects a non-existent column from a CSV file that has an extension, (.tgz) results in IOB Exception. Whereas, the same query that projects a non-existent column (columns[8]) in the test query, does not return the exception, and we see the expected results where null is returned for a non-existent column in a CSV file that is NOT compressed in (.tgz) compression format. Tests were performed on 4 node cluster on CentOS. > {code} > 0: jdbc:drill:> select columns[8] from `deletions.tgz` limit 4; > +------------+ > | EXPR$0 | > +------------+ > | null | > | null | > | null | > | null | > Query failed: RemoteRpcException: Failure while running fragment., index: 18990, length: 1 (expected: range(0, 16384)) [ 1f8b0c2e-ffc1-4384-874b-fae2cc4e129b on centos-04.qa.lab:31010 ] > [ 1f8b0c2e-ffc1-4384-874b-fae2cc4e129b on centos-04.qa.lab:31010 ] > java.lang.RuntimeException: java.sql.SQLException: Failure while executing query. > at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514) > at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148) > at sqlline.SqlLine.print(SqlLine.java:1809) > at sqlline.SqlLine$Commands.execute(SqlLine.java:3766) > at sqlline.SqlLine$Commands.sql(SqlLine.java:3663) > at sqlline.SqlLine.dispatch(SqlLine.java:889) > at sqlline.SqlLine.begin(SqlLine.java:763) > at sqlline.SqlLine.start(SqlLine.java:498) > at sqlline.SqlLine.main(SqlLine.java:460) > 0: jdbc:drill:> select columns[8] from `deletions/deletions-00000-of-00020.csv` limit 4; > +------------+ > | EXPR$0 | > +------------+ > | null | > | null | > | null | > | null | > +------------+ > 4 rows selected (0.388 seconds): > stack trace from drillbit.log file > 2015-04-16 15:15:58,363 [2ad02dd2-9990-de56-4d94-f901ebe8db3c:frag:1:5] WARN o.a.d.e.w.fragment.FragmentExecutor - Error while initializing or executing fragment > java.lang.IndexOutOfBoundsException: index: 18990, length: 1 (expected: range(0, 16384)) > at io.netty.buffer.DrillBuf.checkIndexD(DrillBuf.java:187) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:4.0.24.Final] > at io.netty.buffer.DrillBuf.chk(DrillBuf.java:209) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:4.0.24.Final] > at io.netty.buffer.DrillBuf.setByte(DrillBuf.java:608) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:4.0.24.Final] > at org.apache.drill.exec.vector.UInt1Vector$Mutator.set(UInt1Vector.java:359) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.vector.UInt1Vector$Mutator.setSafe(UInt1Vector.java:366) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.vector.NullableVarCharVector$Mutator.setSafe(NullableVarCharVector.java:500) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.test.generated.ProjectorGen0.doEval(ProjectorTemplate.java:25) ~[na:na] > at org.apache.drill.exec.test.generated.ProjectorGen0.projectRecords(ProjectorTemplate.java:62) ~[na:na] > at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:174) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:93) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:134) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:142) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:118) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:68) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.physical.impl.SingleSenderCreator$SingleSenderRootExec.innerNext(SingleSenderCreator.java:99) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:58) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:163) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) [drill-common-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_75] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_75] > at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75] > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)