Return-Path: X-Original-To: apmail-drill-issues-archive@minotaur.apache.org Delivered-To: apmail-drill-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E386211367 for ; Mon, 16 Jun 2014 18:40:26 +0000 (UTC) Received: (qmail 94840 invoked by uid 500); 16 Jun 2014 18:40:26 -0000 Delivered-To: apmail-drill-issues-archive@drill.apache.org Received: (qmail 94814 invoked by uid 500); 16 Jun 2014 18:40:26 -0000 Mailing-List: contact issues-help@drill.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.incubator.apache.org Delivered-To: mailing list issues@drill.incubator.apache.org Received: (qmail 94805 invoked by uid 99); 16 Jun 2014 18:40:26 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 Jun 2014 18:40:26 +0000 X-ASF-Spam-Status: No, hits=-2000.7 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Mon, 16 Jun 2014 18:40:27 +0000 Received: (qmail 93000 invoked by uid 99); 16 Jun 2014 18:40:01 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 Jun 2014 18:40:01 +0000 Date: Mon, 16 Jun 2014 18:40:01 +0000 (UTC) From: "George Chow (JIRA)" To: issues@drill.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (DRILL-947) Select query with limit failed for json files with mutant MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/DRILL-947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Chow updated DRILL-947: ------------------------------ Attachment: tableau_tsv_error.PNG Screen-shot originated from Krystal via an email to George. > Select query with limit failed for json files with mutant > --------------------------------------------------------- > > Key: DRILL-947 > URL: https://issues.apache.org/jira/browse/DRILL-947 > Project: Apache Drill > Issue Type: Bug > Reporter: Xiao Meng > Attachments: drillbit.log, metadata-evolution-test5.json, tableau_tsv_error.PNG > > > Given a json file with mutant like the one in DRILL-835, where the majority has the schema > {code} > (name, isDirectory, isFile, isSymlink, length, ownerName, groupName, modificationTime, accessTime, permission) > {code} > and there exists a record with different schema > {code} > (name, mutant, age, firstName, powers) > {code} > the following query generated by Tableau fails: > {code} > SELECT 1 AS `Number_of_Records`, > `/opt/drill/raw-files/metadata-evolution-test5.json`.`accessTime` AS `accessTime`, > `/opt/drill/raw-files/metadata-evolution-test5.json`.`groupName` AS `groupName`, > `/opt/drill/raw-files/metadata-evolution-test5.json`.`isDirectory` AS `isDirectory`, > `/opt/drill/raw-files/metadata-evolution-test5.json`.`isFile` AS `isFile`, > `/opt/drill/raw-files/metadata-evolution-test5.json`.`isSymlink` AS `isSymlink`, > `/opt/drill/raw-files/metadata-evolution-test5.json`.`length` AS `length`, > `/opt/drill/raw-files/metadata-evolution-test5.json`.`modificationTime` AS `modificationTime`, > `/opt/drill/raw-files/metadata-evolution-test5.json`.`name` AS `name`, > `/opt/drill/raw-files/metadata-evolution-test5.json`.`ownerName` AS `ownerName`, > `/opt/drill/raw-files/metadata-evolution-test5.json`.`permission` AS `permission` > FROM `dfs.default`.`/opt/drill/raw-files/metadata-evolution-test5.json` `/opt/drill/raw-files/metadata-evolution-test5.json` > LIMIT 10000 > {code} > The stacktrace is > {code} > 2014-06-10 16:20:37,771 [cd37bd9c-bc0b-4e2a-972d-36ec548661f8:frag:0:0] DEBUG o.a.d.e.w.fragment.FragmentExecutor - Caught exception while running fragment > java.lang.UnsupportedOperationException: Attemped to access a DeadBuf. This would happen if you attempted to interact with a buffer that has been moved or not yet initialized. > at org.apache.drill.exec.record.DeadBuf.retain(DeadBuf.java:792) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT] > at org.apache.drill.exec.vector.IntVector.transferTo(IntVector.java:195) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT] > at org.apache.drill.exec.vector.IntVector$TransferImpl.transfer(IntVector.java:226) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT] > at org.apache.drill.exec.physical.impl.limit.LimitRecordBatch.doWork(LimitRecordBatch.java:110) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT] > at org.apache.drill.exec.record.AbstractSingleRecordBatch.next(AbstractSingleRecordBatch.java:71) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT] > at org.apache.drill.exec.physical.impl.limit.LimitRecordBatch.next(LimitRecordBatch.java:99) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT] > at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:69) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT] > at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:63) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT] > at org.apache.drill.exec.record.AbstractSingleRecordBatch.next(AbstractSingleRecordBatch.java:47) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT] > at org.apache.drill.exec.physical.impl.svremover.RemovingRecordBatch.next(RemovingRecordBatch.java:91) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT] > at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:69) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT] > at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:63) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT] > at org.apache.drill.exec.record.AbstractSingleRecordBatch.next(AbstractSingleRecordBatch.java:47) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT] > at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.next(ProjectRecordBatch.java:83) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT] > at org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.next(ScreenCreator.java:81) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT] > at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:98) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [na:1.7.0_51] > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)