Return-Path: X-Original-To: apmail-drill-issues-archive@minotaur.apache.org Delivered-To: apmail-drill-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BF1E6113F1 for ; Wed, 6 Aug 2014 20:45:36 +0000 (UTC) Received: (qmail 7597 invoked by uid 500); 6 Aug 2014 20:45:36 -0000 Delivered-To: apmail-drill-issues-archive@drill.apache.org Received: (qmail 7571 invoked by uid 500); 6 Aug 2014 20:45:36 -0000 Mailing-List: contact issues-help@drill.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.incubator.apache.org Delivered-To: mailing list issues@drill.incubator.apache.org Received: (qmail 7562 invoked by uid 99); 6 Aug 2014 20:45:36 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Aug 2014 20:45:36 +0000 X-ASF-Spam-Status: No, hits=-2000.7 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Wed, 06 Aug 2014 20:45:32 +0000 Received: (qmail 785 invoked by uid 99); 6 Aug 2014 20:45:12 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Aug 2014 20:45:12 +0000 Date: Wed, 6 Aug 2014 20:45:12 +0000 (UTC) From: "Abhishek Girish (JIRA)" To: issues@drill.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (DRILL-1269) Select * on parquet files containing nulls fail MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/DRILL-1269?page=3Dcom.atlassia= n.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Girish updated DRILL-1269: ----------------------------------- Description:=20 Select * on a parquet file fails when some rows contain null columns.=20 This is not seen when the nulls in the dataset are removed.=20 [dataset does not contain null] > select * from promotion6 where p_promo_sk=3D5;=20 [Succeeds] [dataset contains null] [sample: ABC|DEF||JKL] > select * from promotion5 where p_promo_sk=3D5;=20 [Fails with below error] Query failed: Screen received stop request sent. null [25a465b6-3acf-49fc-a= 6ea-0488439ec307] Error: exception while executing query: Failure while trying to get next re= sult batch. (state=3D,code=3D0) =20 LOG: =20 2014-08-06 00:56:18,157 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.d.exec.physical.impl.ScanBatch - Failed to read the batch. Stopping= =E2=80=A6 java.lang.ArrayIndexOutOfBoundsException: null 2014-08-06 00:56:18,158 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] ERR= OR o.a.drill.exec.ops.FragmentContext - Fragment Context received failure. = {} java.lang.ArrayIndexOutOfBoundsException: null 2014-08-06 00:56:18,159 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] ERR= OR o.a.d.e.p.i.ScreenCreator$ScreenRoot - Error 25a465b6-3acf-49fc-a6ea-048= 8439ec307: Screen received stop request sent. java.lang.ArrayIndexOutOfBoundsException: null 2014-08-06 00:56:18,161 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.drill.exec.ops.OperatorContext - Closing context for org.apache.dril= l.exec.physical.config.Screen 2014-08-06 00:56:18,161 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.drill.exec.ops.OperatorContext - Closing context for org.apache.dril= l.exec.physical.config.Project 2014-08-06 00:56:18,162 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.drill.exec.ops.OperatorContext - Closing context for org.apache.dril= l.exec.physical.config.SelectionVectorRemover 2014-08-06 00:56:18,162 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.drill.exec.ops.OperatorContext - Closing context for org.apache.dril= l.exec.physical.config.Filter 2014-08-06 00:56:18,162 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.drill.exec.ops.OperatorContext - Closing context for org.apache.dril= l.exec.store.parquet.ParquetRowGroupScan 2014-08-06 00:56:18,163 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] ERR= OR o.a.d.e.w.f.AbstractStatusReporter - Error 0d7f9f82-ba3c-445a-a7ff-4731c= 282397f: Failure while running fragment. java.lang.ArrayIndexOutOfBoundsException: null 2014-08-06 00:56:18,164 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.d.exec.work.foreman.QueryManager - New fragment status was provided = to Foreman of profile { state: FAILED error { error_id: "0d7f9f82-ba3c-445a-a7ff-4731c282397f" endpoint { address: "drillats3.qa.lab" user_port: 31010 control_port: 31011 data_port: 31012 } error_type: 0 message: "Failure while running fragment. null [0d7f9f82-ba3c-445a-a7ff= -4731c282397f]" } minor_fragment_id: 0 operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 4 operator_type: 21 setup_nanos: 0 process_nanos: 90838172 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 3 operator_type: 2 setup_nanos: 0 process_nanos: 3307 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 2 operator_type: 14 setup_nanos: 0 process_nanos: 2552 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 1 operator_type: 10 setup_nanos: 0 process_nanos: 3445 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 0 operator_type: 13 setup_nanos: 0 process_nanos: 996491 local_memory_allocated: 0 wait_nanos: 106634 } start_time: 1407286578031 end_time: 1407286578162 memory_used: 0 } handle { query_id { part1: -6293552266575722108 part2: -8769049111628070660 } major_fragment_id: 0 minor_fragment_id: 0 } =20 2014-08-06 00:56:18,164 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.d.exec.rpc.control.WorkEventBus - Removing framgent status listener = for queryId part1: -6293552266575722108 part2: -8769049111628070660 . 2014-08-06 00:56:18,165 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.d.exec.work.foreman.QueryManager - New fragment status was provided = to Foreman of profile { state: CANCELLED minor_fragment_id: 0 operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 4 operator_type: 21 setup_nanos: 0 process_nanos: 90838172 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 3 operator_type: 2 setup_nanos: 0 process_nanos: 3307 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 2 operator_type: 14 setup_nanos: 0 process_nanos: 2552 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 1 operator_type: 10 setup_nanos: 0 process_nanos: 3445 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 0 operator_type: 13 setup_nanos: 0 process_nanos: 996491 local_memory_allocated: 0 wait_nanos: 106634 } start_time: 1407286578031 end_time: 1407286578164 memory_used: 0 } handle { query_id { part1: -6293552266575722108 part2: -8769049111628070660 } major_fragment_id: 0 minor_fragment_id: 0 } =20 2014-08-06 00:56:18,165 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.d.e.w.fragment.FragmentExecutor - Cancelled Fragment query_id { part1: -6293552266575722108 part2: -8769049111628070660 } major_fragment_id: 0 minor_fragment_id: 0 =20 2014-08-06 00:56:18,167 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.d.e.w.fragment.FragmentExecutor - Caught exception while running fra= gment java.lang.RuntimeException: Failure while accessing Zookeeper at org.apache.drill.exec.store.sys.zk.ZkPStore.put(ZkPStore.java:96= ) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubating] at org.apache.drill.exec.work.foreman.QueryStatus.updateCache(Query= Status.java:133) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incu= bating] at org.apache.drill.exec.work.foreman.QueryStatus.update(QueryStatu= s.java:126) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubatin= g] at org.apache.drill.exec.work.foreman.QueryManager.updateStatus(Que= ryManager.java:175) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-i= ncubating] at org.apache.drill.exec.work.foreman.QueryManager.fail(QueryManage= r.java:199) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubatin= g] at org.apache.drill.exec.work.foreman.QueryManager.statusUpdate(Que= ryManager.java:161) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-i= ncubating] at org.apache.drill.exec.work.foreman.QueryManager$RootStatusHandle= r.statusChange(QueryManager.java:286) ~[drill-java-exec-0.4.0-incubating-re= buffed.jar:0.4.0-incubating] at org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(= AbstractStatusReporter.java:113) ~[drill-java-exec-0.4.0-incubating-rebuffe= d.jar:0.4.0-incubating] at org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(= AbstractStatusReporter.java:109) ~[drill-java-exec-0.4.0-incubating-rebuffe= d.jar:0.4.0-incubating] at org.apache.drill.exec.work.fragment.FragmentExecutor.internalFai= l(FragmentExecutor.java:158) ~[drill-java-exec-0.4.0-incubating-rebuffed.ja= r:0.4.0-incubating] at org.apache.drill.exec.work.fragment.FragmentExecutor.run(Fragmen= tExecutor.java:128) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-i= ncubating] at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkM= anager.java:250) [drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incub= ating] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1145) [na:1.7.0_45] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:615) [na:1.7.0_45] at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45] Caused by: java.lang.InterruptedException: null at java.lang.Object.wait(Native Method) ~[na:1.7.0_45] at java.lang.Object.wait(Object.java:503) ~[na:1.7.0_45] at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:13= 42) ~[zookeeper-3.4.6.jar:3.4.6-1569965] at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) ~[zoo= keeper-3.4.6.jar:3.4.6-1569965] at org.apache.curator.framework.imps.ExistsBuilderImpl$2.call(Exist= sBuilderImpl.java:172) ~[curator-framework-2.5.0.jar:na] at org.apache.curator.framework.imps.ExistsBuilderImpl$2.call(Exist= sBuilderImpl.java:161) ~[curator-framework-2.5.0.jar:na] at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107) ~= [curator-client-2.5.0.jar:na] at org.apache.curator.framework.imps.ExistsBuilderImpl.pathInForegr= ound(ExistsBuilderImpl.java:157) ~[curator-framework-2.5.0.jar:na] at org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(Exis= tsBuilderImpl.java:148) ~[curator-framework-2.5.0.jar:na] at org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(Exis= tsBuilderImpl.java:36) ~[curator-framework-2.5.0.jar:na] at org.apache.drill.exec.store.sys.zk.ZkPStore.put(ZkPStore.java:89= ) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubating] ... 14 common frames omitted 2014-08-06 00:56:18,168 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] ERR= OR o.a.d.e.w.f.AbstractStatusReporter - Error b746b426-1aa1-469e-88a6-a8dea= 5dc9365: Failure while running fragment. java.lang.InterruptedException: null at java.lang.Object.wait(Native Method) ~[na:1.7.0_45] at java.lang.Object.wait(Object.java:503) ~[na:1.7.0_45] at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:13= 42) ~[zookeeper-3.4.6.jar:3.4.6-1569965] at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) ~[zoo= keeper-3.4.6.jar:3.4.6-1569965] at org.apache.curator.framework.imps.ExistsBuilderImpl$2.call(Exist= sBuilderImpl.java:172) ~[curator-framework-2.5.0.jar:na] at org.apache.curator.framework.imps.ExistsBuilderImpl$2.call(Exist= sBuilderImpl.java:161) ~[curator-framework-2.5.0.jar:na] at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107) ~= [curator-client-2.5.0.jar:na] at org.apache.curator.framework.imps.ExistsBuilderImpl.pathInForegr= ound(ExistsBuilderImpl.java:157) ~[curator-framework-2.5.0.jar:na] at org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(Exis= tsBuilderImpl.java:148) ~[curator-framework-2.5.0.jar:na] at org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(Exis= tsBuilderImpl.java:36) ~[curator-framework-2.5.0.jar:na] at org.apache.drill.exec.store.sys.zk.ZkPStore.put(ZkPStore.java:89= ) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubating] at org.apache.drill.exec.work.foreman.QueryStatus.updateCache(Query= Status.java:133) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incu= bating] at org.apache.drill.exec.work.foreman.QueryStatus.update(QueryStatu= s.java:126) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubatin= g] at org.apache.drill.exec.work.foreman.QueryManager.updateStatus(Que= ryManager.java:175) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-i= ncubating] at org.apache.drill.exec.work.foreman.QueryManager.fail(QueryManage= r.java:199) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubatin= g] at org.apache.drill.exec.work.foreman.QueryManager.statusUpdate(Que= ryManager.java:161) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-i= ncubating] at org.apache.drill.exec.work.foreman.QueryManager$RootStatusHandle= r.statusChange(QueryManager.java:286) ~[drill-java-exec-0.4.0-incubating-re= buffed.jar:0.4.0-incubating] at org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(= AbstractStatusReporter.java:113) ~[drill-java-exec-0.4.0-incubating-rebuffe= d.jar:0.4.0-incubating] at org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(= AbstractStatusReporter.java:109) ~[drill-java-exec-0.4.0-incubating-rebuffe= d.jar:0.4.0-incubating] at org.apache.drill.exec.work.fragment.FragmentExecutor.internalFai= l(FragmentExecutor.java:158) ~[drill-java-exec-0.4.0-incubating-rebuffed.ja= r:0.4.0-incubating] at org.apache.drill.exec.work.fragment.FragmentExecutor.run(Fragmen= tExecutor.java:128) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-i= ncubating] at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkM= anager.java:250) [drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incub= ating] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1145) [na:1.7.0_45] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:615) [na:1.7.0_45] at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45] =20 2014-08-06 00:56:18,169 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.d.exec.work.foreman.QueryManager - New fragment status was provided = to Foreman of profile { state: FAILED error { error_id: "b746b426-1aa1-469e-88a6-a8dea5dc9365" endpoint { address: "drillats3.qa.lab" user_port: 31010 control_port: 31011 data_port: 31012 } error_type: 0 message: "Failure while running fragment. Failure while accessing Zooke= eper [b746b426-1aa1-469e-88a6-a8dea5dc9365]" } minor_fragment_id: 0 operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 4 operator_type: 21 setup_nanos: 0 process_nanos: 90838172 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 3 operator_type: 2 setup_nanos: 0 process_nanos: 3307 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 2 operator_type: 14 setup_nanos: 0 process_nanos: 2552 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 1 operator_type: 10 setup_nanos: 0 process_nanos: 3445 local_memory_allocated: 0 wait_nanos: 0 } =20 operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 0 operator_type: 13 setup_nanos: 0 process_nanos: 996491 local_memory_allocated: 0 wait_nanos: 106634 } start_time: 1407286578031 end_time: 1407286578167 memory_used: 0 } handle { query_id { part1: -6293552266575722108 part2: -8769049111628070660 } major_fragment_id: 0 minor_fragment_id: 0 } =20 2014-08-06 00:56:18,170 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.d.exec.rpc.control.WorkEventBus - Removing framgent status listener = for queryId part1: -6293552266575722108 part2: -8769049111628070660 . 2014-08-06 00:56:18,189 [WorkManager-32] ERROR o.a.d.e.w.f.AbstractStatusRe= porter - Error bd02bfe2-369f-49ff-8ec3-59ae3620edad: Failure while running = fragment. java.lang.ArrayIndexOutOfBoundsException: null 2014-08-06 00:56:18,189 [WorkManager-32] DEBUG o.a.d.exec.work.foreman.Quer= yManager - New fragment status was provided to Foreman of profile { state: FAILED error { error_id: "bd02bfe2-369f-49ff-8ec3-59ae3620edad" endpoint { address: "drillats3.qa.lab" user_port: 31010 control_port: 31011 data_port: 31012 } error_type: 0 message: "Failure while running fragment. null [bd02bfe2-369f-49ff-8ec3= -59ae3620edad]" } minor_fragment_id: 0 operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 4 operator_type: 21 setup_nanos: 0 process_nanos: 90838172 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 3 operator_type: 2 setup_nanos: 0 process_nanos: 3307 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 2 operator_type: 14 setup_nanos: 0 process_nanos: 2552 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 1 operator_type: 10 setup_nanos: 0 process_nanos: 3445 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 0 operator_type: 13 setup_nanos: 0 process_nanos: 996491 local_memory_allocated: 0 wait_nanos: 106634 } start_time: 1407286578031 end_time: 1407286578188 memory_used: 0 } handle { query_id { part1: -6293552266575722108 part2: -8769049111628070660 } major_fragment_id: 0 minor_fragment_id: 0 } =20 2014-08-06 00:56:18,190 [WorkManager-32] DEBUG o.a.d.exec.rpc.control.WorkE= ventBus - Removing framgent status listener for queryId part1: -62935522665= 75722108 part2: -8769049111628070660 . 2014-08-06 00:56:18,214 [WorkManager-32] DEBUG o.a.d.e.w.fragment.FragmentE= xecutor - Fragment runner complete. 0:0 was: Select * on a parquet file fails when some rows may contain null columns.= =20 This is not seen when the nulls in the dataset are removed.=20 [dataset does not contain null] > select * from promotion6 where p_promo_sk=3D5;=20 [Succeeds] [dataset contains null] [sample: ABC|DEF||JKL] > select * from promotion5 where p_promo_sk=3D5;=20 [Fails with below error] Query failed: Screen received stop request sent. null [25a465b6-3acf-49fc-a= 6ea-0488439ec307] Error: exception while executing query: Failure while trying to get next re= sult batch. (state=3D,code=3D0) =20 LOG: =20 2014-08-06 00:56:18,157 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.d.exec.physical.impl.ScanBatch - Failed to read the batch. Stopping= =E2=80=A6 java.lang.ArrayIndexOutOfBoundsException: null 2014-08-06 00:56:18,158 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] ERR= OR o.a.drill.exec.ops.FragmentContext - Fragment Context received failure. = {} java.lang.ArrayIndexOutOfBoundsException: null 2014-08-06 00:56:18,159 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] ERR= OR o.a.d.e.p.i.ScreenCreator$ScreenRoot - Error 25a465b6-3acf-49fc-a6ea-048= 8439ec307: Screen received stop request sent. java.lang.ArrayIndexOutOfBoundsException: null 2014-08-06 00:56:18,161 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.drill.exec.ops.OperatorContext - Closing context for org.apache.dril= l.exec.physical.config.Screen 2014-08-06 00:56:18,161 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.drill.exec.ops.OperatorContext - Closing context for org.apache.dril= l.exec.physical.config.Project 2014-08-06 00:56:18,162 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.drill.exec.ops.OperatorContext - Closing context for org.apache.dril= l.exec.physical.config.SelectionVectorRemover 2014-08-06 00:56:18,162 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.drill.exec.ops.OperatorContext - Closing context for org.apache.dril= l.exec.physical.config.Filter 2014-08-06 00:56:18,162 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.drill.exec.ops.OperatorContext - Closing context for org.apache.dril= l.exec.store.parquet.ParquetRowGroupScan 2014-08-06 00:56:18,163 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] ERR= OR o.a.d.e.w.f.AbstractStatusReporter - Error 0d7f9f82-ba3c-445a-a7ff-4731c= 282397f: Failure while running fragment. java.lang.ArrayIndexOutOfBoundsException: null 2014-08-06 00:56:18,164 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.d.exec.work.foreman.QueryManager - New fragment status was provided = to Foreman of profile { state: FAILED error { error_id: "0d7f9f82-ba3c-445a-a7ff-4731c282397f" endpoint { address: "drillats3.qa.lab" user_port: 31010 control_port: 31011 data_port: 31012 } error_type: 0 message: "Failure while running fragment. null [0d7f9f82-ba3c-445a-a7ff= -4731c282397f]" } minor_fragment_id: 0 operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 4 operator_type: 21 setup_nanos: 0 process_nanos: 90838172 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 3 operator_type: 2 setup_nanos: 0 process_nanos: 3307 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 2 operator_type: 14 setup_nanos: 0 process_nanos: 2552 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 1 operator_type: 10 setup_nanos: 0 process_nanos: 3445 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 0 operator_type: 13 setup_nanos: 0 process_nanos: 996491 local_memory_allocated: 0 wait_nanos: 106634 } start_time: 1407286578031 end_time: 1407286578162 memory_used: 0 } handle { query_id { part1: -6293552266575722108 part2: -8769049111628070660 } major_fragment_id: 0 minor_fragment_id: 0 } =20 2014-08-06 00:56:18,164 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.d.exec.rpc.control.WorkEventBus - Removing framgent status listener = for queryId part1: -6293552266575722108 part2: -8769049111628070660 . 2014-08-06 00:56:18,165 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.d.exec.work.foreman.QueryManager - New fragment status was provided = to Foreman of profile { state: CANCELLED minor_fragment_id: 0 operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 4 operator_type: 21 setup_nanos: 0 process_nanos: 90838172 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 3 operator_type: 2 setup_nanos: 0 process_nanos: 3307 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 2 operator_type: 14 setup_nanos: 0 process_nanos: 2552 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 1 operator_type: 10 setup_nanos: 0 process_nanos: 3445 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 0 operator_type: 13 setup_nanos: 0 process_nanos: 996491 local_memory_allocated: 0 wait_nanos: 106634 } start_time: 1407286578031 end_time: 1407286578164 memory_used: 0 } handle { query_id { part1: -6293552266575722108 part2: -8769049111628070660 } major_fragment_id: 0 minor_fragment_id: 0 } =20 2014-08-06 00:56:18,165 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.d.e.w.fragment.FragmentExecutor - Cancelled Fragment query_id { part1: -6293552266575722108 part2: -8769049111628070660 } major_fragment_id: 0 minor_fragment_id: 0 =20 2014-08-06 00:56:18,167 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.d.e.w.fragment.FragmentExecutor - Caught exception while running fra= gment java.lang.RuntimeException: Failure while accessing Zookeeper at org.apache.drill.exec.store.sys.zk.ZkPStore.put(ZkPStore.java:96= ) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubating] at org.apache.drill.exec.work.foreman.QueryStatus.updateCache(Query= Status.java:133) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incu= bating] at org.apache.drill.exec.work.foreman.QueryStatus.update(QueryStatu= s.java:126) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubatin= g] at org.apache.drill.exec.work.foreman.QueryManager.updateStatus(Que= ryManager.java:175) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-i= ncubating] at org.apache.drill.exec.work.foreman.QueryManager.fail(QueryManage= r.java:199) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubatin= g] at org.apache.drill.exec.work.foreman.QueryManager.statusUpdate(Que= ryManager.java:161) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-i= ncubating] at org.apache.drill.exec.work.foreman.QueryManager$RootStatusHandle= r.statusChange(QueryManager.java:286) ~[drill-java-exec-0.4.0-incubating-re= buffed.jar:0.4.0-incubating] at org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(= AbstractStatusReporter.java:113) ~[drill-java-exec-0.4.0-incubating-rebuffe= d.jar:0.4.0-incubating] at org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(= AbstractStatusReporter.java:109) ~[drill-java-exec-0.4.0-incubating-rebuffe= d.jar:0.4.0-incubating] at org.apache.drill.exec.work.fragment.FragmentExecutor.internalFai= l(FragmentExecutor.java:158) ~[drill-java-exec-0.4.0-incubating-rebuffed.ja= r:0.4.0-incubating] at org.apache.drill.exec.work.fragment.FragmentExecutor.run(Fragmen= tExecutor.java:128) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-i= ncubating] at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkM= anager.java:250) [drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incub= ating] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1145) [na:1.7.0_45] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:615) [na:1.7.0_45] at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45] Caused by: java.lang.InterruptedException: null at java.lang.Object.wait(Native Method) ~[na:1.7.0_45] at java.lang.Object.wait(Object.java:503) ~[na:1.7.0_45] at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:13= 42) ~[zookeeper-3.4.6.jar:3.4.6-1569965] at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) ~[zoo= keeper-3.4.6.jar:3.4.6-1569965] at org.apache.curator.framework.imps.ExistsBuilderImpl$2.call(Exist= sBuilderImpl.java:172) ~[curator-framework-2.5.0.jar:na] at org.apache.curator.framework.imps.ExistsBuilderImpl$2.call(Exist= sBuilderImpl.java:161) ~[curator-framework-2.5.0.jar:na] at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107) ~= [curator-client-2.5.0.jar:na] at org.apache.curator.framework.imps.ExistsBuilderImpl.pathInForegr= ound(ExistsBuilderImpl.java:157) ~[curator-framework-2.5.0.jar:na] at org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(Exis= tsBuilderImpl.java:148) ~[curator-framework-2.5.0.jar:na] at org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(Exis= tsBuilderImpl.java:36) ~[curator-framework-2.5.0.jar:na] at org.apache.drill.exec.store.sys.zk.ZkPStore.put(ZkPStore.java:89= ) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubating] ... 14 common frames omitted 2014-08-06 00:56:18,168 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] ERR= OR o.a.d.e.w.f.AbstractStatusReporter - Error b746b426-1aa1-469e-88a6-a8dea= 5dc9365: Failure while running fragment. java.lang.InterruptedException: null at java.lang.Object.wait(Native Method) ~[na:1.7.0_45] at java.lang.Object.wait(Object.java:503) ~[na:1.7.0_45] at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:13= 42) ~[zookeeper-3.4.6.jar:3.4.6-1569965] at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) ~[zoo= keeper-3.4.6.jar:3.4.6-1569965] at org.apache.curator.framework.imps.ExistsBuilderImpl$2.call(Exist= sBuilderImpl.java:172) ~[curator-framework-2.5.0.jar:na] at org.apache.curator.framework.imps.ExistsBuilderImpl$2.call(Exist= sBuilderImpl.java:161) ~[curator-framework-2.5.0.jar:na] at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107) ~= [curator-client-2.5.0.jar:na] at org.apache.curator.framework.imps.ExistsBuilderImpl.pathInForegr= ound(ExistsBuilderImpl.java:157) ~[curator-framework-2.5.0.jar:na] at org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(Exis= tsBuilderImpl.java:148) ~[curator-framework-2.5.0.jar:na] at org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(Exis= tsBuilderImpl.java:36) ~[curator-framework-2.5.0.jar:na] at org.apache.drill.exec.store.sys.zk.ZkPStore.put(ZkPStore.java:89= ) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubating] at org.apache.drill.exec.work.foreman.QueryStatus.updateCache(Query= Status.java:133) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incu= bating] at org.apache.drill.exec.work.foreman.QueryStatus.update(QueryStatu= s.java:126) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubatin= g] at org.apache.drill.exec.work.foreman.QueryManager.updateStatus(Que= ryManager.java:175) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-i= ncubating] at org.apache.drill.exec.work.foreman.QueryManager.fail(QueryManage= r.java:199) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubatin= g] at org.apache.drill.exec.work.foreman.QueryManager.statusUpdate(Que= ryManager.java:161) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-i= ncubating] at org.apache.drill.exec.work.foreman.QueryManager$RootStatusHandle= r.statusChange(QueryManager.java:286) ~[drill-java-exec-0.4.0-incubating-re= buffed.jar:0.4.0-incubating] at org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(= AbstractStatusReporter.java:113) ~[drill-java-exec-0.4.0-incubating-rebuffe= d.jar:0.4.0-incubating] at org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(= AbstractStatusReporter.java:109) ~[drill-java-exec-0.4.0-incubating-rebuffe= d.jar:0.4.0-incubating] at org.apache.drill.exec.work.fragment.FragmentExecutor.internalFai= l(FragmentExecutor.java:158) ~[drill-java-exec-0.4.0-incubating-rebuffed.ja= r:0.4.0-incubating] at org.apache.drill.exec.work.fragment.FragmentExecutor.run(Fragmen= tExecutor.java:128) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-i= ncubating] at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkM= anager.java:250) [drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incub= ating] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec= utor.java:1145) [na:1.7.0_45] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:615) [na:1.7.0_45] at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45] =20 2014-08-06 00:56:18,169 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.d.exec.work.foreman.QueryManager - New fragment status was provided = to Foreman of profile { state: FAILED error { error_id: "b746b426-1aa1-469e-88a6-a8dea5dc9365" endpoint { address: "drillats3.qa.lab" user_port: 31010 control_port: 31011 data_port: 31012 } error_type: 0 message: "Failure while running fragment. Failure while accessing Zooke= eper [b746b426-1aa1-469e-88a6-a8dea5dc9365]" } minor_fragment_id: 0 operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 4 operator_type: 21 setup_nanos: 0 process_nanos: 90838172 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 3 operator_type: 2 setup_nanos: 0 process_nanos: 3307 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 2 operator_type: 14 setup_nanos: 0 process_nanos: 2552 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 1 operator_type: 10 setup_nanos: 0 process_nanos: 3445 local_memory_allocated: 0 wait_nanos: 0 } =20 operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 0 operator_type: 13 setup_nanos: 0 process_nanos: 996491 local_memory_allocated: 0 wait_nanos: 106634 } start_time: 1407286578031 end_time: 1407286578167 memory_used: 0 } handle { query_id { part1: -6293552266575722108 part2: -8769049111628070660 } major_fragment_id: 0 minor_fragment_id: 0 } =20 2014-08-06 00:56:18,170 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] DEB= UG o.a.d.exec.rpc.control.WorkEventBus - Removing framgent status listener = for queryId part1: -6293552266575722108 part2: -8769049111628070660 . 2014-08-06 00:56:18,189 [WorkManager-32] ERROR o.a.d.e.w.f.AbstractStatusRe= porter - Error bd02bfe2-369f-49ff-8ec3-59ae3620edad: Failure while running = fragment. java.lang.ArrayIndexOutOfBoundsException: null 2014-08-06 00:56:18,189 [WorkManager-32] DEBUG o.a.d.exec.work.foreman.Quer= yManager - New fragment status was provided to Foreman of profile { state: FAILED error { error_id: "bd02bfe2-369f-49ff-8ec3-59ae3620edad" endpoint { address: "drillats3.qa.lab" user_port: 31010 control_port: 31011 data_port: 31012 } error_type: 0 message: "Failure while running fragment. null [bd02bfe2-369f-49ff-8ec3= -59ae3620edad]" } minor_fragment_id: 0 operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 4 operator_type: 21 setup_nanos: 0 process_nanos: 90838172 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 3 operator_type: 2 setup_nanos: 0 process_nanos: 3307 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 2 operator_type: 14 setup_nanos: 0 process_nanos: 2552 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 1 operator_type: 10 setup_nanos: 0 process_nanos: 3445 local_memory_allocated: 0 wait_nanos: 0 } operator_profile { input_profile { records: 0 batches: 0 schemas: 0 } operator_id: 0 operator_type: 13 setup_nanos: 0 process_nanos: 996491 local_memory_allocated: 0 wait_nanos: 106634 } start_time: 1407286578031 end_time: 1407286578188 memory_used: 0 } handle { query_id { part1: -6293552266575722108 part2: -8769049111628070660 } major_fragment_id: 0 minor_fragment_id: 0 } =20 2014-08-06 00:56:18,190 [WorkManager-32] DEBUG o.a.d.exec.rpc.control.WorkE= ventBus - Removing framgent status listener for queryId part1: -62935522665= 75722108 part2: -8769049111628070660 . 2014-08-06 00:56:18,214 [WorkManager-32] DEBUG o.a.d.e.w.fragment.FragmentE= xecutor - Fragment runner complete. 0:0 > Select * on parquet files containing nulls fail > ----------------------------------------------- > > Key: DRILL-1269 > URL: https://issues.apache.org/jira/browse/DRILL-1269 > Project: Apache Drill > Issue Type: Bug > Components: Storage - Parquet > Reporter: Abhishek Girish > Assignee: Mehant Baid > > Select * on a parquet file fails when some rows contain null columns.=20 > This is not seen when the nulls in the dataset are removed.=20 > [dataset does not contain null] > > select * from promotion6 where p_promo_sk=3D5;=20 > [Succeeds] > [dataset contains null] > [sample: ABC|DEF||JKL] > > select * from promotion5 where p_promo_sk=3D5;=20 > [Fails with below error] > Query failed: Screen received stop request sent. null [25a465b6-3acf-49fc= -a6ea-0488439ec307] > Error: exception while executing query: Failure while trying to get next = result batch. (state=3D,code=3D0) > =20 > LOG: > =20 > 2014-08-06 00:56:18,157 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] D= EBUG o.a.d.exec.physical.impl.ScanBatch - Failed to read the batch. Stoppin= g=E2=80=A6 > java.lang.ArrayIndexOutOfBoundsException: null > 2014-08-06 00:56:18,158 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] E= RROR o.a.drill.exec.ops.FragmentContext - Fragment Context received failure= . {} > java.lang.ArrayIndexOutOfBoundsException: null > 2014-08-06 00:56:18,159 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] E= RROR o.a.d.e.p.i.ScreenCreator$ScreenRoot - Error 25a465b6-3acf-49fc-a6ea-0= 488439ec307: Screen received stop request sent. > java.lang.ArrayIndexOutOfBoundsException: null > 2014-08-06 00:56:18,161 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] D= EBUG o.a.drill.exec.ops.OperatorContext - Closing context for org.apache.dr= ill.exec.physical.config.Screen > 2014-08-06 00:56:18,161 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] D= EBUG o.a.drill.exec.ops.OperatorContext - Closing context for org.apache.dr= ill.exec.physical.config.Project > 2014-08-06 00:56:18,162 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] D= EBUG o.a.drill.exec.ops.OperatorContext - Closing context for org.apache.dr= ill.exec.physical.config.SelectionVectorRemover > 2014-08-06 00:56:18,162 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] D= EBUG o.a.drill.exec.ops.OperatorContext - Closing context for org.apache.dr= ill.exec.physical.config.Filter > 2014-08-06 00:56:18,162 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] D= EBUG o.a.drill.exec.ops.OperatorContext - Closing context for org.apache.dr= ill.exec.store.parquet.ParquetRowGroupScan > 2014-08-06 00:56:18,163 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] E= RROR o.a.d.e.w.f.AbstractStatusReporter - Error 0d7f9f82-ba3c-445a-a7ff-473= 1c282397f: Failure while running fragment. > java.lang.ArrayIndexOutOfBoundsException: null > 2014-08-06 00:56:18,164 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] D= EBUG o.a.d.exec.work.foreman.QueryManager - New fragment status was provide= d to Foreman of profile { > state: FAILED > error { > error_id: "0d7f9f82-ba3c-445a-a7ff-4731c282397f" > endpoint { > address: "drillats3.qa.lab" > user_port: 31010 > control_port: 31011 > data_port: 31012 > } > error_type: 0 > message: "Failure while running fragment. null [0d7f9f82-ba3c-445a-a7= ff-4731c282397f]" > } > minor_fragment_id: 0 > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 4 > operator_type: 21 > setup_nanos: 0 > process_nanos: 90838172 > local_memory_allocated: 0 > wait_nanos: 0 > } > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 3 > operator_type: 2 > setup_nanos: 0 > process_nanos: 3307 > local_memory_allocated: 0 > wait_nanos: 0 > } > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 2 > operator_type: 14 > setup_nanos: 0 > process_nanos: 2552 > local_memory_allocated: 0 > wait_nanos: 0 > } > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 1 > operator_type: 10 > setup_nanos: 0 > process_nanos: 3445 > local_memory_allocated: 0 > wait_nanos: 0 > } > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 0 > operator_type: 13 > setup_nanos: 0 > process_nanos: 996491 > local_memory_allocated: 0 > wait_nanos: 106634 > } > start_time: 1407286578031 > end_time: 1407286578162 > memory_used: 0 > } > handle { > query_id { > part1: -6293552266575722108 > part2: -8769049111628070660 > } > major_fragment_id: 0 > minor_fragment_id: 0 > } > =20 > 2014-08-06 00:56:18,164 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] D= EBUG o.a.d.exec.rpc.control.WorkEventBus - Removing framgent status listene= r for queryId part1: -6293552266575722108 > part2: -8769049111628070660 > . > 2014-08-06 00:56:18,165 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] D= EBUG o.a.d.exec.work.foreman.QueryManager - New fragment status was provide= d to Foreman of profile { > state: CANCELLED > minor_fragment_id: 0 > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 4 > operator_type: 21 > setup_nanos: 0 > process_nanos: 90838172 > local_memory_allocated: 0 > wait_nanos: 0 > } > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 3 > operator_type: 2 > setup_nanos: 0 > process_nanos: 3307 > local_memory_allocated: 0 > wait_nanos: 0 > } > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 2 > operator_type: 14 > setup_nanos: 0 > process_nanos: 2552 > local_memory_allocated: 0 > wait_nanos: 0 > } > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 1 > operator_type: 10 > setup_nanos: 0 > process_nanos: 3445 > local_memory_allocated: 0 > wait_nanos: 0 > } > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 0 > operator_type: 13 > setup_nanos: 0 > process_nanos: 996491 > local_memory_allocated: 0 > wait_nanos: 106634 > } > start_time: 1407286578031 > end_time: 1407286578164 > memory_used: 0 > } > handle { > query_id { > part1: -6293552266575722108 > part2: -8769049111628070660 > } > major_fragment_id: 0 > minor_fragment_id: 0 > } > =20 > 2014-08-06 00:56:18,165 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] D= EBUG o.a.d.e.w.fragment.FragmentExecutor - Cancelled Fragment query_id { > part1: -6293552266575722108 > part2: -8769049111628070660 > } > major_fragment_id: 0 > minor_fragment_id: 0 > =20 > 2014-08-06 00:56:18,167 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] D= EBUG o.a.d.e.w.fragment.FragmentExecutor - Caught exception while running f= ragment > java.lang.RuntimeException: Failure while accessing Zookeeper > at org.apache.drill.exec.store.sys.zk.ZkPStore.put(ZkPStore.java:= 96) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubating] > at org.apache.drill.exec.work.foreman.QueryStatus.updateCache(Que= ryStatus.java:133) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-in= cubating] > at org.apache.drill.exec.work.foreman.QueryStatus.update(QuerySta= tus.java:126) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubat= ing] > at org.apache.drill.exec.work.foreman.QueryManager.updateStatus(Q= ueryManager.java:175) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0= -incubating] > at org.apache.drill.exec.work.foreman.QueryManager.fail(QueryMana= ger.java:199) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubat= ing] > at org.apache.drill.exec.work.foreman.QueryManager.statusUpdate(Q= ueryManager.java:161) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0= -incubating] > at org.apache.drill.exec.work.foreman.QueryManager$RootStatusHand= ler.statusChange(QueryManager.java:286) ~[drill-java-exec-0.4.0-incubating-= rebuffed.jar:0.4.0-incubating] > at org.apache.drill.exec.work.fragment.AbstractStatusReporter.fai= l(AbstractStatusReporter.java:113) ~[drill-java-exec-0.4.0-incubating-rebuf= fed.jar:0.4.0-incubating] > at org.apache.drill.exec.work.fragment.AbstractStatusReporter.fai= l(AbstractStatusReporter.java:109) ~[drill-java-exec-0.4.0-incubating-rebuf= fed.jar:0.4.0-incubating] > at org.apache.drill.exec.work.fragment.FragmentExecutor.internalF= ail(FragmentExecutor.java:158) ~[drill-java-exec-0.4.0-incubating-rebuffed.= jar:0.4.0-incubating] > at org.apache.drill.exec.work.fragment.FragmentExecutor.run(Fragm= entExecutor.java:128) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0= -incubating] > at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(Wor= kManager.java:250) [drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-inc= ubating] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1145) [na:1.7.0_45] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:615) [na:1.7.0_45] > at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45] > Caused by: java.lang.InterruptedException: null > at java.lang.Object.wait(Native Method) ~[na:1.7.0_45] > at java.lang.Object.wait(Object.java:503) ~[na:1.7.0_45] > at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:= 1342) ~[zookeeper-3.4.6.jar:3.4.6-1569965] > at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) ~[z= ookeeper-3.4.6.jar:3.4.6-1569965] > at org.apache.curator.framework.imps.ExistsBuilderImpl$2.call(Exi= stsBuilderImpl.java:172) ~[curator-framework-2.5.0.jar:na] > at org.apache.curator.framework.imps.ExistsBuilderImpl$2.call(Exi= stsBuilderImpl.java:161) ~[curator-framework-2.5.0.jar:na] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)= ~[curator-client-2.5.0.jar:na] > at org.apache.curator.framework.imps.ExistsBuilderImpl.pathInFore= ground(ExistsBuilderImpl.java:157) ~[curator-framework-2.5.0.jar:na] > at org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(Ex= istsBuilderImpl.java:148) ~[curator-framework-2.5.0.jar:na] > at org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(Ex= istsBuilderImpl.java:36) ~[curator-framework-2.5.0.jar:na] > at org.apache.drill.exec.store.sys.zk.ZkPStore.put(ZkPStore.java:= 89) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubating] > ... 14 common frames omitted > 2014-08-06 00:56:18,168 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] E= RROR o.a.d.e.w.f.AbstractStatusReporter - Error b746b426-1aa1-469e-88a6-a8d= ea5dc9365: Failure while running fragment. > java.lang.InterruptedException: null > at java.lang.Object.wait(Native Method) ~[na:1.7.0_45] > at java.lang.Object.wait(Object.java:503) ~[na:1.7.0_45] > at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:= 1342) ~[zookeeper-3.4.6.jar:3.4.6-1569965] > at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) ~[z= ookeeper-3.4.6.jar:3.4.6-1569965] > at org.apache.curator.framework.imps.ExistsBuilderImpl$2.call(Exi= stsBuilderImpl.java:172) ~[curator-framework-2.5.0.jar:na] > at org.apache.curator.framework.imps.ExistsBuilderImpl$2.call(Exi= stsBuilderImpl.java:161) ~[curator-framework-2.5.0.jar:na] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)= ~[curator-client-2.5.0.jar:na] > at org.apache.curator.framework.imps.ExistsBuilderImpl.pathInFore= ground(ExistsBuilderImpl.java:157) ~[curator-framework-2.5.0.jar:na] > at org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(Ex= istsBuilderImpl.java:148) ~[curator-framework-2.5.0.jar:na] > at org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(Ex= istsBuilderImpl.java:36) ~[curator-framework-2.5.0.jar:na] > at org.apache.drill.exec.store.sys.zk.ZkPStore.put(ZkPStore.java:= 89) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubating] > at org.apache.drill.exec.work.foreman.QueryStatus.updateCache(Que= ryStatus.java:133) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-in= cubating] > at org.apache.drill.exec.work.foreman.QueryStatus.update(QuerySta= tus.java:126) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubat= ing] > at org.apache.drill.exec.work.foreman.QueryManager.updateStatus(Q= ueryManager.java:175) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0= -incubating] > at org.apache.drill.exec.work.foreman.QueryManager.fail(QueryMana= ger.java:199) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-incubat= ing] > at org.apache.drill.exec.work.foreman.QueryManager.statusUpdate(Q= ueryManager.java:161) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0= -incubating] > at org.apache.drill.exec.work.foreman.QueryManager$RootStatusHand= ler.statusChange(QueryManager.java:286) ~[drill-java-exec-0.4.0-incubating-= rebuffed.jar:0.4.0-incubating] > at org.apache.drill.exec.work.fragment.AbstractStatusReporter.fai= l(AbstractStatusReporter.java:113) ~[drill-java-exec-0.4.0-incubating-rebuf= fed.jar:0.4.0-incubating] > at org.apache.drill.exec.work.fragment.AbstractStatusReporter.fai= l(AbstractStatusReporter.java:109) ~[drill-java-exec-0.4.0-incubating-rebuf= fed.jar:0.4.0-incubating] > at org.apache.drill.exec.work.fragment.FragmentExecutor.internalF= ail(FragmentExecutor.java:158) ~[drill-java-exec-0.4.0-incubating-rebuffed.= jar:0.4.0-incubating] > at org.apache.drill.exec.work.fragment.FragmentExecutor.run(Fragm= entExecutor.java:128) ~[drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0= -incubating] > at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(Wor= kManager.java:250) [drill-java-exec-0.4.0-incubating-rebuffed.jar:0.4.0-inc= ubating] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1145) [na:1.7.0_45] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:615) [na:1.7.0_45] > at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45] > =20 > 2014-08-06 00:56:18,169 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] D= EBUG o.a.d.exec.work.foreman.QueryManager - New fragment status was provide= d to Foreman of profile { > state: FAILED > error { > error_id: "b746b426-1aa1-469e-88a6-a8dea5dc9365" > endpoint { > address: "drillats3.qa.lab" > user_port: 31010 > control_port: 31011 > data_port: 31012 > } > error_type: 0 > message: "Failure while running fragment. Failure while accessing Zoo= keeper [b746b426-1aa1-469e-88a6-a8dea5dc9365]" > } > minor_fragment_id: 0 > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 4 > operator_type: 21 > setup_nanos: 0 > process_nanos: 90838172 > local_memory_allocated: 0 > wait_nanos: 0 > } > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 3 > operator_type: 2 > setup_nanos: 0 > process_nanos: 3307 > local_memory_allocated: 0 > wait_nanos: 0 > } > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 2 > operator_type: 14 > setup_nanos: 0 > process_nanos: 2552 > local_memory_allocated: 0 > wait_nanos: 0 > } > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 1 > operator_type: 10 > setup_nanos: 0 > process_nanos: 3445 > local_memory_allocated: 0 > wait_nanos: 0 > } > =20 > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 0 > operator_type: 13 > setup_nanos: 0 > process_nanos: 996491 > local_memory_allocated: 0 > wait_nanos: 106634 > } > start_time: 1407286578031 > end_time: 1407286578167 > memory_used: 0 > } > handle { > query_id { > part1: -6293552266575722108 > part2: -8769049111628070660 > } > major_fragment_id: 0 > minor_fragment_id: 0 > } > =20 > 2014-08-06 00:56:18,170 [a8a8cf8e-e766-4984-864e-144b1b7440fc:frag:0:0] D= EBUG o.a.d.exec.rpc.control.WorkEventBus - Removing framgent status listene= r for queryId part1: -6293552266575722108 > part2: -8769049111628070660 > . > 2014-08-06 00:56:18,189 [WorkManager-32] ERROR o.a.d.e.w.f.AbstractStatus= Reporter - Error bd02bfe2-369f-49ff-8ec3-59ae3620edad: Failure while runnin= g fragment. > java.lang.ArrayIndexOutOfBoundsException: null > 2014-08-06 00:56:18,189 [WorkManager-32] DEBUG o.a.d.exec.work.foreman.Qu= eryManager - New fragment status was provided to Foreman of profile { > state: FAILED > error { > error_id: "bd02bfe2-369f-49ff-8ec3-59ae3620edad" > endpoint { > address: "drillats3.qa.lab" > user_port: 31010 > control_port: 31011 > data_port: 31012 > } > error_type: 0 > message: "Failure while running fragment. null [bd02bfe2-369f-49ff-8e= c3-59ae3620edad]" > } > minor_fragment_id: 0 > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 4 > operator_type: 21 > setup_nanos: 0 > process_nanos: 90838172 > local_memory_allocated: 0 > wait_nanos: 0 > } > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 3 > operator_type: 2 > setup_nanos: 0 > process_nanos: 3307 > local_memory_allocated: 0 > wait_nanos: 0 > } > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 2 > operator_type: 14 > setup_nanos: 0 > process_nanos: 2552 > local_memory_allocated: 0 > wait_nanos: 0 > } > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 1 > operator_type: 10 > setup_nanos: 0 > process_nanos: 3445 > local_memory_allocated: 0 > wait_nanos: 0 > } > operator_profile { > input_profile { > records: 0 > batches: 0 > schemas: 0 > } > operator_id: 0 > operator_type: 13 > setup_nanos: 0 > process_nanos: 996491 > local_memory_allocated: 0 > wait_nanos: 106634 > } > start_time: 1407286578031 > end_time: 1407286578188 > memory_used: 0 > } > handle { > query_id { > part1: -6293552266575722108 > part2: -8769049111628070660 > } > major_fragment_id: 0 > minor_fragment_id: 0 > } > =20 > 2014-08-06 00:56:18,190 [WorkManager-32] DEBUG o.a.d.exec.rpc.control.Wor= kEventBus - Removing framgent status listener for queryId part1: -629355226= 6575722108 > part2: -8769049111628070660 > . > 2014-08-06 00:56:18,214 [WorkManager-32] DEBUG o.a.d.e.w.fragment.Fragmen= tExecutor - Fragment runner complete. 0:0 -- This message was sent by Atlassian JIRA (v6.2#6252)