drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chun Chang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-1581) tpch100 text queries are failing - regression
Date Fri, 24 Oct 2014 23:53:33 GMT
Chun Chang created DRILL-1581:
---------------------------------

             Summary: tpch100 text queries are failing - regression
                 Key: DRILL-1581
                 URL: https://issues.apache.org/jira/browse/DRILL-1581
             Project: Apache Drill
          Issue Type: Bug
          Components: Execution - Data Types
    Affects Versions: 0.7.0
            Reporter: Chun Chang


code base:
#Generated by Git-Commit-Id-Plugin
#Fri Oct 24 11:15:44 PDT 2014
git.commit.id.abbrev=b956e45

The following tpch100 text query was working before the following checkin (not verified)

Commit after which tests started failing
https://github.com/apache/incubator-drill/commit/17a4d921417ff914cb81588926b692d1aea09e56
or
https://github.com/apache/incubator-drill/commit/38c5d4e4bb693fe65118f84463dce9246d7096fe

The query:
Test_Started: 2014/10/24 16:29:15.0015
/root/forgitcommit/private-sql-hadoop-test/framework/resources/Advanced/Passing/tpch100/text/03.q
:
create view nation as select cast(columns[0] as int) n_nationkey, columns[1] n_name, cast(columns[2]
as int) n_regionkey, columns[3] n_comment from `nation_text`

/root/forgitcommit/private-sql-hadoop-test/framework/resources/Advanced/Passing/tpch100/text/03.q
:

create view region as select cast(columns[0] as int) r_regionkey, columns[1] r_name, columns[2]
r_comment from `region_text`

/root/forgitcommit/private-sql-hadoop-test/framework/resources/Advanced/Passing/tpch100/text/03.q
:

create view part as select cast(columns[0] as int) p_partkey, columns[1] p_name, columns[2]
p_mfgr, columns[3] p_brand, columns[4] p_type, cast(columns[5] as int) p_size, columns[6]
p_container, cast(columns[7] as double) p_retailprice, columns[8] p_comment from `part_text`

/root/forgitcommit/private-sql-hadoop-test/framework/resources/Advanced/Passing/tpch100/text/03.q
:

create view supplier as select cast(columns[0] as int) s_suppkey, columns[1] s_name, columns[2]
s_address, cast(columns[3] as int) s_nationkey, columns[4] s_phone, cast(columns[5] as double)
s_acctbal, columns[6] s_comment from `supplier_text`

/root/forgitcommit/private-sql-hadoop-test/framework/resources/Advanced/Passing/tpch100/text/03.q
:

create view partsupp as select cast(columns[0] as int) ps_partkey, cast(columns[1] as int)
ps_suppkey, cast(columns[2] as int) ps_availqty, cast(columns[3] as double) ps_supplycost,
columns[4] ps_comment from `partsupp_text`

/root/forgitcommit/private-sql-hadoop-test/framework/resources/Advanced/Passing/tpch100/text/03.q
:

create view customer as select cast(columns[0] as int) c_custkey, columns[1] c_name, columns[2]
c_address, cast(columns[3] as int) c_nationkey, columns[4] c_phone, cast(columns[5] as double)
c_acctbal, columns[6] c_mktsegment, columns[7] c_comment from `customer_text`

/root/forgitcommit/private-sql-hadoop-test/framework/resources/Advanced/Passing/tpch100/text/03.q
:

create view orders as select cast(columns[0] as int) o_orderkey, cast(columns[1] as int) o_custkey,
columns[2] o_orderstatus, cast(columns[3] as double) o_totalprice, cast(columns[4] as date)o_orderdate,
columns[5] o_orderpriority, columns[6] o_clerk, cast(columns[7] as int) o_shippriority, columns[8]
o_comment from `orders_text`

/root/forgitcommit/private-sql-hadoop-test/framework/resources/Advanced/Passing/tpch100/text/03.q
:

create view lineitem as select cast(columns[0] as int) l_orderkey, cast(columns[1] as int)
l_partkey, cast(columns[2] as int) l_suppkey, cast(columns[3] as int) l_linenumber, cast(columns[4]
as double) l_quantity, cast(columns[5] as double) l_extendedprice, cast(columns[6] as double)
l_discount, cast(columns[7] as double) l_tax, columns[8] l_returnflag, columns[9] l_linestatus,
cast(columns[10] as date) l_shipdate, cast(columns[11] as date) l_commitdate, cast(columns[12]
as date) l_receiptdate, columns[13] l_shipinstruct, columns[14] l_shipmode, columns[15] l_comment
from `lineitem_text`

/root/forgitcommit/private-sql-hadoop-test/framework/resources/Advanced/Passing/tpch100/text/03.q
:

-- tpch3 using 1395599672 as a seed to the RNG
select
  l.l_orderkey,
  sum(l.l_extendedprice * (1 - l.l_discount)) as revenue,
  o.o_orderdate,
  o.o_shippriority
from
  customer c,
  orders o,
  lineitem l
where
  c.c_mktsegment = 'HOUSEHOLD'
  and c.c_custkey = o.o_custkey
  and l.l_orderkey = o.o_orderkey
  and o.o_orderdate < date '1995-03-25'
  and l.l_shipdate > date '1995-03-25'
group by
  l.l_orderkey,
  o.o_orderdate,
  o.o_shippriority
order by
  revenue desc,
  o.o_orderdate
limit 10

Query failed: Failure while running fragment. 299064069 [f197040e-0b70-4ef7-bbb2-a1dc88e340da]

/root/forgitcommit/private-sql-hadoop-test/framework/resources/Advanced/Passing/tpch100/text/03.q
:

drop view nation

/root/forgitcommit/private-sql-hadoop-test/framework/resources/Advanced/Passing/tpch100/text/03.q
:

drop view region

/root/forgitcommit/private-sql-hadoop-test/framework/resources/Advanced/Passing/tpch100/text/03.q
:

drop view part

/root/forgitcommit/private-sql-hadoop-test/framework/resources/Advanced/Passing/tpch100/text/03.q
:

drop view supplier

/root/forgitcommit/private-sql-hadoop-test/framework/resources/Advanced/Passing/tpch100/text/03.q
:

drop view partsupp

/root/forgitcommit/private-sql-hadoop-test/framework/resources/Advanced/Passing/tpch100/text/03.q
:

drop view customer

/root/forgitcommit/private-sql-hadoop-test/framework/resources/Advanced/Passing/tpch100/text/03.q
:

drop view orders

/root/forgitcommit/private-sql-hadoop-test/framework/resources/Advanced/Passing/tpch100/text/03.q
:

drop view lineitem


Test_Failed: 2014/10/24 16:29:21.0021 - Failed to execute.
END of Test

In drillbit.log, I saw interrupted exception:
16:29:15.664 [68a9af00-8c19-4327-bc6a-4f3672a841e0:frag:0:0] WARN  o.a.d.e.p.impl.SendingAccountor
- Failure while waiting for send complete.
java.lang.InterruptedException: null
  at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:996)
~[na:1.7.0_45]
  at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
~[na:1.7.0_45]
  at java.util.concurrent.Semaphore.acquire(Semaphore.java:472) ~[na:1.7.0_45]
  at org.apache.drill.exec.physical.impl.SendingAccountor.waitForSendComplete(SendingAccountor.java:44)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.stop(ScreenCreator.java:186)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources(FragmentExecutor.java:134)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:109) [drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250) [drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
  at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]


And error messages such as:

16:29:20.712 [BitServer-4] ERROR o.a.d.exec.rpc.control.WorkEventBus - A fragment message
arrived but there was no registered listener for that message for handle query_id {
  part1: 5422968853476163806
  part2: -5881537513090378761
}
major_fragment_id: 5
minor_fragment_id: 25


There is also RpcException:
16:29:20.852 [2a0c0d77-65a1-4109-ab57-32476ceaab18:frag:0:0] ERROR o.a.d.e.p.i.ScreenCreator$ScreenRoot
- Failure while sending data to user.
org.apache.drill.exec.rpc.RpcException: java.lang.InterruptedException
  at org.apache.drill.exec.rpc.RemoteConnection.blockOnNotWritable(RemoteConnection.java:56)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.rpc.RpcBus.send(RpcBus.java:89) [drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.rpc.user.UserServer$UserClientConnection.sendResult(UserServer.java:132)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:139)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57) [drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:104) [drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250) [drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
  at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
Caused by: java.lang.InterruptedException: null
  at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1301)
~[na:1.7.0_45]
  at org.apache.drill.exec.rpc.ResettableBarrier.await(ResettableBarrier.java:70) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.rpc.RemoteConnection$WriteManager.waitForWritable(RemoteConnection.java:80)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.rpc.RemoteConnection.blockOnNotWritable(RemoteConnection.java:53)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  ... 9 common frames omitted


And NumberFormatException:

16:29:20.912 [4b424170-ab74-40de-ae60-94cb271d13f7:frag:5:59] WARN  o.a.d.e.w.fragment.FragmentExecutor
- Error while initializing or executing fragment
java.lang.NumberFormatException: 540000001
  at org.apache.drill.exec.expr.fn.impl.StringFunctionHelpers.nfeI(StringFunctionHelpers.java:93)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.expr.fn.impl.StringFunctionHelpers.varCharToInt(StringFunctionHelpers.java:124)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.test.generated.ProjectorGen267.doEval(ProjectorTemplate.java:135)
~[na:na]
  at org.apache.drill.exec.test.generated.ProjectorGen267.projectRecords(ProjectorTemplate.java:64)
~[na:na]
  at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:145)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:85)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:127)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:105) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:117)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:85) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:75) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:50)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:105) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:117)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:67) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.physical.impl.partitionsender.PartitionSenderRootExec.innerNext(PartitionSenderRootExec.java:124)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:104) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250) [drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
  at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]


And RuntimeException accessing zookeeper:

16:29:20.925 [a000da5d-a42c-4bb9-bbb0-f203fc0769e4:frag:0:0] WARN  o.a.d.e.w.fragment.FragmentExecutor
- Error while initializing or executing fragment
java.lang.RuntimeException: Failure while accessing Zookeeper
  at org.apache.drill.exec.store.sys.zk.ZkPStore.put(ZkPStore.java:111) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.foreman.QueryStatus.updateCache(QueryStatus.java:125) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.foreman.QueryStatus.update(QueryStatus.java:119) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.foreman.QueryManager.updateStatus(QueryManager.java:173) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.foreman.QueryManager.finished(QueryManager.java:189) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.foreman.QueryManager.statusUpdate(QueryManager.java:162) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.foreman.QueryManager$RootStatusHandler.statusChange(QueryManager.java:284)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.fragment.AbstractStatusReporter.finished(AbstractStatusReporter.java:101)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.fragment.AbstractStatusReporter.stateChanged(AbstractStatusReporter.java:73)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.fragment.FragmentExecutor.updateState(FragmentExecutor.java:172)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:110) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250) [drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
  at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message