drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Khurram Faraaz (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-4249) DROP TABLE HANGS indefinitely
Date Fri, 29 Jan 2016 10:42:40 GMT

    [ https://issues.apache.org/jira/browse/DRILL-4249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123331#comment-15123331
] 

Khurram Faraaz commented on DRILL-4249:
---------------------------------------

Yes the DROP TABLE hang is reproducible on my 4 node cluster, MapR Drill 1.4.0 GA and MapR
FS 5.0.0 GA and JDK8

kill -QUIT 5194 , did not output the stack trace of the hung process to standard output.

Doing this (Ctril+\) gave me the stack trace on sqlline prompt, for the hung drop table process

{noformat}
0: jdbc:drill:schema=dfs.tmp> drop table tblMD332_wp;
2016-01-29 10:31:26
Full thread dump OpenJDK 64-Bit Server VM (25.65-b01 mixed mode):

"threadDeathWatcher-2-1" #29 daemon prio=1 os_prio=0 tid=0x00007ffe40254000 nid=0x1b51 waiting
on condition [0x00007ffe305db000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at io.netty.util.ThreadDeathWatcher$Watcher.run(ThreadDeathWatcher.java:137)
	at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
	at java.lang.Thread.run(Thread.java:745)

"Client-1" #27 daemon prio=10 os_prio=0 tid=0x00007ffe90f01000 nid=0x1b3a runnable [0x00007ffe30c8c000]
   java.lang.Thread.State: RUNNABLE
	at io.netty.channel.epoll.Native.epollWait0(Native Method)
	at io.netty.channel.epoll.Native.epollWait(Native.java:148)
	at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:180)
	at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:205)
	at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
	at java.lang.Thread.run(Thread.java:745)

"Curator-ServiceCache-0" #26 daemon prio=5 os_prio=0 tid=0x00007ffe90e2d000 nid=0x1ae0 waiting
on condition [0x00007ffe30ae6000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c0033898> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"Curator-Framework-0" #25 daemon prio=5 os_prio=0 tid=0x00007ffe90dde800 nid=0x1adf waiting
on condition [0x00007ffe30d8d000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c003b878> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.DelayQueue.take(DelayQueue.java:211)
	at java.util.concurrent.DelayQueue.take(DelayQueue.java:70)
	at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:780)
	at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:62)
	at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:257)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
	
"main-EventThread" #24 daemon prio=5 os_prio=0 tid=0x00007ffe90dc3000 nid=0x1ade waiting on
condition [0x00007ffe30f33000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c00436a0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)

"main-SendThread(centos-01.qa.lab:5181)" #23 daemon prio=5 os_prio=0 tid=0x00007ffe90dcf000
nid=0x1add runnable [0x00007ffe4410c000]
   java.lang.Thread.State: RUNNABLE
	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
	- locked <0x00000006c004b710> (a sun.nio.ch.Util$2)
	- locked <0x00000006c004b720> (a java.util.Collections$UnmodifiableSet)
	- locked <0x00000006c004b6c8> (a sun.nio.ch.EPollSelectorImpl)
	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1070)
	
"Curator-ConnectionStateManager-0" #22 daemon prio=5 os_prio=0 tid=0x00007ffe90de7000 nid=0x1ada
waiting on condition [0x00007ffe31234000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000006c0053648> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
	at org.apache.curator.framework.state.ConnectionStateManager.processEvents(ConnectionStateManager.java:245)
	at org.apache.curator.framework.state.ConnectionStateManager.access$000(ConnectionStateManager.java:43)
	at org.apache.curator.framework.state.ConnectionStateManager$1.call(ConnectionStateManager.java:111)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"NonBlockingInputStreamThread" #20 daemon prio=5 os_prio=0 tid=0x00007ffe90a7c800 nid=0x1acb
in Object.wait() [0x00007ffe44293000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at jline.internal.NonBlockingInputStream.run(NonBlockingInputStream.java:278)
	- locked <0x00000006c0033b20> (a jline.internal.NonBlockingInputStream)
	at java.lang.Thread.run(Thread.java:745)
	
"Service Thread" #17 daemon prio=9 os_prio=0 tid=0x00007ffe90123800 nid=0x1ab8 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread11" #16 daemon prio=9 os_prio=0 tid=0x00007ffe90118800 nid=0x1ab7 waiting
on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread10" #15 daemon prio=9 os_prio=0 tid=0x00007ffe90116800 nid=0x1ab6 waiting
on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread9" #14 daemon prio=9 os_prio=0 tid=0x00007ffe90115000 nid=0x1ab5 waiting
on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread8" #13 daemon prio=9 os_prio=0 tid=0x00007ffe90112800 nid=0x1ab4 waiting
on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread7" #12 daemon prio=9 os_prio=0 tid=0x00007ffe90108000 nid=0x1ab3 waiting
on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread6" #11 daemon prio=9 os_prio=0 tid=0x00007ffe90106000 nid=0x1ab2 waiting
on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread5" #10 daemon prio=9 os_prio=0 tid=0x00007ffe90104800 nid=0x1ab1 waiting
on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread4" #9 daemon prio=9 os_prio=0 tid=0x00007ffe900fa000 nid=0x1ab0 waiting
on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE
   
"C2 CompilerThread3" #8 daemon prio=9 os_prio=0 tid=0x00007ffe900f8000 nid=0x1aaf waiting
on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread2" #7 daemon prio=9 os_prio=0 tid=0x00007ffe900f6000 nid=0x1aae waiting
on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread1" #6 daemon prio=9 os_prio=0 tid=0x00007ffe900f4000 nid=0x1aad waiting
on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread0" #5 daemon prio=9 os_prio=0 tid=0x00007ffe900e7000 nid=0x1aac waiting
on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" #4 daemon prio=9 os_prio=0 tid=0x00007ffe900e5000 nid=0x1aab waiting on
condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007ffe900b6800 nid=0x1aaa in Object.wait()
[0x00007ffe45d72000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
	- locked <0x00000006c0015088> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
	at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
	
"Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007ffe900ae800 nid=0x1aa9 in Object.wait()
[0x00007ffe45e73000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:157)
	- locked <0x00000006c0033b10> (a java.lang.ref.Reference$Lock)

"main" #1 prio=5 os_prio=0 tid=0x00007ffe90011800 nid=0x1a95 waiting on condition [0x00007ffe96825000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x000000076ae9ab70> (a java.util.concurrent.CountDownLatch$Sync)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
	at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:231)
	at org.apache.drill.jdbc.impl.DrillResultSetImpl.execute(DrillResultSetImpl.java:1909)
	at org.apache.drill.jdbc.impl.DrillResultSetImpl.execute(DrillResultSetImpl.java:73)
	at net.hydromatic.avatica.AvaticaConnection.executeQueryInternal(AvaticaConnection.java:404)
	at net.hydromatic.avatica.AvaticaStatement.executeQueryInternal(AvaticaStatement.java:351)
	at net.hydromatic.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:338)
	at net.hydromatic.avatica.AvaticaStatement.execute(AvaticaStatement.java:69)
	at org.apache.drill.jdbc.impl.DrillStatementImpl.execute(DrillStatementImpl.java:101)
    at sqlline.Commands.execute(Commands.java:841)
	at sqlline.Commands.sql(Commands.java:751)
	at sqlline.SqlLine.dispatch(SqlLine.java:746)
	at sqlline.SqlLine.begin(SqlLine.java:621)
	at sqlline.SqlLine.start(SqlLine.java:375)
	at sqlline.SqlLine.main(SqlLine.java:268)

"VM Thread" os_prio=0 tid=0x00007ffe900a9800 nid=0x1aa8 runnable

"GC task thread#0 (ParallelGC)" os_prio=0 tid=0x00007ffe90027000 nid=0x1a96 runnable

"GC task thread#1 (ParallelGC)" os_prio=0 tid=0x00007ffe90028800 nid=0x1a97 runnable

"GC task thread#2 (ParallelGC)" os_prio=0 tid=0x00007ffe9002a800 nid=0x1a98 runnable

"GC task thread#3 (ParallelGC)" os_prio=0 tid=0x00007ffe9002c000 nid=0x1a99 runnable

"GC task thread#4 (ParallelGC)" os_prio=0 tid=0x00007ffe9002e000 nid=0x1a9a runnable

"GC task thread#5 (ParallelGC)" os_prio=0 tid=0x00007ffe9002f800 nid=0x1a9b runnable

"GC task thread#6 (ParallelGC)" os_prio=0 tid=0x00007ffe90031800 nid=0x1a9c runnable

"GC task thread#7 (ParallelGC)" os_prio=0 tid=0x00007ffe90033000 nid=0x1a9d runnable

"GC task thread#8 (ParallelGC)" os_prio=0 tid=0x00007ffe90035000 nid=0x1a9e runnable

"GC task thread#9 (ParallelGC)" os_prio=0 tid=0x00007ffe90036800 nid=0x1a9f runnable

"GC task thread#10 (ParallelGC)" os_prio=0 tid=0x00007ffe90038800 nid=0x1aa0 runnable

"GC task thread#11 (ParallelGC)" os_prio=0 tid=0x00007ffe9003a000 nid=0x1aa1 runnable

"GC task thread#12 (ParallelGC)" os_prio=0 tid=0x00007ffe9003b800 nid=0x1aa2 runnable

"GC task thread#13 (ParallelGC)" os_prio=0 tid=0x00007ffe9003d800 nid=0x1aa3 runnable

"GC task thread#14 (ParallelGC)" os_prio=0 tid=0x00007ffe9003f000 nid=0x1aa4 runnable

"GC task thread#15 (ParallelGC)" os_prio=0 tid=0x00007ffe90041000 nid=0x1aa5 runnable

"GC task thread#16 (ParallelGC)" os_prio=0 tid=0x00007ffe90042800 nid=0x1aa6 runnable

"GC task thread#17 (ParallelGC)" os_prio=0 tid=0x00007ffe90044800 nid=0x1aa7 runnable

"VM Periodic Task Thread" os_prio=0 tid=0x00007ffe90126000 nid=0x1ab9 waiting on condition

JNI global references: 342

Heap
 PSYoungGen      total 1223168K, used 146801K [0x000000076ab00000, 0x00000007c0000000, 0x00000007c0000000)
  eden space 1048576K, 14% used [0x000000076ab00000,0x0000000773a5c420,0x00000007aab00000)
  from space 174592K, 0% used [0x00000007aab00000,0x00000007aab00000,0x00000007b5580000)
  to   space 174592K, 0% used [0x00000007b5580000,0x00000007b5580000,0x00000007c0000000)
 ParOldGen       total 2796544K, used 15530K [0x00000006c0000000, 0x000000076ab00000, 0x000000076ab00000)
  object space 2796544K, 0% used [0x00000006c0000000,0x00000006c0f2a8a8,0x000000076ab00000)
 Metaspace       used 22218K, capacity 22366K, committed 22400K, reserved 1069056K
  class space    used 2590K, capacity 2659K, committed 2688K, reserved 1048576K
{noformat}

>From the file to which jmap output was written, it appears that there is a deadlock!

{noformat}
Attaching to process ID 5194, please wait...
Debugger attached successfully.
Server compiler detected.
JVM version is 25.65-b01
Deadlock Detection:

Can't print deadlocks:Unable to deduce type of thread from address 0x00007fd412df8000 (expected
type JavaThread, CompilerThread, ServiceThread, JvmtiAgentThread, or SurrogateLockerThread)
{noformat}

Details of hung process from /proc/5194/task/5194

{noformat}
[root@centos-01 5194]# cat status
Name:	java
State:	S (sleeping)
Tgid:	5194
Pid:	5194
PPid:	5069
TracerPid:	0
Uid:	2000	2000	2000	2000
Gid:	2000	2000	2000	2000
Utrace:	0
FDSize:	512
Groups:	2000 2001
VmPeak:	 7401296 kB
VmSize:	 7335760 kB
VmLck:	       0 kB
VmHWM:	 1072800 kB
VmRSS:	 1072760 kB
VmData:	 7119568 kB
VmStk:	      88 kB
VmExe:	       4 kB
VmLib:	   29436 kB
VmPTE:	    2668 kB
VmSwap:	       0 kB
Threads:	119
SigQ:	0/385903
SigPnd:	0000000000000000
ShdPnd:	0000000000000000
SigBlk:	0000000000000004
SigIgn:	0000000000001003
SigCgt:	2000000181004ccc
CapInh:	0000000000000000
CapPrm:	0000000000000000
CapEff:	0000000000000000
CapBnd:	ffffffffffffffff
Cpus_allowed:	ffffff
Cpus_allowed_list:	0-23
Mems_allowed:	00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000003
Mems_allowed_list:	0-1
voluntary_ctxt_switches:	24
nonvoluntary_ctxt_switches:	3
{noformat}

JMAP output for hung process

{noformat}
[root@centos-01 framework]# jmap 5194
Attaching to process ID 5194, please wait...
Debugger attached successfully.
Server compiler detected.
JVM version is 25.65-b01
0x0000000000400000	9K	/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/bin/java
0x00000030d7e00000	153K	/lib64/ld-2.12.so
0x00000030d8600000	1881K	/lib64/libc-2.12.so
0x00000030d8a00000	142K	/lib64/libpthread-2.12.so
0x00000030d8e00000	45K	/lib64/librt-2.12.so
0x00000030d9200000	88K	/lib64/libz.so.1.2.3
0x00000030d9600000	585K	/lib64/libm-2.12.so
0x00000030da200000	111K	/lib64/libresolv-2.12.so
0x00000030db600000	91K	/lib64/libgcc_s-4.4.7-20120601.so.1
0x00000030dbe00000	966K	/usr/lib64/libstdc++.so.6.0.13
0x0000003aea000000	22K	/lib64/libdl-2.12.so
0x0000003aea400000	42K	/lib64/libcrypt-2.12.so
0x0000003aea800000	461K	/lib64/libfreebl3.so
0x0000003ff8e00000	57K	/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/jli/libjli.so
0x0000003ff9200000	57K	/lib64/libpam.so.0.82.2
0x00007fd3ab15d000	5K	/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/libjaas_unix.so
0x00007fd3ab65f000	70074K	/tmp/mapr-mapr-libMapRClient.4.1.0.34989-mapr.so
0x00007fd3acc5d000	71K	/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/libnio.so
0x00007fd3ace6f000	51K	/tmp/libnetty-transport-native-epoll8942720480120192851.so
0x00007fd3ad64b000	35K	/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/libmanagement.so
0x00007fd3ad854000	26K	/lib64/libnss_dns-2.12.so
0x00007fd3ade7d000	91K	/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/libnet.so
0x00007fd415fc4000	32K	/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/libzip.so
0x00007fd4161cc000	64K	/lib64/libnss_files-2.12.so
0x00007fd4163e3000	173K	/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/libjava.so
0x00007fd41660e000	58K	/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/libverify.so
0x00007fd41691e000	13284K	/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/server/libjvm.so
0x00007fd41783c000	112K	/lib64/libaudit.so.1.0.0
[root@centos-01 framework]#
{noformat}

jstack did not give me the required stack trace, instead it reported some Exception.

{noformat}
[root@centos-01 framework]# jstack 5194
5194: Unable to open socket file: target process not responding or HotSpot VM not loaded
The -F option can be used when the target process is not responding
[root@centos-01 framework]# jstack -F 5194 > jstk_out_droptbl
java.lang.RuntimeException: Unable to deduce type of thread from address 0x00007fd412df8000
(expected type JavaThread, CompilerThread, ServiceThread, JvmtiAgentThread, or SurrogateLockerThread)
	at sun.jvm.hotspot.runtime.Threads.createJavaThreadWrapper(Threads.java:166)
	at sun.jvm.hotspot.runtime.Threads.first(Threads.java:150)
	at sun.jvm.hotspot.runtime.DeadlockDetector.createThreadTable(DeadlockDetector.java:149)
	at sun.jvm.hotspot.runtime.DeadlockDetector.print(DeadlockDetector.java:56)
	at sun.jvm.hotspot.runtime.DeadlockDetector.print(DeadlockDetector.java:39)
	at sun.jvm.hotspot.tools.StackTrace.run(StackTrace.java:62)
	at sun.jvm.hotspot.tools.StackTrace.run(StackTrace.java:45)
	at sun.jvm.hotspot.tools.JStack.run(JStack.java:66)
	at sun.jvm.hotspot.tools.Tool.startInternal(Tool.java:260)
	at sun.jvm.hotspot.tools.Tool.start(Tool.java:223)
	at sun.jvm.hotspot.tools.Tool.execute(Tool.java:118)
	at sun.jvm.hotspot.tools.JStack.main(JStack.java:92)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at sun.tools.jstack.JStack.runJStackTool(JStack.java:140)
	at sun.tools.jstack.JStack.main(JStack.java:106)
Caused by: sun.jvm.hotspot.types.WrongTypeException: No suitable match for type of address
0x00007fd412df8000
at sun.jvm.hotspot.runtime.InstanceConstructor.newWrongTypeException(InstanceConstructor.java:62)
	at sun.jvm.hotspot.runtime.VirtualConstructor.instantiateWrapperFor(VirtualConstructor.java:80)
	at sun.jvm.hotspot.runtime.Threads.createJavaThreadWrapper(Threads.java:162)
...
{noformat}

> DROP TABLE HANGS indefinitely
> -----------------------------
>
>                 Key: DRILL-4249
>                 URL: https://issues.apache.org/jira/browse/DRILL-4249
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Flow
>    Affects Versions: 1.4.0
>         Environment: 4 node cluster on CentOS
>            Reporter: Khurram Faraaz
>
> DROP TABLE hangs. Table was created using CTAS and the input to CTAS was a directory
that had 2000 JSON files.
> There is no Exception or error message on sqlline prompt nor in drillbit.log
> Drill 1.4.0, git commitID: 32b85160
> hadoop fs -ls /tmp shows that the directory exists (at the time when DROP TABLE was hung)
> drwxr-xr-x   - mapr mapr   10550677 2016-01-05 12:14 /tmp/tblMD332_wp
> {noformat}
> Snippet from drillbit.log, there's no further information after the below text in drillbit.log
> 2016-01-06 10:03:09,817 [297319a1-fb9d-8247-7d12-c8d551d56d2d:foreman] INFO  o.a.drill.exec.work.foreman.Foreman
- Query text for query id 297319a1-fb9d-8247-7d12-c8d551d56d2d: drop table tblMD332_wp
> 2016-01-06 10:03:11,516 [297319a1-fb9d-8247-7d12-c8d551d56d2d:foreman] INFO  o.a.d.exec.store.dfs.FileSelection
- FileSelection.create() took 6 ms
> 2016-01-06 10:03:11,517 [297319a1-fb9d-8247-7d12-c8d551d56d2d:foreman] INFO  o.a.d.exec.store.dfs.FileSelection
- FileSelection.getStatuses() took 0 ms, numFiles: 1
> {noformat}
> {noformat}
> Note that DROP TABLE commands hangs indefinitely.
> [root@centos-01 bin]# ./sqlline -u "jdbc:drill:schema=dfs.tmp -n mapr -p mapr"
> apache drill 1.4.0
> "got drill?"
> 0: jdbc:drill:schema=dfs.tmp> drop table tblMD332_wp;
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message