hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yongzhi Chen (JIRA)" <>
Subject [jira] [Created] (HIVE-15572) Improve the response time for query canceling when it happens during acquiring locks
Date Tue, 10 Jan 2017 20:55:58 GMT
Yongzhi Chen created HIVE-15572:

             Summary: Improve the response time for query canceling when it happens during
acquiring locks
                 Key: HIVE-15572
             Project: Hive
          Issue Type: Improvement
            Reporter: Yongzhi Chen
            Assignee: Yongzhi Chen

When query canceling command sent during Hive Acquire locks (from zookeeper), hive will finish
acquiring all the locks and release them. As it is shown in the following log:
It took 165 s to finish acquire the lock,then spend 81s to release them.
We can improve the performance by not acquiring any more locks and releasing held locks when
the query canceling command is received. 
Background-Pool: Thread-224]: <PERFLOG method=TimeToSubmit from=org.apache.hadoop.hive.ql.Driver>
2017-01-03 10:50:35,413 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Background-Pool:
Thread-224]: <PERFLOG method=acquireReadWriteLocks from=org.apache.hadoop.hive.ql.Driver>
2017-01-03 10:51:00,671 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Background-Pool:
Thread-218]: </PERFLOG method=acquireReadWriteLocks start=1483469295080 end=1483469460671
duration=165591 from=org.apache.hadoop.hive.ql.Driver>
2017-01-03 10:51:00,672 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Background-Pool:
Thread-218]: <PERFLOG method=Driver.execute from=org.apache.hadoop.hive.ql.Driver>
2017-01-03 10:51:00,672 ERROR org.apache.hadoop.hive.ql.Driver: [HiveServer2-Background-Pool:
Thread-218]: FAILED: query select count(*) from manyparttbl has been cancelled
2017-01-03 10:51:00,673 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Background-Pool:
Thread-218]: <PERFLOG method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>
2017-01-03 10:51:40,755 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Background-Pool:
Thread-215]: </PERFLOG method=releaseLocks start=1483469419487 end=1483469500755 duration=81268

This message was sent by Atlassian JIRA

View raw message