hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <>
Subject [jira] [Commented] (HIVE-4132) Connection to Zookeeper is created for each client of HS2
Date Wed, 19 Jun 2013 13:28:25 GMT


Brock Noland commented on HIVE-4132:

It's possible but I believe this one was more around the fact that there is no pool of zookeeper
connections. For example an HS2 with 500 concurrent users will have 500 connections to zookeeper
even though zk connections are used for fairly short periods.
> Connection to Zookeeper is created for each client of HS2
> ---------------------------------------------------------
>                 Key: HIVE-4132
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Server Infrastructure
>            Reporter: Brock Noland
>              Labels: HiveServer2
> Currently when concurrency is enabled and HS2 is used each client will have a connection
to Zookeeper. Zookeeper has a property, maxClientCnxns, in the zoo.cfg which limits the number
of connections *per* host to a low number like 50. The stack trace of the threads accessing
zookeeper is below for reference.
> {noformat}
> - org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager.lock(java.util.List,
boolean) @bci=94, line=220 (Interpreted frame)
>  - org.apache.hadoop.hive.ql.Driver.acquireReadWriteLocks() @bci=428, line=834 (Interpreted
>  - @bci=453, line=944 (Interpreted
>  - @bci=126, line=95 (Interpreted
>  - org.apache.hive.service.cli.session.HiveSessionImpl.executeStatement(java.lang.String,
java.util.Map) @bci=19, line=168 (Interpreted frame)
>  - org.apache.hive.service.cli.CLIService.executeStatement(org.apache.hive.service.cli.SessionHandle,
java.lang.String, java.util.Map) @bci=10, line=153 (Interpreted frame)
>  - org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(org.apache.hive.service.cli.thrift.TExecuteStatementReq)
@bci=41, line=190 (Interpreted frame)
>  - org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(org.apache.hive.service.cli.thrift.TCLIService$Iface,
org.apache.hive.service.cli.thrift.TCLIService$ExecuteStatement_args) @bci=14, line=1133 (Interpreted
> {noformat}

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message