hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <>
Subject [jira] [Commented] (HIVE-4132) Connection to Zookeeper is created for each client of HS2
Date Wed, 06 Mar 2013 19:58:12 GMT


Brock Noland commented on HIVE-4132:

Setting maxClientCnxns to a high number in zoo.cfg works around this issue. However, since
the Zookeeper object itself is thread safe (except for a few methods noted here
it might make sense to use a single object or a pool of objects.
> Connection to Zookeeper is created for each client of HS2
> ---------------------------------------------------------
>                 Key: HIVE-4132
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Server Infrastructure
>            Reporter: Brock Noland
>              Labels: HiveServer2
> Currently when concurrency is enabled and HS2 is used each client will have a connection
to Zookeeper. Zookeeper has a property, maxClientCnxns, in the zoo.cfg which limits the number
of connections *per* host to a low number like 50. The stack trace of the threads accessing
zookeeper is below for reference.
> {noformat}
> - org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager.lock(java.util.List,
boolean) @bci=94, line=220 (Interpreted frame)
>  - org.apache.hadoop.hive.ql.Driver.acquireReadWriteLocks() @bci=428, line=834 (Interpreted
>  - @bci=453, line=944 (Interpreted
>  - @bci=126, line=95 (Interpreted
>  - org.apache.hive.service.cli.session.HiveSessionImpl.executeStatement(java.lang.String,
java.util.Map) @bci=19, line=168 (Interpreted frame)
>  - org.apache.hive.service.cli.CLIService.executeStatement(org.apache.hive.service.cli.SessionHandle,
java.lang.String, java.util.Map) @bci=10, line=153 (Interpreted frame)
>  - org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(org.apache.hive.service.cli.thrift.TExecuteStatementReq)
@bci=41, line=190 (Interpreted frame)
>  - org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(org.apache.hive.service.cli.thrift.TCLIService$Iface,
org.apache.hive.service.cli.thrift.TCLIService$ExecuteStatement_args) @bci=14, line=1133 (Interpreted
> {noformat}

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message