hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jean-Daniel Cryans (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-3773) Set ZK max connections much higher in 0.90
Date Tue, 12 Apr 2011 22:00:05 GMT

    [ https://issues.apache.org/jira/browse/HBASE-3773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019072#comment-13019072
] 

Jean-Daniel Cryans commented on HBASE-3773:
-------------------------------------------

I tried creating as many connections as I could in the shell on my MBP using a line like this:

bq. 3000.times { HTable.isTableEnabled("t") }

During that time I also monitored the total number of threads used by ZK and by the shell.
What happens is that the server doesn't create new threads, only the client does, and it eventually
dies of OOME unable to create new threads.

I wouldn't mind setting the max connections lower, like to a number just under MBP's default
max number of threads, so that we would hit the ConnectionLoss before OOME.

> Set ZK max connections much higher in 0.90
> ------------------------------------------
>
>                 Key: HBASE-3773
>                 URL: https://issues.apache.org/jira/browse/HBASE-3773
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 0.90.2
>            Reporter: Jean-Daniel Cryans
>            Priority: Blocker
>             Fix For: 0.90.3
>
>
> I think by now we can all acknowledge that 0.90 has an issue with ZK connections, in
that we create too many of them and it's also too easy for our users to shoot themselves in
the foot.
> For 0.90.3, I think we should change the default configuration of 30 that we ship with
and set it much much higher, I'm thinking of 32k.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message