zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Cameron McKenzie <cammcken...@apache.org>
Subject ZOOKEEPER-706
Date Wed, 03 Feb 2016 23:40:07 GMT
Guys,
We have an application that potentially has over 100k watches at a given
time, and we're running into ZOOKEEPER-706 (
https://issues.apache.org/jira/browse/ZOOKEEPER-706) when reconnecting to
the cluster.

We tried upgrading the client to 3.4.7 (and upgraded the server also even
though looking at the patch I believe it should be a client only fix), but
we're still getting the same problem.

Logs during reconnection below:

2016-02-04 09:15:36,035 [myid:1] - INFO  [QuorumPeer[myid=1]/0.0.0.0:2181
:ZooKeeperServer@617] - Established session 0x152a92db7e80000 with
negotiated timeout 10000 for client /10.70.20.57:61918

2016-02-04 09:15:36,193 [myid:1] - WARN  [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxn@362] - Exception causing close of
session 0x152a92db7e80000 due to java.io.IOException: Len error 19780352

2016-02-04 09:15:36,199 [myid:1] - INFO  [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1007] - Closed socket connection for
client /10.70.20.57:61918 which had sessionid 0x152a92db7e80000

2016-02-04 09:15:40,983 [myid:1] - INFO  [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection
from /10.70.20.57:61922

2016-02-04 09:15:40,984 [myid:1] - INFO  [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:ZooKeeperServer@861] - Client attempting to renew
session 0x152a92db7e80000 at /10.70.20.57:61922

2016-02-04 09:15:40,984 [myid:1] - INFO  [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:Learner@108] - Revalidating client: 0x152a92db7e80000

2016-02-04 09:15:40,986 [myid:1] - INFO  [QuorumPeer[myid=1]/0.0.0.0:2181
:ZooKeeperServer@617] - Established session 0x152a92db7e80000 with
negotiated timeout 10000 for client /10.70.20.57:61922

2016-02-04 09:15:50,713 [myid:1] - WARN  [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxn@362] - Exception causing close of
session 0x152a92db7e80000 due to java.io.IOException: Len error 959591480

2016-02-04 09:15:50,737 [myid:1] - INFO  [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1007] - Closed socket connection for
client /10.70.20.57:61922 which had sessionid 0x152a92db7e80000

2016-02-04 09:16:37,401 [myid:1] - INFO  [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection
from /10.70.20.57:61934

2016-02-04 09:16:37,411 [myid:1] - INFO  [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:ZooKeeperServer@861] - Client attempting to renew
session 0x152a92db7e80000 at /10.70.20.57:61934

2016-02-04 09:16:37,412 [myid:1] - INFO  [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:Learner@108] - Revalidating client: 0x152a92db7e80000

2016-02-04 09:16:37,413 [myid:1] - INFO  [QuorumPeer[myid=1]/0.0.0.0:2181
:ZooKeeperServer@617] - Established session 0x152a92db7e80000 with
negotiated timeout 10000 for client /10.70.20.57:61934

2016-02-04 09:16:44,187 [myid:1] - WARN  [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:ZooKeeperServer@675] - Received packet at server of
unknown type 1024

2016-02-04 09:16:44,187 [myid:1] - WARN  [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxn@362] - Exception causing close of
session 0x152a92db7e80000 due to java.io.IOException: Len error 1293960047

2016-02-04 09:16:44,199 [myid:1] - INFO  [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1007] - Closed socket connection for
client /10.70.20.57:61934 which had sessionid 0x152a92db7e80000

2016-02-04 09:16:48,862 [myid:1] - INFO  [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection
from /10.70.20.57:61938

2016-02-04 09:16:48,870 [myid:1] - INFO  [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:ZooKeeperServer@861] - Client attempting to renew
session 0x152a92db7e80000 at /10.70.20.57:61938

2016-02-04 09:16:48,870 [myid:1] - INFO  [NIOServerCxn.Factory:
0.0.0.0/0.0.0.0:2181:Learner@108] - Revalidating client: 0x152a92db7e80000

2016-02-04 09:16:48,872 [myid:1] - INFO  [QuorumPeer[myid=1]/0.0.0.0:2181
:ZooKeeperServer@617] - Established session 0x152a92db7e80000 with
negotiated timeout 10000 for client /10.70.20.57:61938


Any ideas?

cheers

Cam

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message