incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From S C <as...@outlook.com>
Subject gossip not working
Date Thu, 04 Apr 2013 23:11:36 GMT
I was in the middle of upgrade to 1.1.9. I brought one node with 1.1.9 while the other were
running on 1.1.5. Once one of the node was on 1.1.9 it is no longer recognizing other nodes
in the ring.
On 192.168.56.10 and 11
192.168.56.10  DC1-Cass    RAC1        Up     Normal  28.06 GB        50.00%             
0                                           192.168.56.11  DC1-Cass    RAC1        Up    
Normal  31.59 GB        25.00%              42535295865117307932921825928971026432      192.168.56.12
 DC1-Cass    RAC1        Down   Normal  29.02 GB        25.00%              85070591730234615865843651857942052864
   

On 192.168.56.12
192.168.56.10  DC1-Cass    RAC1        Down     Normal  28.06 GB        50.00%           
  0                                           192.168.56.11  DC1-Cass    RAC1        Down
    Normal  31.59 GB        25.00%              42535295865117307932921825928971026432   
  192.168.56.12  DC1-Cass    RAC1        Up   Normal  29.02 GB        25.00%             
85070591730234615865843651857942052864    

I do not see anything in the logs that tells me that there is a gossip issue.
nodetool infoToken            : 85070591730234615865843651857942052864Gossip active    : trueThrift
active    : trueLoad             : 29.05 GBGeneration No    : 1365114563Uptime (seconds) :
2127Heap Memory (MB) : 848.71 / 7945.94Exceptions       : 0Key Cache        : size 2208 (bytes),
capacity 104857584 (bytes), 1056 hits, 1099 requests, 0.961 recent hit rate, 14400 save period
in secondsRow Cache        : size 0 (bytes), capacity 0 (bytes), 0 hits, 0 requests, NaN recent
hit rate, 0 save period in seconds
nodetool infoToken            : 42535295865117307932921825928971026432Gossip active    : trueThrift
active    : trueLoad             : 31.59 GBGeneration No    : 1364413038Uptime (seconds) :
703904Heap Memory (MB) : 733.02 / 7945.94Exceptions       : 1Key Cache        : size 3693312
(bytes), capacity 104857584 (bytes), 26071678 hits, 26616282 requests, 0.980 recent hit rate,
14400 save period in secondsRow Cache        : size 0 (bytes), capacity 0 (bytes), 0 hits,
0 requests, NaN recent hit rate, 0 save period in seconds


There is no firewall between the nodes and I can reach each other on storage port. What else
should I be looking at to find root cause? Appreciate your inputs. 		 	   		  
Mime
View raw message