incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From pob <peterob...@gmail.com>
Subject Re: what kind of bug?
Date Fri, 25 Mar 2011 13:03:45 GMT
Hi,

from the node log that has inconsistent view -there is

 INFO [ScheduledTasks:1] 2011-03-25 10:27:31,089 Gossiper.java (line 224)
InetAddress /XXX is now dead.

But from that node i can telnet/ping XXX on 9160,7000

Thats strange.





2011/3/23 Dave Viner <daveviner@gmail.com>

> I saw this once when my servers ran out of file descriptors.  This caused
> totally weird problems.
>
> Make sure all nodes in the cluster are listening on the gossip port (7000
> by default).
>
> Also check out
> http://www.datastax.com/docs/0.7/troubleshooting/index#view-of-ring-differs-between-some-nodesor
> http://www.datastax.com/docs/0.6/troubleshooting/index#view-of-ring-differs-between-some-nodes
>
> depending on your version.
>
> On Wed, Mar 23, 2011 at 11:39 AM, Aaron Morton <aaron@thelastpickle.com>wrote:
>
>> First thing is check the logs on host 1. Check the view of the ring from
>> all other nodes in the cluster, do they think nodes 2 and 3 are also down?
>> Then confirm all nodes have the same config for listen port and all nodes
>> can telnet to the listen port for the other nodes.
>>
>> I'm guessing the insert fails for some inserts because you are working at
>> Quorum and your replication factor is less than 5.
>>
>> Aaron
>> On 23/03/2011, at 11:31 PM, pob <peterob333@gmail.com> wrote:
>>
>> > Hello,
>> >
>> > what kind of bug is it?
>> >
>> >
>> > If I do nodetool host1 ring, the output is:
>> >
>> > Address         Status State   Load            Owns    Token
>> >
>>  141784319550391026443072753096570088105
>> > 1.174  Up     Normal  4.14 GB         16.67%  0
>> > 1.173  Down   Normal  4.07 GB         16.67%
>>  28356863910078205288614550619314017621
>> > 1.172  Down   Normal  4.1 GB          16.67%
>>  56713727820156410577229101238628035242
>> > 1.179  Up     Normal  4.05 GB         16.67%
>>  85070591730234615865843651857942052863
>> > 1.175  Up     Normal  4.13 GB         16.67%
>>  113427455640312821154458202477256070484
>> > 1.177  Up     Normal  4.12 GB         16.67%
>>  141784319550391026443072753096570088105
>> >
>> >
>> > but if I do nodetool host3 ring, the output is:
>> >
>> > Address         Status State   Load            Owns    Token
>> >
>>  141784319550391026443072753096570088105
>> > 1.174  Up     Normal  4.14 GB         16.67%  0
>> > 1.173  Up   Normal  4.07 GB         16.67%
>>  28356863910078205288614550619314017621
>> > 1.172  Up   Normal  4.1 GB          16.67%
>>  56713727820156410577229101238628035242
>> > 1.179  Up     Normal  4.05 GB         16.67%
>>  85070591730234615865843651857942052863
>> > 1.175  Up     Normal  4.13 GB         16.67%
>>  113427455640312821154458202477256070484
>> > 1.177  Up     Normal  4.12 GB         16.67%
>>  141784319550391026443072753096570088105
>> >
>> >
>> > Some nodes see some nodes Down, and its impossible to do correct insert.
>> The cassandra is running on nodes that is matched "down".
>> >
>> >
>> > Any ideas? Thanks
>> >
>> >
>> > Best,
>> > Peter
>> >
>> >
>>
>
>

Mime
View raw message