ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Evgenii Zhuravlev <e.zhuravlev...@gmail.com>
Subject Re: Cache was inconsistent state
Date Thu, 07 May 2020 17:14:30 GMT
Hi,

It looks like the third server node was not a part of this cluster before
restart. Can you share full logs from all server nodes?

Evgenii

чт, 7 мая 2020 г. в 09:11, John Smith <java.dev.mtl@gmail.com>:

> Hi, running 2.7.0 on 3 deployed on VMs running Ubuntu.
>
> I checked the state of the cluster by going to: /ignite?cmd=currentState
> And the response was: {"successStatus":0,"error":null,"sessionToken":null,"response":true}
> I also checked: /ignite?cmd=size&cacheName=....
>
> 2 nodes where reporting 3 million records
> 1 node was reporting 2 million records.
>
> When I connected to visor and ran the node command... The details where
> wrong as it only showed 2 server nodes and only 1 client, but 3 server
> nodes actually exist and more clients are connected.
>
> So I rebooted the node that was claiming 2 million records instead of 3
> and when I re-ran the node command displayed all the proper nodes.
> Also after the reboot all the nodes started reporting 2 million records
> instead of 3 million so there some sort of rebalancing or correction (the
> cache has a 90 day TTL)?
>
>
>
> Before reboot
>
> +=============================================================================================================================+
> | # |       Node ID8(@), IP       |            Consistent ID             |
> Node Type | Up Time  | CPUs | CPU Load | Free Heap |
>
> +=============================================================================================================================+
> | 0 | xxxxxx(@n0), xxxxxx.69 | xxxxxx | Server    | 20:25:30 | 4    | 1.27
> %   | 84.00 %   |
> | 1 | xxxxxx(@n1), xxxxxx.1 | xxxxxx | Client    | 13:12:01 | 3    | 0.67
> %   | 74.00 %   |
> | 2 | xxxxxx(@n2), xxxxxx.63 | xxxxxx | Server    | 16:55:05 | 4    | 6.57
> %   | 84.00 %   |
>
> +-----------------------------------------------------------------------------------------------------------------------------+
>
> After reboot
>
> +=============================================================================================================================+
> | # |       Node ID8(@), IP       |            Consistent ID             |
> Node Type | Up Time  | CPUs | CPU Load | Free Heap |
>
> +=============================================================================================================================+
> | 0 | xxxxxx(@n0), xxxxxx.69 | xxxxxx | Server    | 21:13:45 | 4    | 0.77
> %   | 56.00 %   |
> | 1 | xxxxxx(@n1), xxxxxx.1 | xxxxxx | Client    | 14:00:17 | 3    | 0.77
> %   | 56.00 %   |
> | 2 | xxxxxx(@n2), xxxxxx.63 | xxxxxx | Server    | 17:43:20 | 4    | 1.00
> %   | 60.00 %   |
> | 3 | xxxxxx(@n3), xxxxxx.65 | xxxxxx | Client    | 01:42:45 | 4    | 4.10
> %   | 56.00 %   |
> | 4 | xxxxxx(@n4), xxxxxx.65 | xxxxxx | Client    | 01:42:45 | 4    | 3.93
> %   | 56.00 %   |
> | 5 | xxxxxx(@n5), xxxxxx.1 | xxxxxx | Client    | 16:59:53 | 2    | 0.67
> %   | 91.00 %   |
> | 6 | xxxxxx(@n6), xxxxxx.79 | xxxxxx | Server    | 00:41:31 | 4    | 1.00
> %   | 97.00 %   |
>
> +-----------------------------------------------------------------------------------------------------------------------------+
>

Mime
View raw message