From issues-return-10081-archive-asf-public=cust-asf.ponee.io@ratis.incubator.apache.org Sun Jun 28 07:31:02 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 68B7318066D for ; Sun, 28 Jun 2020 09:31:02 +0200 (CEST) Received: (qmail 48607 invoked by uid 500); 28 Jun 2020 07:31:01 -0000 Mailing-List: contact issues-help@ratis.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ratis.incubator.apache.org Delivered-To: mailing list issues@ratis.incubator.apache.org Received: (qmail 48575 invoked by uid 99); 28 Jun 2020 07:31:01 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 28 Jun 2020 07:31:01 +0000 Received: from jira-he-de.apache.org (static.172.67.40.188.clients.your-server.de [188.40.67.172]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id DA55C40963 for ; Sun, 28 Jun 2020 07:31:00 +0000 (UTC) Received: from jira-he-de.apache.org (localhost.localdomain [127.0.0.1]) by jira-he-de.apache.org (ASF Mail Server at jira-he-de.apache.org) with ESMTP id 208B47805C9 for ; Sun, 28 Jun 2020 07:31:00 +0000 (UTC) Date: Sun, 28 Jun 2020 07:31:00 +0000 (UTC) From: "runzhiwang (Jira)" To: issues@ratis.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (RATIS-988) Update follower next when receive heartbeat reply MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/RATIS-988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated RATIS-988: ----------------------------- Issue Type: Improvement (was: Bug) > Update follower next when receive heartbeat reply > ------------------------------------------------- > > Key: RATIS-988 > URL: https://issues.apache.org/jira/browse/RATIS-988 > Project: Ratis > Issue Type: Improvement > Reporter: runzhiwang > Assignee: runzhiwang > Priority: Major > > client receive org.apache.ratis.protocol.NotLeaderException: Server s1@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, but it did not change leader to s0. > {code:java} > 2020-06-26T04:32:37.6394628Z 2020-06-26 04:32:37,638 [Thread-450] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s1@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s1@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s1@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s1:c132, s0:c132, s2:c132] > 2020-06-26T04:32:40.8611959Z 2020-06-26 04:32:40,860 [Thread-536] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s2@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s2:c132, s0:c132, s1:c132] > 2020-06-26T04:32:42.2757200Z 2020-06-26 04:32:42,274 [Timer-0] INFO ratis.MiniRaftCluster (MiniRaftCluster.java:lambda$null$5(297)) - TIMED-PRINT: printing ALL groups > 2020-06-26T04:32:42.2758497Z s0: RUNNING LEADER s0@group-B309CD2D8643:t2, leader=s0, voted=s0, raftlog=s0@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f133,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:32:42.2759383Z s1: RUNNING FOLLOWER s1@group-B309CD2D8643:t2, leader=s0, voted=null, raftlog=s1@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f132,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:32:42.2760258Z s2: RUNNING FOLLOWER s2@group-B309CD2D8643:t2, leader=s0, voted=s0, raftlog=s2@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f132,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:32:44.1652305Z 2020-06-26 04:32:44,164 [Thread-624] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s2@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s2:c132, s0:c132, s1:c132] > 2020-06-26T04:32:47.3785586Z 2020-06-26 04:32:47,377 [Thread-710] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s2@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s2:c132, s0:c132, s1:c132] > 2020-06-26T04:32:50.5979127Z 2020-06-26 04:32:50,596 [Thread-797] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s2@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s2:c132, s0:c132, s1:c132] > 2020-06-26T04:32:52.2754050Z 2020-06-26 04:32:52,273 [Timer-0] INFO ratis.MiniRaftCluster (MiniRaftCluster.java:lambda$null$5(297)) - TIMED-PRINT: printing ALL groups > 2020-06-26T04:32:52.2754863Z s0: RUNNING LEADER s0@group-B309CD2D8643:t2, leader=s0, voted=s0, raftlog=s0@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f133,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:32:52.2755536Z s1: RUNNING FOLLOWER s1@group-B309CD2D8643:t2, leader=s0, voted=null, raftlog=s1@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f132,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:32:52.2756213Z s2: RUNNING FOLLOWER s2@group-B309CD2D8643:t2, leader=s0, voted=s0, raftlog=s2@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f132,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:32:53.8130061Z 2020-06-26 04:32:53,811 [Thread-884] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s2@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s2:c132, s0:c132, s1:c132] > 2020-06-26T04:32:57.1807590Z 2020-06-26 04:32:57,179 [Thread-976] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s1@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s1@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s1@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s1:c132, s0:c132, s2:c132] > 2020-06-26T04:33:00.3976035Z 2020-06-26 04:33:00,396 [Thread-1063] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s1@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s1@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s1@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s1:c132, s0:c132, s2:c132] > 2020-06-26T04:33:02.2749045Z 2020-06-26 04:33:02,273 [Timer-0] INFO ratis.MiniRaftCluster (MiniRaftCluster.java:lambda$null$5(297)) - TIMED-PRINT: printing ALL groups > 2020-06-26T04:33:02.2750140Z s0: RUNNING LEADER s0@group-B309CD2D8643:t2, leader=s0, voted=s0, raftlog=s0@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f133,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:33:02.2750847Z s1: RUNNING FOLLOWER s1@group-B309CD2D8643:t2, leader=s0, voted=null, raftlog=s1@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f132,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:33:02.2751499Z s2: RUNNING FOLLOWER s2@group-B309CD2D8643:t2, leader=s0, voted=s0, raftlog=s2@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f132,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:33:03.6146366Z 2020-06-26 04:33:03,613 [Thread-1150] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s2@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s2:c132, s0:c132, s1:c132] > 2020-06-26T04:33:06.8321037Z 2020-06-26 04:33:06,831 [Thread-1237] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s1@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s1@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s1@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s1:c132, s0:c132, s2:c132] > 2020-06-26T04:33:10.2640359Z 2020-06-26 04:33:10,263 [Thread-1327] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s2@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s2:c132, s0:c132, s1:c132] > 2020-06-26T04:33:12.2753778Z 2020-06-26 04:33:12,273 [Timer-0] INFO ratis.MiniRaftCluster (MiniRaftCluster.java:lambda$null$5(297)) - TIMED-PRINT: printing ALL groups > 2020-06-26T04:33:12.2754582Z s0: RUNNING LEADER s0@group-B309CD2D8643:t2, leader=s0, voted=s0, raftlog=s0@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f133,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:33:12.2755259Z s1: RUNNING FOLLOWER s1@group-B309CD2D8643:t2, leader=s0, voted=null, raftlog=s1@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f132,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:33:12.2755932Z s2: RUNNING FOLLOWER s2@group-B309CD2D8643:t2, leader=s0, voted=s0, raftlog=s2@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f132,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:33:13.4787369Z 2020-06-26 04:33:13,477 [Thread-1414] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s2@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s2:c132, s0:c132, s1:c132] > 2020-06-26T04:33:16.7024358Z 2020-06-26 04:33:16,699 [Thread-1501] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s1@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s1@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s1@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s1:c132, s0:c132, s2:c132] > 2020-06-26T04:33:19.9173011Z 2020-06-26 04:33:19,916 [Thread-1588] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s2@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s2:c132, s0:c132, s1:c132] > 2020-06-26T04:33:22.2758152Z 2020-06-26 04:33:22,274 [Timer-0] INFO ratis.MiniRaftCluster (MiniRaftCluster.java:lambda$null$5(297)) - TIMED-PRINT: printing ALL groups > 2020-06-26T04:33:22.2758994Z s0: RUNNING LEADER s0@group-B309CD2D8643:t2, leader=s0, voted=s0, raftlog=s0@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f133,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:33:22.2760683Z s1: RUNNING FOLLOWER s1@group-B309CD2D8643:t2, leader=s0, voted=null, raftlog=s1@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f132,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:33:22.2761645Z s2: RUNNING FOLLOWER s2@group-B309CD2D8643:t2, leader=s0, voted=s0, raftlog=s2@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f132,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:33:23.2077420Z 2020-06-26 04:33:23,206 [Thread-1677] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s2@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s2:c132, s0:c132, s1:c132] > 2020-06-26T04:33:26.4214334Z 2020-06-26 04:33:26,420 [Thread-1763] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s1@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s1@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s1@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s1:c132, s0:c132, s2:c132] > 2020-06-26T04:33:29.6350401Z 2020-06-26 04:33:29,633 [Thread-1850] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s2@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s2:c132, s0:c132, s1:c132] > 2020-06-26T04:33:32.2761706Z 2020-06-26 04:33:32,274 [Timer-0] INFO ratis.MiniRaftCluster (MiniRaftCluster.java:lambda$null$5(297)) - TIMED-PRINT: printing ALL groups > 2020-06-26T04:33:32.2762405Z s0: RUNNING LEADER s0@group-B309CD2D8643:t2, leader=s0, voted=s0, raftlog=s0@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f133,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:33:32.2762936Z s1: RUNNING FOLLOWER s1@group-B309CD2D8643:t2, leader=s0, voted=null, raftlog=s1@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f132,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:33:32.2763447Z s2: RUNNING FOLLOWER s2@group-B309CD2D8643:t2, leader=s0, voted=s0, raftlog=s2@group-B309CD2D8643-SegmentedRaftLog:OPENED:c132,f132,i133, conf=0: [s0:0.0.0.0:43317, s1:0.0.0.0:35077, s2:0.0.0.0:39141], old=null RUNNING > 2020-06-26T04:33:32.8521952Z 2020-06-26 04:33:32,851 [Thread-1937] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s1@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s1@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s1@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s1:c132, s0:c132, s2:c132] > 2020-06-26T04:33:36.0889022Z 2020-06-26 04:33:36,086 [Thread-2025] INFO client.GrpcClientProtocolService (GrpcClientProtocolService.java:lambda$processClientRequest$0(283)) - Failed RaftClientRequest:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, seq=0, RW, Message:6d3636, reply=RaftClientReply:client-54283F516BF5->s2@group-B309CD2D8643, cid=66, FAILED org.apache.ratis.protocol.NotLeaderException: Server s2@group-B309CD2D8643 is not the leader s0:0.0.0.0:43317, logIndex=0, commits[s2:c132, s0:c132, s1:c132] > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)