[DEBUG] [04/11/2024 01:14:14.778] [main] [EventStream(akka://test)] logger log1-TestEventListener started
01:14:14,779 AM [test-akka.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started
[DEBUG] [04/11/2024 01:14:14.781] [main] [EventStream(akka://test)] logger log2-Slf4jLogger started
[DEBUG] [04/11/2024 01:14:14.781] [main] [EventStream(akka://test)] Default Loggers started
01:14:14,798 AM [test-akka.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.171.228:25520] with UID [496984428200904475]
[INFO] [04/11/2024 01:14:14.798] [main] [ArteryTransport(akka://test)] Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.171.228:25520] with UID [496984428200904475]
[INFO] [04/11/2024 01:14:14.799] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.228:25520] - Starting up, Akka version [2.6.21] ...
01:14:14,799 AM [test-akka.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [akka://test@10.30.171.228:25520] - Starting up, Akka version [2.6.21] ...
[INFO] [04/11/2024 01:14:14.802] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.228:25520] - Registered cluster JMX MBean [akka:type=Cluster]
[INFO] [04/11/2024 01:14:14.802] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.228:25520] - Started up successfully
01:14:14,806 AM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.171.228:25520] - Registered cluster JMX MBean [akka:type=Cluster]
01:14:14,806 AM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.171.228:25520] - Started up successfully
01:14:14,810 AM [test-akka.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [akka://test@10.30.171.228:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
01:14:14,810 AM [test-akka.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [akka://test@10.30.171.228:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
[INFO] [04/11/2024 01:14:14.809] [test-akka.actor.internal-dispatcher-2] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.228:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
[INFO] [04/11/2024 01:14:14.809] [test-akka.actor.internal-dispatcher-2] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.228:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
01:14:14,814 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferAborted starting
01:14:14,814 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [04/11/2024 01:14:14.817] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower646]: org.opendaylight.controller.cluster.common.actor.Monitor@46a50a2e
01:14:14,817 AM [test-akka.actor.default-dispatcher-7] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower646] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [akkaDeadLetter][04/11/2024 01:14:14.817] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower646] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:14:14,819 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower646 with journal batch size 1000
01:14:14,819 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower646: SnapshotOffer called.
01:14:14,820 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower646: Moving last applied index from -1 to -1
01:14:14,820 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower646: Set currentTerm=1, votedFor=null
01:14:14,820 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower646: Updated server config: isVoting: true, peers: [PeerInfo [id=follower648, address=akka://test/user/follower648, votingState=NON_VOTING], PeerInfo [id=leader645, address=akka://test/user/leader645, votingState=VOTING], PeerInfo [id=follower647, address=akka://test/user/follower647, votingState=VOTING]]
01:14:14,820 AM [test-akka.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower646 in 60.04 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:14,821 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower646: Recovery completed  in 903.5 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:14,821 AM [test-akka.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower647 with journal batch size 1000
01:14:14,821 AM [test-akka.actor.default-dispatcher-7] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower647] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[WARN] [04/11/2024 01:14:14.821] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower647]: org.opendaylight.controller.cluster.common.actor.Monitor@89b89ad
[INFO] [akkaDeadLetter][04/11/2024 01:14:14.821] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower647] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:14:14,822 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower647: SnapshotOffer called.
01:14:14,822 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower647: Moving last applied index from -1 to -1
01:14:14,822 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower647: Set currentTerm=1, votedFor=null
01:14:14,822 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower647: Updated server config: isVoting: true, peers: [PeerInfo [id=follower648, address=akka://test/user/follower648, votingState=NON_VOTING], PeerInfo [id=leader645, address=akka://test/user/leader645, votingState=VOTING], PeerInfo [id=follower646, address=akka://test/user/follower646, votingState=VOTING]]
01:14:14,822 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower647 in 78.14 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:14,823 AM [test-akka.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower647: Recovery completed  in 791.1 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [04/11/2024 01:14:14.823] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower648]: org.opendaylight.controller.cluster.common.actor.Monitor@13e35355
01:14:14,823 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower648 with journal batch size 1000
[INFO] [akkaDeadLetter][04/11/2024 01:14:14.823] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower648] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:14:14,824 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower648: SnapshotOffer called.
01:14:14,824 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower648: Moving last applied index from -1 to -1
01:14:14,824 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower648: Set currentTerm=1, votedFor=null
01:14:14,824 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower648: Updated server config: isVoting: false, peers: [PeerInfo [id=leader645, address=akka://test/user/leader645, votingState=VOTING], PeerInfo [id=follower647, address=akka://test/user/follower647, votingState=VOTING], PeerInfo [id=follower646, address=akka://test/user/follower646, votingState=VOTING]]
01:14:14,824 AM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower648 in 41.53 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:14,825 AM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower648: Recovery completed  in 1.014 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:14,829 AM [test-akka.actor.default-dispatcher-15] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower648] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[WARN] [04/11/2024 01:14:14.925] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader645]: org.opendaylight.controller.cluster.common.actor.Monitor@766c2df1
01:14:14,926 AM [test-akka.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/leader645] to Actor[akka://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [akkaDeadLetter][04/11/2024 01:14:14.926] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/leader645] to Actor[akka://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:14:14,927 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader645 with journal batch size 1000
01:14:14,928 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645: SnapshotOffer called.
01:14:14,928 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645: Moving last applied index from -1 to -1
01:14:14,928 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645: Set currentTerm=1, votedFor=null
01:14:14,928 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645: Updated server config: isVoting: true, peers: [PeerInfo [id=follower648, address=akka://test/user/follower648, votingState=NON_VOTING], PeerInfo [id=follower647, address=akka://test/user/follower647, votingState=VOTING], PeerInfo [id=follower646, address=akka://test/user/follower646, votingState=VOTING]]
01:14:14,928 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader645 in 92.81 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:14,929 AM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader645: Recovery completed  in 1.104 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:15,333 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:15,333 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.171.228:25520, Removed)
01:14:15,333 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Follower): Received ElectionTimeout - switching to Candidate
01:14:15,333 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Candidate): Election: Candidate has following voting peers: [follower647, follower646]
01:14:15,333 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645: Set currentTerm=2, votedFor=leader645
01:14:15,334 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Candidate): Starting new election term 2
01:14:15,334 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Candidate): Sending RequestVote [term=2, candidateId=leader645, lastLogIndex=-1, lastLogTerm=-1] to peer follower647
01:14:15,334 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Candidate): Sending RequestVote [term=2, candidateId=leader645, lastLogIndex=-1, lastLogTerm=-1] to peer follower646
01:14:15,334 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
01:14:15,334 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower647 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:15,334 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower647 (Follower): Cluster state: []
01:14:15,334 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower647 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader645, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
01:14:15,334 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower647 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader645, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
01:14:15,334 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower647: Set currentTerm=2, votedFor=null
01:14:15,335 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower647 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader645, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
01:14:15,335 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower646 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:15,335 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower647: Set currentTerm=2, votedFor=leader645
01:14:15,335 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower646 (Follower): Cluster state: []
01:14:15,335 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower646 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader645, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
01:14:15,335 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower647 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
01:14:15,335 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower646 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader645, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
01:14:15,335 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower646: Set currentTerm=2, votedFor=null
01:14:15,335 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower646 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader645, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
01:14:15,335 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower646: Set currentTerm=2, votedFor=leader645
01:14:15,335 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower646 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
01:14:15,342 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2
01:14:15,342 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1
01:14:15,342 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Leader): Election: Leader has following peers: [follower648, follower647, follower646]
01:14:15,342 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Leader): Checking sendAppendEntries for follower follower648: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:15,342 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Leader): Checking sendAppendEntries for follower follower647: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:15,342 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Leader): Checking sendAppendEntries for follower follower646: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:15,342 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
01:14:15,342 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower648 (Follower): Term 2 in "AppendEntries [leaderId=leader645, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term
01:14:15,342 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower648: Set currentTerm=2, votedFor=null
01:14:15,342 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower648: Last sync leader does not match current leader leader645, need to catch up to -1
01:14:15,342 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower648 updated: matchIndex: -1, nextIndex: 0
01:14:15,343 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Leader): Checking sendAppendEntries for follower follower648: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:15,343 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower647: Last sync leader does not match current leader leader645, need to catch up to -1
01:14:15,343 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower646: Last sync leader does not match current leader leader645, need to catch up to -1
01:14:15,343 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower647 updated: matchIndex: -1, nextIndex: 0
[WARN] [04/11/2024 01:14:15.343] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower647] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@10fa26c4
[WARN] [04/11/2024 01:14:15.343] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower646] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@358f2ec
01:14:15,343 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Leader): Checking sendAppendEntries for follower follower647: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:15,343 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower646 updated: matchIndex: -1, nextIndex: 0
[INFO] [akkaDeadLetter][04/11/2024 01:14:15.343] [test-akka.actor.default-dispatcher-18] [akka://test/user/follower647] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower647] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:14:15,343 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Leader): Checking sendAppendEntries for follower follower646: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[INFO] [akkaDeadLetter][04/11/2024 01:14:15.343] [test-akka.actor.default-dispatcher-18] [akka://test/user/follower646] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower646] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:14:15,343 AM [test-akka.actor.default-dispatcher-18] [INFO] TestActorRef - Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower647] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:14:15,343 AM [test-akka.actor.default-dispatcher-18] [INFO] TestActorRef - Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower646] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:14:15,344 AM [test-akka.actor.default-dispatcher-15] [INFO] TestActorRef - Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower648] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[WARN] [04/11/2024 01:14:15.344] [test-akka.actor.default-dispatcher-18] [akka://test/user/follower648] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@3bbaac49
[INFO] [akkaDeadLetter][04/11/2024 01:14:15.344] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower648] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower648] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:14:15,383 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
01:14:15,383 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/leader645 starting
01:14:15,386 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645: onShutDown
01:14:15,386 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645: Initiating leader transfer
01:14:15,386 AM [test-akka.actor.default-dispatcher-15] [DEBUG] RaftActorLeadershipTransferCohort - leader645: pauseLeader successfully completed - doing transfer
01:14:15,386 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Leader): Attempting to transfer leadership
01:14:15,386 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower648: onLeaderTransitioning: LeaderTransitioning [leaderId=leader645]
01:14:15,386 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Leader): Checking sendAppendEntries for follower follower648: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:15,386 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Leader): Checking sendAppendEntries for follower follower647: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:15,386 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Leader): Checking sendAppendEntries for follower follower646: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:15,386 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower648: Lagging 0 entries behind leader leader645 and reached -1 (of expected -1)
01:14:15,386 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower647: Lagging 0 entries behind leader leader645 and reached -1 (of expected -1)
01:14:15,386 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower647: onLeaderTransitioning: LeaderTransitioning [leaderId=leader645]
01:14:15,386 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower646: Lagging 0 entries behind leader leader645 and reached -1 (of expected -1)
01:14:15,387 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower646: onLeaderTransitioning: LeaderTransitioning [leaderId=leader645]
[WARN] [04/11/2024 01:14:15.386] [test-akka.actor.default-dispatcher-18] [akka://test/user/follower648] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@641af407
[WARN] [04/11/2024 01:14:15.387] [test-akka.actor.default-dispatcher-18] [akka://test/user/follower647] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@4a3c25a7
01:14:15,387 AM [test-akka.actor.default-dispatcher-18] [INFO] TestActorRef - Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower648] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[WARN] [04/11/2024 01:14:15.387] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower646] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5cd542d1
01:14:15,387 AM [test-akka.actor.default-dispatcher-18] [INFO] TestActorRef - Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower647] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [akkaDeadLetter][04/11/2024 01:14:15.387] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower648] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower648] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [akkaDeadLetter][04/11/2024 01:14:15.387] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower647] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower647] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [akkaDeadLetter][04/11/2024 01:14:15.387] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower646] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower646] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:14:15,387 AM [test-akka.actor.default-dispatcher-15] [INFO] TestActorRef - Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower646] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:14:15,453 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower648: Lagging 0 entries behind leader leader645 and reached -1 (of expected -1)
01:14:15,453 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower647: Lagging 0 entries behind leader leader645 and reached -1 (of expected -1)
01:14:15,454 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower646: Lagging 0 entries behind leader leader645 and reached -1 (of expected -1)
01:14:15,572 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower647: Lagging 0 entries behind leader leader645 and reached -1 (of expected -1)
01:14:15,572 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower648: Lagging 0 entries behind leader leader645 and reached -1 (of expected -1)
01:14:15,572 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower646: Lagging 0 entries behind leader leader645 and reached -1 (of expected -1)
01:14:15,693 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorLeadershipTransferCohort - leader645: leader transfer aborted
01:14:15,693 AM [test-akka.actor.default-dispatcher-16] [WARN] RaftActorLeadershipTransferCohort - leader645: Failed to transfer leadership in 306.7 ms
01:14:15,693 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645: leader transfer failed - sending PoisonPill
01:14:15,693 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader645 (Leader): Leadership transfer expired
01:14:15,693 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower648: Lagging 0 entries behind leader leader645 and reached -1 (of expected -1)
01:14:15,693 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower646: Lagging 0 entries behind leader leader645 and reached -1 (of expected -1)
01:14:15,693 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower647: Lagging 0 entries behind leader leader645 and reached -1 (of expected -1)
[WARN] [04/11/2024 01:14:15.694] [test-akka.actor.default-dispatcher-17] [akka://test/user/leader645] received dead letter from TestActor[akka://test/user/follower646]: AppendEntriesReply [term=2, success=true, followerId=follower646, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
[WARN] [04/11/2024 01:14:15.694] [test-akka.actor.default-dispatcher-17] [akka://test/user/leader645] received dead letter from TestActor[akka://test/user/follower647]: AppendEntriesReply [term=2, success=true, followerId=follower647, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
01:14:15,695 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/leader645 ending
01:14:15,696 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending
01:14:15,696 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower646-notifier649#1588222576]
01:14:15,707 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower646-collector650#-75236173]
01:14:15,707 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower646]
01:14:15,707 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower647-notifier651#-1503801134]
01:14:15,707 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower647-collector652#436581545]
01:14:15,707 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower647]
01:14:15,707 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower648-notifier653#-593196126]
01:14:15,708 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower648-collector654#1798845398]
01:14:15,708 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower648]
01:14:15,708 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader645-notifier655#299947891]
01:14:15,708 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader645-collector656#281766061]
01:14:15,708 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader645]
01:14:15,709 AM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 starting
01:14:15,709 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [04/11/2024 01:14:15.710] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower658]: org.opendaylight.controller.cluster.common.actor.Monitor@2ef4e8ae
01:14:15,710 AM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower658 with journal batch size 1000
[WARN] [04/11/2024 01:14:15.711] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower659]: org.opendaylight.controller.cluster.common.actor.Monitor@4c1fea4b
01:14:15,712 AM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower659 with journal batch size 1000
[WARN] [04/11/2024 01:14:15.712] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower660]: org.opendaylight.controller.cluster.common.actor.Monitor@242011a3
01:14:15,713 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658: SnapshotOffer called.
01:14:15,713 AM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower660 with journal batch size 1000
01:14:15,713 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658: Moving last applied index from -1 to -1
01:14:15,713 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658: Set currentTerm=1, votedFor=null
01:14:15,713 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658: Updated server config: isVoting: true, peers: [PeerInfo [id=follower659, address=akka://test/user/follower659, votingState=VOTING], PeerInfo [id=leader657, address=akka://test/user/leader657, votingState=VOTING], PeerInfo [id=follower660, address=akka://test/user/follower660, votingState=NON_VOTING]]
01:14:15,713 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659: SnapshotOffer called.
01:14:15,713 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659: Moving last applied index from -1 to -1
01:14:15,713 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659: Set currentTerm=1, votedFor=null
01:14:15,713 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659: Updated server config: isVoting: true, peers: [PeerInfo [id=leader657, address=akka://test/user/leader657, votingState=VOTING], PeerInfo [id=follower658, address=akka://test/user/follower658, votingState=VOTING], PeerInfo [id=follower660, address=akka://test/user/follower660, votingState=NON_VOTING]]
01:14:15,713 AM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower658 in 73.18 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:15,713 AM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower659 in 66.76 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:15,713 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower660: SnapshotOffer called.
01:14:15,713 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower660: Moving last applied index from -1 to -1
01:14:15,713 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower660: Set currentTerm=1, votedFor=null
01:14:15,713 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower660: Updated server config: isVoting: false, peers: [PeerInfo [id=follower659, address=akka://test/user/follower659, votingState=VOTING], PeerInfo [id=leader657, address=akka://test/user/leader657, votingState=VOTING], PeerInfo [id=follower658, address=akka://test/user/follower658, votingState=VOTING]]
01:14:15,713 AM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower660 in 26.54 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
[WARN] [04/11/2024 01:14:15.714] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader657]: org.opendaylight.controller.cluster.common.actor.Monitor@67aa4bb7
01:14:15,715 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower658: Recovery completed  in 2.020 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:15,715 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader657 with journal batch size 1000
01:14:15,715 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower659: Recovery completed  in 2.023 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:15,715 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower660: Recovery completed  in 1.894 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:15,716 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657: SnapshotOffer called.
01:14:15,716 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657: Moving last applied index from -1 to -1
01:14:15,716 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657: Set currentTerm=1, votedFor=null
01:14:15,716 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657: Updated server config: isVoting: true, peers: [PeerInfo [id=follower659, address=akka://test/user/follower659, votingState=VOTING], PeerInfo [id=follower658, address=akka://test/user/follower658, votingState=VOTING], PeerInfo [id=follower660, address=akka://test/user/follower660, votingState=NON_VOTING]]
01:14:15,716 AM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader657 in 37.59 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:15,717 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader657: Recovery completed  in 877.7 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:16,42 AM [test-akka.actor.default-dispatcher-17] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:16,43 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.171.228:25520, Removed)
01:14:16,43 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Follower): Received ElectionTimeout - switching to Candidate
01:14:16,43 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Candidate): Election: Candidate has following voting peers: [follower659, follower658]
01:14:16,43 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657: Set currentTerm=2, votedFor=leader657
01:14:16,43 AM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Candidate): Starting new election term 2
01:14:16,43 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Candidate): Sending RequestVote [term=2, candidateId=leader657, lastLogIndex=-1, lastLogTerm=-1] to peer follower659
01:14:16,43 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Candidate): Sending RequestVote [term=2, candidateId=leader657, lastLogIndex=-1, lastLogTerm=-1] to peer follower658
01:14:16,43 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:16,43 AM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
01:14:16,43 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Follower): Cluster state: []
01:14:16,43 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader657, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
01:14:16,43 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader657, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
01:14:16,43 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659: Set currentTerm=2, votedFor=null
01:14:16,43 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:16,43 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658 (Follower): Cluster state: []
01:14:16,43 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader657, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
01:14:16,43 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader657, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
01:14:16,43 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659: Set currentTerm=2, votedFor=leader657
01:14:16,43 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower658 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader657, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
01:14:16,43 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658: Set currentTerm=2, votedFor=null
01:14:16,44 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
01:14:16,44 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader657, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
01:14:16,44 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658: Set currentTerm=2, votedFor=leader657
01:14:16,44 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
01:14:16,44 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2
01:14:16,44 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1
01:14:16,44 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Election: Leader has following peers: [follower659, follower658, follower660]
01:14:16,44 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Checking sendAppendEntries for follower follower659: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,44 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Checking sendAppendEntries for follower follower658: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,44 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Checking sendAppendEntries for follower follower660: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,44 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
01:14:16,45 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower658: Last sync leader does not match current leader leader657, need to catch up to -1
01:14:16,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower659: Last sync leader does not match current leader leader657, need to catch up to -1
01:14:16,45 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower658 updated: matchIndex: -1, nextIndex: 0
01:14:16,45 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Checking sendAppendEntries for follower follower658: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,45 AM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower660 (Follower): Term 2 in "AppendEntries [leaderId=leader657, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term
01:14:16,45 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower660: Set currentTerm=2, votedFor=null
01:14:16,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower659 updated: matchIndex: -1, nextIndex: 0
[WARN] [04/11/2024 01:14:16.045] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower658] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5c7457ad
01:14:16,45 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower660: Last sync leader does not match current leader leader657, need to catch up to -1
01:14:16,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Checking sendAppendEntries for follower follower659: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/11/2024 01:14:16.045] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower659] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@638863d1
01:14:16,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower660 updated: matchIndex: -1, nextIndex: 0
01:14:16,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Checking sendAppendEntries for follower follower660: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/11/2024 01:14:16.045] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower660] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@514bb43f
01:14:16,69 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
01:14:16,69 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
01:14:16,69 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
01:14:16,69 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
01:14:16,70 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
01:14:16,70 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657: onRequestLeadership RequestLeadership [requestedFollowerId=follower659, replyTo=Actor[akka://test/user/$a#251291591]]
01:14:16,71 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657: Initiating leader transfer
01:14:16,71 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader657: pauseLeader successfully completed - doing transfer
01:14:16,71 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Attempting to transfer leadership
01:14:16,72 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658: onLeaderTransitioning: LeaderTransitioning [leaderId=leader657]
01:14:16,72 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Checking sendAppendEntries for follower follower659: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,72 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Checking sendAppendEntries for follower follower658: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,72 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower660: onLeaderTransitioning: LeaderTransitioning [leaderId=leader657]
01:14:16,72 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Checking sendAppendEntries for follower follower660: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,72 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower659: Lagging 0 entries behind leader leader657 and reached -1 (of expected -1)
01:14:16,72 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower658: Lagging 0 entries behind leader leader657 and reached -1 (of expected -1)
01:14:16,72 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659: onLeaderTransitioning: LeaderTransitioning [leaderId=leader657]
01:14:16,72 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower660: Lagging 0 entries behind leader leader657 and reached -1 (of expected -1)
01:14:16,72 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): tryToCompleteLeadershipTransfer: followerId: follower659, matchIndex: -1, lastIndex: -1, isVoting: true
01:14:16,72 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Follower's log matches - sending ElectionTimeout
[WARN] [04/11/2024 01:14:16.072] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower659] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6b323c6c
01:14:16,72 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Checking sendAppendEntries for follower follower659: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/11/2024 01:14:16.072] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower660] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6340b793
[WARN] [04/11/2024 01:14:16.072] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower658] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6fa61d88
01:14:16,72 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Checking sendAppendEntries for follower follower658: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,72 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower659: Lagging 0 entries behind leader leader657 and reached -1 (of expected -1)
01:14:16,72 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Checking sendAppendEntries for follower follower660: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,72 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower658: Lagging 0 entries behind leader leader657 and reached -1 (of expected -1)
01:14:16,72 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower660: Lagging 0 entries behind leader leader657 and reached -1 (of expected -1)
01:14:16,72 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Leader transfer complete
01:14:16,72 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader657: leader transfer complete - waiting for new leader
01:14:16,72 AM [test-akka.actor.default-dispatcher-17] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:16,72 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Follower): Received TimeoutNow - switching to Candidate
01:14:16,72 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Candidate): Election: Candidate has following voting peers: [leader657, follower658]
01:14:16,72 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659: Set currentTerm=3, votedFor=follower659
01:14:16,72 AM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Candidate): Starting new election term 3
01:14:16,72 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Candidate): Sending RequestVote [term=3, candidateId=follower659, lastLogIndex=-1, lastLogTerm=-1] to peer leader657
01:14:16,72 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Candidate): Sending RequestVote [term=3, candidateId=follower659, lastLogIndex=-1, lastLogTerm=-1] to peer follower658
01:14:16,72 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:16,72 AM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
01:14:16,72 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:16,73 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658 (Follower): Cluster state: []
01:14:16,73 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658 (Follower): Candidate in requestVote:RequestVote [term=3, candidateId=follower659, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
01:14:16,73 AM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower658 (Follower): Term 3 in "RequestVote [term=3, candidateId=follower659, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 2 - updating term
01:14:16,73 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Cluster state: []
01:14:16,73 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658: Set currentTerm=3, votedFor=null
01:14:16,73 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Candidate in requestVote:RequestVote [term=3, candidateId=follower659, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
01:14:16,73 AM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Term 3 in "RequestVote [term=3, candidateId=follower659, lastLogIndex=-1, lastLogTerm=-1]" message is greater than leader's term 2 - switching to Follower
01:14:16,73 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657: Set currentTerm=3, votedFor=null
01:14:16,73 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658 (Follower): In requestVote:  RequestVote [term=3, candidateId=follower659, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
01:14:16,73 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658: Set currentTerm=3, votedFor=follower659
01:14:16,73 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower658 (Follower): requestVote returning: RequestVoteReply [term=3, voteGranted=true]
01:14:16,73 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): Leadership transfer in progress - processing RequestVote
01:14:16,73 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): In requestVote:  RequestVote [term=3, candidateId=follower659, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
01:14:16,73 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657: Set currentTerm=3, votedFor=follower659
01:14:16,73 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader): requestVote returning: RequestVoteReply [term=3, voteGranted=true]
01:14:16,73 AM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader657 (Leader) :- Switching from behavior Leader to Follower, election term: 3
01:14:16,73 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Candidate): RaftRPC message received RequestVoteReply [term=3, voteGranted=true], my term is 3
01:14:16,73 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Candidate): handleRequestVoteReply: RequestVoteReply [term=3, voteGranted=true], current voteCount: 1
01:14:16,73 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Leader): Election: Leader has following peers: [leader657, follower658, follower660]
01:14:16,73 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Leader): Checking sendAppendEntries for follower leader657: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,74 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Leader): Checking sendAppendEntries for follower follower658: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,74 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Leader): Checking sendAppendEntries for follower follower660: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,74 AM [test-akka.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
01:14:16,74 AM [test-akka.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower660 (Follower): Term 3 in "AppendEntries [leaderId=follower659, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 2 - updating term
01:14:16,74 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - leader657: Last sync leader does not match current leader follower659, need to catch up to -1
01:14:16,74 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower660: Set currentTerm=3, votedFor=null
01:14:16,74 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower658: Last sync leader does not match current leader follower659, need to catch up to -1
01:14:16,74 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader657: leader changed to follower659
01:14:16,74 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower660: Last sync leader does not match current leader follower659, need to catch up to -1
[WARN] [04/11/2024 01:14:16.074] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower658] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@a88c440
01:14:16,74 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader657 updated: matchIndex: -1, nextIndex: 0
01:14:16,74 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Leader): Checking sendAppendEntries for follower leader657: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,74 AM [test-akka.actor.default-dispatcher-6] [INFO] RaftActorLeadershipTransferCohort - leader657: Successfully transferred leadership to follower659 in 2.507 ms
01:14:16,74 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower658 updated: matchIndex: -1, nextIndex: 0
01:14:16,74 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader657: Leadership transferred successfully to follower659
01:14:16,74 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Leader): Checking sendAppendEntries for follower follower658: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,74 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower660 updated: matchIndex: -1, nextIndex: 0
01:14:16,74 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower659 (Leader): Checking sendAppendEntries for follower follower660: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/11/2024 01:14:16.074] [test-akka.actor.default-dispatcher-6] [akka://test/user/leader657] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@3be9e289
[WARN] [04/11/2024 01:14:16.075] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower660] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@41a85849
01:14:16,125 AM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 ending
01:14:16,125 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower658-notifier661#-1303427719]
01:14:16,136 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower658-collector662#110907863]
01:14:16,136 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower658]
01:14:16,137 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower659-notifier663#1337401430]
01:14:16,137 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower659-collector664#-994697813]
01:14:16,137 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower659]
01:14:16,137 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower660-notifier665#-1419335787]
01:14:16,137 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower660-collector666#-882913809]
01:14:16,138 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower660]
01:14:16,138 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader657-notifier667#338815198]
01:14:16,138 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader657-collector668#-1071409472]
01:14:16,138 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader657]
01:14:16,138 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$a#251291591]
01:14:16,139 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown starting
01:14:16,139 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [04/11/2024 01:14:16.141] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower670]: org.opendaylight.controller.cluster.common.actor.Monitor@683a1537
01:14:16,142 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower670 with journal batch size 1000
01:14:16,142 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower670: SnapshotOffer called.
01:14:16,142 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower670: Moving last applied index from -1 to -1
01:14:16,142 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower670: Set currentTerm=1, votedFor=null
01:14:16,142 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower670: Updated server config: isVoting: true, peers: [PeerInfo [id=leader669, address=akka://test/user/leader669, votingState=VOTING], PeerInfo [id=follower672, address=akka://test/user/follower672, votingState=NON_VOTING], PeerInfo [id=follower671, address=akka://test/user/follower671, votingState=VOTING]]
01:14:16,143 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower670 in 80.41 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:16,144 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower670: Recovery completed  in 1.124 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [04/11/2024 01:14:16.243] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower671]: org.opendaylight.controller.cluster.common.actor.Monitor@263fa1fd
01:14:16,244 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower671 with journal batch size 1000
01:14:16,244 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower671: SnapshotOffer called.
01:14:16,244 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower671: Moving last applied index from -1 to -1
01:14:16,244 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower671: Set currentTerm=1, votedFor=null
01:14:16,244 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower671: Updated server config: isVoting: true, peers: [PeerInfo [id=leader669, address=akka://test/user/leader669, votingState=VOTING], PeerInfo [id=follower670, address=akka://test/user/follower670, votingState=VOTING], PeerInfo [id=follower672, address=akka://test/user/follower672, votingState=NON_VOTING]]
01:14:16,245 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower671 in 94.48 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:16,246 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower671: Recovery completed  in 1.150 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [04/11/2024 01:14:16.246] [test-akka.actor.default-dispatcher-17] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower672]: org.opendaylight.controller.cluster.common.actor.Monitor@6c1216ad
01:14:16,247 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower672 with journal batch size 1000
01:14:16,247 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower672: SnapshotOffer called.
01:14:16,247 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower672: Moving last applied index from -1 to -1
01:14:16,247 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower672: Set currentTerm=1, votedFor=null
01:14:16,247 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower672: Updated server config: isVoting: false, peers: [PeerInfo [id=leader669, address=akka://test/user/leader669, votingState=VOTING], PeerInfo [id=follower670, address=akka://test/user/follower670, votingState=VOTING], PeerInfo [id=follower671, address=akka://test/user/follower671, votingState=VOTING]]
01:14:16,247 AM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower672 in 59.26 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:16,248 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower672: Recovery completed  in 887.6 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [04/11/2024 01:14:16.250] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader669]: org.opendaylight.controller.cluster.common.actor.Monitor@226c744
01:14:16,250 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader669 with journal batch size 1000
01:14:16,251 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669: SnapshotOffer called.
01:14:16,251 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669: Moving last applied index from -1 to -1
01:14:16,251 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669: Set currentTerm=1, votedFor=null
01:14:16,251 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669: Updated server config: isVoting: true, peers: [PeerInfo [id=follower670, address=akka://test/user/follower670, votingState=VOTING], PeerInfo [id=follower672, address=akka://test/user/follower672, votingState=NON_VOTING], PeerInfo [id=follower671, address=akka://test/user/follower671, votingState=VOTING]]
01:14:16,251 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader669 in 85.85 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:16,252 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader669: Recovery completed  in 822.7 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:16,632 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:16,633 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.171.228:25520, Removed)
01:14:16,633 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Follower): Received ElectionTimeout - switching to Candidate
01:14:16,633 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Candidate): Election: Candidate has following voting peers: [follower670, follower671]
01:14:16,633 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669: Set currentTerm=2, votedFor=leader669
01:14:16,633 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Candidate): Starting new election term 2
01:14:16,633 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Candidate): Sending RequestVote [term=2, candidateId=leader669, lastLogIndex=-1, lastLogTerm=-1] to peer follower670
01:14:16,633 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Candidate): Sending RequestVote [term=2, candidateId=leader669, lastLogIndex=-1, lastLogTerm=-1] to peer follower671
01:14:16,633 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower670 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:16,633 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
01:14:16,633 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower670 (Follower): Cluster state: []
01:14:16,633 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower670 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader669, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
01:14:16,633 AM [test-akka.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower670 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader669, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
01:14:16,633 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower670: Set currentTerm=2, votedFor=null
01:14:16,634 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower670 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader669, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
01:14:16,634 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower670: Set currentTerm=2, votedFor=leader669
01:14:16,634 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower671 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:16,634 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower670 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
01:14:16,634 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower671 (Follower): Cluster state: []
01:14:16,634 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower671 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader669, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
01:14:16,634 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower671 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader669, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
01:14:16,634 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower671: Set currentTerm=2, votedFor=null
01:14:16,634 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower671 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader669, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
01:14:16,634 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower671: Set currentTerm=2, votedFor=leader669
01:14:16,634 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower671 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
01:14:16,635 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2
01:14:16,635 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1
01:14:16,635 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Leader): Election: Leader has following peers: [follower670, follower672, follower671]
01:14:16,635 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Leader): Checking sendAppendEntries for follower follower670: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,635 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Leader): Checking sendAppendEntries for follower follower672: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,635 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower670: Last sync leader does not match current leader leader669, need to catch up to -1
01:14:16,635 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Leader): Checking sendAppendEntries for follower follower671: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,635 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
[WARN] [04/11/2024 01:14:16.635] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower670] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@33070cfa
01:14:16,635 AM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower672 (Follower): Term 2 in "AppendEntries [leaderId=leader669, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term
01:14:16,635 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower672: Set currentTerm=2, votedFor=null
01:14:16,635 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower670 updated: matchIndex: -1, nextIndex: 0
01:14:16,635 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower672: Last sync leader does not match current leader leader669, need to catch up to -1
01:14:16,635 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Leader): Checking sendAppendEntries for follower follower670: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,635 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower671: Last sync leader does not match current leader leader669, need to catch up to -1
01:14:16,636 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower672 updated: matchIndex: -1, nextIndex: 0
[WARN] [04/11/2024 01:14:16.636] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower671] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@69c84bc2
01:14:16,636 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Leader): Checking sendAppendEntries for follower follower672: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,636 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower671 updated: matchIndex: -1, nextIndex: 0
01:14:16,636 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Leader): Checking sendAppendEntries for follower follower671: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/11/2024 01:14:16.636] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower672] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@689d8ef9
01:14:16,654 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
01:14:16,654 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
01:14:16,655 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
01:14:16,655 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/follower671 starting
01:14:16,655 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower671: onShutDown
01:14:16,655 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/follower671 ending
01:14:16,655 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
01:14:16,655 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
01:14:16,655 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669: onRequestLeadership RequestLeadership [requestedFollowerId=follower671, replyTo=Actor[akka://test/user/$b#1639361641]]
01:14:16,655 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669: Initiating leader transfer
01:14:16,655 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower670: onLeaderTransitioning: LeaderTransitioning [leaderId=leader669]
01:14:16,655 AM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorLeadershipTransferCohort - leader669: pauseLeader successfully completed - doing transfer
01:14:16,655 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Leader): Attempting to transfer leadership
01:14:16,655 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower672: onLeaderTransitioning: LeaderTransitioning [leaderId=leader669]
01:14:16,655 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Leader): Checking sendAppendEntries for follower follower670: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,656 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Leader): Checking sendAppendEntries for follower follower672: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:16,656 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Leader): Checking sendAppendEntries for follower follower671: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/11/2024 01:14:16.655] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower671] received dead letter from TestActor[akka://test/user/leader669]: LeaderTransitioning [leaderId=leader669]
[WARN] [04/11/2024 01:14:16.656] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower671] received dead letter from TestActor[akka://test/user/leader669]: AppendEntries [leaderId=leader669, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
01:14:16,656 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower670: Lagging 0 entries behind leader leader669 and reached -1 (of expected -1)
01:14:16,656 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower672: Lagging 0 entries behind leader leader669 and reached -1 (of expected -1)
[WARN] [04/11/2024 01:14:16.656] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower670] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@42ef0972
[WARN] [04/11/2024 01:14:16.656] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower672] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@506b0556
[WARN] [04/11/2024 01:14:16.753] [test-akka.actor.default-dispatcher-18] [akka://test/user/follower671] received dead letter from TestActor[akka://test/user/leader669]: AppendEntries [leaderId=leader669, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
01:14:16,873 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower670: Lagging 0 entries behind leader leader669 and reached -1 (of expected -1)
01:14:16,873 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower672: Lagging 0 entries behind leader leader669 and reached -1 (of expected -1)
[WARN] [04/11/2024 01:14:16.873] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower671] received dead letter from TestActor[akka://test/user/leader669]: AppendEntries [leaderId=leader669, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
01:14:16,993 AM [test-akka.actor.default-dispatcher-15] [DEBUG] RaftActorLeadershipTransferCohort - leader669: leader transfer aborted
01:14:16,993 AM [test-akka.actor.default-dispatcher-15] [WARN] RaftActorLeadershipTransferCohort - leader669: Failed to transfer leadership in 337.6 ms
01:14:16,993 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669: LeadershipTransfer request from follower671 failed
01:14:16,994 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader669 (Leader): Leadership transfer expired
01:14:16,994 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower670: Lagging 0 entries behind leader leader669 and reached -1 (of expected -1)
01:14:16,994 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower672: Lagging 0 entries behind leader leader669 and reached -1 (of expected -1)
[WARN] [04/11/2024 01:14:16.994] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower671] received dead letter from TestActor[akka://test/user/leader669]: AppendEntries [leaderId=leader669, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
01:14:17,8 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown ending
01:14:17,8 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower670-notifier673#-335045403]
01:14:17,19 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower670-collector674#-1216983507]
01:14:17,19 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower670]
01:14:17,20 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower671-notifier675#-1928639907]
01:14:17,20 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower671-collector676#-730209198]
01:14:17,20 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower671]
01:14:17,20 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower672-notifier677#-2139498301]
01:14:17,20 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower672-collector678#-981207651]
01:14:17,20 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower672]
01:14:17,20 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader669-notifier679#475072654]
01:14:17,21 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader669-collector680#-721854270]
01:14:17,21 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader669]
01:14:17,21 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$b#1639361641]
01:14:17,22 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown starting
01:14:17,22 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [04/11/2024 01:14:17.026] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower682]: org.opendaylight.controller.cluster.common.actor.Monitor@7149d4db
01:14:17,27 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower682 with journal batch size 1000
01:14:17,27 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682: SnapshotOffer called.
01:14:17,27 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682: Moving last applied index from -1 to -1
01:14:17,27 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682: Set currentTerm=1, votedFor=null
01:14:17,27 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682: Updated server config: isVoting: true, peers: [PeerInfo [id=follower684, address=akka://test/user/follower684, votingState=NON_VOTING], PeerInfo [id=leader681, address=akka://test/user/leader681, votingState=VOTING], PeerInfo [id=follower683, address=akka://test/user/follower683, votingState=VOTING]]
01:14:17,27 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower682 in 62.71 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
[WARN] [04/11/2024 01:14:17.028] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower683]: org.opendaylight.controller.cluster.common.actor.Monitor@21f9fc5d
01:14:17,28 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower683 with journal batch size 1000
01:14:17,28 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower682: Recovery completed  in 982.1 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:17,29 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683: SnapshotOffer called.
01:14:17,29 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683: Moving last applied index from -1 to -1
01:14:17,29 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683: Set currentTerm=1, votedFor=null
01:14:17,29 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683: Updated server config: isVoting: true, peers: [PeerInfo [id=follower684, address=akka://test/user/follower684, votingState=NON_VOTING], PeerInfo [id=leader681, address=akka://test/user/leader681, votingState=VOTING], PeerInfo [id=follower682, address=akka://test/user/follower682, votingState=VOTING]]
01:14:17,29 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower683 in 50.84 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:17,29 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower683: Recovery completed  in 526.3 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [04/11/2024 01:14:17.030] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower684]: org.opendaylight.controller.cluster.common.actor.Monitor@78f476f5
01:14:17,31 AM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower684 with journal batch size 1000
01:14:17,32 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684: SnapshotOffer called.
01:14:17,32 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684: Moving last applied index from -1 to -1
01:14:17,32 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684: Set currentTerm=1, votedFor=null
01:14:17,32 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684: Updated server config: isVoting: false, peers: [PeerInfo [id=leader681, address=akka://test/user/leader681, votingState=VOTING], PeerInfo [id=follower683, address=akka://test/user/follower683, votingState=VOTING], PeerInfo [id=follower682, address=akka://test/user/follower682, votingState=VOTING]]
01:14:17,32 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower684 in 41.09 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:17,33 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower684: Recovery completed  in 722.3 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [04/11/2024 01:14:17.033] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader681]: org.opendaylight.controller.cluster.common.actor.Monitor@4d10fcf2
01:14:17,34 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader681 with journal batch size 1000
01:14:17,34 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: SnapshotOffer called.
01:14:17,34 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: Moving last applied index from -1 to -1
01:14:17,34 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: Set currentTerm=1, votedFor=null
01:14:17,34 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: Updated server config: isVoting: true, peers: [PeerInfo [id=follower684, address=akka://test/user/follower684, votingState=NON_VOTING], PeerInfo [id=follower683, address=akka://test/user/follower683, votingState=VOTING], PeerInfo [id=follower682, address=akka://test/user/follower682, votingState=VOTING]]
01:14:17,34 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader681 in 38.33 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:17,35 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: Recovery completed  in 465.5 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:17,442 AM [test-akka.actor.default-dispatcher-17] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:17,442 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.171.228:25520, Removed)
01:14:17,442 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Follower): Received ElectionTimeout - switching to Candidate
01:14:17,442 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Candidate): Election: Candidate has following voting peers: [follower683, follower682]
01:14:17,442 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: Set currentTerm=2, votedFor=leader681
01:14:17,443 AM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Candidate): Starting new election term 2
01:14:17,443 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Candidate): Sending RequestVote [term=2, candidateId=leader681, lastLogIndex=-1, lastLogTerm=-1] to peer follower683
01:14:17,443 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Candidate): Sending RequestVote [term=2, candidateId=leader681, lastLogIndex=-1, lastLogTerm=-1] to peer follower682
01:14:17,443 AM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
01:14:17,443 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:17,443 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:17,443 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Follower): Cluster state: []
01:14:17,443 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): Cluster state: []
01:14:17,443 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader681, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
01:14:17,443 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader681, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
01:14:17,443 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader681, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
01:14:17,443 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader681, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
01:14:17,443 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683: Set currentTerm=2, votedFor=null
01:14:17,443 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682: Set currentTerm=2, votedFor=null
01:14:17,443 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader681, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
01:14:17,443 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader681, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
01:14:17,443 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683: Set currentTerm=2, votedFor=leader681
01:14:17,443 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682: Set currentTerm=2, votedFor=leader681
01:14:17,443 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
01:14:17,443 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
01:14:17,444 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2
01:14:17,444 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1
01:14:17,444 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Election: Leader has following peers: [follower684, follower683, follower682]
01:14:17,444 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Checking sendAppendEntries for follower follower684: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:17,444 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Checking sendAppendEntries for follower follower683: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:17,444 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Checking sendAppendEntries for follower follower682: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:17,444 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower684 (Follower): Term 2 in "AppendEntries [leaderId=leader681, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term
01:14:17,444 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684: Set currentTerm=2, votedFor=null
01:14:17,444 AM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
01:14:17,444 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower684: Last sync leader does not match current leader leader681, need to catch up to -1
01:14:17,444 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower684 updated: matchIndex: -1, nextIndex: 0
01:14:17,444 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Checking sendAppendEntries for follower follower684: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:17,445 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower682: Last sync leader does not match current leader leader681, need to catch up to -1
01:14:17,445 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower682 updated: matchIndex: -1, nextIndex: 0
01:14:17,445 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Checking sendAppendEntries for follower follower682: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:17,445 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower683: Last sync leader does not match current leader leader681, need to catch up to -1
01:14:17,445 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower683 updated: matchIndex: -1, nextIndex: 0
[WARN] [04/11/2024 01:14:17.445] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower682] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@487aa323
[WARN] [04/11/2024 01:14:17.445] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower684] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@74d90cba
01:14:17,446 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Checking sendAppendEntries for follower follower683: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/11/2024 01:14:17.446] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower683] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@55f9a0f7
01:14:17,490 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
01:14:17,490 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting
01:14:17,490 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: Persist data SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
01:14:17,490 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 
01:14:17,490 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
01:14:17,490 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Checking sendAppendEntries for follower follower684: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:17,490 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): sendAppendEntries: 0 is present for follower follower684
01:14:17,490 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Sending AppendEntries to follower follower684: AppendEntries [leaderId=leader681, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
01:14:17,490 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Checking sendAppendEntries for follower follower683: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:17,490 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): sendAppendEntries: 0 is present for follower follower683
01:14:17,490 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Sending AppendEntries to follower follower683: AppendEntries [leaderId=leader681, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
01:14:17,490 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684 (Follower): handleAppendEntries: AppendEntries [leaderId=leader681, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
01:14:17,490 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Checking sendAppendEntries for follower follower682: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:17,490 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): sendAppendEntries: 0 is present for follower follower682
01:14:17,490 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684 (Follower): Number of entries to be appended = 1
01:14:17,490 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Sending AppendEntries to follower follower682: AppendEntries [leaderId=leader681, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
01:14:17,490 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
01:14:17,490 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684 (Follower): Append entry to log zero
01:14:17,490 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 
01:14:17,490 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Follower): handleAppendEntries: AppendEntries [leaderId=leader681, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
01:14:17,490 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Follower): Number of entries to be appended = 1
01:14:17,490 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
01:14:17,490 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Follower): Append entry to log zero
01:14:17,490 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 
01:14:17,490 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684 (Follower): Log size is now 1
01:14:17,490 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Follower): Log size is now 1
01:14:17,490 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684 (Follower): handleAppendEntries returning : AppendEntriesReply [term=2, success=true, followerId=follower684, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
01:14:17,490 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Follower): handleAppendEntries returning : AppendEntriesReply [term=2, success=true, followerId=follower682, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
01:14:17,490 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower684: Lagging 0 entries behind leader leader681 and reached -1 (of expected -1)
01:14:17,490 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower682: Lagging 0 entries behind leader leader681 and reached -1 (of expected -1)
01:14:17,491 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower684 updated: matchIndex: 0, nextIndex: 1
01:14:17,491 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Checking sendAppendEntries for follower follower684: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:17,491 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower682 updated: matchIndex: 0, nextIndex: 1
01:14:17,491 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
01:14:17,491 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Checking sendAppendEntries for follower follower682: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:17,491 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
01:14:17,491 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
[WARN] [04/11/2024 01:14:17.491] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower682] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@782bca88
01:14:17,491 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
[WARN] [04/11/2024 01:14:17.491] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower684] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@1572eabd
01:14:17,491 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Setting last applied to 0
01:14:17,491 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: Moving last applied index from -1 to 0
01:14:17,491 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: Applying state for log index 0 data zero
01:14:17,491 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: applyState called: zero
01:14:17,491 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: Persisting ApplyJournalEntries with index=0
01:14:17,563 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): sendAppendEntries: 0 is present for follower follower683
01:14:17,563 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Sending AppendEntries to follower follower683: AppendEntries [leaderId=leader681, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
01:14:17,683 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): sendAppendEntries: 0 is present for follower follower683
01:14:17,683 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Sending AppendEntries to follower follower683: AppendEntries [leaderId=leader681, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
01:14:17,683 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684 (Follower): Commit index set to 0
01:14:17,683 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower684: Lagging 0 entries behind leader leader681 and reached 0 (of expected -1)
01:14:17,683 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
01:14:17,683 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684 (Follower): Setting last applied to 0
01:14:17,683 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684: Moving last applied index from -1 to 0
01:14:17,683 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684: Applying state for log index 0 data zero
01:14:17,683 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Follower): Commit index set to 0
01:14:17,683 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower682: Lagging 0 entries behind leader leader681 and reached 0 (of expected -1)
01:14:17,683 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
01:14:17,683 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Follower): Setting last applied to 0
01:14:17,683 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682: Moving last applied index from -1 to 0
01:14:17,683 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682: Applying state for log index 0 data zero
01:14:17,683 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower684: applyState called: zero
01:14:17,683 AM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower682: applyState called: zero
01:14:17,683 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684: Persisting ApplyJournalEntries with index=0
01:14:17,683 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682: Persisting ApplyJournalEntries with index=0
01:14:17,691 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending
01:14:17,691 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 starting
01:14:17,691 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: onShutDown
01:14:17,691 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: Initiating leader transfer
01:14:17,691 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684: onLeaderTransitioning: LeaderTransitioning [leaderId=leader681]
01:14:17,691 AM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader681: pauseLeader successfully completed - doing transfer
01:14:17,691 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Attempting to transfer leadership
01:14:17,691 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Checking sendAppendEntries for follower follower684: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:17,691 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682: onLeaderTransitioning: LeaderTransitioning [leaderId=leader681]
01:14:17,692 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Checking sendAppendEntries for follower follower683: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:17,692 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): sendAppendEntries: 0 is present for follower follower683
01:14:17,692 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Checking sendAppendEntries for follower follower682: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:17,692 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower684: Lagging 0 entries behind leader leader681 and reached 0 (of expected -1)
01:14:17,692 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): tryToCompleteLeadershipTransfer: followerId: follower684, matchIndex: 0, lastIndex: 0, isVoting: false
01:14:17,692 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower682: Lagging 0 entries behind leader leader681 and reached 0 (of expected -1)
01:14:17,692 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): tryToCompleteLeadershipTransfer: followerId: follower682, matchIndex: 0, lastIndex: 0, isVoting: true
01:14:17,692 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Follower's log matches - sending ElectionTimeout
01:14:17,692 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Checking sendAppendEntries for follower follower684: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:17,692 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Checking sendAppendEntries for follower follower683: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:17,692 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): sendAppendEntries: 0 is present for follower follower683
01:14:17,692 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Checking sendAppendEntries for follower follower682: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:17,692 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower684: Lagging 0 entries behind leader leader681 and reached 0 (of expected -1)
01:14:17,692 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Leader transfer complete
01:14:17,692 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower682: Lagging 0 entries behind leader leader681 and reached 0 (of expected -1)
01:14:17,692 AM [test-akka.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader681: leader transfer complete - waiting for new leader
01:14:17,692 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:17,692 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Follower): Received TimeoutNow - switching to Candidate
01:14:17,692 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Candidate): Election: Candidate has following voting peers: [leader681, follower683]
01:14:17,692 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682: Set currentTerm=3, votedFor=follower682
01:14:17,693 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Candidate): Starting new election term 3
01:14:17,693 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Candidate): Sending RequestVote [term=3, candidateId=follower682, lastLogIndex=0, lastLogTerm=2] to peer leader681
01:14:17,693 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Candidate): Sending RequestVote [term=3, candidateId=follower682, lastLogIndex=0, lastLogTerm=2] to peer follower683
01:14:17,693 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:17,693 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
01:14:17,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:17,693 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Cluster state: []
01:14:17,693 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Candidate in requestVote:RequestVote [term=3, candidateId=follower682, lastLogIndex=0, lastLogTerm=2] with higher term appears reachable, updating term.
01:14:17,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): Cluster state: []
01:14:17,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): Candidate in requestVote:RequestVote [term=3, candidateId=follower682, lastLogIndex=0, lastLogTerm=2] with higher term appears reachable, updating term.
01:14:17,693 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): Term 3 in "RequestVote [term=3, candidateId=follower682, lastLogIndex=0, lastLogTerm=2]" message is greater than follower's term 2 - updating term
01:14:17,693 AM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Term 3 in "RequestVote [term=3, candidateId=follower682, lastLogIndex=0, lastLogTerm=2]" message is greater than leader's term 2 - switching to Follower
01:14:17,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683: Set currentTerm=3, votedFor=null
01:14:17,693 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: Set currentTerm=3, votedFor=null
01:14:17,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): In requestVote:  RequestVote [term=3, candidateId=follower682, lastLogIndex=0, lastLogTerm=2] - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
01:14:17,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683: Set currentTerm=3, votedFor=follower682
01:14:17,693 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): Leadership transfer in progress - processing RequestVote
01:14:17,693 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): In requestVote:  RequestVote [term=3, candidateId=follower682, lastLogIndex=0, lastLogTerm=2] - currentTerm: 3, votedFor: null, lastIndex: 0, lastTerm: 2
01:14:17,693 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: Set currentTerm=3, votedFor=follower682
01:14:17,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): requestVote returning: RequestVoteReply [term=3, voteGranted=true]
01:14:17,693 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader): requestVote returning: RequestVoteReply [term=3, voteGranted=true]
01:14:17,693 AM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader681 (Leader) :- Switching from behavior Leader to Follower, election term: 3
01:14:17,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Candidate): RaftRPC message received RequestVoteReply [term=3, voteGranted=true], my term is 3
01:14:17,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Candidate): handleRequestVoteReply: RequestVoteReply [term=3, voteGranted=true], current voteCount: 1
01:14:17,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Leader): Election: Leader has following peers: [follower684, leader681, follower683]
01:14:17,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Leader): Checking sendAppendEntries for follower follower684: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:17,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Leader): Checking sendAppendEntries for follower leader681: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:17,694 AM [test-akka.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower684 (Follower): Term 3 in "AppendEntries [leaderId=follower682, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 2 - updating term
01:14:17,694 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Leader): Checking sendAppendEntries for follower follower683: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:17,694 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower684: Set currentTerm=3, votedFor=null
01:14:17,694 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
01:14:17,694 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower684: Last sync leader does not match current leader follower682, need to catch up to -1
01:14:17,694 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower684 updated: matchIndex: 0, nextIndex: 1
01:14:17,694 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Leader): Checking sendAppendEntries for follower follower684: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:17,694 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - leader681: Last sync leader does not match current leader follower682, need to catch up to -1
01:14:17,694 AM [test-akka.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader681: leader changed to follower682
01:14:17,694 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader681 updated: matchIndex: 0, nextIndex: 1
01:14:17,694 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Leader): Checking sendAppendEntries for follower leader681: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:17,694 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower684: Lagging 0 entries behind leader follower682 and reached 0 (of expected -1)
01:14:17,694 AM [test-akka.actor.default-dispatcher-7] [INFO] RaftActorLeadershipTransferCohort - leader681: Successfully transferred leadership to follower682 in 2.720 ms
[WARN] [04/11/2024 01:14:17.694] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower684] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2e3586e9
01:14:17,694 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader681: leader transfer succeeded - sending PoisonPill
[WARN] [04/11/2024 01:14:17.694] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower684] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@30266bc7
01:14:17,694 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - leader681: Lagging 0 entries behind leader follower682 and reached 0 (of expected -1)
[WARN] [04/11/2024 01:14:17.695] [test-akka.actor.default-dispatcher-5] [akka://test/user/leader681] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@384fe957
[WARN] [04/11/2024 01:14:17.695] [test-akka.actor.default-dispatcher-6] [akka://test/user/leader681] received dead letter: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@66a0833e
01:14:18,213 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower684: Lagging 0 entries behind leader follower682 and reached 0 (of expected -1)
[WARN] [04/11/2024 01:14:18.213] [test-akka.actor.default-dispatcher-18] [akka://test/user/leader681] received dead letter from TestActor[akka://test/user/follower682]: AppendEntries [leaderId=follower682, prevLogIndex=0, prevLogTerm=2, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
01:14:18,213 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower683: Last sync leader does not match current leader follower682, need to catch up to -1
01:14:18,213 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Leader): sendAppendEntries: 0 is present for follower follower683
01:14:18,214 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Leader): Sending AppendEntries to follower follower683: AppendEntries [leaderId=follower682, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
[WARN] [04/11/2024 01:14:18.214] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower683] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@44660595
01:14:18,214 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): handleAppendEntries: AppendEntries [leaderId=follower682, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
01:14:18,214 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): Number of entries to be appended = 1
01:14:18,214 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
01:14:18,214 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): Append entry to log zero
01:14:18,214 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 
01:14:18,214 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): Log size is now 1
01:14:18,214 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): Commit index set to 0
01:14:18,214 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): handleAppendEntries returning : AppendEntriesReply [term=3, success=true, followerId=follower683, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
01:14:18,214 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower683: Lagging 0 entries behind leader follower682 and reached 0 (of expected -1)
01:14:18,214 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
01:14:18,214 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683 (Follower): Setting last applied to 0
01:14:18,214 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683: Moving last applied index from -1 to 0
01:14:18,214 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683: Applying state for log index 0 data zero
01:14:18,214 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower683 updated: matchIndex: 0, nextIndex: 1
01:14:18,214 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower682 (Leader): Checking sendAppendEntries for follower follower683: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:18,214 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower683: applyState called: zero
01:14:18,215 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
01:14:18,215 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683: Persisting ApplyJournalEntries with index=0
[WARN] [04/11/2024 01:14:18.215] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower683] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@30e6a099
01:14:18,245 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683: onLeaderTransitioning: LeaderTransitioning [leaderId=leader681]
01:14:18,245 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 ending
01:14:18,245 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/follower683 starting
01:14:18,246 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower683: onShutDown
01:14:18,247 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/follower683 ending
01:14:18,247 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending
01:14:18,247 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower682-notifier685#441917447]
01:14:18,258 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower682-collector686#1635963215]
01:14:18,258 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower682]
01:14:18,258 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower683-notifier687#-1434248413]
01:14:18,258 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower683-collector688#477755515]
01:14:18,258 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower683]
01:14:18,258 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower684-notifier689#-1507438099]
01:14:18,259 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower684-collector690#-290940881]
01:14:18,259 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower684]
01:14:18,260 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader681-notifier691#-125344626]
01:14:18,261 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader681-collector692#-1708821667]
01:14:18,261 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader681]
01:14:18,262 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers starting
[WARN] [04/11/2024 01:14:18.264] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader693]: org.opendaylight.controller.cluster.common.actor.Monitor@1b118eff
01:14:18,265 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader693 with journal batch size 1000
01:14:18,272 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader693: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:18,273 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:18,273 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader693 (Follower): Received TimeoutNow - switching to Candidate
01:14:18,273 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader693 (Candidate): Election: Candidate has following voting peers: []
01:14:18,273 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader693: Set currentTerm=1, votedFor=leader693
01:14:18,273 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader693 (Candidate): Starting new election term 1
01:14:18,273 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader693 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
01:14:18,274 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader693 (Candidate): Received ElectionTimeout
01:14:18,274 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader693 (Leader): Election: Leader has following peers: []
01:14:18,274 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader693 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
01:14:18,364 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/leader693 starting
01:14:18,365 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader693: onShutDown
01:14:18,365 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/leader693 ending
01:14:18,366 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers ending
01:14:18,366 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader693-collector697#708990630]
01:14:18,377 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader693]
01:14:18,377 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging starting
01:14:18,377 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [04/11/2024 01:14:18.379] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower699]: org.opendaylight.controller.cluster.common.actor.Monitor@1eecb1a
01:14:18,380 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower699 with journal batch size 1000
01:14:18,380 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699: SnapshotOffer called.
01:14:18,380 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699: Moving last applied index from -1 to -1
01:14:18,380 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699: Set currentTerm=1, votedFor=null
01:14:18,380 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699: Updated server config: isVoting: true, peers: [PeerInfo [id=follower700, address=akka://test/user/follower700, votingState=VOTING], PeerInfo [id=leader698, address=akka://test/user/leader698, votingState=VOTING], PeerInfo [id=follower701, address=akka://test/user/follower701, votingState=NON_VOTING]]
01:14:18,380 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower699 in 115.2 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:18,382 AM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower699: Recovery completed  in 1.250 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [04/11/2024 01:14:18.481] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower700]: org.opendaylight.controller.cluster.common.actor.Monitor@3271f729
01:14:18,482 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower700 with journal batch size 1000
01:14:18,483 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower700: SnapshotOffer called.
01:14:18,483 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower700: Moving last applied index from -1 to -1
01:14:18,483 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower700: Set currentTerm=1, votedFor=null
01:14:18,483 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower700: Updated server config: isVoting: true, peers: [PeerInfo [id=follower699, address=akka://test/user/follower699, votingState=VOTING], PeerInfo [id=leader698, address=akka://test/user/leader698, votingState=VOTING], PeerInfo [id=follower701, address=akka://test/user/follower701, votingState=NON_VOTING]]
01:14:18,483 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower700 in 81.02 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:18,484 AM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower700: Recovery completed  in 1.150 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [04/11/2024 01:14:18.583] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower701]: org.opendaylight.controller.cluster.common.actor.Monitor@e06a3fb
01:14:18,584 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower701 with journal batch size 1000
01:14:18,584 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701: SnapshotOffer called.
01:14:18,584 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701: Moving last applied index from -1 to -1
01:14:18,584 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701: Set currentTerm=1, votedFor=null
01:14:18,584 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701: Updated server config: isVoting: false, peers: [PeerInfo [id=follower700, address=akka://test/user/follower700, votingState=VOTING], PeerInfo [id=follower699, address=akka://test/user/follower699, votingState=VOTING], PeerInfo [id=leader698, address=akka://test/user/leader698, votingState=VOTING]]
01:14:18,584 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower701 in 71.37 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:18,585 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower701: Recovery completed  in 957.7 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [04/11/2024 01:14:18.686] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader698]: org.opendaylight.controller.cluster.common.actor.Monitor@4b289cd1
01:14:18,687 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader698 with journal batch size 1000
01:14:18,687 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698: SnapshotOffer called.
01:14:18,687 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698: Moving last applied index from -1 to -1
01:14:18,687 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698: Set currentTerm=1, votedFor=null
01:14:18,688 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698: Updated server config: isVoting: true, peers: [PeerInfo [id=follower700, address=akka://test/user/follower700, votingState=VOTING], PeerInfo [id=follower699, address=akka://test/user/follower699, votingState=VOTING], PeerInfo [id=follower701, address=akka://test/user/follower701, votingState=NON_VOTING]]
01:14:18,688 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader698 in 111.1 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:18,689 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader698: Recovery completed  in 1.226 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:19,73 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:19,73 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.171.228:25520, Removed)
01:14:19,73 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Follower): Received ElectionTimeout - switching to Candidate
01:14:19,73 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Candidate): Election: Candidate has following voting peers: [follower700, follower699]
01:14:19,73 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698: Set currentTerm=2, votedFor=leader698
01:14:19,73 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Candidate): Starting new election term 2
01:14:19,73 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Candidate): Sending RequestVote [term=2, candidateId=leader698, lastLogIndex=-1, lastLogTerm=-1] to peer follower700
01:14:19,73 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Candidate): Sending RequestVote [term=2, candidateId=leader698, lastLogIndex=-1, lastLogTerm=-1] to peer follower699
01:14:19,73 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower700 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:19,73 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
01:14:19,73 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower700 (Follower): Cluster state: []
01:14:19,73 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower700 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader698, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
01:14:19,73 AM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower700 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader698, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
01:14:19,73 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower700: Set currentTerm=2, votedFor=null
01:14:19,74 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower700 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader698, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
01:14:19,74 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower700: Set currentTerm=2, votedFor=leader698
01:14:19,74 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:19,74 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699 (Follower): Cluster state: []
01:14:19,74 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower700 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
01:14:19,74 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader698, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
01:14:19,74 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower699 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader698, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
01:14:19,74 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699: Set currentTerm=2, votedFor=null
01:14:19,74 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader698, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
01:14:19,74 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699: Set currentTerm=2, votedFor=leader698
01:14:19,74 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
01:14:19,74 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2
01:14:19,74 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1
01:14:19,75 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Election: Leader has following peers: [follower700, follower699, follower701]
01:14:19,75 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Checking sendAppendEntries for follower follower700: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:19,75 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Checking sendAppendEntries for follower follower699: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:19,75 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Checking sendAppendEntries for follower follower701: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:19,75 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower700: Last sync leader does not match current leader leader698, need to catch up to -1
01:14:19,75 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
01:14:19,75 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower700 updated: matchIndex: -1, nextIndex: 0
[WARN] [04/11/2024 01:14:19.075] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower700] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2bb7e107
01:14:19,75 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Checking sendAppendEntries for follower follower700: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:19,75 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower701 (Follower): Term 2 in "AppendEntries [leaderId=leader698, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term
01:14:19,75 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701: Set currentTerm=2, votedFor=null
01:14:19,75 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower699: Last sync leader does not match current leader leader698, need to catch up to -1
01:14:19,75 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower701: Last sync leader does not match current leader leader698, need to catch up to -1
01:14:19,75 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower699 updated: matchIndex: -1, nextIndex: 0
01:14:19,75 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Checking sendAppendEntries for follower follower699: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:19,75 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower701 updated: matchIndex: -1, nextIndex: 0
01:14:19,75 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Checking sendAppendEntries for follower follower701: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/11/2024 01:14:19.075] [test-akka.actor.default-dispatcher-5] [akka://test/user/follower699] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@26b12be9
[WARN] [04/11/2024 01:14:19.076] [test-akka.actor.default-dispatcher-18] [akka://test/user/follower701] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2aaa37bc
01:14:19,87 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
01:14:19,87 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
01:14:19,88 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
01:14:19,88 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698: Persist data SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Checking sendAppendEntries for follower follower700: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): sendAppendEntries: 0 is present for follower follower700
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Sending AppendEntries to follower follower700: AppendEntries [leaderId=leader698, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Checking sendAppendEntries for follower follower699: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): sendAppendEntries: 0 is present for follower follower699
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Sending AppendEntries to follower follower699: AppendEntries [leaderId=leader698, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Checking sendAppendEntries for follower follower701: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): sendAppendEntries: 0 is present for follower follower701
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Sending AppendEntries to follower follower701: AppendEntries [leaderId=leader698, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
01:14:19,89 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699 (Follower): handleAppendEntries: AppendEntries [leaderId=leader698, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
01:14:19,89 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699 (Follower): Number of entries to be appended = 1
01:14:19,89 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
01:14:19,89 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699 (Follower): Append entry to log zero
01:14:19,89 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701 (Follower): handleAppendEntries: AppendEntries [leaderId=leader698, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701 (Follower): Number of entries to be appended = 1
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701 (Follower): Append entry to log zero
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 
01:14:19,89 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699 (Follower): Log size is now 1
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701 (Follower): Log size is now 1
01:14:19,89 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699 (Follower): handleAppendEntries returning : AppendEntriesReply [term=2, success=true, followerId=follower699, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
01:14:19,89 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower699: Lagging 0 entries behind leader leader698 and reached -1 (of expected -1)
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701 (Follower): handleAppendEntries returning : AppendEntriesReply [term=2, success=true, followerId=follower701, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
01:14:19,89 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower701: Lagging 0 entries behind leader leader698 and reached -1 (of expected -1)
01:14:19,89 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower699 updated: matchIndex: 0, nextIndex: 1
01:14:19,89 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Checking sendAppendEntries for follower follower699: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:19,89 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower701 updated: matchIndex: 0, nextIndex: 1
01:14:19,89 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Checking sendAppendEntries for follower follower701: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:19,90 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
01:14:19,90 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
01:14:19,90 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Setting last applied to 0
01:14:19,90 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698: Moving last applied index from -1 to 0
01:14:19,90 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698: Applying state for log index 0 data zero
01:14:19,90 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader698: applyState called: zero
01:14:19,90 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698: Persisting ApplyJournalEntries with index=0
01:14:19,90 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
01:14:19,90 AM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
[WARN] [04/11/2024 01:14:19.091] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower699] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@4829a160
[WARN] [04/11/2024 01:14:19.091] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower701] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@760ae177
01:14:19,193 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): sendAppendEntries: 0 is present for follower follower700
01:14:19,193 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Sending AppendEntries to follower follower700: AppendEntries [leaderId=leader698, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
01:14:19,193 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699 (Follower): Commit index set to 0
01:14:19,193 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701 (Follower): Commit index set to 0
01:14:19,193 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower699: Lagging 0 entries behind leader leader698 and reached 0 (of expected -1)
01:14:19,193 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
01:14:19,193 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower701: Lagging 0 entries behind leader leader698 and reached 0 (of expected -1)
01:14:19,193 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
01:14:19,193 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699 (Follower): Setting last applied to 0
01:14:19,193 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701 (Follower): Setting last applied to 0
01:14:19,193 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699: Moving last applied index from -1 to 0
01:14:19,193 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701: Moving last applied index from -1 to 0
01:14:19,193 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699: Applying state for log index 0 data zero
01:14:19,193 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701: Applying state for log index 0 data zero
01:14:19,194 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower699: applyState called: zero
01:14:19,194 AM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower701: applyState called: zero
01:14:19,194 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699: Persisting ApplyJournalEntries with index=0
01:14:19,194 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701: Persisting ApplyJournalEntries with index=0
01:14:19,240 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending
01:14:19,240 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
01:14:19,240 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
01:14:19,241 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698: onRequestLeadership RequestLeadership [requestedFollowerId=follower700, replyTo=Actor[akka://test/user/$c#1398583155]]
01:14:19,241 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698: Initiating leader transfer
01:14:19,241 AM [test-akka.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader698: pauseLeader successfully completed - doing transfer
01:14:19,241 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Attempting to transfer leadership
01:14:19,241 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Checking sendAppendEntries for follower follower700: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:19,241 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): sendAppendEntries: 0 is present for follower follower700
01:14:19,241 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower699: onLeaderTransitioning: LeaderTransitioning [leaderId=leader698]
01:14:19,241 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Checking sendAppendEntries for follower follower699: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:19,241 AM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower700: onLeaderTransitioning: LeaderTransitioning [leaderId=leader698]
01:14:19,241 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower701: onLeaderTransitioning: LeaderTransitioning [leaderId=leader698]
01:14:19,241 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Checking sendAppendEntries for follower follower701: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:19,241 AM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower699: Lagging 0 entries behind leader leader698 and reached 0 (of expected -1)
01:14:19,241 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower701: Lagging 0 entries behind leader leader698 and reached 0 (of expected -1)
01:14:19,312 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): sendAppendEntries: 0 is present for follower follower700
01:14:19,313 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Sending AppendEntries to follower follower700: AppendEntries [leaderId=leader698, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
01:14:19,433 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower699: Lagging 0 entries behind leader leader698 and reached 0 (of expected -1)
01:14:19,433 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower701: Lagging 0 entries behind leader leader698 and reached 0 (of expected -1)
01:14:19,552 AM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorLeadershipTransferCohort - leader698: leader transfer aborted
01:14:19,553 AM [test-akka.actor.default-dispatcher-16] [WARN] RaftActorLeadershipTransferCohort - leader698: Failed to transfer leadership in 311.6 ms
01:14:19,553 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698: LeadershipTransfer request from follower700 failed
01:14:19,553 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader698 (Leader): Leadership transfer expired
01:14:19,553 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower699: Lagging 0 entries behind leader leader698 and reached 0 (of expected -1)
01:14:19,553 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower701: Lagging 0 entries behind leader leader698 and reached 0 (of expected -1)
01:14:19,594 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging ending
01:14:19,594 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower699-notifier702#2081316963]
01:14:19,605 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower699-collector703#-1742787568]
01:14:19,605 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower699]
01:14:19,605 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower700-notifier704#-479798021]
01:14:19,605 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower700-collector705#-1701468735]
01:14:19,605 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower700]
01:14:19,611 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower701-notifier706#1978700219]
01:14:19,611 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower701-collector707#2141895791]
01:14:19,611 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower701]
01:14:19,611 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader698-notifier708#1645609174]
01:14:19,611 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader698-collector709#-1415698285]
01:14:19,612 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader698]
01:14:19,612 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$c#1398583155]
01:14:19,612 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown starting
01:14:19,612 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [04/11/2024 01:14:19.614] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower711]: org.opendaylight.controller.cluster.common.actor.Monitor@5819bd11
01:14:19,615 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower711 with journal batch size 1000
01:14:19,615 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower711: SnapshotOffer called.
01:14:19,615 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower711: Moving last applied index from -1 to -1
01:14:19,615 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower711: Set currentTerm=1, votedFor=null
01:14:19,615 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower711: Updated server config: isVoting: true, peers: [PeerInfo [id=follower713, address=akka://test/user/follower713, votingState=NON_VOTING], PeerInfo [id=follower712, address=akka://test/user/follower712, votingState=VOTING], PeerInfo [id=leader710, address=akka://test/user/leader710, votingState=VOTING]]
01:14:19,616 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower711 in 115.5 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:19,617 AM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower711: Recovery completed  in 1.310 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [04/11/2024 01:14:19.716] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower712]: org.opendaylight.controller.cluster.common.actor.Monitor@483a17fd
01:14:19,717 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower712 with journal batch size 1000
01:14:19,717 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712: SnapshotOffer called.
01:14:19,717 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712: Moving last applied index from -1 to -1
01:14:19,717 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712: Set currentTerm=1, votedFor=null
01:14:19,717 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712: Updated server config: isVoting: true, peers: [PeerInfo [id=follower711, address=akka://test/user/follower711, votingState=VOTING], PeerInfo [id=follower713, address=akka://test/user/follower713, votingState=NON_VOTING], PeerInfo [id=leader710, address=akka://test/user/leader710, votingState=VOTING]]
01:14:19,717 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower712 in 80.14 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
[WARN] [04/11/2024 01:14:19.718] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower713]: org.opendaylight.controller.cluster.common.actor.Monitor@5b1c26a5
01:14:19,718 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower713 with journal batch size 1000
01:14:19,718 AM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower712: Recovery completed  in 988.5 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:19,720 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower713: SnapshotOffer called.
01:14:19,720 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower713: Moving last applied index from -1 to -1
01:14:19,720 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower713: Set currentTerm=1, votedFor=null
01:14:19,720 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower713: Updated server config: isVoting: false, peers: [PeerInfo [id=follower711, address=akka://test/user/follower711, votingState=VOTING], PeerInfo [id=follower712, address=akka://test/user/follower712, votingState=VOTING], PeerInfo [id=leader710, address=akka://test/user/leader710, votingState=VOTING]]
[WARN] [04/11/2024 01:14:19.720] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader710]: org.opendaylight.controller.cluster.common.actor.Monitor@2e4919e4
01:14:19,720 AM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower713 in 92.40 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:19,721 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader710 with journal batch size 1000
01:14:19,721 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower713: Recovery completed  in 968.0 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:19,721 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710: SnapshotOffer called.
01:14:19,721 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710: Moving last applied index from -1 to -1
01:14:19,721 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710: Set currentTerm=1, votedFor=null
01:14:19,721 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710: Updated server config: isVoting: true, peers: [PeerInfo [id=follower711, address=akka://test/user/follower711, votingState=VOTING], PeerInfo [id=follower713, address=akka://test/user/follower713, votingState=NON_VOTING], PeerInfo [id=follower712, address=akka://test/user/follower712, votingState=VOTING]]
01:14:19,722 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader710 in 86.63 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
01:14:19,725 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader710: Recovery completed  in 4.014 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:20,52 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:20,52 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.171.228:25520, Removed)
01:14:20,52 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Follower): Received ElectionTimeout - switching to Candidate
01:14:20,53 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Candidate): Election: Candidate has following voting peers: [follower711, follower712]
01:14:20,53 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710: Set currentTerm=2, votedFor=leader710
01:14:20,53 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Candidate): Starting new election term 2
01:14:20,53 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Candidate): Sending RequestVote [term=2, candidateId=leader710, lastLogIndex=-1, lastLogTerm=-1] to peer follower711
01:14:20,53 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Candidate): Sending RequestVote [term=2, candidateId=leader710, lastLogIndex=-1, lastLogTerm=-1] to peer follower712
01:14:20,53 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
01:14:20,53 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower711 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:20,53 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower711 (Follower): Cluster state: []
01:14:20,53 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower711 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader710, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
01:14:20,53 AM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower711 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader710, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
01:14:20,53 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower711: Set currentTerm=2, votedFor=null
01:14:20,53 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:20,53 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Follower): Cluster state: []
01:14:20,53 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader710, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
01:14:20,53 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower711 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader710, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
01:14:20,53 AM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader710, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
01:14:20,53 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower711: Set currentTerm=2, votedFor=leader710
01:14:20,53 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712: Set currentTerm=2, votedFor=null
01:14:20,53 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower711 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
01:14:20,53 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader710, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
01:14:20,53 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712: Set currentTerm=2, votedFor=leader710
01:14:20,54 AM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
01:14:20,54 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2
01:14:20,54 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1
01:14:20,54 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Election: Leader has following peers: [follower711, follower713, follower712]
01:14:20,54 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Checking sendAppendEntries for follower follower711: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:20,54 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Checking sendAppendEntries for follower follower713: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:20,54 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Checking sendAppendEntries for follower follower712: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:20,54 AM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
01:14:20,55 AM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower713 (Follower): Term 2 in "AppendEntries [leaderId=leader710, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term
01:14:20,55 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower713: Set currentTerm=2, votedFor=null
01:14:20,55 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower713: Last sync leader does not match current leader leader710, need to catch up to -1
01:14:20,55 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower713 updated: matchIndex: -1, nextIndex: 0
01:14:20,55 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Checking sendAppendEntries for follower follower713: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:20,55 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower711: Last sync leader does not match current leader leader710, need to catch up to -1
01:14:20,55 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower711 updated: matchIndex: -1, nextIndex: 0
01:14:20,55 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Checking sendAppendEntries for follower follower711: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/11/2024 01:14:20.055] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower711] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2789efd6
01:14:20,55 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower712: Last sync leader does not match current leader leader710, need to catch up to -1
01:14:20,55 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower712 updated: matchIndex: -1, nextIndex: 0
01:14:20,56 AM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Checking sendAppendEntries for follower follower712: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/11/2024 01:14:20.056] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower712] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@249b2784
[WARN] [04/11/2024 01:14:20.056] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower713] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@7596151a
01:14:20,78 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
01:14:20,78 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
01:14:20,79 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
01:14:20,79 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower711]
01:14:20,90 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower713]
01:14:20,100 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
01:14:20,100 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
01:14:20,101 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710: onRequestLeadership RequestLeadership [requestedFollowerId=follower712, replyTo=Actor[akka://test/user/$d#1711854347]]
01:14:20,101 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710: Initiating leader transfer
01:14:20,101 AM [test-akka.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader710: pauseLeader successfully completed - doing transfer
01:14:20,101 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Attempting to transfer leadership
01:14:20,101 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Checking sendAppendEntries for follower follower711: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/11/2024 01:14:20.101] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower711] received dead letter from TestActor[akka://test/user/leader710]: LeaderTransitioning [leaderId=leader710]
[WARN] [04/11/2024 01:14:20.101] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower713] received dead letter from TestActor[akka://test/user/leader710]: LeaderTransitioning [leaderId=leader710]
01:14:20,101 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Checking sendAppendEntries for follower follower713: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/11/2024 01:14:20.101] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower711] received dead letter from TestActor[akka://test/user/leader710]: AppendEntries [leaderId=leader710, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
01:14:20,101 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Checking sendAppendEntries for follower follower712: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/11/2024 01:14:20.101] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower713] received dead letter from TestActor[akka://test/user/leader710]: AppendEntries [leaderId=leader710, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
01:14:20,101 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower712: Lagging 0 entries behind leader leader710 and reached -1 (of expected -1)
01:14:20,101 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712: onLeaderTransitioning: LeaderTransitioning [leaderId=leader710]
01:14:20,101 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): tryToCompleteLeadershipTransfer: followerId: follower712, matchIndex: -1, lastIndex: -1, isVoting: true
01:14:20,101 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Follower's log matches - sending ElectionTimeout
01:14:20,101 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Checking sendAppendEntries for follower follower711: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:20,101 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Checking sendAppendEntries for follower follower713: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:20,102 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Checking sendAppendEntries for follower follower712: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/11/2024 01:14:20.102] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower711] received dead letter from TestActor[akka://test/user/leader710]: AppendEntries [leaderId=leader710, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
01:14:20,102 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Leader transfer complete
01:14:20,102 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorLeadershipTransferCohort - leader710: leader transfer complete - waiting for new leader
[WARN] [04/11/2024 01:14:20.102] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower712] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6a287178
01:14:20,102 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower712: Lagging 0 entries behind leader leader710 and reached -1 (of expected -1)
[WARN] [04/11/2024 01:14:20.102] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower713] received dead letter from TestActor[akka://test/user/leader710]: AppendEntries [leaderId=leader710, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
01:14:20,102 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:20,102 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Follower): Received TimeoutNow - switching to Candidate
01:14:20,102 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Candidate): Election: Candidate has following voting peers: [follower711, leader710]
01:14:20,102 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712: Set currentTerm=3, votedFor=follower712
01:14:20,102 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Candidate): Starting new election term 3
01:14:20,102 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Candidate): Sending RequestVote [term=3, candidateId=follower712, lastLogIndex=-1, lastLogTerm=-1] to peer follower711
01:14:20,102 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Candidate): Sending RequestVote [term=3, candidateId=follower712, lastLogIndex=-1, lastLogTerm=-1] to peer leader710
01:14:20,102 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
[WARN] [04/11/2024 01:14:20.102] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower711] received dead letter from TestActor[akka://test/user/follower712]: RequestVote [term=3, candidateId=follower712, lastLogIndex=-1, lastLogTerm=-1]
01:14:20,102 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:20,102 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Cluster state: []
01:14:20,102 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Candidate in requestVote:RequestVote [term=3, candidateId=follower712, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
01:14:20,102 AM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Term 3 in "RequestVote [term=3, candidateId=follower712, lastLogIndex=-1, lastLogTerm=-1]" message is greater than leader's term 2 - switching to Follower
01:14:20,103 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710: Set currentTerm=3, votedFor=null
01:14:20,103 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): Leadership transfer in progress - processing RequestVote
01:14:20,103 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): In requestVote:  RequestVote [term=3, candidateId=follower712, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
01:14:20,103 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710: Set currentTerm=3, votedFor=follower712
01:14:20,103 AM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader): requestVote returning: RequestVoteReply [term=3, voteGranted=true]
01:14:20,103 AM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader710 (Leader) :- Switching from behavior Leader to Follower, election term: 3
01:14:20,103 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Candidate): RaftRPC message received RequestVoteReply [term=3, voteGranted=true], my term is 3
01:14:20,103 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Candidate): handleRequestVoteReply: RequestVoteReply [term=3, voteGranted=true], current voteCount: 1
01:14:20,103 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Leader): Election: Leader has following peers: [follower711, follower713, leader710]
01:14:20,103 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Leader): Checking sendAppendEntries for follower follower711: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:20,103 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Leader): Checking sendAppendEntries for follower follower713: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:20,103 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Leader): Checking sendAppendEntries for follower leader710: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:20,103 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
[WARN] [04/11/2024 01:14:20.103] [test-akka.actor.default-dispatcher-7] [akka://test/user/follower711] received dead letter from TestActor[akka://test/user/follower712]: AppendEntries [leaderId=follower712, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]
[WARN] [04/11/2024 01:14:20.103] [test-akka.actor.default-dispatcher-7] [akka://test/user/follower713] received dead letter from TestActor[akka://test/user/follower712]: AppendEntries [leaderId=follower712, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]
01:14:20,104 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - leader710: Last sync leader does not match current leader follower712, need to catch up to -1
01:14:20,104 AM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorLeadershipTransferCohort - leader710: leader changed to follower712
01:14:20,104 AM [test-akka.actor.default-dispatcher-12] [INFO] RaftActorLeadershipTransferCohort - leader710: Successfully transferred leadership to follower712 in 2.926 ms
01:14:20,104 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader710: Leadership transferred successfully to follower712
01:14:20,104 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader710 updated: matchIndex: -1, nextIndex: 0
01:14:20,104 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower712 (Leader): Checking sendAppendEntries for follower leader710: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [04/11/2024 01:14:20.104] [test-akka.actor.default-dispatcher-12] [akka://test/user/leader710] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@72295361
01:14:20,152 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown ending
01:14:20,152 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower711-notifier714#-1066444628]
01:14:20,163 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower711-collector715#-350666837]
01:14:20,163 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower712-notifier716#1849119206]
01:14:20,163 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower712-collector717#51060273]
01:14:20,163 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower712]
01:14:20,164 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower713-notifier718#1023019572]
01:14:20,164 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower713-collector719#1891874413]
01:14:20,164 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader710-notifier720#-728163310]
01:14:20,164 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader710-collector721#-2029691835]
01:14:20,164 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader710]
01:14:20,164 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$d#1711854347]
[INFO] [04/11/2024 01:14:20.165] [main] [CoordinatedShutdown(akka://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
01:14:20,165 AM [test-akka.actor.default-dispatcher-6] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
[WARN] [04/11/2024 01:14:20.167] [test-akka.actor.default-dispatcher-6] [akka://test/system/cluster/core/daemon] unhandled message from Actor[akka://test/deadLetters]: Leave(akka://test@10.30.171.228:25520)
[INFO] [04/11/2024 01:14:20.167] [test-akka.actor.internal-dispatcher-3] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.228:25520] - Exiting completed
01:14:20,167 AM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.171.228:25520] - Exiting completed
01:14:20,167 AM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.171.228:25520] - Shutting down...
[INFO] [04/11/2024 01:14:20.167] [test-akka.actor.internal-dispatcher-3] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.228:25520] - Shutting down...
[INFO] [04/11/2024 01:14:20.167] [test-akka.actor.internal-dispatcher-3] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.228:25520] - Successfully shut down
01:14:20,168 AM [test-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://test@10.30.171.228:25520] - Successfully shut down
[INFO] [04/11/2024 01:14:20.169] [test-akka.remote.default-remote-dispatcher-8] [akka://test@10.30.171.228:25520/system/remoting-terminator] Shutting down remote daemon.
01:14:20,170 AM [test-akka.actor.default-dispatcher-6] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
[INFO] [04/11/2024 01:14:20.170] [test-akka.remote.default-remote-dispatcher-8] [akka://test@10.30.171.228:25520/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports.
01:14:20,170 AM [test-akka.actor.default-dispatcher-5] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.