[DEBUG] [03/26/2024 16:58:30.170] [main] [EventStream(akka://test)] logger log1-TestEventListener started
04:58:30,171 PM [test-akka.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started
[DEBUG] [03/26/2024 16:58:30.171] [main] [EventStream(akka://test)] logger log2-Slf4jLogger started
[DEBUG] [03/26/2024 16:58:30.171] [main] [EventStream(akka://test)] Default Loggers started
[INFO] [03/26/2024 16:58:30.192] [main] [ArteryTransport(akka://test)] Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.171.176:25520] with UID [4406554136128778460]
[INFO] [03/26/2024 16:58:30.193] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.176:25520] - Starting up, Akka version [2.6.21] ...
04:58:30,193 PM [test-akka.actor.default-dispatcher-7] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.171.176:25520] with UID [4406554136128778460]
04:58:30,193 PM [test-akka.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [akka://test@10.30.171.176:25520] - Starting up, Akka version [2.6.21] ...
04:58:30,208 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferAborted starting
04:58:30,208 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[INFO] [03/26/2024 16:58:30.196] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.176:25520] - Registered cluster JMX MBean [akka:type=Cluster]
04:58:30,212 PM [test-akka.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [akka://test@10.30.171.176:25520] - Registered cluster JMX MBean [akka:type=Cluster]
04:58:30,212 PM [test-akka.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [akka://test@10.30.171.176:25520] - Started up successfully
04:58:30,212 PM [test-akka.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [akka://test@10.30.171.176:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
04:58:30,212 PM [test-akka.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [akka://test@10.30.171.176:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
[INFO] [03/26/2024 16:58:30.196] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.176:25520] - Started up successfully
[INFO] [03/26/2024 16:58:30.208] [test-akka.actor.internal-dispatcher-3] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.176:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
[INFO] [03/26/2024 16:58:30.208] [test-akka.actor.internal-dispatcher-3] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.176:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
[WARN] [03/26/2024 16:58:30.217] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower462]: org.opendaylight.controller.cluster.common.actor.Monitor@6ceb45ae
[INFO] [akkaDeadLetter][03/26/2024 16:58:30.217] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower462] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
04:58:30,217 PM [test-akka.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower462] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
04:58:30,218 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower462 with journal batch size 1000
04:58:30,225 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower462: SnapshotOffer called.
04:58:30,225 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower462: Moving last applied index from -1 to -1
04:58:30,225 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower462: Set currentTerm=1, votedFor=null
04:58:30,228 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower462: Updated server config: isVoting: true, peers: [PeerInfo [id=follower464, address=akka://test/user/follower464, votingState=NON_VOTING], PeerInfo [id=leader461, address=akka://test/user/leader461, votingState=VOTING], PeerInfo [id=follower463, address=akka://test/user/follower463, votingState=VOTING]]
04:58:30,228 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower462 in 2.462 ms: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:30,229 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower462: Recovery completed  in 3.702 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [03/26/2024 16:58:30.318] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower463]: org.opendaylight.controller.cluster.common.actor.Monitor@4b980a43
[INFO] [akkaDeadLetter][03/26/2024 16:58:30.319] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower463] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
04:58:30,319 PM [test-akka.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower463] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
04:58:30,319 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower463 with journal batch size 1000
04:58:30,320 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower463: SnapshotOffer called.
04:58:30,320 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower463: Moving last applied index from -1 to -1
04:58:30,320 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower463: Set currentTerm=1, votedFor=null
04:58:30,320 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower463: Updated server config: isVoting: true, peers: [PeerInfo [id=follower464, address=akka://test/user/follower464, votingState=NON_VOTING], PeerInfo [id=leader461, address=akka://test/user/leader461, votingState=VOTING], PeerInfo [id=follower462, address=akka://test/user/follower462, votingState=VOTING]]
04:58:30,320 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower463 in 151.1 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:30,321 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower463: Recovery completed  in 1.432 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [03/26/2024 16:58:30.421] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower464]: org.opendaylight.controller.cluster.common.actor.Monitor@3db10116
[INFO] [akkaDeadLetter][03/26/2024 16:58:30.421] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower464] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
04:58:30,421 PM [test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower464] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
04:58:30,422 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower464 with journal batch size 1000
04:58:30,422 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower464: SnapshotOffer called.
04:58:30,422 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower464: Moving last applied index from -1 to -1
04:58:30,422 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower464: Set currentTerm=1, votedFor=null
04:58:30,423 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower464: Updated server config: isVoting: false, peers: [PeerInfo [id=leader461, address=akka://test/user/leader461, votingState=VOTING], PeerInfo [id=follower463, address=akka://test/user/follower463, votingState=VOTING], PeerInfo [id=follower462, address=akka://test/user/follower462, votingState=VOTING]]
04:58:30,423 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower464 in 109.4 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:30,424 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower464: Recovery completed  in 1.341 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
04:58:30,523 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader461 with journal batch size 1000
[WARN] [03/26/2024 16:58:30.523] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader461]: org.opendaylight.controller.cluster.common.actor.Monitor@48de4659
04:58:30,523 PM [test-akka.actor.default-dispatcher-13] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/leader461] to Actor[akka://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [akkaDeadLetter][03/26/2024 16:58:30.523] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/leader461] to Actor[akka://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
04:58:30,524 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461: SnapshotOffer called.
04:58:30,524 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461: Moving last applied index from -1 to -1
04:58:30,524 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461: Set currentTerm=1, votedFor=null
04:58:30,524 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461: Updated server config: isVoting: true, peers: [PeerInfo [id=follower464, address=akka://test/user/follower464, votingState=NON_VOTING], PeerInfo [id=follower463, address=akka://test/user/follower463, votingState=VOTING], PeerInfo [id=follower462, address=akka://test/user/follower462, votingState=VOTING]]
04:58:30,524 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader461 in 65.91 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:30,525 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader461: Recovery completed  in 951.6 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
04:58:30,914 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
04:58:30,914 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.171.176:25520, Removed)
04:58:30,914 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Follower): Received ElectionTimeout - switching to Candidate
04:58:30,914 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Candidate): Election: Candidate has following voting peers: [follower463, follower462]
04:58:30,914 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461: Set currentTerm=2, votedFor=leader461
04:58:30,915 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Candidate): Starting new election term 2
04:58:30,915 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Candidate): Sending RequestVote [term=2, candidateId=leader461, lastLogIndex=-1, lastLogTerm=-1] to peer follower463
04:58:30,915 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Candidate): Sending RequestVote [term=2, candidateId=leader461, lastLogIndex=-1, lastLogTerm=-1] to peer follower462
04:58:30,915 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower463 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
04:58:30,915 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
04:58:30,915 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower463 (Follower): Cluster state: []
04:58:30,915 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower462 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
04:58:30,915 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower463 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader461, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
04:58:30,915 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower463 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader461, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
04:58:30,915 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower463: Set currentTerm=2, votedFor=null
04:58:30,915 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower462 (Follower): Cluster state: []
04:58:30,915 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower462 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader461, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
04:58:30,915 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower462 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader461, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
04:58:30,915 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower463 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader461, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
04:58:30,915 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower462: Set currentTerm=2, votedFor=null
04:58:30,915 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower463: Set currentTerm=2, votedFor=leader461
04:58:30,915 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower462 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader461, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
04:58:30,915 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower462: Set currentTerm=2, votedFor=leader461
04:58:30,915 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower462 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
04:58:30,917 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2
04:58:30,917 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1
04:58:30,917 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Leader): Election: Leader has following peers: [follower464, follower463, follower462]
04:58:30,917 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Leader): Checking sendAppendEntries for follower follower464: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:30,917 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Leader): Checking sendAppendEntries for follower follower463: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:30,918 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Leader): Checking sendAppendEntries for follower follower462: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:30,918 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
04:58:30,918 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower464 (Follower): Term 2 in "AppendEntries [leaderId=leader461, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term
04:58:30,918 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower464: Set currentTerm=2, votedFor=null
04:58:30,918 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower462: Last sync leader does not match current leader leader461, need to catch up to -1
04:58:30,918 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower464: Last sync leader does not match current leader leader461, need to catch up to -1
04:58:30,918 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower462 updated: matchIndex: -1, nextIndex: 0
04:58:30,918 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Leader): Checking sendAppendEntries for follower follower462: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:30,918 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower464 updated: matchIndex: -1, nextIndex: 0
04:58:30,918 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Leader): Checking sendAppendEntries for follower follower464: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:30,919 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower463 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
04:58:30,924 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower463: Last sync leader does not match current leader leader461, need to catch up to -1
04:58:30,924 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower463 updated: matchIndex: -1, nextIndex: 0
04:58:30,925 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Leader): Checking sendAppendEntries for follower follower463: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [03/26/2024 16:58:30.925] [test-akka.actor.default-dispatcher-13] [akka://test/user/follower463] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@a3db1e0
[INFO] [akkaDeadLetter][03/26/2024 16:58:30.925] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower463] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower463] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[WARN] [03/26/2024 16:58:30.925] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower464] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@55c6f9a1
04:58:30,925 PM [test-akka.actor.default-dispatcher-13] [INFO] TestActorRef - Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower463] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [akkaDeadLetter][03/26/2024 16:58:30.925] [test-akka.actor.default-dispatcher-13] [akka://test/user/follower464] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower464] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
04:58:30,925 PM [test-akka.actor.default-dispatcher-13] [INFO] TestActorRef - Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower464] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[WARN] [03/26/2024 16:58:30.925] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower462] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@580daa34
04:58:30,925 PM [test-akka.actor.default-dispatcher-12] [INFO] TestActorRef - Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower462] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [akkaDeadLetter][03/26/2024 16:58:30.925] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower462] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower462] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
04:58:30,928 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
04:58:30,928 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/leader461 starting
04:58:30,931 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461: onShutDown
04:58:30,931 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461: Initiating leader transfer
04:58:30,932 PM [test-akka.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader461: pauseLeader successfully completed - doing transfer
04:58:30,932 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Leader): Attempting to transfer leadership
04:58:30,932 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Leader): Checking sendAppendEntries for follower follower464: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:30,932 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Leader): Checking sendAppendEntries for follower follower463: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:30,932 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Leader): Checking sendAppendEntries for follower follower462: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:30,932 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower463: Lagging 0 entries behind leader leader461 and reached -1 (of expected -1)
04:58:30,932 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower462: Lagging 0 entries behind leader leader461 and reached -1 (of expected -1)
04:58:30,932 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower463: onLeaderTransitioning: LeaderTransitioning [leaderId=leader461]
04:58:30,932 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower464: onLeaderTransitioning: LeaderTransitioning [leaderId=leader461]
04:58:30,932 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower462: onLeaderTransitioning: LeaderTransitioning [leaderId=leader461]
04:58:30,933 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower464: Lagging 0 entries behind leader leader461 and reached -1 (of expected -1)
[WARN] [03/26/2024 16:58:30.933] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower462] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@14a23339
04:58:30,933 PM [test-akka.actor.default-dispatcher-12] [INFO] TestActorRef - Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower462] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [akkaDeadLetter][03/26/2024 16:58:30.933] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower462] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower462] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[WARN] [03/26/2024 16:58:30.933] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower464] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@9817d43
04:58:30,933 PM [test-akka.actor.default-dispatcher-13] [INFO] TestActorRef - Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower464] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [akkaDeadLetter][03/26/2024 16:58:30.933] [test-akka.actor.default-dispatcher-13] [akka://test/user/follower464] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower464] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[WARN] [03/26/2024 16:58:30.933] [test-akka.actor.default-dispatcher-7] [akka://test/user/follower463] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@4269eaa8
04:58:30,933 PM [test-akka.actor.default-dispatcher-7] [INFO] TestActorRef - Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower463] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [akkaDeadLetter][03/26/2024 16:58:30.933] [test-akka.actor.default-dispatcher-7] [akka://test/user/follower463] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower463] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
04:58:31,35 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower464: Lagging 0 entries behind leader leader461 and reached -1 (of expected -1)
04:58:31,35 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower463: Lagging 0 entries behind leader leader461 and reached -1 (of expected -1)
04:58:31,35 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower462: Lagging 0 entries behind leader leader461 and reached -1 (of expected -1)
04:58:31,154 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower462: Lagging 0 entries behind leader leader461 and reached -1 (of expected -1)
04:58:31,154 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower463: Lagging 0 entries behind leader leader461 and reached -1 (of expected -1)
04:58:31,154 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower464: Lagging 0 entries behind leader leader461 and reached -1 (of expected -1)
04:58:31,274 PM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorLeadershipTransferCohort - leader461: leader transfer aborted
04:58:31,275 PM [test-akka.actor.default-dispatcher-11] [WARN] RaftActorLeadershipTransferCohort - leader461: Failed to transfer leadership in 343.1 ms
04:58:31,275 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461: leader transfer failed - sending PoisonPill
04:58:31,275 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader461 (Leader): Leadership transfer expired
04:58:31,275 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower463: Lagging 0 entries behind leader leader461 and reached -1 (of expected -1)
04:58:31,275 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower464: Lagging 0 entries behind leader leader461 and reached -1 (of expected -1)
04:58:31,275 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower462: Lagging 0 entries behind leader leader461 and reached -1 (of expected -1)
[WARN] [03/26/2024 16:58:31.275] [test-akka.actor.default-dispatcher-6] [akka://test/user/leader461] received dead letter from TestActor[akka://test/user/follower463]: AppendEntriesReply [term=2, success=true, followerId=follower463, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
[WARN] [03/26/2024 16:58:31.276] [test-akka.actor.default-dispatcher-6] [akka://test/user/leader461] received dead letter from TestActor[akka://test/user/follower464]: AppendEntriesReply [term=2, success=true, followerId=follower464, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
[WARN] [03/26/2024 16:58:31.276] [test-akka.actor.default-dispatcher-6] [akka://test/user/leader461] received dead letter from TestActor[akka://test/user/follower462]: AppendEntriesReply [term=2, success=true, followerId=follower462, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
04:58:31,276 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/leader461 ending
04:58:31,277 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending
04:58:31,278 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower462-notifier465#100801758]
04:58:31,289 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower462-collector466#-782888002]
04:58:31,289 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower462]
04:58:31,290 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower463-notifier467#-491466765]
04:58:31,290 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower463-collector468#1563673839]
04:58:31,290 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower463]
04:58:31,290 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower464-notifier469#-891807279]
04:58:31,290 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower464-collector470#358377522]
04:58:31,291 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower464]
04:58:31,291 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader461-notifier471#223818130]
04:58:31,291 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader461-collector472#1947548840]
04:58:31,291 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader461]
04:58:31,292 PM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 starting
04:58:31,292 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [03/26/2024 16:58:31.295] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower474]: org.opendaylight.controller.cluster.common.actor.Monitor@19031861
04:58:31,295 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower474 with journal batch size 1000
04:58:31,296 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474: SnapshotOffer called.
04:58:31,296 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474: Moving last applied index from -1 to -1
04:58:31,296 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474: Set currentTerm=1, votedFor=null
04:58:31,297 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474: Updated server config: isVoting: true, peers: [PeerInfo [id=follower476, address=akka://test/user/follower476, votingState=NON_VOTING], PeerInfo [id=follower475, address=akka://test/user/follower475, votingState=VOTING], PeerInfo [id=leader473, address=akka://test/user/leader473, votingState=VOTING]]
04:58:31,297 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower474 in 182.3 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:31,298 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower474: Recovery completed  in 1.186 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [03/26/2024 16:58:31.397] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower475]: org.opendaylight.controller.cluster.common.actor.Monitor@622752c1
04:58:31,397 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower475 with journal batch size 1000
04:58:31,399 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475: SnapshotOffer called.
04:58:31,399 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475: Moving last applied index from -1 to -1
04:58:31,399 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475: Set currentTerm=1, votedFor=null
04:58:31,399 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475: Updated server config: isVoting: true, peers: [PeerInfo [id=follower476, address=akka://test/user/follower476, votingState=NON_VOTING], PeerInfo [id=leader473, address=akka://test/user/leader473, votingState=VOTING], PeerInfo [id=follower474, address=akka://test/user/follower474, votingState=VOTING]]
04:58:31,399 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower475 in 133.4 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:31,401 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower475: Recovery completed  in 1.723 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [03/26/2024 16:58:31.499] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower476]: org.opendaylight.controller.cluster.common.actor.Monitor@b3dbabc
04:58:31,500 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower476 with journal batch size 1000
04:58:31,501 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower476: SnapshotOffer called.
04:58:31,501 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower476: Moving last applied index from -1 to -1
04:58:31,501 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower476: Set currentTerm=1, votedFor=null
04:58:31,501 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower476: Updated server config: isVoting: false, peers: [PeerInfo [id=follower475, address=akka://test/user/follower475, votingState=VOTING], PeerInfo [id=leader473, address=akka://test/user/leader473, votingState=VOTING], PeerInfo [id=follower474, address=akka://test/user/follower474, votingState=VOTING]]
04:58:31,502 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower476 in 150.9 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:31,503 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower476: Recovery completed  in 1.639 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
04:58:31,602 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader473 with journal batch size 1000
[WARN] [03/26/2024 16:58:31.602] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader473]: org.opendaylight.controller.cluster.common.actor.Monitor@36439eb2
04:58:31,603 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473: SnapshotOffer called.
04:58:31,603 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473: Moving last applied index from -1 to -1
04:58:31,603 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473: Set currentTerm=1, votedFor=null
04:58:31,603 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473: Updated server config: isVoting: true, peers: [PeerInfo [id=follower476, address=akka://test/user/follower476, votingState=NON_VOTING], PeerInfo [id=follower475, address=akka://test/user/follower475, votingState=VOTING], PeerInfo [id=follower474, address=akka://test/user/follower474, votingState=VOTING]]
04:58:31,603 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader473 in 97.68 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:31,605 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader473: Recovery completed  in 1.319 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
04:58:31,934 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
04:58:31,934 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.171.176:25520, Removed)
04:58:31,934 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Follower): Received ElectionTimeout - switching to Candidate
04:58:31,935 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Candidate): Election: Candidate has following voting peers: [follower475, follower474]
04:58:31,935 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473: Set currentTerm=2, votedFor=leader473
04:58:31,935 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Candidate): Starting new election term 2
04:58:31,935 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Candidate): Sending RequestVote [term=2, candidateId=leader473, lastLogIndex=-1, lastLogTerm=-1] to peer follower475
04:58:31,935 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Candidate): Sending RequestVote [term=2, candidateId=leader473, lastLogIndex=-1, lastLogTerm=-1] to peer follower474
04:58:31,935 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
04:58:31,935 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
04:58:31,935 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Follower): Cluster state: []
04:58:31,935 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader473, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
04:58:31,935 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader473, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
04:58:31,935 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475: Set currentTerm=2, votedFor=null
04:58:31,935 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
04:58:31,935 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474 (Follower): Cluster state: []
04:58:31,935 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader473, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
04:58:31,935 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader473, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
04:58:31,935 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower474 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader473, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
04:58:31,935 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475: Set currentTerm=2, votedFor=leader473
04:58:31,935 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474: Set currentTerm=2, votedFor=null
04:58:31,935 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
04:58:31,936 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader473, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
04:58:31,936 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474: Set currentTerm=2, votedFor=leader473
04:58:31,936 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
04:58:31,937 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2
04:58:31,937 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1
04:58:31,937 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Election: Leader has following peers: [follower476, follower475, follower474]
04:58:31,937 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Checking sendAppendEntries for follower follower476: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:31,937 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Checking sendAppendEntries for follower follower475: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:31,937 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Checking sendAppendEntries for follower follower474: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:31,938 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower476 (Follower): Term 2 in "AppendEntries [leaderId=leader473, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term
04:58:31,938 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
04:58:31,938 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower475: Last sync leader does not match current leader leader473, need to catch up to -1
04:58:31,938 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower476: Set currentTerm=2, votedFor=null
04:58:31,938 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower476: Last sync leader does not match current leader leader473, need to catch up to -1
04:58:31,938 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower475 updated: matchIndex: -1, nextIndex: 0
04:58:31,938 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Checking sendAppendEntries for follower follower475: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [03/26/2024 16:58:31.938] [test-akka.actor.default-dispatcher-13] [akka://test/user/follower475] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@78626f75
04:58:31,938 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower476 updated: matchIndex: -1, nextIndex: 0
04:58:31,938 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower474: Last sync leader does not match current leader leader473, need to catch up to -1
04:58:31,938 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Checking sendAppendEntries for follower follower476: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:31,938 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower474 updated: matchIndex: -1, nextIndex: 0
04:58:31,938 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Checking sendAppendEntries for follower follower474: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [03/26/2024 16:58:31.938] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower474] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@4ff49510
[WARN] [03/26/2024 16:58:31.939] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower476] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@536c939e
04:58:31,953 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
04:58:31,953 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
04:58:31,954 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
04:58:31,954 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
04:58:31,954 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
04:58:31,955 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473: onRequestLeadership RequestLeadership [requestedFollowerId=follower475, replyTo=Actor[akka://test/user/$a#-493305001]]
04:58:31,956 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473: Initiating leader transfer
04:58:31,957 PM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader473: pauseLeader successfully completed - doing transfer
04:58:31,957 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Attempting to transfer leadership
04:58:31,957 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower476: onLeaderTransitioning: LeaderTransitioning [leaderId=leader473]
04:58:31,957 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Checking sendAppendEntries for follower follower476: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:31,957 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475: onLeaderTransitioning: LeaderTransitioning [leaderId=leader473]
04:58:31,957 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Checking sendAppendEntries for follower follower475: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:31,957 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474: onLeaderTransitioning: LeaderTransitioning [leaderId=leader473]
04:58:31,957 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Checking sendAppendEntries for follower follower474: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:31,957 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower475: Lagging 0 entries behind leader leader473 and reached -1 (of expected -1)
04:58:31,957 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower476: Lagging 0 entries behind leader leader473 and reached -1 (of expected -1)
04:58:31,957 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): tryToCompleteLeadershipTransfer: followerId: follower475, matchIndex: -1, lastIndex: -1, isVoting: true
04:58:31,957 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Follower's log matches - sending ElectionTimeout
04:58:31,957 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Checking sendAppendEntries for follower follower476: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [03/26/2024 16:58:31.957] [test-akka.actor.default-dispatcher-7] [akka://test/user/follower475] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@3369706f
04:58:31,957 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Checking sendAppendEntries for follower follower475: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:31,957 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower476: Lagging 0 entries behind leader leader473 and reached -1 (of expected -1)
[WARN] [03/26/2024 16:58:31.957] [test-akka.actor.default-dispatcher-7] [akka://test/user/follower476] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@7f15162e
04:58:31,957 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Checking sendAppendEntries for follower follower474: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:31,958 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Leader transfer complete
04:58:31,958 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower475: Lagging 0 entries behind leader leader473 and reached -1 (of expected -1)
04:58:31,958 PM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorLeadershipTransferCohort - leader473: leader transfer complete - waiting for new leader
04:58:31,958 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
04:58:31,958 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Follower): Received TimeoutNow - switching to Candidate
04:58:31,958 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower474: Lagging 0 entries behind leader leader473 and reached -1 (of expected -1)
04:58:31,958 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Candidate): Election: Candidate has following voting peers: [leader473, follower474]
04:58:31,958 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475: Set currentTerm=3, votedFor=follower475
04:58:31,959 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Candidate): Starting new election term 3
04:58:31,959 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower474: Lagging 0 entries behind leader leader473 and reached -1 (of expected -1)
04:58:31,959 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Candidate): Sending RequestVote [term=3, candidateId=follower475, lastLogIndex=-1, lastLogTerm=-1] to peer leader473
04:58:31,959 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Candidate): Sending RequestVote [term=3, candidateId=follower475, lastLogIndex=-1, lastLogTerm=-1] to peer follower474
04:58:31,959 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
04:58:31,959 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
04:58:31,959 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Cluster state: []
04:58:31,959 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Candidate in requestVote:RequestVote [term=3, candidateId=follower475, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
04:58:31,959 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Term 3 in "RequestVote [term=3, candidateId=follower475, lastLogIndex=-1, lastLogTerm=-1]" message is greater than leader's term 2 - switching to Follower
04:58:31,959 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473: Set currentTerm=3, votedFor=null
04:58:31,959 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
04:58:31,959 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): Leadership transfer in progress - processing RequestVote
04:58:31,959 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474 (Follower): Cluster state: []
04:58:31,959 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): In requestVote:  RequestVote [term=3, candidateId=follower475, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
04:58:31,959 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474 (Follower): Candidate in requestVote:RequestVote [term=3, candidateId=follower475, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
04:58:31,959 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473: Set currentTerm=3, votedFor=follower475
04:58:31,959 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower474 (Follower): Term 3 in "RequestVote [term=3, candidateId=follower475, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 2 - updating term
04:58:31,959 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474: Set currentTerm=3, votedFor=null
04:58:31,959 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader): requestVote returning: RequestVoteReply [term=3, voteGranted=true]
04:58:31,959 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474 (Follower): In requestVote:  RequestVote [term=3, candidateId=follower475, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
04:58:31,959 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474: Set currentTerm=3, votedFor=follower475
04:58:31,959 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader473 (Leader) :- Switching from behavior Leader to Follower, election term: 3
04:58:31,959 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower474 (Follower): requestVote returning: RequestVoteReply [term=3, voteGranted=true]
[WARN] [03/26/2024 16:58:31.960] [test-akka.actor.default-dispatcher-7] [akka://test/user/follower474] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@112c287d
04:58:31,960 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Candidate): RaftRPC message received RequestVoteReply [term=3, voteGranted=true], my term is 3
04:58:31,960 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Candidate): handleRequestVoteReply: RequestVoteReply [term=3, voteGranted=true], current voteCount: 1
04:58:31,960 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Leader): Election: Leader has following peers: [follower476, leader473, follower474]
04:58:31,961 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Leader): Checking sendAppendEntries for follower follower476: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:31,961 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Leader): Checking sendAppendEntries for follower leader473: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:31,961 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower476 (Follower): Term 3 in "AppendEntries [leaderId=follower475, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 2 - updating term
04:58:31,961 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower476: Set currentTerm=3, votedFor=null
04:58:31,961 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Leader): Checking sendAppendEntries for follower follower474: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:31,961 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
04:58:31,961 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower476: Last sync leader does not match current leader follower475, need to catch up to -1
04:58:31,961 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - leader473: Last sync leader does not match current leader follower475, need to catch up to -1
04:58:31,961 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower474: Last sync leader does not match current leader follower475, need to catch up to -1
04:58:31,961 PM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorLeadershipTransferCohort - leader473: leader changed to follower475
04:58:31,961 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower476 updated: matchIndex: -1, nextIndex: 0
[WARN] [03/26/2024 16:58:31.961] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower474] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@3e03d47b
04:58:31,961 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Leader): Checking sendAppendEntries for follower follower476: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:31,961 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader473 updated: matchIndex: -1, nextIndex: 0
04:58:31,961 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Leader): Checking sendAppendEntries for follower leader473: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:31,961 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower474 updated: matchIndex: -1, nextIndex: 0
04:58:31,961 PM [test-akka.actor.default-dispatcher-16] [INFO] RaftActorLeadershipTransferCohort - leader473: Successfully transferred leadership to follower475 in 4.434 ms
04:58:31,961 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower475 (Leader): Checking sendAppendEntries for follower follower474: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:31,961 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader473: Leadership transferred successfully to follower475
[WARN] [03/26/2024 16:58:31.962] [test-akka.actor.default-dispatcher-16] [akka://test/user/leader473] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@f2599d3
[WARN] [03/26/2024 16:58:31.962] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower476] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@b1a1cef
04:58:32,24 PM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 ending
04:58:32,24 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower474-notifier477#-803884279]
04:58:32,35 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower474-collector478#802873340]
04:58:32,35 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower474]
04:58:32,36 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower475-notifier479#898211793]
04:58:32,36 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower475-collector480#-1934624740]
04:58:32,36 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower475]
04:58:32,36 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower476-notifier481#-96907032]
04:58:32,36 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower476-collector482#-148047522]
04:58:32,37 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower476]
04:58:32,37 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader473-notifier483#-1676318776]
04:58:32,37 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader473-collector484#-640432417]
04:58:32,37 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader473]
04:58:32,37 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$a#-493305001]
04:58:32,38 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown starting
04:58:32,38 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [03/26/2024 16:58:32.040] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower486]: org.opendaylight.controller.cluster.common.actor.Monitor@38d75fca
04:58:32,41 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower486 with journal batch size 1000
04:58:32,41 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower486: SnapshotOffer called.
04:58:32,41 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower486: Moving last applied index from -1 to -1
04:58:32,41 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower486: Set currentTerm=1, votedFor=null
04:58:32,42 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower486: Updated server config: isVoting: true, peers: [PeerInfo [id=leader485, address=akka://test/user/leader485, votingState=VOTING], PeerInfo [id=follower487, address=akka://test/user/follower487, votingState=VOTING], PeerInfo [id=follower488, address=akka://test/user/follower488, votingState=NON_VOTING]]
04:58:32,42 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower486 in 87.65 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:32,43 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower486: Recovery completed  in 1.088 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [03/26/2024 16:58:32.142] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower487]: org.opendaylight.controller.cluster.common.actor.Monitor@1a2f8860
04:58:32,143 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower487 with journal batch size 1000
04:58:32,144 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower487: SnapshotOffer called.
04:58:32,144 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower487: Moving last applied index from -1 to -1
04:58:32,144 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower487: Set currentTerm=1, votedFor=null
04:58:32,144 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower487: Updated server config: isVoting: true, peers: [PeerInfo [id=leader485, address=akka://test/user/leader485, votingState=VOTING], PeerInfo [id=follower486, address=akka://test/user/follower486, votingState=VOTING], PeerInfo [id=follower488, address=akka://test/user/follower488, votingState=NON_VOTING]]
04:58:32,144 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower487 in 118.7 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:32,146 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower487: Recovery completed  in 1.471 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [03/26/2024 16:58:32.245] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower488]: org.opendaylight.controller.cluster.common.actor.Monitor@4e9192c3
04:58:32,246 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower488 with journal batch size 1000
04:58:32,247 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower488: SnapshotOffer called.
04:58:32,247 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower488: Moving last applied index from -1 to -1
04:58:32,247 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower488: Set currentTerm=1, votedFor=null
04:58:32,247 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower488: Updated server config: isVoting: false, peers: [PeerInfo [id=leader485, address=akka://test/user/leader485, votingState=VOTING], PeerInfo [id=follower487, address=akka://test/user/follower487, votingState=VOTING], PeerInfo [id=follower486, address=akka://test/user/follower486, votingState=VOTING]]
04:58:32,247 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower488 in 160.2 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:32,248 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower488: Recovery completed  in 1.441 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [03/26/2024 16:58:32.250] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader485]: org.opendaylight.controller.cluster.common.actor.Monitor@6ef1f62c
04:58:32,251 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader485 with journal batch size 1000
04:58:32,251 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485: SnapshotOffer called.
04:58:32,251 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485: Moving last applied index from -1 to -1
04:58:32,251 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485: Set currentTerm=1, votedFor=null
04:58:32,251 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485: Updated server config: isVoting: true, peers: [PeerInfo [id=follower487, address=akka://test/user/follower487, votingState=VOTING], PeerInfo [id=follower486, address=akka://test/user/follower486, votingState=VOTING], PeerInfo [id=follower488, address=akka://test/user/follower488, votingState=NON_VOTING]]
04:58:32,251 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader485 in 122.1 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:32,252 PM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader485: Recovery completed  in 825.2 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
04:58:32,644 PM [test-akka.actor.default-dispatcher-11] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
04:58:32,644 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.171.176:25520, Removed)
04:58:32,644 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Follower): Received ElectionTimeout - switching to Candidate
04:58:32,644 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Candidate): Election: Candidate has following voting peers: [follower487, follower486]
04:58:32,644 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485: Set currentTerm=2, votedFor=leader485
04:58:32,644 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Candidate): Starting new election term 2
04:58:32,645 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Candidate): Sending RequestVote [term=2, candidateId=leader485, lastLogIndex=-1, lastLogTerm=-1] to peer follower487
04:58:32,645 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Candidate): Sending RequestVote [term=2, candidateId=leader485, lastLogIndex=-1, lastLogTerm=-1] to peer follower486
04:58:32,645 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
04:58:32,645 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower487 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
04:58:32,645 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower487 (Follower): Cluster state: []
04:58:32,645 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower487 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader485, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
04:58:32,645 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower487 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader485, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
04:58:32,645 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower487: Set currentTerm=2, votedFor=null
04:58:32,645 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower487 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader485, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
04:58:32,645 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower487: Set currentTerm=2, votedFor=leader485
04:58:32,645 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower487 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
04:58:32,645 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower486 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
04:58:32,645 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower486 (Follower): Cluster state: []
04:58:32,646 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower486 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader485, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
04:58:32,646 PM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower486 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader485, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
04:58:32,646 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower486: Set currentTerm=2, votedFor=null
04:58:32,646 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower486 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader485, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
04:58:32,646 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower486: Set currentTerm=2, votedFor=leader485
04:58:32,646 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower486 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
04:58:32,647 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2
04:58:32,647 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1
04:58:32,647 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Leader): Election: Leader has following peers: [follower487, follower486, follower488]
04:58:32,647 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Leader): Checking sendAppendEntries for follower follower487: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:32,647 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Leader): Checking sendAppendEntries for follower follower486: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:32,647 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Leader): Checking sendAppendEntries for follower follower488: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:32,647 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower487: Last sync leader does not match current leader leader485, need to catch up to -1
04:58:32,647 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
04:58:32,647 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower486: Last sync leader does not match current leader leader485, need to catch up to -1
04:58:32,648 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower488 (Follower): Term 2 in "AppendEntries [leaderId=leader485, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term
04:58:32,648 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower488: Set currentTerm=2, votedFor=null
04:58:32,648 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower488: Last sync leader does not match current leader leader485, need to catch up to -1
[WARN] [03/26/2024 16:58:32.648] [test-akka.actor.default-dispatcher-13] [akka://test/user/follower487] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2cb466bb
[WARN] [03/26/2024 16:58:32.648] [test-akka.actor.default-dispatcher-13] [akka://test/user/follower486] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5f23b073
04:58:32,648 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower487 updated: matchIndex: -1, nextIndex: 0
04:58:32,648 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Leader): Checking sendAppendEntries for follower follower487: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:32,648 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower486 updated: matchIndex: -1, nextIndex: 0
04:58:32,648 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Leader): Checking sendAppendEntries for follower follower486: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:32,648 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower488 updated: matchIndex: -1, nextIndex: 0
04:58:32,648 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Leader): Checking sendAppendEntries for follower follower488: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [03/26/2024 16:58:32.650] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower488] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@1a3c1752
04:58:32,652 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
04:58:32,652 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
04:58:32,653 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
04:58:32,653 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/follower487 starting
04:58:32,653 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower487: onShutDown
04:58:32,654 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/follower487 ending
04:58:32,654 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
04:58:32,654 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
04:58:32,654 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485: onRequestLeadership RequestLeadership [requestedFollowerId=follower487, replyTo=Actor[akka://test/user/$b#1769946]]
04:58:32,654 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485: Initiating leader transfer
04:58:32,654 PM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader485: pauseLeader successfully completed - doing transfer
04:58:32,654 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Leader): Attempting to transfer leadership
04:58:32,654 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower486: onLeaderTransitioning: LeaderTransitioning [leaderId=leader485]
04:58:32,654 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Leader): Checking sendAppendEntries for follower follower487: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:32,654 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Leader): Checking sendAppendEntries for follower follower486: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [03/26/2024 16:58:32.654] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower487] received dead letter from TestActor[akka://test/user/leader485]: LeaderTransitioning [leaderId=leader485]
04:58:32,654 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower488: onLeaderTransitioning: LeaderTransitioning [leaderId=leader485]
04:58:32,654 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Leader): Checking sendAppendEntries for follower follower488: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:32,654 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower488: Lagging 0 entries behind leader leader485 and reached -1 (of expected -1)
04:58:32,654 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower486: Lagging 0 entries behind leader leader485 and reached -1 (of expected -1)
[WARN] [03/26/2024 16:58:32.654] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower487] received dead letter from TestActor[akka://test/user/leader485]: AppendEntries [leaderId=leader485, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
[WARN] [03/26/2024 16:58:32.654] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower488] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@21e4e332
[WARN] [03/26/2024 16:58:32.654] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower486] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@47b0784b
04:58:32,764 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower486: Lagging 0 entries behind leader leader485 and reached -1 (of expected -1)
04:58:32,764 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower488: Lagging 0 entries behind leader leader485 and reached -1 (of expected -1)
[WARN] [03/26/2024 16:58:32.764] [test-akka.actor.default-dispatcher-11] [akka://test/user/follower487] received dead letter from TestActor[akka://test/user/leader485]: AppendEntries [leaderId=leader485, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
04:58:32,885 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower486: Lagging 0 entries behind leader leader485 and reached -1 (of expected -1)
04:58:32,885 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower488: Lagging 0 entries behind leader leader485 and reached -1 (of expected -1)
[WARN] [03/26/2024 16:58:32.885] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower487] received dead letter from TestActor[akka://test/user/leader485]: AppendEntries [leaderId=leader485, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
04:58:33,4 PM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader485: leader transfer aborted
04:58:33,5 PM [test-akka.actor.default-dispatcher-6] [WARN] RaftActorLeadershipTransferCohort - leader485: Failed to transfer leadership in 350.8 ms
04:58:33,5 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485: LeadershipTransfer request from follower487 failed
04:58:33,6 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader485 (Leader): Leadership transfer expired
04:58:33,6 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower486: Lagging 0 entries behind leader leader485 and reached -1 (of expected -1)
04:58:33,6 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower488: Lagging 0 entries behind leader leader485 and reached -1 (of expected -1)
[WARN] [03/26/2024 16:58:33.006] [test-akka.actor.default-dispatcher-11] [akka://test/user/follower487] received dead letter from TestActor[akka://test/user/leader485]: AppendEntries [leaderId=leader485, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
04:58:33,6 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown ending
04:58:33,7 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower486-notifier489#-452955304]
04:58:33,17 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower486-collector490#459665481]
04:58:33,18 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower486]
04:58:33,18 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower487-notifier491#405051716]
04:58:33,18 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower487-collector492#-1352363101]
04:58:33,18 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower487]
04:58:33,18 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower488-notifier493#-1743562342]
04:58:33,19 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower488-collector494#-439722370]
04:58:33,19 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower488]
04:58:33,19 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader485-notifier495#246228864]
04:58:33,19 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader485-collector496#1925018559]
04:58:33,19 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader485]
04:58:33,20 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$b#1769946]
04:58:33,20 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown starting
04:58:33,20 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [03/26/2024 16:58:33.022] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower498]: org.opendaylight.controller.cluster.common.actor.Monitor@16cb978c
04:58:33,23 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower498 with journal batch size 1000
04:58:33,23 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498: SnapshotOffer called.
04:58:33,23 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498: Moving last applied index from -1 to -1
04:58:33,23 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498: Set currentTerm=1, votedFor=null
04:58:33,23 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498: Updated server config: isVoting: true, peers: [PeerInfo [id=leader497, address=akka://test/user/leader497, votingState=VOTING], PeerInfo [id=follower500, address=akka://test/user/follower500, votingState=NON_VOTING], PeerInfo [id=follower499, address=akka://test/user/follower499, votingState=VOTING]]
04:58:33,24 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower498 in 70.40 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:33,25 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower498: Recovery completed  in 1.166 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [03/26/2024 16:58:33.026] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower499]: org.opendaylight.controller.cluster.common.actor.Monitor@269ff624
04:58:33,27 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower499 with journal batch size 1000
04:58:33,28 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499: SnapshotOffer called.
04:58:33,28 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499: Moving last applied index from -1 to -1
04:58:33,28 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499: Set currentTerm=1, votedFor=null
04:58:33,28 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499: Updated server config: isVoting: true, peers: [PeerInfo [id=leader497, address=akka://test/user/leader497, votingState=VOTING], PeerInfo [id=follower498, address=akka://test/user/follower498, votingState=VOTING], PeerInfo [id=follower500, address=akka://test/user/follower500, votingState=NON_VOTING]]
04:58:33,28 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower499 in 126.2 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:33,39 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower499: Recovery completed  in 11.46 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [03/26/2024 16:58:33.128] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower500]: org.opendaylight.controller.cluster.common.actor.Monitor@52e4f292
04:58:33,128 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower500 with journal batch size 1000
04:58:33,129 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500: SnapshotOffer called.
04:58:33,129 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500: Moving last applied index from -1 to -1
04:58:33,129 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500: Set currentTerm=1, votedFor=null
04:58:33,129 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500: Updated server config: isVoting: false, peers: [PeerInfo [id=leader497, address=akka://test/user/leader497, votingState=VOTING], PeerInfo [id=follower498, address=akka://test/user/follower498, votingState=VOTING], PeerInfo [id=follower499, address=akka://test/user/follower499, votingState=VOTING]]
04:58:33,129 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower500 in 70.86 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:33,130 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower500: Recovery completed  in 909.1 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [03/26/2024 16:58:33.229] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader497]: org.opendaylight.controller.cluster.common.actor.Monitor@aeab20c
04:58:33,230 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader497 with journal batch size 1000
04:58:33,231 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: SnapshotOffer called.
04:58:33,231 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: Moving last applied index from -1 to -1
04:58:33,231 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: Set currentTerm=1, votedFor=null
04:58:33,231 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: Updated server config: isVoting: true, peers: [PeerInfo [id=follower498, address=akka://test/user/follower498, votingState=VOTING], PeerInfo [id=follower500, address=akka://test/user/follower500, votingState=NON_VOTING], PeerInfo [id=follower499, address=akka://test/user/follower499, votingState=VOTING]]
04:58:33,231 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader497 in 72.97 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:33,232 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: Recovery completed  in 771.4 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
04:58:33,564 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
04:58:33,564 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.171.176:25520, Removed)
04:58:33,564 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Follower): Received ElectionTimeout - switching to Candidate
04:58:33,564 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Candidate): Election: Candidate has following voting peers: [follower498, follower499]
04:58:33,564 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: Set currentTerm=2, votedFor=leader497
04:58:33,564 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Candidate): Starting new election term 2
04:58:33,564 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Candidate): Sending RequestVote [term=2, candidateId=leader497, lastLogIndex=-1, lastLogTerm=-1] to peer follower498
04:58:33,564 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Candidate): Sending RequestVote [term=2, candidateId=leader497, lastLogIndex=-1, lastLogTerm=-1] to peer follower499
04:58:33,564 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
04:58:33,564 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
04:58:33,564 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Follower): Cluster state: []
04:58:33,564 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader497, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
04:58:33,565 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader497, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
04:58:33,565 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498: Set currentTerm=2, votedFor=null
04:58:33,565 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
04:58:33,565 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): Cluster state: []
04:58:33,565 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader497, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
04:58:33,565 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader497, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
04:58:33,565 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498: Set currentTerm=2, votedFor=leader497
04:58:33,565 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader497, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
04:58:33,565 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499: Set currentTerm=2, votedFor=null
04:58:33,565 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
04:58:33,565 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader497, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
04:58:33,565 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499: Set currentTerm=2, votedFor=leader497
04:58:33,565 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
04:58:33,566 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2
04:58:33,566 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1
04:58:33,566 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Election: Leader has following peers: [follower498, follower500, follower499]
04:58:33,566 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Checking sendAppendEntries for follower follower498: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:33,566 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Checking sendAppendEntries for follower follower500: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:33,566 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Checking sendAppendEntries for follower follower499: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:33,566 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
04:58:33,566 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower500 (Follower): Term 2 in "AppendEntries [leaderId=leader497, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term
04:58:33,566 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500: Set currentTerm=2, votedFor=null
04:58:33,566 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower498: Last sync leader does not match current leader leader497, need to catch up to -1
04:58:33,566 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower500: Last sync leader does not match current leader leader497, need to catch up to -1
04:58:33,566 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower498 updated: matchIndex: -1, nextIndex: 0
04:58:33,567 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Checking sendAppendEntries for follower follower498: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:33,567 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower500 updated: matchIndex: -1, nextIndex: 0
04:58:33,567 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Checking sendAppendEntries for follower follower500: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:33,567 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower499: Last sync leader does not match current leader leader497, need to catch up to -1
[WARN] [03/26/2024 16:58:33.567] [test-akka.actor.default-dispatcher-11] [akka://test/user/follower498] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@146a257a
04:58:33,567 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower499 updated: matchIndex: -1, nextIndex: 0
04:58:33,567 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Checking sendAppendEntries for follower follower499: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [03/26/2024 16:58:33.567] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower499] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@709f7c94
[WARN] [03/26/2024 16:58:33.568] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower500] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6ba0bb87
04:58:33,587 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
04:58:33,587 PM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting
04:58:33,587 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: Persist data SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
04:58:33,587 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 
04:58:33,588 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, payload: class org.opendaylight.controller.cluster.raft.MockRaftActorContext$MockPayload, isSendImmediate: true
04:58:33,588 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Checking sendAppendEntries for follower follower498: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:33,588 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): sendAppendEntries: 0 is present for follower follower498
04:58:33,588 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Sending AppendEntries to follower follower498: AppendEntries [leaderId=leader497, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
04:58:33,588 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Checking sendAppendEntries for follower follower500: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:33,588 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): sendAppendEntries: 0 is present for follower follower500
04:58:33,588 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Sending AppendEntries to follower follower500: AppendEntries [leaderId=leader497, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
04:58:33,588 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Follower): handleAppendEntries: AppendEntries [leaderId=leader497, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
04:58:33,588 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Follower): Number of entries to be appended = 1
04:58:33,588 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Checking sendAppendEntries for follower follower499: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:33,588 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
04:58:33,588 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): sendAppendEntries: 0 is present for follower follower499
04:58:33,588 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Follower): Append entry to log zero
04:58:33,588 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500 (Follower): handleAppendEntries: AppendEntries [leaderId=leader497, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
04:58:33,588 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 
04:58:33,588 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500 (Follower): Number of entries to be appended = 1
04:58:33,588 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Sending AppendEntries to follower follower499: AppendEntries [leaderId=leader497, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
04:58:33,588 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
04:58:33,588 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500 (Follower): Append entry to log zero
04:58:33,588 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 
04:58:33,589 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Follower): Log size is now 1
04:58:33,589 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500 (Follower): Log size is now 1
04:58:33,589 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500 (Follower): handleAppendEntries returning : AppendEntriesReply [term=2, success=true, followerId=follower500, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
04:58:33,589 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Follower): handleAppendEntries returning : AppendEntriesReply [term=2, success=true, followerId=follower498, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
04:58:33,589 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower500: Lagging 0 entries behind leader leader497 and reached -1 (of expected -1)
04:58:33,589 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower498: Lagging 0 entries behind leader leader497 and reached -1 (of expected -1)
04:58:33,589 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower500 updated: matchIndex: 0, nextIndex: 1
04:58:33,589 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Checking sendAppendEntries for follower follower500: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:33,589 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower498 updated: matchIndex: 0, nextIndex: 1
04:58:33,589 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Checking sendAppendEntries for follower follower498: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:33,591 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
04:58:33,591 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
04:58:33,591 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
04:58:33,591 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Setting last applied to 0
04:58:33,591 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: Moving last applied index from -1 to 0
04:58:33,591 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: Applying state for log index 0 data zero
[WARN] [03/26/2024 16:58:33.591] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower500] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@8ea9c15
04:58:33,591 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
04:58:33,591 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: applyState called: zero
[WARN] [03/26/2024 16:58:33.591] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower498] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@3e602d03
04:58:33,591 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: Persisting ApplyJournalEntries with index=0
04:58:33,684 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): sendAppendEntries: 0 is present for follower follower499
04:58:33,684 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Sending AppendEntries to follower follower499: AppendEntries [leaderId=leader497, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
04:58:33,804 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): sendAppendEntries: 0 is present for follower follower499
04:58:33,804 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Follower): Commit index set to 0
04:58:33,804 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower498: Lagging 0 entries behind leader leader497 and reached 0 (of expected -1)
04:58:33,804 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Sending AppendEntries to follower follower499: AppendEntries [leaderId=leader497, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
04:58:33,804 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
04:58:33,804 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500 (Follower): Commit index set to 0
04:58:33,804 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Follower): Setting last applied to 0
04:58:33,804 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498: Moving last applied index from -1 to 0
04:58:33,804 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498: Applying state for log index 0 data zero
04:58:33,804 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower500: Lagging 0 entries behind leader leader497 and reached 0 (of expected -1)
04:58:33,804 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
04:58:33,805 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500 (Follower): Setting last applied to 0
04:58:33,805 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500: Moving last applied index from -1 to 0
04:58:33,805 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500: Applying state for log index 0 data zero
04:58:33,805 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower500: applyState called: zero
04:58:33,805 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower498: applyState called: zero
04:58:33,805 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500: Persisting ApplyJournalEntries with index=0
04:58:33,805 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498: Persisting ApplyJournalEntries with index=0
04:58:33,840 PM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending
04:58:33,840 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 starting
04:58:33,841 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: onShutDown
04:58:33,841 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: Initiating leader transfer
04:58:33,841 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498: onLeaderTransitioning: LeaderTransitioning [leaderId=leader497]
04:58:33,841 PM [test-akka.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader497: pauseLeader successfully completed - doing transfer
04:58:33,841 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Attempting to transfer leadership
04:58:33,841 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500: onLeaderTransitioning: LeaderTransitioning [leaderId=leader497]
04:58:33,841 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Checking sendAppendEntries for follower follower498: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:33,841 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Checking sendAppendEntries for follower follower500: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:33,841 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower498: Lagging 0 entries behind leader leader497 and reached 0 (of expected -1)
04:58:33,841 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Checking sendAppendEntries for follower follower499: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:33,841 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): sendAppendEntries: 0 is present for follower follower499
04:58:33,841 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower500: Lagging 0 entries behind leader leader497 and reached 0 (of expected -1)
04:58:33,842 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): tryToCompleteLeadershipTransfer: followerId: follower498, matchIndex: 0, lastIndex: 0, isVoting: true
04:58:33,842 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Follower's log matches - sending ElectionTimeout
04:58:33,842 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Checking sendAppendEntries for follower follower498: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:33,842 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Checking sendAppendEntries for follower follower500: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:33,842 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Checking sendAppendEntries for follower follower499: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:33,842 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower498: Lagging 0 entries behind leader leader497 and reached 0 (of expected -1)
04:58:33,842 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): sendAppendEntries: 0 is present for follower follower499
04:58:33,842 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower500: Lagging 0 entries behind leader leader497 and reached 0 (of expected -1)
04:58:33,842 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Leader transfer complete
04:58:33,842 PM [test-akka.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader497: leader transfer complete - waiting for new leader
04:58:33,842 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
04:58:33,842 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Follower): Received TimeoutNow - switching to Candidate
04:58:33,842 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Candidate): Election: Candidate has following voting peers: [leader497, follower499]
04:58:33,842 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498: Set currentTerm=3, votedFor=follower498
04:58:33,842 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Candidate): Starting new election term 3
04:58:33,842 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Candidate): Sending RequestVote [term=3, candidateId=follower498, lastLogIndex=0, lastLogTerm=2] to peer leader497
04:58:33,843 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Candidate): Sending RequestVote [term=3, candidateId=follower498, lastLogIndex=0, lastLogTerm=2] to peer follower499
04:58:33,843 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
04:58:33,843 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
04:58:33,843 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
04:58:33,843 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Cluster state: []
04:58:33,843 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): Cluster state: []
04:58:33,843 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Candidate in requestVote:RequestVote [term=3, candidateId=follower498, lastLogIndex=0, lastLogTerm=2] with higher term appears reachable, updating term.
04:58:33,843 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): Candidate in requestVote:RequestVote [term=3, candidateId=follower498, lastLogIndex=0, lastLogTerm=2] with higher term appears reachable, updating term.
04:58:33,843 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Term 3 in "RequestVote [term=3, candidateId=follower498, lastLogIndex=0, lastLogTerm=2]" message is greater than leader's term 2 - switching to Follower
04:58:33,843 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): Term 3 in "RequestVote [term=3, candidateId=follower498, lastLogIndex=0, lastLogTerm=2]" message is greater than follower's term 2 - updating term
04:58:33,843 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: Set currentTerm=3, votedFor=null
04:58:33,843 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499: Set currentTerm=3, votedFor=null
04:58:33,843 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): Leadership transfer in progress - processing RequestVote
04:58:33,843 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): In requestVote:  RequestVote [term=3, candidateId=follower498, lastLogIndex=0, lastLogTerm=2] - currentTerm: 3, votedFor: null, lastIndex: 0, lastTerm: 2
04:58:33,843 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): In requestVote:  RequestVote [term=3, candidateId=follower498, lastLogIndex=0, lastLogTerm=2] - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
04:58:33,843 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: Set currentTerm=3, votedFor=follower498
04:58:33,843 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499: Set currentTerm=3, votedFor=follower498
04:58:33,843 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader): requestVote returning: RequestVoteReply [term=3, voteGranted=true]
04:58:33,843 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): requestVote returning: RequestVoteReply [term=3, voteGranted=true]
04:58:33,843 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader497 (Leader) :- Switching from behavior Leader to Follower, election term: 3
04:58:33,844 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Candidate): RaftRPC message received RequestVoteReply [term=3, voteGranted=true], my term is 3
04:58:33,844 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Candidate): handleRequestVoteReply: RequestVoteReply [term=3, voteGranted=true], current voteCount: 1
04:58:33,844 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Leader): Election: Leader has following peers: [leader497, follower500, follower499]
04:58:33,844 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Leader): Checking sendAppendEntries for follower leader497: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:33,844 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Leader): Checking sendAppendEntries for follower follower500: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:33,844 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Leader): Checking sendAppendEntries for follower follower499: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:33,844 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
04:58:33,844 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - leader497: Last sync leader does not match current leader follower498, need to catch up to -1
04:58:33,844 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower500 (Follower): Term 3 in "AppendEntries [leaderId=follower498, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 2 - updating term
04:58:33,844 PM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader497: leader changed to follower498
04:58:33,844 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower500: Set currentTerm=3, votedFor=null
04:58:33,844 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader497 updated: matchIndex: 0, nextIndex: 1
04:58:33,844 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower500: Last sync leader does not match current leader follower498, need to catch up to -1
04:58:33,844 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Leader): Checking sendAppendEntries for follower leader497: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:33,845 PM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorLeadershipTransferCohort - leader497: Successfully transferred leadership to follower498 in 3.322 ms
04:58:33,845 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower500 updated: matchIndex: 0, nextIndex: 1
04:58:33,845 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader497: leader transfer succeeded - sending PoisonPill
04:58:33,845 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Leader): Checking sendAppendEntries for follower follower500: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:33,845 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - leader497: Lagging 0 entries behind leader follower498 and reached 0 (of expected -1)
[WARN] [03/26/2024 16:58:33.845] [test-akka.actor.default-dispatcher-7] [akka://test/user/leader497] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@3e4d1750
[WARN] [03/26/2024 16:58:33.845] [test-akka.actor.default-dispatcher-7] [akka://test/user/leader497] received dead letter: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@4f4e3f28
04:58:33,846 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower500: Lagging 0 entries behind leader follower498 and reached 0 (of expected -1)
[WARN] [03/26/2024 16:58:33.846] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower500] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5b826431
[WARN] [03/26/2024 16:58:33.846] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower500] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@7d44160
04:58:34,355 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower500: Lagging 0 entries behind leader follower498 and reached 0 (of expected -1)
[WARN] [03/26/2024 16:58:34.355] [test-akka.actor.default-dispatcher-13] [akka://test/user/leader497] received dead letter from TestActor[akka://test/user/follower498]: AppendEntries [leaderId=follower498, prevLogIndex=0, prevLogTerm=2, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
04:58:34,355 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower499: Last sync leader does not match current leader follower498, need to catch up to -1
04:58:34,355 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Leader): sendAppendEntries: 0 is present for follower follower499
[WARN] [03/26/2024 16:58:34.355] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower499] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@60f40429
04:58:34,356 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Leader): Sending AppendEntries to follower follower499: AppendEntries [leaderId=follower498, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
04:58:34,356 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): handleAppendEntries: AppendEntries [leaderId=follower498, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
04:58:34,356 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): Number of entries to be appended = 1
04:58:34,356 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
04:58:34,356 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): Append entry to log zero
04:58:34,356 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 
04:58:34,356 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): Log size is now 1
04:58:34,356 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): Commit index set to 0
04:58:34,356 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): handleAppendEntries returning : AppendEntriesReply [term=3, success=true, followerId=follower499, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
04:58:34,356 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower499: Lagging 0 entries behind leader follower498 and reached 0 (of expected -1)
04:58:34,356 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
04:58:34,356 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499 (Follower): Setting last applied to 0
04:58:34,356 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499: Moving last applied index from -1 to 0
04:58:34,356 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499: Applying state for log index 0 data zero
04:58:34,356 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower499 updated: matchIndex: 0, nextIndex: 1
04:58:34,356 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower498 (Leader): Checking sendAppendEntries for follower follower499: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:34,356 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower499: applyState called: zero
04:58:34,357 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
04:58:34,357 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499: Persisting ApplyJournalEntries with index=0
[WARN] [03/26/2024 16:58:34.358] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower499] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@69eeae52
04:58:34,395 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499: onLeaderTransitioning: LeaderTransitioning [leaderId=leader497]
04:58:34,396 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 ending
04:58:34,396 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/follower499 starting
04:58:34,396 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower499: onShutDown
04:58:34,397 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/follower499 ending
04:58:34,397 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending
04:58:34,397 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower498-notifier501#1444805866]
04:58:34,408 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower498-collector502#-1113787552]
04:58:34,413 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower498]
04:58:34,414 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower499-notifier503#45738302]
04:58:34,414 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower499-collector504#437593630]
04:58:34,414 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower499]
04:58:34,414 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower500-notifier505#-2044598860]
04:58:34,414 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower500-collector506#-1073899758]
04:58:34,414 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower500]
04:58:34,414 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader497-notifier507#-1703680124]
04:58:34,414 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader497-collector508#1341057429]
04:58:34,415 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader497]
04:58:34,415 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers starting
04:58:34,417 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader509 with journal batch size 1000
[WARN] [03/26/2024 16:58:34.417] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader509]: org.opendaylight.controller.cluster.common.actor.Monitor@4a245f5b
04:58:34,429 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader509: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
04:58:34,429 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
04:58:34,429 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader509 (Follower): Received TimeoutNow - switching to Candidate
04:58:34,429 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader509 (Candidate): Election: Candidate has following voting peers: []
04:58:34,429 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader509: Set currentTerm=1, votedFor=leader509
04:58:34,429 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader509 (Candidate): Starting new election term 1
04:58:34,429 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader509 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
04:58:34,430 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader509 (Candidate): Received ElectionTimeout
04:58:34,430 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader509 (Leader): Election: Leader has following peers: []
04:58:34,430 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader509 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
04:58:34,431 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/leader509 starting
04:58:34,431 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader509: onShutDown
04:58:34,431 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/leader509 ending
04:58:34,431 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers ending
04:58:34,432 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader509-collector513#345013816]
04:58:34,442 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader509]
04:58:34,443 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging starting
04:58:34,443 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [03/26/2024 16:58:34.445] [test-akka.actor.default-dispatcher-17] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower515]: org.opendaylight.controller.cluster.common.actor.Monitor@5594612a
04:58:34,445 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower515 with journal batch size 1000
04:58:34,448 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower516 with journal batch size 1000
[WARN] [03/26/2024 16:58:34.448] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower516]: org.opendaylight.controller.cluster.common.actor.Monitor@347ba502
04:58:34,450 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515: SnapshotOffer called.
04:58:34,450 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515: Moving last applied index from -1 to -1
[WARN] [03/26/2024 16:58:34.450] [test-akka.actor.default-dispatcher-17] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower517]: org.opendaylight.controller.cluster.common.actor.Monitor@5a0f585d
04:58:34,450 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower516: SnapshotOffer called.
04:58:34,450 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515: Set currentTerm=1, votedFor=null
04:58:34,450 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower516: Moving last applied index from -1 to -1
04:58:34,450 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower516: Set currentTerm=1, votedFor=null
04:58:34,450 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515: Updated server config: isVoting: true, peers: [PeerInfo [id=follower517, address=akka://test/user/follower517, votingState=NON_VOTING], PeerInfo [id=follower516, address=akka://test/user/follower516, votingState=VOTING], PeerInfo [id=leader514, address=akka://test/user/leader514, votingState=VOTING]]
04:58:34,450 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower516: Updated server config: isVoting: true, peers: [PeerInfo [id=follower517, address=akka://test/user/follower517, votingState=NON_VOTING], PeerInfo [id=leader514, address=akka://test/user/leader514, votingState=VOTING], PeerInfo [id=follower515, address=akka://test/user/follower515, votingState=VOTING]]
04:58:34,451 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower517 with journal batch size 1000
04:58:34,451 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower515 in 95.62 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:34,451 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower516 in 87.05 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:34,451 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517: SnapshotOffer called.
04:58:34,451 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517: Moving last applied index from -1 to -1
04:58:34,451 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517: Set currentTerm=1, votedFor=null
04:58:34,451 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517: Updated server config: isVoting: false, peers: [PeerInfo [id=follower516, address=akka://test/user/follower516, votingState=VOTING], PeerInfo [id=leader514, address=akka://test/user/leader514, votingState=VOTING], PeerInfo [id=follower515, address=akka://test/user/follower515, votingState=VOTING]]
04:58:34,451 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower517 in 52.39 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:34,453 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower516: Recovery completed  in 2.129 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
04:58:34,453 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower515: Recovery completed  in 2.845 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
04:58:34,453 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower517: Recovery completed  in 2.060 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [03/26/2024 16:58:34.454] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader514]: org.opendaylight.controller.cluster.common.actor.Monitor@3fd1897c
04:58:34,454 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader514 with journal batch size 1000
04:58:34,455 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514: SnapshotOffer called.
04:58:34,455 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514: Moving last applied index from -1 to -1
04:58:34,455 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514: Set currentTerm=1, votedFor=null
04:58:34,455 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514: Updated server config: isVoting: true, peers: [PeerInfo [id=follower517, address=akka://test/user/follower517, votingState=NON_VOTING], PeerInfo [id=follower516, address=akka://test/user/follower516, votingState=VOTING], PeerInfo [id=follower515, address=akka://test/user/follower515, votingState=VOTING]]
04:58:34,455 PM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader514 in 83.02 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:34,456 PM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader514: Recovery completed  in 1.297 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
04:58:34,834 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
04:58:34,834 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.171.176:25520, Removed)
04:58:34,834 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Follower): Received ElectionTimeout - switching to Candidate
04:58:34,834 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Candidate): Election: Candidate has following voting peers: [follower516, follower515]
04:58:34,834 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514: Set currentTerm=2, votedFor=leader514
04:58:34,834 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Candidate): Starting new election term 2
04:58:34,834 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Candidate): Sending RequestVote [term=2, candidateId=leader514, lastLogIndex=-1, lastLogTerm=-1] to peer follower516
04:58:34,835 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Candidate): Sending RequestVote [term=2, candidateId=leader514, lastLogIndex=-1, lastLogTerm=-1] to peer follower515
04:58:34,835 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
04:58:34,835 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower516 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
04:58:34,835 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower516 (Follower): Cluster state: []
04:58:34,835 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower516 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader514, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
04:58:34,835 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower516 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader514, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
04:58:34,835 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower516: Set currentTerm=2, votedFor=null
04:58:34,835 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower516 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader514, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
04:58:34,835 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower516: Set currentTerm=2, votedFor=leader514
04:58:34,835 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
04:58:34,835 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower516 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
04:58:34,835 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515 (Follower): Cluster state: []
04:58:34,835 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader514, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
04:58:34,835 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower515 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader514, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
04:58:34,835 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515: Set currentTerm=2, votedFor=null
04:58:34,835 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader514, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
04:58:34,835 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515: Set currentTerm=2, votedFor=leader514
04:58:34,835 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
04:58:34,837 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2
04:58:34,837 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1
04:58:34,837 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Election: Leader has following peers: [follower517, follower516, follower515]
04:58:34,837 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Checking sendAppendEntries for follower follower517: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:34,837 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Checking sendAppendEntries for follower follower516: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:34,837 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Checking sendAppendEntries for follower follower515: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:34,837 PM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
04:58:34,837 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower517 (Follower): Term 2 in "AppendEntries [leaderId=leader514, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term
04:58:34,837 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517: Set currentTerm=2, votedFor=null
04:58:34,838 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower515: Last sync leader does not match current leader leader514, need to catch up to -1
04:58:34,838 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower517: Last sync leader does not match current leader leader514, need to catch up to -1
04:58:34,838 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower516: Last sync leader does not match current leader leader514, need to catch up to -1
04:58:34,838 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower515 updated: matchIndex: -1, nextIndex: 0
04:58:34,838 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Checking sendAppendEntries for follower follower515: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:34,838 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower517 updated: matchIndex: -1, nextIndex: 0
04:58:34,838 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Checking sendAppendEntries for follower follower517: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:34,838 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower516 updated: matchIndex: -1, nextIndex: 0
04:58:34,838 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Checking sendAppendEntries for follower follower516: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [03/26/2024 16:58:34.838] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower515] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@74062f6b
[WARN] [03/26/2024 16:58:34.838] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower516] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5ad206e1
[WARN] [03/26/2024 16:58:34.839] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower517] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@633cc117
04:58:34,855 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
04:58:34,855 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
04:58:34,856 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
04:58:34,856 PM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting
04:58:34,856 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514: Persist data SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
04:58:34,856 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 
04:58:34,856 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, payload: class org.opendaylight.controller.cluster.raft.MockRaftActorContext$MockPayload, isSendImmediate: true
04:58:34,856 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Checking sendAppendEntries for follower follower517: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:34,856 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): sendAppendEntries: 0 is present for follower follower517
04:58:34,856 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Sending AppendEntries to follower follower517: AppendEntries [leaderId=leader514, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
04:58:34,857 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Checking sendAppendEntries for follower follower516: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:34,857 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): sendAppendEntries: 0 is present for follower follower516
04:58:34,857 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Sending AppendEntries to follower follower516: AppendEntries [leaderId=leader514, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
04:58:34,857 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517 (Follower): handleAppendEntries: AppendEntries [leaderId=leader514, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
04:58:34,857 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517 (Follower): Number of entries to be appended = 1
04:58:34,857 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
04:58:34,857 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Checking sendAppendEntries for follower follower515: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:34,857 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517 (Follower): Append entry to log zero
04:58:34,857 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): sendAppendEntries: 0 is present for follower follower515
04:58:34,857 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 
04:58:34,857 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Sending AppendEntries to follower follower515: AppendEntries [leaderId=leader514, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
04:58:34,857 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515 (Follower): handleAppendEntries: AppendEntries [leaderId=leader514, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
04:58:34,857 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515 (Follower): Number of entries to be appended = 1
04:58:34,857 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
04:58:34,857 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515 (Follower): Append entry to log zero
04:58:34,857 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 
04:58:34,857 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515 (Follower): Log size is now 1
04:58:34,857 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515 (Follower): handleAppendEntries returning : AppendEntriesReply [term=2, success=true, followerId=follower515, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
04:58:34,857 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower515: Lagging 0 entries behind leader leader514 and reached -1 (of expected -1)
04:58:34,857 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower515 updated: matchIndex: 0, nextIndex: 1
04:58:34,857 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Checking sendAppendEntries for follower follower515: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:34,857 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517 (Follower): Log size is now 1
04:58:34,857 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517 (Follower): handleAppendEntries returning : AppendEntriesReply [term=2, success=true, followerId=follower517, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5]
04:58:34,857 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower517: Lagging 0 entries behind leader leader514 and reached -1 (of expected -1)
04:58:34,857 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower517 updated: matchIndex: 0, nextIndex: 1
04:58:34,857 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Checking sendAppendEntries for follower follower517: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:34,858 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
04:58:34,858 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
04:58:34,858 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Setting last applied to 0
04:58:34,858 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514: Moving last applied index from -1 to 0
04:58:34,858 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514: Applying state for log index 0 data zero
04:58:34,858 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader514: applyState called: zero
04:58:34,858 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514: Persisting ApplyJournalEntries with index=0
04:58:34,858 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
04:58:34,858 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero]
[WARN] [03/26/2024 16:58:34.858] [test-akka.actor.default-dispatcher-7] [akka://test/user/follower515] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@20b15199
[WARN] [03/26/2024 16:58:34.858] [test-akka.actor.default-dispatcher-7] [akka://test/user/follower517] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@76902548
04:58:34,954 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): sendAppendEntries: 0 is present for follower follower516
04:58:34,954 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Sending AppendEntries to follower follower516: AppendEntries [leaderId=leader514, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
04:58:35,75 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): sendAppendEntries: 0 is present for follower follower516
04:58:35,75 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517 (Follower): Commit index set to 0
04:58:35,75 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower517: Lagging 0 entries behind leader leader514 and reached 0 (of expected -1)
04:58:35,75 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
04:58:35,75 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517 (Follower): Setting last applied to 0
04:58:35,75 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517: Moving last applied index from -1 to 0
04:58:35,75 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517: Applying state for log index 0 data zero
04:58:35,75 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Sending AppendEntries to follower follower516: AppendEntries [leaderId=leader514, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]]
04:58:35,75 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower517: applyState called: zero
04:58:35,75 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515 (Follower): Commit index set to 0
04:58:35,75 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower515: Lagging 0 entries behind leader leader514 and reached 0 (of expected -1)
04:58:35,75 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
04:58:35,75 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515 (Follower): Setting last applied to 0
04:58:35,75 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517: Persisting ApplyJournalEntries with index=0
04:58:35,75 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515: Moving last applied index from -1 to 0
04:58:35,75 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515: Applying state for log index 0 data zero
04:58:35,76 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower515: applyState called: zero
04:58:35,76 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515: Persisting ApplyJournalEntries with index=0
04:58:35,109 PM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending
04:58:35,109 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
04:58:35,109 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
04:58:35,109 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514: onRequestLeadership RequestLeadership [requestedFollowerId=follower516, replyTo=Actor[akka://test/user/$c#-1654229464]]
04:58:35,109 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514: Initiating leader transfer
04:58:35,109 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower517: onLeaderTransitioning: LeaderTransitioning [leaderId=leader514]
04:58:35,109 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower516: onLeaderTransitioning: LeaderTransitioning [leaderId=leader514]
04:58:35,109 PM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader514: pauseLeader successfully completed - doing transfer
04:58:35,110 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Attempting to transfer leadership
04:58:35,110 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower515: onLeaderTransitioning: LeaderTransitioning [leaderId=leader514]
04:58:35,110 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Checking sendAppendEntries for follower follower517: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:35,110 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Checking sendAppendEntries for follower follower516: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:35,110 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): sendAppendEntries: 0 is present for follower follower516
04:58:35,110 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Checking sendAppendEntries for follower follower515: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
04:58:35,110 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower517: Lagging 0 entries behind leader leader514 and reached 0 (of expected -1)
04:58:35,110 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower515: Lagging 0 entries behind leader leader514 and reached 0 (of expected -1)
04:58:35,314 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower517: Lagging 0 entries behind leader leader514 and reached 0 (of expected -1)
04:58:35,314 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower515: Lagging 0 entries behind leader leader514 and reached 0 (of expected -1)
04:58:35,434 PM [test-akka.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader514: leader transfer aborted
04:58:35,435 PM [test-akka.actor.default-dispatcher-18] [WARN] RaftActorLeadershipTransferCohort - leader514: Failed to transfer leadership in 325.4 ms
04:58:35,435 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514: LeadershipTransfer request from follower516 failed
04:58:35,435 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader514 (Leader): Leadership transfer expired
04:58:35,435 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower515: Lagging 0 entries behind leader leader514 and reached 0 (of expected -1)
04:58:35,435 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower517: Lagging 0 entries behind leader leader514 and reached 0 (of expected -1)
04:58:35,462 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging ending
04:58:35,462 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower515-notifier518#675234914]
04:58:35,474 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower515-collector519#-1806792384]
04:58:35,474 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower515]
04:58:35,475 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower516-notifier520#-96024366]
04:58:35,475 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower516-collector521#-358819353]
04:58:35,475 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower516]
04:58:35,476 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower517-notifier522#-1863541469]
04:58:35,476 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower517-collector523#-635826753]
04:58:35,476 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower517]
04:58:35,476 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader514-notifier524#1387551569]
04:58:35,479 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader514-collector525#-725743494]
04:58:35,479 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader514]
04:58:35,480 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$c#-1654229464]
04:58:35,481 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown starting
04:58:35,481 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [03/26/2024 16:58:35.483] [test-akka.actor.default-dispatcher-17] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower527]: org.opendaylight.controller.cluster.common.actor.Monitor@7a3df4d5
04:58:35,483 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower527 with journal batch size 1000
04:58:35,483 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower527: SnapshotOffer called.
04:58:35,483 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower527: Moving last applied index from -1 to -1
04:58:35,483 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower527: Set currentTerm=1, votedFor=null
04:58:35,483 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower527: Updated server config: isVoting: true, peers: [PeerInfo [id=follower528, address=akka://test/user/follower528, votingState=VOTING], PeerInfo [id=follower529, address=akka://test/user/follower529, votingState=NON_VOTING], PeerInfo [id=leader526, address=akka://test/user/leader526, votingState=VOTING]]
04:58:35,484 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower527 in 63.77 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:35,486 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower527: Recovery completed  in 2.135 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [03/26/2024 16:58:35.585] [test-akka.actor.default-dispatcher-17] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower528]: org.opendaylight.controller.cluster.common.actor.Monitor@4199b851
04:58:35,586 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower528 with journal batch size 1000
04:58:35,587 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528: SnapshotOffer called.
04:58:35,587 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528: Moving last applied index from -1 to -1
04:58:35,587 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528: Set currentTerm=1, votedFor=null
04:58:35,587 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528: Updated server config: isVoting: true, peers: [PeerInfo [id=follower527, address=akka://test/user/follower527, votingState=VOTING], PeerInfo [id=follower529, address=akka://test/user/follower529, votingState=NON_VOTING], PeerInfo [id=leader526, address=akka://test/user/leader526, votingState=VOTING]]
04:58:35,587 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower528 in 97.14 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:35,589 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower528: Recovery completed  in 1.500 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [03/26/2024 16:58:35.590] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower529]: org.opendaylight.controller.cluster.common.actor.Monitor@8f163a3
04:58:35,590 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower529 with journal batch size 1000
04:58:35,591 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower529: SnapshotOffer called.
04:58:35,591 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower529: Moving last applied index from -1 to -1
04:58:35,591 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower529: Set currentTerm=1, votedFor=null
04:58:35,592 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower529: Updated server config: isVoting: false, peers: [PeerInfo [id=follower528, address=akka://test/user/follower528, votingState=VOTING], PeerInfo [id=follower527, address=akka://test/user/follower527, votingState=VOTING], PeerInfo [id=leader526, address=akka://test/user/leader526, votingState=VOTING]]
04:58:35,592 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower529 in 88.25 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:35,593 PM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower529: Recovery completed  in 1.266 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [03/26/2024 16:58:35.691] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader526]: org.opendaylight.controller.cluster.common.actor.Monitor@fd089c9
04:58:35,691 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader526 with journal batch size 1000
04:58:35,692 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526: SnapshotOffer called.
04:58:35,692 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526: Moving last applied index from -1 to -1
04:58:35,692 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526: Set currentTerm=1, votedFor=null
04:58:35,692 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526: Updated server config: isVoting: true, peers: [PeerInfo [id=follower528, address=akka://test/user/follower528, votingState=VOTING], PeerInfo [id=follower527, address=akka://test/user/follower527, votingState=VOTING], PeerInfo [id=follower529, address=akka://test/user/follower529, votingState=NON_VOTING]]
04:58:35,693 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader526 in 118.6 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
04:58:35,694 PM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader526: Recovery completed  in 1.529 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
04:58:36,54 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
04:58:36,55 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.171.176:25520, Removed)
04:58:36,55 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Follower): Received ElectionTimeout - switching to Candidate
04:58:36,55 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Candidate): Election: Candidate has following voting peers: [follower528, follower527]
04:58:36,55 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526: Set currentTerm=2, votedFor=leader526
04:58:36,55 PM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Candidate): Starting new election term 2
04:58:36,55 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Candidate): Sending RequestVote [term=2, candidateId=leader526, lastLogIndex=-1, lastLogTerm=-1] to peer follower528
04:58:36,55 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Candidate): Sending RequestVote [term=2, candidateId=leader526, lastLogIndex=-1, lastLogTerm=-1] to peer follower527
04:58:36,55 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
04:58:36,55 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower527 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
04:58:36,55 PM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
04:58:36,55 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower527 (Follower): Cluster state: []
04:58:36,55 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Follower): Cluster state: []
04:58:36,55 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader526, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
04:58:36,55 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower527 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader526, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
04:58:36,55 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader526, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
04:58:36,55 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower527 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader526, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term
04:58:36,55 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528: Set currentTerm=2, votedFor=null
04:58:36,55 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower527: Set currentTerm=2, votedFor=null
04:58:36,55 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader526, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
04:58:36,55 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower527 (Follower): In requestVote:  RequestVote [term=2, candidateId=leader526, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
04:58:36,55 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528: Set currentTerm=2, votedFor=leader526
04:58:36,56 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower527: Set currentTerm=2, votedFor=leader526
04:58:36,56 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
04:58:36,56 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower527 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true]
04:58:36,57 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2
04:58:36,57 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1
04:58:36,57 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Election: Leader has following peers: [follower528, follower527, follower529]
04:58:36,57 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Checking sendAppendEntries for follower follower528: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:36,57 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Checking sendAppendEntries for follower follower527: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:36,57 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Checking sendAppendEntries for follower follower529: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:36,57 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
04:58:36,57 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower528: Last sync leader does not match current leader leader526, need to catch up to -1
04:58:36,57 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower527: Last sync leader does not match current leader leader526, need to catch up to -1
04:58:36,57 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower528 updated: matchIndex: -1, nextIndex: 0
04:58:36,57 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower529 (Follower): Term 2 in "AppendEntries [leaderId=leader526, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term
04:58:36,57 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Checking sendAppendEntries for follower follower528: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:36,58 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower529: Set currentTerm=2, votedFor=null
04:58:36,58 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower527 updated: matchIndex: -1, nextIndex: 0
[WARN] [03/26/2024 16:58:36.057] [test-akka.actor.default-dispatcher-18] [akka://test/user/follower528] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@41bc1fd9
04:58:36,58 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower529: Last sync leader does not match current leader leader526, need to catch up to -1
04:58:36,58 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Checking sendAppendEntries for follower follower527: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:36,58 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower529 updated: matchIndex: -1, nextIndex: 0
[WARN] [03/26/2024 16:58:36.058] [test-akka.actor.default-dispatcher-18] [akka://test/user/follower527] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@4aa948e6
04:58:36,58 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Checking sendAppendEntries for follower follower529: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [03/26/2024 16:58:36.059] [test-akka.actor.default-dispatcher-7] [akka://test/user/follower529] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@4899e3cd
04:58:36,97 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
04:58:36,97 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
04:58:36,98 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
04:58:36,98 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower527]
04:58:36,108 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower529]
04:58:36,120 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
04:58:36,120 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
04:58:36,120 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526: onRequestLeadership RequestLeadership [requestedFollowerId=follower528, replyTo=Actor[akka://test/user/$d#-2108690491]]
04:58:36,120 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526: Initiating leader transfer
04:58:36,120 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528: onLeaderTransitioning: LeaderTransitioning [leaderId=leader526]
04:58:36,121 PM [test-akka.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader526: pauseLeader successfully completed - doing transfer
04:58:36,121 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Attempting to transfer leadership
[WARN] [03/26/2024 16:58:36.121] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower527] received dead letter from TestActor[akka://test/user/leader526]: LeaderTransitioning [leaderId=leader526]
04:58:36,121 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Checking sendAppendEntries for follower follower528: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:36,121 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Checking sendAppendEntries for follower follower527: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [03/26/2024 16:58:36.121] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower529] received dead letter from TestActor[akka://test/user/leader526]: LeaderTransitioning [leaderId=leader526]
04:58:36,121 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower528: Lagging 0 entries behind leader leader526 and reached -1 (of expected -1)
04:58:36,121 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Checking sendAppendEntries for follower follower529: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [03/26/2024 16:58:36.121] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower527] received dead letter from TestActor[akka://test/user/leader526]: AppendEntries [leaderId=leader526, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
[WARN] [03/26/2024 16:58:36.121] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower529] received dead letter from TestActor[akka://test/user/leader526]: AppendEntries [leaderId=leader526, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
04:58:36,122 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): tryToCompleteLeadershipTransfer: followerId: follower528, matchIndex: -1, lastIndex: -1, isVoting: true
04:58:36,122 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Follower's log matches - sending ElectionTimeout
04:58:36,122 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Checking sendAppendEntries for follower follower528: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [03/26/2024 16:58:36.122] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower528] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2079fb74
04:58:36,122 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Checking sendAppendEntries for follower follower527: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:36,122 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower528: Lagging 0 entries behind leader leader526 and reached -1 (of expected -1)
04:58:36,122 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Checking sendAppendEntries for follower follower529: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [03/26/2024 16:58:36.122] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower527] received dead letter from TestActor[akka://test/user/leader526]: AppendEntries [leaderId=leader526, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
04:58:36,122 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Leader transfer complete
04:58:36,122 PM [test-akka.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader526: leader transfer complete - waiting for new leader
[WARN] [03/26/2024 16:58:36.122] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower529] received dead letter from TestActor[akka://test/user/leader526]: AppendEntries [leaderId=leader526, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]]
04:58:36,122 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
04:58:36,122 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Follower): Received TimeoutNow - switching to Candidate
04:58:36,123 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Candidate): Election: Candidate has following voting peers: [follower527, leader526]
04:58:36,123 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528: Set currentTerm=3, votedFor=follower528
04:58:36,123 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Candidate): Starting new election term 3
04:58:36,123 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Candidate): Sending RequestVote [term=3, candidateId=follower528, lastLogIndex=-1, lastLogTerm=-1] to peer follower527
04:58:36,123 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Candidate): Sending RequestVote [term=3, candidateId=follower528, lastLogIndex=-1, lastLogTerm=-1] to peer leader526
04:58:36,123 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
[WARN] [03/26/2024 16:58:36.123] [test-akka.actor.default-dispatcher-18] [akka://test/user/follower527] received dead letter from TestActor[akka://test/user/follower528]: RequestVote [term=3, candidateId=follower528, lastLogIndex=-1, lastLogTerm=-1]
04:58:36,123 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
04:58:36,123 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Cluster state: []
04:58:36,123 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Candidate in requestVote:RequestVote [term=3, candidateId=follower528, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term.
04:58:36,123 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Term 3 in "RequestVote [term=3, candidateId=follower528, lastLogIndex=-1, lastLogTerm=-1]" message is greater than leader's term 2 - switching to Follower
04:58:36,123 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526: Set currentTerm=3, votedFor=null
04:58:36,124 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): Leadership transfer in progress - processing RequestVote
04:58:36,124 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): In requestVote:  RequestVote [term=3, candidateId=follower528, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
04:58:36,124 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526: Set currentTerm=3, votedFor=follower528
04:58:36,124 PM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader): requestVote returning: RequestVoteReply [term=3, voteGranted=true]
04:58:36,124 PM [test-akka.actor.default-dispatcher-13] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader526 (Leader) :- Switching from behavior Leader to Follower, election term: 3
04:58:36,124 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Candidate): RaftRPC message received RequestVoteReply [term=3, voteGranted=true], my term is 3
04:58:36,124 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Candidate): handleRequestVoteReply: RequestVoteReply [term=3, voteGranted=true], current voteCount: 1
04:58:36,125 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Leader): Election: Leader has following peers: [follower527, follower529, leader526]
04:58:36,125 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Leader): Checking sendAppendEntries for follower follower527: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:36,125 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Leader): Checking sendAppendEntries for follower follower529: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:36,125 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Leader): Checking sendAppendEntries for follower leader526: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:36,125 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
[WARN] [03/26/2024 16:58:36.125] [test-akka.actor.default-dispatcher-11] [akka://test/user/follower527] received dead letter from TestActor[akka://test/user/follower528]: AppendEntries [leaderId=follower528, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]
[WARN] [03/26/2024 16:58:36.125] [test-akka.actor.default-dispatcher-11] [akka://test/user/follower529] received dead letter from TestActor[akka://test/user/follower528]: AppendEntries [leaderId=follower528, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]
04:58:36,126 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - leader526: Last sync leader does not match current leader follower528, need to catch up to -1
04:58:36,126 PM [test-akka.actor.default-dispatcher-11] [DEBUG] RaftActorLeadershipTransferCohort - leader526: leader changed to follower528
04:58:36,126 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader526 updated: matchIndex: -1, nextIndex: 0
04:58:36,126 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower528 (Leader): Checking sendAppendEntries for follower leader526: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
04:58:36,126 PM [test-akka.actor.default-dispatcher-11] [INFO] RaftActorLeadershipTransferCohort - leader526: Successfully transferred leadership to follower528 in 5.525 ms
04:58:36,126 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader526: Leadership transferred successfully to follower528
[WARN] [03/26/2024 16:58:36.126] [test-akka.actor.default-dispatcher-11] [akka://test/user/leader526] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@419250c8
04:58:36,171 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown ending
04:58:36,171 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower527-notifier530#-1337431123]
04:58:36,182 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower527-collector531#-760052260]
04:58:36,183 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower528-notifier532#665196948]
04:58:36,183 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower528-collector533#805849212]
04:58:36,183 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower528]
04:58:36,183 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower529-notifier534#264892334]
04:58:36,183 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower529-collector535#2107213529]
04:58:36,183 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader526-notifier536#1397237055]
04:58:36,184 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader526-collector537#888841472]
04:58:36,184 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader526]
04:58:36,184 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$d#-2108690491]
[INFO] [03/26/2024 16:58:36.185] [main] [CoordinatedShutdown(akka://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
04:58:36,185 PM [test-akka.actor.default-dispatcher-6] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
[WARN] [03/26/2024 16:58:36.186] [test-akka.actor.default-dispatcher-6] [akka://test/system/cluster/core/daemon] unhandled message from Actor[akka://test/deadLetters]: Leave(akka://test@10.30.171.176:25520)
[INFO] [03/26/2024 16:58:36.187] [test-akka.actor.internal-dispatcher-3] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.176:25520] - Exiting completed
[INFO] [03/26/2024 16:58:36.187] [test-akka.actor.internal-dispatcher-3] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.176:25520] - Shutting down...
[INFO] [03/26/2024 16:58:36.187] [test-akka.actor.internal-dispatcher-3] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.176:25520] - Successfully shut down
04:58:36,187 PM [test-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://test@10.30.171.176:25520] - Exiting completed
04:58:36,187 PM [test-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://test@10.30.171.176:25520] - Shutting down...
04:58:36,187 PM [test-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://test@10.30.171.176:25520] - Successfully shut down
[INFO] [03/26/2024 16:58:36.189] [test-akka.remote.default-remote-dispatcher-9] [akka://test@10.30.171.176:25520/system/remoting-terminator] Shutting down remote daemon.
[INFO] [03/26/2024 16:58:36.189] [test-akka.remote.default-remote-dispatcher-9] [akka://test@10.30.171.176:25520/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports.
04:58:36,189 PM [test-akka.actor.default-dispatcher-6] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
04:58:36,189 PM [test-akka.actor.default-dispatcher-6] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
[INFO] [03/26/2024 16:58:36.193] [test-akka.remote.default-remote-dispatcher-9] [akka://test@10.30.171.176:25520/system/remoting-terminator] Remoting shut down.
04:58:36,193 PM [test-akka.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[DEBUG] [03/26/2024 16:58:36.193] [test-akka.actor.internal-dispatcher-5] [EventStream] shutting down: StandardOutLogger