[DEBUG] [09/16/2025 13:05:25.801] [main] [EventStream(akka://test)] logger log1-TestEventListener started 01:05:25,802 PM [test-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [09/16/2025 13:05:25.802] [main] [EventStream(akka://test)] logger log2-Slf4jLogger started [DEBUG] [09/16/2025 13:05:25.802] [main] [EventStream(akka://test)] Default Loggers started [INFO] [09/16/2025 13:05:25.814] [main] [ArteryTransport(akka://test)] Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.170.168:25520] with UID [3632647621360375194] 01:05:25,815 PM [test-akka.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.170.168:25520] with UID [3632647621360375194] [INFO] [09/16/2025 13:05:25.815] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.168:25520] - Starting up, Akka version [2.6.21] ... 01:05:25,815 PM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.170.168:25520] - Starting up, Akka version [2.6.21] ... [INFO] [09/16/2025 13:05:25.818] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.168:25520] - Registered cluster JMX MBean [akka:type=Cluster] [INFO] [09/16/2025 13:05:25.818] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.168:25520] - Started up successfully 01:05:25,818 PM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.170.168:25520] - Registered cluster JMX MBean [akka:type=Cluster] 01:05:25,818 PM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.170.168:25520] - Started up successfully 01:05:25,820 PM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.170.168:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing 01:05:25,820 PM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.170.168:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining [INFO] [09/16/2025 13:05:25.819] [test-akka.actor.internal-dispatcher-3] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.168:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing [INFO] [09/16/2025 13:05:25.819] [test-akka.actor.internal-dispatcher-3] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.168:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining 01:05:25,828 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferAborted starting 01:05:25,828 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting [WARN] [09/16/2025 13:05:25.838] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower286]: org.opendaylight.controller.cluster.common.actor.Monitor@1d21010 [INFO] [akkaDeadLetter][09/16/2025 13:05:25.838] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower286] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:05:25,838 PM [test-akka.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - akkaDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower286] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:05:25,840 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower286 with journal batch size 1000 [WARN] [09/16/2025 13:05:25.841] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower287]: org.opendaylight.controller.cluster.common.actor.Monitor@4735d2d1 [INFO] [akkaDeadLetter][09/16/2025 13:05:25.841] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower287] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:05:25,841 PM [test-akka.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - akkaDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower287] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:05:25,842 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower287 with journal batch size 1000 01:05:25,842 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower286: SnapshotOffer called. 01:05:25,842 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower286: Moving last applied index from -1 to -1 01:05:25,842 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower286: Set currentTerm=1, votedFor=null 01:05:25,842 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower286: Updated server config: isVoting: true, peers: [PeerInfo [id=follower288, address=akka://test/user/follower288, votingState=NON_VOTING], PeerInfo [id=leader285, address=akka://test/user/leader285, votingState=VOTING], PeerInfo [id=follower287, address=akka://test/user/follower287, votingState=VOTING]] 01:05:25,842 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower286 in 97.38 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:25,843 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower286: Recovery completed in 802.3 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:05:25,844 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower287: SnapshotOffer called. 01:05:25,844 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower287: Moving last applied index from -1 to -1 01:05:25,844 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower287: Set currentTerm=1, votedFor=null 01:05:25,844 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower287: Updated server config: isVoting: true, peers: [PeerInfo [id=follower288, address=akka://test/user/follower288, votingState=NON_VOTING], PeerInfo [id=leader285, address=akka://test/user/leader285, votingState=VOTING], PeerInfo [id=follower286, address=akka://test/user/follower286, votingState=VOTING]] 01:05:25,844 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower287 in 39.93 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:25,844 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower288 with journal batch size 1000 01:05:25,844 PM [test-akka.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - akkaDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower288] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:05:25,845 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower287: Recovery completed in 938.5 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:05:25,846 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower288: SnapshotOffer called. 01:05:25,847 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower288: Moving last applied index from -1 to -1 01:05:25,847 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower288: Set currentTerm=1, votedFor=null 01:05:25,847 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower288: Updated server config: isVoting: false, peers: [PeerInfo [id=leader285, address=akka://test/user/leader285, votingState=VOTING], PeerInfo [id=follower287, address=akka://test/user/follower287, votingState=VOTING], PeerInfo [id=follower286, address=akka://test/user/follower286, votingState=VOTING]] 01:05:25,847 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower288 in 76.14 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:25,848 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader285 with journal batch size 1000 01:05:25,849 PM [test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - akkaDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/leader285] to Actor[akka://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [WARN] [09/16/2025 13:05:25.849] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower288]: org.opendaylight.controller.cluster.common.actor.Monitor@6ed1dba [INFO] [akkaDeadLetter][09/16/2025 13:05:25.844] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/follower288] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:05:25,849 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower288: Recovery completed in 2.318 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [09/16/2025 13:05:25.849] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader285]: org.opendaylight.controller.cluster.common.actor.Monitor@6dfcd947 [INFO] [akkaDeadLetter][09/16/2025 13:05:25.848] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/leader285] to Actor[akka://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:05:25,850 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285: SnapshotOffer called. 01:05:25,850 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285: Moving last applied index from -1 to -1 01:05:25,850 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285: Set currentTerm=1, votedFor=null 01:05:25,850 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285: Updated server config: isVoting: true, peers: [PeerInfo [id=follower288, address=akka://test/user/follower288, votingState=NON_VOTING], PeerInfo [id=follower287, address=akka://test/user/follower287, votingState=VOTING], PeerInfo [id=follower286, address=akka://test/user/follower286, votingState=VOTING]] 01:05:25,850 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader285 in 46.98 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:25,851 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader285: Recovery completed in 402.1 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:05:26,247 PM [test-akka.actor.default-dispatcher-17] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:05:26,247 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.170.168:25520, Removed) 01:05:26,248 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Follower): Received ElectionTimeout - switching to Candidate 01:05:26,248 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Candidate): Election: Candidate has following voting peers: [follower287, follower286] 01:05:26,248 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285: Set currentTerm=2, votedFor=leader285 01:05:26,248 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Candidate): Starting new election term 2 01:05:26,248 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Candidate): Sending RequestVote [term=2, candidateId=leader285, lastLogIndex=-1, lastLogTerm=-1] to peer follower287 01:05:26,248 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Candidate): Sending RequestVote [term=2, candidateId=leader285, lastLogIndex=-1, lastLogTerm=-1] to peer follower286 01:05:26,248 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower287 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:05:26,248 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 01:05:26,248 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower286 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:05:26,249 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower286 (Follower): Cluster state: [] 01:05:26,249 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower287 (Follower): Cluster state: [] 01:05:26,249 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower286 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader285, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 01:05:26,249 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower287 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader285, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 01:05:26,249 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower286 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader285, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term 01:05:26,249 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower286: Set currentTerm=2, votedFor=null 01:05:26,249 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower287 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader285, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term 01:05:26,249 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower287: Set currentTerm=2, votedFor=null 01:05:26,249 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower286 (Follower): In requestVote: RequestVote [term=2, candidateId=leader285, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 01:05:26,249 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower286: Set currentTerm=2, votedFor=leader285 01:05:26,249 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower286 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true] 01:05:26,249 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower287 (Follower): In requestVote: RequestVote [term=2, candidateId=leader285, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 01:05:26,249 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower287: Set currentTerm=2, votedFor=leader285 01:05:26,249 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower287 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true] 01:05:26,250 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2 01:05:26,250 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1 01:05:26,250 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Leader): Election: Leader has following peers: [follower288, follower287, follower286] 01:05:26,250 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Leader): Checking sendAppendEntries for follower follower288: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:26,250 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Leader): Checking sendAppendEntries for follower follower287: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:26,250 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Leader): Checking sendAppendEntries for follower follower286: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:26,250 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 01:05:26,250 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower288 (Follower): Term 2 in "AppendEntries [leaderId=leader285, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term 01:05:26,250 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower288: Set currentTerm=2, votedFor=null 01:05:26,250 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower288: Last sync leader does not match current leader leader285, need to catch up to -1 01:05:26,250 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower288 updated: matchIndex: -1, nextIndex: 0 01:05:26,251 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower286: Last sync leader does not match current leader leader285, need to catch up to -1 01:05:26,251 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Leader): Checking sendAppendEntries for follower follower288: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:26,251 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower286 updated: matchIndex: -1, nextIndex: 0 01:05:26,251 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Leader): Checking sendAppendEntries for follower follower286: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:26,251 PM [test-akka.actor.default-dispatcher-11] [INFO] TestActorRef - akkaDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower286] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:05:26,251 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower287: Last sync leader does not match current leader leader285, need to catch up to -1 01:05:26,251 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower287 updated: matchIndex: -1, nextIndex: 0 01:05:26,251 PM [test-akka.actor.default-dispatcher-12] [INFO] TestActorRef - akkaDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower288] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:05:26,251 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Leader): Checking sendAppendEntries for follower follower287: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:26,251 PM [test-akka.actor.default-dispatcher-12] [INFO] TestActorRef - akkaDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower287] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [WARN] [09/16/2025 13:05:26.251] [test-akka.actor.default-dispatcher-18] [akka://test/user/follower286] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@49235bc9 [INFO] [akkaDeadLetter][09/16/2025 13:05:26.251] [test-akka.actor.default-dispatcher-11] [akka://test/user/follower286] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower286] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [WARN] [09/16/2025 13:05:26.252] [test-akka.actor.default-dispatcher-18] [akka://test/user/follower288] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@c21cc89 [INFO] [akkaDeadLetter][09/16/2025 13:05:26.251] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower288] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower288] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [WARN] [09/16/2025 13:05:26.252] [test-akka.actor.default-dispatcher-18] [akka://test/user/follower287] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@16e57b4c [INFO] [akkaDeadLetter][09/16/2025 13:05:26.251] [test-akka.actor.default-dispatcher-5] [akka://test/user/follower287] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower287] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:05:26,254 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 01:05:26,254 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/leader285 starting 01:05:26,257 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285: onShutDown 01:05:26,257 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285: Initiating leader transfer 01:05:26,257 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower288: onLeaderTransitioning: LeaderTransitioning [leaderId=leader285] 01:05:26,257 PM [test-akka.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader285: pauseLeader successfully completed - doing transfer 01:05:26,257 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Leader): Attempting to transfer leadership 01:05:26,257 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower286: onLeaderTransitioning: LeaderTransitioning [leaderId=leader285] 01:05:26,257 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower287: onLeaderTransitioning: LeaderTransitioning [leaderId=leader285] 01:05:26,257 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Leader): Checking sendAppendEntries for follower follower288: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:26,258 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Leader): Checking sendAppendEntries for follower follower287: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:26,258 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower288: Lagging 0 entries behind leader leader285 and reached -1 (of expected -1) 01:05:26,258 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower287: Lagging 0 entries behind leader leader285 and reached -1 (of expected -1) [WARN] [09/16/2025 13:05:26.258] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower287] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@30525c99 [WARN] [09/16/2025 13:05:26.258] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower288] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@68959bc [INFO] [akkaDeadLetter][09/16/2025 13:05:26.258] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower287] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower287] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:05:26,258 PM [test-akka.actor.default-dispatcher-12] [INFO] TestActorRef - akkaDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower287] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:05:26,258 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Leader): Checking sendAppendEntries for follower follower286: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [INFO] [akkaDeadLetter][09/16/2025 13:05:26.258] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower288] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower288] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:05:26,258 PM [test-akka.actor.default-dispatcher-12] [INFO] TestActorRef - akkaDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower288] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:05:26,258 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower286: Lagging 0 entries behind leader leader285 and reached -1 (of expected -1) [WARN] [09/16/2025 13:05:26.260] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower286] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6a411524 01:05:26,260 PM [test-akka.actor.default-dispatcher-16] [INFO] TestActorRef - akkaDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower286] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][09/16/2025 13:05:26.260] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower286] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[akka://test/user/follower286] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:05:26,368 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower288: Lagging 0 entries behind leader leader285 and reached -1 (of expected -1) 01:05:26,368 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower287: Lagging 0 entries behind leader leader285 and reached -1 (of expected -1) 01:05:26,368 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower286: Lagging 0 entries behind leader leader285 and reached -1 (of expected -1) 01:05:26,487 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower286: Lagging 0 entries behind leader leader285 and reached -1 (of expected -1) 01:05:26,487 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower287: Lagging 0 entries behind leader leader285 and reached -1 (of expected -1) 01:05:26,487 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower288: Lagging 0 entries behind leader leader285 and reached -1 (of expected -1) 01:05:26,607 PM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader285: leader transfer aborted 01:05:26,607 PM [test-akka.actor.default-dispatcher-17] [WARN] RaftActorLeadershipTransferCohort - leader285: Failed to transfer leadership in 349.8 ms 01:05:26,607 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285: leader transfer failed - sending PoisonPill 01:05:26,607 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader285 (Leader): Leadership transfer expired 01:05:26,608 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower287: Lagging 0 entries behind leader leader285 and reached -1 (of expected -1) 01:05:26,608 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower286: Lagging 0 entries behind leader leader285 and reached -1 (of expected -1) [WARN] [09/16/2025 13:05:26.608] [test-akka.actor.default-dispatcher-16] [akka://test/user/leader285] received dead letter from TestActor[akka://test/user/follower288]: AppendEntriesReply [term=2, success=true, followerId=follower288, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5] 01:05:26,608 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower288: Lagging 0 entries behind leader leader285 and reached -1 (of expected -1) [WARN] [09/16/2025 13:05:26.608] [test-akka.actor.default-dispatcher-16] [akka://test/user/leader285] received dead letter from TestActor[akka://test/user/follower287]: AppendEntriesReply [term=2, success=true, followerId=follower287, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5] [WARN] [09/16/2025 13:05:26.608] [test-akka.actor.default-dispatcher-16] [akka://test/user/leader285] received dead letter from TestActor[akka://test/user/follower286]: AppendEntriesReply [term=2, success=true, followerId=follower286, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5] 01:05:26,608 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/leader285 ending 01:05:26,610 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending 01:05:26,610 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower286-notifier289#-2123670900] 01:05:26,621 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower286-collector290#1848810505] 01:05:26,621 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower286] 01:05:26,622 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower287-notifier291#1011276390] 01:05:26,622 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower287-collector292#76841361] 01:05:26,622 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower287] 01:05:26,623 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower288-notifier293#1852176174] 01:05:26,623 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower288-collector294#-1101494095] 01:05:26,623 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower288] 01:05:26,623 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader285-notifier295#2126532846] 01:05:26,623 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader285-collector296#-806409632] 01:05:26,623 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader285] 01:05:26,625 PM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 starting 01:05:26,625 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 01:05:26,627 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower298 with journal batch size 1000 [WARN] [09/16/2025 13:05:26.627] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower298]: org.opendaylight.controller.cluster.common.actor.Monitor@6fdd1ac1 01:05:26,630 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298: SnapshotOffer called. [WARN] [09/16/2025 13:05:26.630] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower299]: org.opendaylight.controller.cluster.common.actor.Monitor@13e7e56f 01:05:26,630 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298: Moving last applied index from -1 to -1 01:05:26,630 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298: Set currentTerm=1, votedFor=null 01:05:26,630 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298: Updated server config: isVoting: true, peers: [PeerInfo [id=follower300, address=akka://test/user/follower300, votingState=NON_VOTING], PeerInfo [id=follower299, address=akka://test/user/follower299, votingState=VOTING], PeerInfo [id=leader297, address=akka://test/user/leader297, votingState=VOTING]] 01:05:26,630 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower298 in 59.60 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:26,630 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower299 with journal batch size 1000 01:05:26,631 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299: SnapshotOffer called. 01:05:26,631 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299: Moving last applied index from -1 to -1 01:05:26,631 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299: Set currentTerm=1, votedFor=null 01:05:26,631 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299: Updated server config: isVoting: true, peers: [PeerInfo [id=follower300, address=akka://test/user/follower300, votingState=NON_VOTING], PeerInfo [id=leader297, address=akka://test/user/leader297, votingState=VOTING], PeerInfo [id=follower298, address=akka://test/user/follower298, votingState=VOTING]] 01:05:26,631 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower299 in 44.31 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:26,631 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower299: Recovery completed in 449.9 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:05:26,631 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower298: Recovery completed in 904.0 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [09/16/2025 13:05:26.632] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower300]: org.opendaylight.controller.cluster.common.actor.Monitor@11787549 01:05:26,632 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower300 with journal batch size 1000 01:05:26,633 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower300: SnapshotOffer called. 01:05:26,633 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower300: Moving last applied index from -1 to -1 01:05:26,633 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower300: Set currentTerm=1, votedFor=null 01:05:26,633 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower300: Updated server config: isVoting: false, peers: [PeerInfo [id=follower299, address=akka://test/user/follower299, votingState=VOTING], PeerInfo [id=leader297, address=akka://test/user/leader297, votingState=VOTING], PeerInfo [id=follower298, address=akka://test/user/follower298, votingState=VOTING]] 01:05:26,633 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower300 in 50.55 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:26,633 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower300: Recovery completed in 510.0 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:05:26,635 PM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader297 with journal batch size 1000 [WARN] [09/16/2025 13:05:26.635] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader297]: org.opendaylight.controller.cluster.common.actor.Monitor@487efb2c 01:05:26,635 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297: SnapshotOffer called. 01:05:26,635 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297: Moving last applied index from -1 to -1 01:05:26,635 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297: Set currentTerm=1, votedFor=null 01:05:26,635 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297: Updated server config: isVoting: true, peers: [PeerInfo [id=follower300, address=akka://test/user/follower300, votingState=NON_VOTING], PeerInfo [id=follower299, address=akka://test/user/follower299, votingState=VOTING], PeerInfo [id=follower298, address=akka://test/user/follower298, votingState=VOTING]] 01:05:26,635 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader297 in 58.90 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:26,636 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader297: Recovery completed in 597.6 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:05:27,37 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:05:27,37 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.170.168:25520, Removed) 01:05:27,37 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Follower): Received ElectionTimeout - switching to Candidate 01:05:27,37 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Candidate): Election: Candidate has following voting peers: [follower299, follower298] 01:05:27,37 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297: Set currentTerm=2, votedFor=leader297 01:05:27,37 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Candidate): Starting new election term 2 01:05:27,37 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Candidate): Sending RequestVote [term=2, candidateId=leader297, lastLogIndex=-1, lastLogTerm=-1] to peer follower299 01:05:27,38 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Candidate): Sending RequestVote [term=2, candidateId=leader297, lastLogIndex=-1, lastLogTerm=-1] to peer follower298 01:05:27,38 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 01:05:27,38 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:05:27,38 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Follower): Cluster state: [] 01:05:27,38 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader297, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 01:05:27,38 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader297, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term 01:05:27,38 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299: Set currentTerm=2, votedFor=null 01:05:27,38 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:05:27,38 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298 (Follower): Cluster state: [] 01:05:27,38 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader297, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 01:05:27,38 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower298 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader297, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term 01:05:27,38 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298: Set currentTerm=2, votedFor=null 01:05:27,38 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298 (Follower): In requestVote: RequestVote [term=2, candidateId=leader297, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 01:05:27,38 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298: Set currentTerm=2, votedFor=leader297 01:05:27,38 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true] 01:05:27,38 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2 01:05:27,38 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1 01:05:27,38 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Election: Leader has following peers: [follower300, follower299, follower298] 01:05:27,38 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Checking sendAppendEntries for follower follower300: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,38 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Checking sendAppendEntries for follower follower299: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,38 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Checking sendAppendEntries for follower follower298: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,38 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 01:05:27,38 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower300 (Follower): Term 2 in "AppendEntries [leaderId=leader297, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term 01:05:27,38 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower300: Set currentTerm=2, votedFor=null 01:05:27,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower300: Last sync leader does not match current leader leader297, need to catch up to -1 01:05:27,39 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower298: Last sync leader does not match current leader leader297, need to catch up to -1 01:05:27,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower300 updated: matchIndex: -1, nextIndex: 0 01:05:27,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Checking sendAppendEntries for follower follower300: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [09/16/2025 13:05:27.039] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower298] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@3fe4d8a7 01:05:27,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower298 updated: matchIndex: -1, nextIndex: 0 01:05:27,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Checking sendAppendEntries for follower follower298: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,39 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Follower): In requestVote: RequestVote [term=2, candidateId=leader297, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 01:05:27,39 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299: Set currentTerm=2, votedFor=leader297 01:05:27,39 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true] [WARN] [09/16/2025 13:05:27.039] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower300] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@1bb1a1fd 01:05:27,40 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower299: Last sync leader does not match current leader leader297, need to catch up to -1 [WARN] [09/16/2025 13:05:27.040] [test-akka.actor.default-dispatcher-11] [akka://test/user/follower299] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@227bf7fb 01:05:27,40 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower299 updated: matchIndex: -1, nextIndex: 0 01:05:27,40 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Checking sendAppendEntries for follower follower299: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,40 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 01:05:27,40 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting 01:05:27,41 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending 01:05:27,41 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting 01:05:27,41 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending 01:05:27,41 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297: onRequestLeadership RequestLeadership [requestedFollowerId=follower299, replyTo=Actor[akka://test/user/$a#1629630055]] 01:05:27,42 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297: Initiating leader transfer 01:05:27,42 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower300: onLeaderTransitioning: LeaderTransitioning [leaderId=leader297] 01:05:27,42 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298: onLeaderTransitioning: LeaderTransitioning [leaderId=leader297] 01:05:27,42 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299: onLeaderTransitioning: LeaderTransitioning [leaderId=leader297] 01:05:27,43 PM [test-akka.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader297: pauseLeader successfully completed - doing transfer 01:05:27,43 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Attempting to transfer leadership 01:05:27,43 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Checking sendAppendEntries for follower follower300: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,43 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Checking sendAppendEntries for follower follower299: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,43 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Checking sendAppendEntries for follower follower298: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,43 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower298: Lagging 0 entries behind leader leader297 and reached -1 (of expected -1) 01:05:27,43 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower299: Lagging 0 entries behind leader leader297 and reached -1 (of expected -1) [WARN] [09/16/2025 13:05:27.043] [test-akka.actor.default-dispatcher-5] [akka://test/user/follower298] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@11db47c3 [WARN] [09/16/2025 13:05:27.043] [test-akka.actor.default-dispatcher-5] [akka://test/user/follower299] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@46f05566 01:05:27,43 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower300: Lagging 0 entries behind leader leader297 and reached -1 (of expected -1) [WARN] [09/16/2025 13:05:27.043] [test-akka.actor.default-dispatcher-11] [akka://test/user/follower300] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@56e03590 01:05:27,43 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): tryToCompleteLeadershipTransfer: followerId: follower299, matchIndex: -1, lastIndex: -1, isVoting: true 01:05:27,43 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Follower's log matches - sending ElectionTimeout 01:05:27,43 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Checking sendAppendEntries for follower follower300: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,43 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower300: Lagging 0 entries behind leader leader297 and reached -1 (of expected -1) 01:05:27,43 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Checking sendAppendEntries for follower follower299: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,43 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Checking sendAppendEntries for follower follower298: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,43 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower298: Lagging 0 entries behind leader leader297 and reached -1 (of expected -1) 01:05:27,43 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower299: Lagging 0 entries behind leader leader297 and reached -1 (of expected -1) 01:05:27,44 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Leader transfer complete 01:05:27,44 PM [test-akka.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader297: leader transfer complete - waiting for new leader 01:05:27,44 PM [test-akka.actor.default-dispatcher-17] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:05:27,44 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Follower): Received TimeoutNow - switching to Candidate 01:05:27,44 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Candidate): Election: Candidate has following voting peers: [leader297, follower298] 01:05:27,44 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299: Set currentTerm=3, votedFor=follower299 01:05:27,44 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Candidate): Starting new election term 3 01:05:27,44 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Candidate): Sending RequestVote [term=3, candidateId=follower299, lastLogIndex=-1, lastLogTerm=-1] to peer leader297 01:05:27,44 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:05:27,44 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Candidate): Sending RequestVote [term=3, candidateId=follower299, lastLogIndex=-1, lastLogTerm=-1] to peer follower298 01:05:27,44 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Cluster state: [] 01:05:27,44 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Candidate in requestVote:RequestVote [term=3, candidateId=follower299, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 01:05:27,44 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Term 3 in "RequestVote [term=3, candidateId=follower299, lastLogIndex=-1, lastLogTerm=-1]" message is greater than leader's term 2 - switching to Follower 01:05:27,44 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297: Set currentTerm=3, votedFor=null 01:05:27,44 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Follower) :- Switching from behavior Follower to Candidate, election term: 3 01:05:27,44 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): Leadership transfer in progress - processing RequestVote 01:05:27,44 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): In requestVote: RequestVote [term=3, candidateId=follower299, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1 01:05:27,44 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297: Set currentTerm=3, votedFor=follower299 01:05:27,44 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader): requestVote returning: RequestVoteReply [term=3, voteGranted=true] 01:05:27,45 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader297 (Leader) :- Switching from behavior Leader to Follower, election term: 3 01:05:27,45 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:05:27,45 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298 (Follower): Cluster state: [] 01:05:27,45 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298 (Follower): Candidate in requestVote:RequestVote [term=3, candidateId=follower299, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 01:05:27,45 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower298 (Follower): Term 3 in "RequestVote [term=3, candidateId=follower299, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 2 - updating term 01:05:27,45 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298: Set currentTerm=3, votedFor=null 01:05:27,45 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298 (Follower): In requestVote: RequestVote [term=3, candidateId=follower299, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1 01:05:27,45 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298: Set currentTerm=3, votedFor=follower299 01:05:27,45 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower298 (Follower): requestVote returning: RequestVoteReply [term=3, voteGranted=true] 01:05:27,52 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Candidate): RaftRPC message received RequestVoteReply [term=3, voteGranted=true], my term is 3 01:05:27,53 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Candidate): handleRequestVoteReply: RequestVoteReply [term=3, voteGranted=true], current voteCount: 1 01:05:27,53 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Leader): Election: Leader has following peers: [follower300, leader297, follower298] 01:05:27,53 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Leader): Checking sendAppendEntries for follower follower300: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,54 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Leader): Checking sendAppendEntries for follower leader297: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,54 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Leader): Checking sendAppendEntries for follower follower298: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,54 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3 01:05:27,54 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower300 (Follower): Term 3 in "AppendEntries [leaderId=follower299, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 2 - updating term 01:05:27,55 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower300: Set currentTerm=3, votedFor=null 01:05:27,55 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower300: Last sync leader does not match current leader follower299, need to catch up to -1 01:05:27,55 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower300 updated: matchIndex: -1, nextIndex: 0 01:05:27,55 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Leader): Checking sendAppendEntries for follower follower300: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,55 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower298: Last sync leader does not match current leader follower299, need to catch up to -1 01:05:27,55 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - leader297: Last sync leader does not match current leader follower299, need to catch up to -1 01:05:27,56 PM [test-akka.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader297: leader changed to follower299 01:05:27,56 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower298 updated: matchIndex: -1, nextIndex: 0 01:05:27,56 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Leader): Checking sendAppendEntries for follower follower298: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,56 PM [test-akka.actor.default-dispatcher-17] [INFO] RaftActorLeadershipTransferCohort - leader297: Successfully transferred leadership to follower299 in 13.16 ms 01:05:27,56 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader297 updated: matchIndex: -1, nextIndex: 0 01:05:27,56 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower299 (Leader): Checking sendAppendEntries for follower leader297: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,56 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader297: Leadership transferred successfully to follower299 [WARN] [09/16/2025 13:05:27.056] [test-akka.actor.default-dispatcher-5] [akka://test/user/follower300] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2c14c33a [WARN] [09/16/2025 13:05:27.056] [test-akka.actor.default-dispatcher-5] [akka://test/user/leader297] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5952fa5a [WARN] [09/16/2025 13:05:27.056] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower298] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@46e4470 01:05:27,102 PM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 ending 01:05:27,102 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower298-notifier301#2072266759] 01:05:27,116 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower298-collector302#622348733] 01:05:27,116 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower298] 01:05:27,116 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower299-notifier303#-305520605] 01:05:27,116 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower299-collector304#1378454883] 01:05:27,116 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower299] 01:05:27,117 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower300-notifier305#609145536] 01:05:27,117 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower300-collector306#1613828549] 01:05:27,117 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower300] 01:05:27,117 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader297-notifier307#394487304] 01:05:27,117 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader297-collector308#1988395494] 01:05:27,117 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader297] 01:05:27,119 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$a#1629630055] 01:05:27,121 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown starting 01:05:27,121 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting [WARN] [09/16/2025 13:05:27.124] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower310]: org.opendaylight.controller.cluster.common.actor.Monitor@27da2c6 01:05:27,125 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower310 with journal batch size 1000 01:05:27,125 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower310: SnapshotOffer called. 01:05:27,126 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower310: Moving last applied index from -1 to -1 01:05:27,126 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower310: Set currentTerm=1, votedFor=null 01:05:27,126 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower310: Updated server config: isVoting: true, peers: [PeerInfo [id=follower311, address=akka://test/user/follower311, votingState=VOTING], PeerInfo [id=leader309, address=akka://test/user/leader309, votingState=VOTING], PeerInfo [id=follower312, address=akka://test/user/follower312, votingState=NON_VOTING]] 01:05:27,126 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower310 in 108.7 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 [WARN] [09/16/2025 13:05:27.126] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower311]: org.opendaylight.controller.cluster.common.actor.Monitor@176700dd 01:05:27,126 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower311 with journal batch size 1000 01:05:27,126 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower311: SnapshotOffer called. 01:05:27,126 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower311: Moving last applied index from -1 to -1 01:05:27,126 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower311: Set currentTerm=1, votedFor=null 01:05:27,126 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower311: Updated server config: isVoting: true, peers: [PeerInfo [id=follower310, address=akka://test/user/follower310, votingState=VOTING], PeerInfo [id=leader309, address=akka://test/user/leader309, votingState=VOTING], PeerInfo [id=follower312, address=akka://test/user/follower312, votingState=NON_VOTING]] 01:05:27,126 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower311 in 43.82 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:27,127 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower310: Recovery completed in 1.415 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:05:27,127 PM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower311: Recovery completed in 713.2 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [09/16/2025 13:05:27.129] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower312]: org.opendaylight.controller.cluster.common.actor.Monitor@3a38968c 01:05:27,129 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower312 with journal batch size 1000 01:05:27,130 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower312: SnapshotOffer called. 01:05:27,130 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower312: Moving last applied index from -1 to -1 01:05:27,130 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower312: Set currentTerm=1, votedFor=null 01:05:27,130 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower312: Updated server config: isVoting: false, peers: [PeerInfo [id=follower311, address=akka://test/user/follower311, votingState=VOTING], PeerInfo [id=follower310, address=akka://test/user/follower310, votingState=VOTING], PeerInfo [id=leader309, address=akka://test/user/leader309, votingState=VOTING]] 01:05:27,130 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower312 in 49.67 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:27,131 PM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower312: Recovery completed in 640.6 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [09/16/2025 13:05:27.132] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader309]: org.opendaylight.controller.cluster.common.actor.Monitor@1b2ab6a4 01:05:27,132 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader309 with journal batch size 1000 01:05:27,133 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309: SnapshotOffer called. 01:05:27,133 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309: Moving last applied index from -1 to -1 01:05:27,133 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309: Set currentTerm=1, votedFor=null 01:05:27,133 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309: Updated server config: isVoting: true, peers: [PeerInfo [id=follower311, address=akka://test/user/follower311, votingState=VOTING], PeerInfo [id=follower310, address=akka://test/user/follower310, votingState=VOTING], PeerInfo [id=follower312, address=akka://test/user/follower312, votingState=NON_VOTING]] 01:05:27,133 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader309 in 69.35 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:27,133 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader309: Recovery completed in 672.6 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:05:27,498 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:05:27,498 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.170.168:25520, Removed) 01:05:27,498 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Follower): Received ElectionTimeout - switching to Candidate 01:05:27,498 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Candidate): Election: Candidate has following voting peers: [follower311, follower310] 01:05:27,498 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309: Set currentTerm=2, votedFor=leader309 01:05:27,498 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Candidate): Starting new election term 2 01:05:27,498 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Candidate): Sending RequestVote [term=2, candidateId=leader309, lastLogIndex=-1, lastLogTerm=-1] to peer follower311 01:05:27,499 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Candidate): Sending RequestVote [term=2, candidateId=leader309, lastLogIndex=-1, lastLogTerm=-1] to peer follower310 01:05:27,499 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower311 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:05:27,499 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 01:05:27,499 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower310 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:05:27,499 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower310 (Follower): Cluster state: [] 01:05:27,499 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower311 (Follower): Cluster state: [] 01:05:27,499 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower310 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader309, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 01:05:27,499 PM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower310 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader309, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term 01:05:27,499 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower310: Set currentTerm=2, votedFor=null 01:05:27,499 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower311 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader309, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 01:05:27,499 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower311 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader309, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term 01:05:27,499 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower311: Set currentTerm=2, votedFor=null 01:05:27,499 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower310 (Follower): In requestVote: RequestVote [term=2, candidateId=leader309, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 01:05:27,499 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower310: Set currentTerm=2, votedFor=leader309 01:05:27,499 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower310 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true] 01:05:27,499 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower311 (Follower): In requestVote: RequestVote [term=2, candidateId=leader309, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 01:05:27,499 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower311: Set currentTerm=2, votedFor=leader309 01:05:27,499 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower311 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true] 01:05:27,500 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2 01:05:27,500 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1 01:05:27,500 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Leader): Election: Leader has following peers: [follower311, follower310, follower312] 01:05:27,500 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Leader): Checking sendAppendEntries for follower follower311: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,501 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Leader): Checking sendAppendEntries for follower follower310: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,501 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Leader): Checking sendAppendEntries for follower follower312: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,501 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower311: Last sync leader does not match current leader leader309, need to catch up to -1 01:05:27,501 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 01:05:27,501 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower310: Last sync leader does not match current leader leader309, need to catch up to -1 01:05:27,501 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower312 (Follower): Term 2 in "AppendEntries [leaderId=leader309, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term 01:05:27,501 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower312: Set currentTerm=2, votedFor=null 01:05:27,501 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower312: Last sync leader does not match current leader leader309, need to catch up to -1 [WARN] [09/16/2025 13:05:27.501] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower311] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@7cb61c1b [WARN] [09/16/2025 13:05:27.501] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower310] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@12594312 [WARN] [09/16/2025 13:05:27.501] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower312] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@3997131c 01:05:27,501 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower311 updated: matchIndex: -1, nextIndex: 0 01:05:27,501 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Leader): Checking sendAppendEntries for follower follower311: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,502 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower310 updated: matchIndex: -1, nextIndex: 0 01:05:27,502 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Leader): Checking sendAppendEntries for follower follower310: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,502 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower312 updated: matchIndex: -1, nextIndex: 0 01:05:27,502 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Leader): Checking sendAppendEntries for follower follower312: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,537 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 01:05:27,537 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting 01:05:27,538 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending 01:05:27,538 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/follower311 starting 01:05:27,538 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower311: onShutDown 01:05:27,538 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/follower311 ending 01:05:27,538 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting 01:05:27,538 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending 01:05:27,538 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309: onRequestLeadership RequestLeadership [requestedFollowerId=follower311, replyTo=Actor[akka://test/user/$b#-990286148]] 01:05:27,538 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309: Initiating leader transfer 01:05:27,539 PM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader309: pauseLeader successfully completed - doing transfer 01:05:27,539 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Leader): Attempting to transfer leadership 01:05:27,539 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower310: onLeaderTransitioning: LeaderTransitioning [leaderId=leader309] 01:05:27,539 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Leader): Checking sendAppendEntries for follower follower311: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,539 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower312: onLeaderTransitioning: LeaderTransitioning [leaderId=leader309] 01:05:27,539 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Leader): Checking sendAppendEntries for follower follower310: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:27,539 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Leader): Checking sendAppendEntries for follower follower312: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [09/16/2025 13:05:27.539] [test-akka.actor.default-dispatcher-5] [akka://test/user/follower311] received dead letter from TestActor[akka://test/user/leader309]: LeaderTransitioning [leaderId=leader309] 01:05:27,539 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower310: Lagging 0 entries behind leader leader309 and reached -1 (of expected -1) 01:05:27,539 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower312: Lagging 0 entries behind leader leader309 and reached -1 (of expected -1) [WARN] [09/16/2025 13:05:27.539] [test-akka.actor.default-dispatcher-5] [akka://test/user/follower311] received dead letter from TestActor[akka://test/user/leader309]: AppendEntries [leaderId=leader309, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]] [WARN] [09/16/2025 13:05:27.539] [test-akka.actor.default-dispatcher-5] [akka://test/user/follower310] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@b93db98 [WARN] [09/16/2025 13:05:27.539] [test-akka.actor.default-dispatcher-5] [akka://test/user/follower312] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5a9e4563 [WARN] [09/16/2025 13:05:27.617] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower311] received dead letter from TestActor[akka://test/user/leader309]: AppendEntries [leaderId=leader309, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]] [WARN] [09/16/2025 13:05:27.738] [test-akka.actor.default-dispatcher-18] [akka://test/user/follower311] received dead letter from TestActor[akka://test/user/leader309]: AppendEntries [leaderId=leader309, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]] 01:05:27,738 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower310: Lagging 0 entries behind leader leader309 and reached -1 (of expected -1) 01:05:27,738 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower312: Lagging 0 entries behind leader leader309 and reached -1 (of expected -1) 01:05:27,857 PM [test-akka.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader309: leader transfer aborted 01:05:27,857 PM [test-akka.actor.default-dispatcher-18] [WARN] RaftActorLeadershipTransferCohort - leader309: Failed to transfer leadership in 318.2 ms 01:05:27,857 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309: LeadershipTransfer request from follower311 failed 01:05:27,858 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader309 (Leader): Leadership transfer expired [WARN] [09/16/2025 13:05:27.858] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower311] received dead letter from TestActor[akka://test/user/leader309]: AppendEntries [leaderId=leader309, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]] 01:05:27,858 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower310: Lagging 0 entries behind leader leader309 and reached -1 (of expected -1) 01:05:27,858 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower312: Lagging 0 entries behind leader leader309 and reached -1 (of expected -1) 01:05:27,891 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown ending 01:05:27,891 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower310-notifier313#31358905] 01:05:27,893 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower310-collector314#1368758544] 01:05:27,893 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower310] 01:05:27,894 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower311-notifier315#488693195] 01:05:27,894 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower311-collector316#1149150367] 01:05:27,894 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower311] 01:05:27,895 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower312-notifier317#66787640] 01:05:27,896 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower312-collector318#-2003623100] 01:05:27,896 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower312] 01:05:27,896 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader309-notifier319#-512120468] 01:05:27,897 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader309-collector320#287929813] 01:05:27,897 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader309] 01:05:27,897 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$b#-990286148] 01:05:27,899 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown starting 01:05:27,899 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting [WARN] [09/16/2025 13:05:27.901] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower322]: org.opendaylight.controller.cluster.common.actor.Monitor@5088bf75 01:05:27,901 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower322 with journal batch size 1000 01:05:27,902 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322: SnapshotOffer called. 01:05:27,902 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322: Moving last applied index from -1 to -1 01:05:27,902 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322: Set currentTerm=1, votedFor=null 01:05:27,902 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322: Updated server config: isVoting: true, peers: [PeerInfo [id=leader321, address=akka://test/user/leader321, votingState=VOTING], PeerInfo [id=follower324, address=akka://test/user/follower324, votingState=NON_VOTING], PeerInfo [id=follower323, address=akka://test/user/follower323, votingState=VOTING]] 01:05:27,902 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower322 in 67.38 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:27,903 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower322: Recovery completed in 594.9 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [09/16/2025 13:05:27.904] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower323]: org.opendaylight.controller.cluster.common.actor.Monitor@3977f7b2 01:05:27,904 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower323 with journal batch size 1000 01:05:27,905 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323: SnapshotOffer called. 01:05:27,905 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323: Moving last applied index from -1 to -1 01:05:27,905 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323: Set currentTerm=1, votedFor=null 01:05:27,905 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323: Updated server config: isVoting: true, peers: [PeerInfo [id=leader321, address=akka://test/user/leader321, votingState=VOTING], PeerInfo [id=follower322, address=akka://test/user/follower322, votingState=VOTING], PeerInfo [id=follower324, address=akka://test/user/follower324, votingState=NON_VOTING]] 01:05:27,905 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower323 in 53.11 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:27,905 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower323: Recovery completed in 485.4 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [09/16/2025 13:05:27.906] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower324]: org.opendaylight.controller.cluster.common.actor.Monitor@39a5c1b7 01:05:27,906 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower324 with journal batch size 1000 01:05:27,907 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324: SnapshotOffer called. 01:05:27,907 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324: Moving last applied index from -1 to -1 01:05:27,907 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324: Set currentTerm=1, votedFor=null 01:05:27,907 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324: Updated server config: isVoting: false, peers: [PeerInfo [id=leader321, address=akka://test/user/leader321, votingState=VOTING], PeerInfo [id=follower322, address=akka://test/user/follower322, votingState=VOTING], PeerInfo [id=follower323, address=akka://test/user/follower323, votingState=VOTING]] 01:05:27,907 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower324 in 59.51 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:27,907 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower324: Recovery completed in 613.9 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [09/16/2025 13:05:27.908] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader321]: org.opendaylight.controller.cluster.common.actor.Monitor@2f642649 01:05:27,909 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader321 with journal batch size 1000 01:05:27,909 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: SnapshotOffer called. 01:05:27,909 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: Moving last applied index from -1 to -1 01:05:27,909 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: Set currentTerm=1, votedFor=null 01:05:27,909 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: Updated server config: isVoting: true, peers: [PeerInfo [id=follower322, address=akka://test/user/follower322, votingState=VOTING], PeerInfo [id=follower324, address=akka://test/user/follower324, votingState=NON_VOTING], PeerInfo [id=follower323, address=akka://test/user/follower323, votingState=VOTING]] 01:05:27,909 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader321 in 52.78 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:27,910 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: Recovery completed in 578.2 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:05:28,287 PM [test-akka.actor.default-dispatcher-11] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:05:28,287 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.170.168:25520, Removed) 01:05:28,287 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Follower): Received ElectionTimeout - switching to Candidate 01:05:28,287 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Candidate): Election: Candidate has following voting peers: [follower322, follower323] 01:05:28,287 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: Set currentTerm=2, votedFor=leader321 01:05:28,288 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Candidate): Starting new election term 2 01:05:28,288 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Candidate): Sending RequestVote [term=2, candidateId=leader321, lastLogIndex=-1, lastLogTerm=-1] to peer follower322 01:05:28,288 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Candidate): Sending RequestVote [term=2, candidateId=leader321, lastLogIndex=-1, lastLogTerm=-1] to peer follower323 01:05:28,288 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 01:05:28,288 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:05:28,288 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): Cluster state: [] 01:05:28,288 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader321, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 01:05:28,288 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader321, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term 01:05:28,288 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323: Set currentTerm=2, votedFor=null 01:05:28,288 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): In requestVote: RequestVote [term=2, candidateId=leader321, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 01:05:28,288 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323: Set currentTerm=2, votedFor=leader321 01:05:28,288 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true] 01:05:28,289 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:05:28,289 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2 01:05:28,289 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Follower): Cluster state: [] 01:05:28,289 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1 01:05:28,289 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader321, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 01:05:28,289 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader321, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term 01:05:28,289 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322: Set currentTerm=2, votedFor=null 01:05:28,289 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Election: Leader has following peers: [follower322, follower324, follower323] 01:05:28,289 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Checking sendAppendEntries for follower follower322: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:28,289 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Follower): In requestVote: RequestVote [term=2, candidateId=leader321, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 01:05:28,289 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322: Set currentTerm=2, votedFor=leader321 01:05:28,289 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Checking sendAppendEntries for follower follower324: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:28,289 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Checking sendAppendEntries for follower follower323: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:28,289 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true] 01:05:28,289 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower324 (Follower): Term 2 in "AppendEntries [leaderId=leader321, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term 01:05:28,289 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 01:05:28,289 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324: Set currentTerm=2, votedFor=null 01:05:28,289 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower323: Last sync leader does not match current leader leader321, need to catch up to -1 01:05:28,289 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower324: Last sync leader does not match current leader leader321, need to catch up to -1 01:05:28,290 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower323 updated: matchIndex: -1, nextIndex: 0 01:05:28,290 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Checking sendAppendEntries for follower follower323: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:28,290 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower324 updated: matchIndex: -1, nextIndex: 0 01:05:28,290 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Checking sendAppendEntries for follower follower324: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [09/16/2025 13:05:28.290] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower323] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6ea53dd [WARN] [09/16/2025 13:05:28.290] [test-akka.actor.default-dispatcher-5] [akka://test/user/follower324] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2e33d45f 01:05:28,290 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower322: Last sync leader does not match current leader leader321, need to catch up to -1 01:05:28,290 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower322 updated: matchIndex: -1, nextIndex: 0 01:05:28,291 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Checking sendAppendEntries for follower follower322: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [09/16/2025 13:05:28.291] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower322] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@69728edb 01:05:28,312 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 01:05:28,312 PM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting 01:05:28,312 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: Persist data SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 01:05:28,312 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 01:05:28,312 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 01:05:28,313 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Checking sendAppendEntries for follower follower322: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:28,313 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): sendAppendEntries: 0 is present for follower follower322 01:05:28,313 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Sending AppendEntries to follower follower322: AppendEntries [leaderId=leader321, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]] 01:05:28,313 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Checking sendAppendEntries for follower follower324: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:28,313 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): sendAppendEntries: 0 is present for follower follower324 01:05:28,313 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Sending AppendEntries to follower follower324: AppendEntries [leaderId=leader321, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]] 01:05:28,313 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Follower): handleAppendEntries: AppendEntries [leaderId=leader321, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]] 01:05:28,313 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Checking sendAppendEntries for follower follower323: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:28,313 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): sendAppendEntries: 0 is present for follower follower323 01:05:28,313 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Follower): Number of entries to be appended = 1 01:05:28,313 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Sending AppendEntries to follower follower323: AppendEntries [leaderId=leader321, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]] 01:05:28,313 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 01:05:28,313 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324 (Follower): handleAppendEntries: AppendEntries [leaderId=leader321, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]] 01:05:28,313 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Follower): Append entry to log zero 01:05:28,313 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324 (Follower): Number of entries to be appended = 1 01:05:28,313 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 01:05:28,313 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 01:05:28,313 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324 (Follower): Append entry to log zero 01:05:28,313 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 01:05:28,313 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 01:05:28,314 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324 (Follower): Log size is now 1 01:05:28,314 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Follower): Log size is now 1 01:05:28,314 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Follower): handleAppendEntries returning : AppendEntriesReply [term=2, success=true, followerId=follower322, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5] 01:05:28,314 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324 (Follower): handleAppendEntries returning : AppendEntriesReply [term=2, success=true, followerId=follower324, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5] 01:05:28,314 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower324: Lagging 0 entries behind leader leader321 and reached -1 (of expected -1) 01:05:28,314 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower322: Lagging 0 entries behind leader leader321 and reached -1 (of expected -1) 01:05:28,314 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower322 updated: matchIndex: 0, nextIndex: 1 01:05:28,314 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 01:05:28,314 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Setting last applied to 0 01:05:28,314 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: Moving last applied index from -1 to 0 01:05:28,314 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: Applying state for log index 0 data zero 01:05:28,314 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: applyState called: zero 01:05:28,314 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Checking sendAppendEntries for follower follower322: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:28,314 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower324 updated: matchIndex: 0, nextIndex: 1 01:05:28,314 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Checking sendAppendEntries for follower follower324: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:28,314 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 01:05:28,314 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 01:05:28,314 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Follower): Commit index set to 0 [WARN] [09/16/2025 13:05:28.314] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower322] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5145053b 01:05:28,314 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower322: Lagging 0 entries behind leader leader321 and reached 0 (of expected -1) 01:05:28,315 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0 01:05:28,315 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Follower): Setting last applied to 0 01:05:28,315 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322: Moving last applied index from -1 to 0 01:05:28,315 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322: Applying state for log index 0 data zero [WARN] [09/16/2025 13:05:28.315] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower324] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5d960aad 01:05:28,315 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324 (Follower): Commit index set to 0 01:05:28,315 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower324: Lagging 0 entries behind leader leader321 and reached 0 (of expected -1) 01:05:28,315 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower322: applyState called: zero 01:05:28,315 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0 01:05:28,315 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324 (Follower): Setting last applied to 0 01:05:28,315 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324: Moving last applied index from -1 to 0 01:05:28,315 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324: Applying state for log index 0 data zero 01:05:28,315 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322: Persisting ApplyJournalEntries with index=0 01:05:28,315 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower324: applyState called: zero 01:05:28,315 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: Persisting ApplyJournalEntries with index=0 01:05:28,315 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324: Persisting ApplyJournalEntries with index=0 01:05:28,363 PM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending 01:05:28,363 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 starting 01:05:28,363 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: onShutDown 01:05:28,363 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: Initiating leader transfer 01:05:28,364 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324: onLeaderTransitioning: LeaderTransitioning [leaderId=leader321] 01:05:28,364 PM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorLeadershipTransferCohort - leader321: pauseLeader successfully completed - doing transfer 01:05:28,364 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Attempting to transfer leadership 01:05:28,364 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322: onLeaderTransitioning: LeaderTransitioning [leaderId=leader321] 01:05:28,364 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Checking sendAppendEntries for follower follower322: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:28,364 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Checking sendAppendEntries for follower follower324: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:28,364 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower322: Lagging 0 entries behind leader leader321 and reached 0 (of expected -1) 01:05:28,364 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Checking sendAppendEntries for follower follower323: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:28,364 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): sendAppendEntries: 0 is present for follower follower323 01:05:28,364 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower324: Lagging 0 entries behind leader leader321 and reached 0 (of expected -1) 01:05:28,364 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Sending AppendEntries to follower follower323: AppendEntries [leaderId=leader321, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]] 01:05:28,364 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): tryToCompleteLeadershipTransfer: followerId: follower322, matchIndex: 0, lastIndex: 0, isVoting: true 01:05:28,364 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Follower's log matches - sending ElectionTimeout 01:05:28,364 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Checking sendAppendEntries for follower follower322: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:28,364 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Checking sendAppendEntries for follower follower324: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:28,364 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Checking sendAppendEntries for follower follower323: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:28,364 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): sendAppendEntries: 0 is present for follower follower323 01:05:28,365 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Leader transfer complete 01:05:28,365 PM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorLeadershipTransferCohort - leader321: leader transfer complete - waiting for new leader 01:05:28,365 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower324: Lagging 0 entries behind leader leader321 and reached 0 (of expected -1) 01:05:28,365 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower322: Lagging 0 entries behind leader leader321 and reached 0 (of expected -1) 01:05:28,365 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:05:28,365 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Follower): Received TimeoutNow - switching to Candidate 01:05:28,365 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Candidate): Election: Candidate has following voting peers: [leader321, follower323] 01:05:28,365 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322: Set currentTerm=3, votedFor=follower322 01:05:28,365 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Candidate): Starting new election term 3 01:05:28,365 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Candidate): Sending RequestVote [term=3, candidateId=follower322, lastLogIndex=0, lastLogTerm=2] to peer leader321 01:05:28,365 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Candidate): Sending RequestVote [term=3, candidateId=follower322, lastLogIndex=0, lastLogTerm=2] to peer follower323 01:05:28,365 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:05:28,365 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Follower) :- Switching from behavior Follower to Candidate, election term: 3 01:05:28,365 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Cluster state: [] 01:05:28,365 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:05:28,365 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Candidate in requestVote:RequestVote [term=3, candidateId=follower322, lastLogIndex=0, lastLogTerm=2] with higher term appears reachable, updating term. 01:05:28,365 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): Cluster state: [] 01:05:28,365 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): Candidate in requestVote:RequestVote [term=3, candidateId=follower322, lastLogIndex=0, lastLogTerm=2] with higher term appears reachable, updating term. 01:05:28,365 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Term 3 in "RequestVote [term=3, candidateId=follower322, lastLogIndex=0, lastLogTerm=2]" message is greater than leader's term 2 - switching to Follower 01:05:28,365 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: Set currentTerm=3, votedFor=null 01:05:28,365 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): Term 3 in "RequestVote [term=3, candidateId=follower322, lastLogIndex=0, lastLogTerm=2]" message is greater than follower's term 2 - updating term 01:05:28,365 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323: Set currentTerm=3, votedFor=null 01:05:28,365 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): In requestVote: RequestVote [term=3, candidateId=follower322, lastLogIndex=0, lastLogTerm=2] - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1 01:05:28,365 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323: Set currentTerm=3, votedFor=follower322 01:05:28,365 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): requestVote returning: RequestVoteReply [term=3, voteGranted=true] 01:05:28,366 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Candidate): RaftRPC message received RequestVoteReply [term=3, voteGranted=true], my term is 3 01:05:28,366 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Candidate): handleRequestVoteReply: RequestVoteReply [term=3, voteGranted=true], current voteCount: 1 01:05:28,366 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Leader): Election: Leader has following peers: [leader321, follower324, follower323] 01:05:28,366 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): Leadership transfer in progress - processing RequestVote 01:05:28,366 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Leader): Checking sendAppendEntries for follower leader321: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:28,366 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): In requestVote: RequestVote [term=3, candidateId=follower322, lastLogIndex=0, lastLogTerm=2] - currentTerm: 3, votedFor: null, lastIndex: 0, lastTerm: 2 01:05:28,366 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: Set currentTerm=3, votedFor=follower322 01:05:28,366 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Leader): Checking sendAppendEntries for follower follower324: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:28,366 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Leader): Checking sendAppendEntries for follower follower323: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:28,366 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader): requestVote returning: RequestVoteReply [term=3, voteGranted=true] 01:05:28,366 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower324 (Follower): Term 3 in "AppendEntries [leaderId=follower322, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 2 - updating term 01:05:28,366 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower324: Set currentTerm=3, votedFor=null 01:05:28,366 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3 01:05:28,366 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader321 (Leader) :- Switching from behavior Leader to Follower, election term: 3 01:05:28,366 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower324: Last sync leader does not match current leader follower322, need to catch up to -1 01:05:28,367 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower324 updated: matchIndex: 0, nextIndex: 1 01:05:28,367 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Leader): Checking sendAppendEntries for follower follower324: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:28,367 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower324: Lagging 0 entries behind leader follower322 and reached 0 (of expected -1) [WARN] [09/16/2025 13:05:28.367] [test-akka.actor.default-dispatcher-11] [akka://test/user/follower324] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@1914fe0c [WARN] [09/16/2025 13:05:28.367] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower324] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6632c4a0 01:05:28,368 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - leader321: Last sync leader does not match current leader follower322, need to catch up to -1 01:05:28,368 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader321 updated: matchIndex: 0, nextIndex: 1 01:05:28,368 PM [test-akka.actor.default-dispatcher-5] [DEBUG] RaftActorLeadershipTransferCohort - leader321: leader changed to follower322 01:05:28,368 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Leader): Checking sendAppendEntries for follower leader321: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:28,368 PM [test-akka.actor.default-dispatcher-5] [INFO] RaftActorLeadershipTransferCohort - leader321: Successfully transferred leadership to follower322 in 4.277 ms 01:05:28,368 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader321: leader transfer succeeded - sending PoisonPill 01:05:28,368 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - leader321: Lagging 0 entries behind leader follower322 and reached 0 (of expected -1) [WARN] [09/16/2025 13:05:28.368] [test-akka.actor.default-dispatcher-11] [akka://test/user/leader321] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@4602ad03 [WARN] [09/16/2025 13:05:28.368] [test-akka.actor.default-dispatcher-11] [akka://test/user/leader321] received dead letter: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@30290e9a 01:05:28,877 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower323: Last sync leader does not match current leader follower322, need to catch up to -1 01:05:28,877 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower324: Lagging 0 entries behind leader follower322 and reached 0 (of expected -1) 01:05:28,877 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Leader): sendAppendEntries: 0 is present for follower follower323 [WARN] [09/16/2025 13:05:28.877] [test-akka.actor.default-dispatcher-5] [akka://test/user/leader321] received dead letter from TestActor[akka://test/user/follower322]: AppendEntries [leaderId=follower322, prevLogIndex=0, prevLogTerm=2, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]] 01:05:28,877 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Leader): Sending AppendEntries to follower follower323: AppendEntries [leaderId=follower322, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]] [WARN] [09/16/2025 13:05:28.877] [test-akka.actor.default-dispatcher-5] [akka://test/user/follower323] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@61bf6a37 01:05:28,877 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): handleAppendEntries: AppendEntries [leaderId=follower322, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]] 01:05:28,877 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): Number of entries to be appended = 1 01:05:28,877 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 01:05:28,877 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): Append entry to log zero 01:05:28,877 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 01:05:28,877 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): Log size is now 1 01:05:28,877 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): Commit index set to 0 01:05:28,877 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): handleAppendEntries returning : AppendEntriesReply [term=3, success=true, followerId=follower323, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5] 01:05:28,877 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower323: Lagging 0 entries behind leader follower322 and reached 0 (of expected -1) 01:05:28,877 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0 01:05:28,877 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323 (Follower): Setting last applied to 0 01:05:28,877 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323: Moving last applied index from -1 to 0 01:05:28,877 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower323 updated: matchIndex: 0, nextIndex: 1 01:05:28,877 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323: Applying state for log index 0 data zero 01:05:28,877 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower322 (Leader): Checking sendAppendEntries for follower follower323: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:28,878 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower323: applyState called: zero 01:05:28,878 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 01:05:28,878 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323: Persisting ApplyJournalEntries with index=0 [WARN] [09/16/2025 13:05:28.879] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower323] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@34ca5015 01:05:28,917 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323: onLeaderTransitioning: LeaderTransitioning [leaderId=leader321] 01:05:28,918 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 ending 01:05:28,918 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/follower323 starting 01:05:28,918 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower323: onShutDown 01:05:28,919 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/follower323 ending 01:05:28,919 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending 01:05:28,919 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower322-notifier325#1584895165] 01:05:28,929 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower322-collector326#995326057] 01:05:28,930 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower322] 01:05:28,930 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower323-notifier327#1202509977] 01:05:28,930 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower323-collector328#1955857458] 01:05:28,930 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower323] 01:05:28,930 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower324-notifier329#-1343916197] 01:05:28,931 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower324-collector330#1566132208] 01:05:28,931 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower324] 01:05:28,931 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader321-notifier331#-231168915] 01:05:28,931 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader321-collector332#806400764] 01:05:28,931 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader321] 01:05:28,932 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers starting [WARN] [09/16/2025 13:05:28.934] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader333]: org.opendaylight.controller.cluster.common.actor.Monitor@2f2ff198 01:05:28,934 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader333 with journal batch size 1000 01:05:28,935 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader333: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:05:28,936 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:05:28,936 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader333 (Follower): Received TimeoutNow - switching to Candidate 01:05:28,936 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader333 (Candidate): Election: Candidate has following voting peers: [] 01:05:28,936 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader333: Set currentTerm=1, votedFor=leader333 01:05:28,936 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader333 (Candidate): Starting new election term 1 01:05:28,936 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader333 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:05:28,936 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader333 (Candidate): Received ElectionTimeout 01:05:28,936 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader333 (Leader): Election: Leader has following peers: [] 01:05:28,936 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader333 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:05:28,936 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/leader333 starting 01:05:28,937 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader333: onShutDown 01:05:28,937 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for akka://test/user/leader333 ending 01:05:28,937 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers ending 01:05:28,937 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader333-collector337#1199885802] 01:05:28,948 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader333] 01:05:28,948 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging starting 01:05:28,948 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting [WARN] [09/16/2025 13:05:28.949] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower339]: org.opendaylight.controller.cluster.common.actor.Monitor@5e765df 01:05:28,950 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower339 with journal batch size 1000 01:05:28,951 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower340 with journal batch size 1000 [WARN] [09/16/2025 13:05:28.951] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower340]: org.opendaylight.controller.cluster.common.actor.Monitor@3e5fdc94 01:05:28,951 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339: SnapshotOffer called. 01:05:28,951 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339: Moving last applied index from -1 to -1 01:05:28,951 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339: Set currentTerm=1, votedFor=null 01:05:28,951 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339: Updated server config: isVoting: true, peers: [PeerInfo [id=leader338, address=akka://test/user/leader338, votingState=VOTING], PeerInfo [id=follower340, address=akka://test/user/follower340, votingState=VOTING], PeerInfo [id=follower341, address=akka://test/user/follower341, votingState=NON_VOTING]] 01:05:28,951 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower340: SnapshotOffer called. 01:05:28,951 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower340: Moving last applied index from -1 to -1 01:05:28,951 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower340: Set currentTerm=1, votedFor=null 01:05:28,951 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower340: Updated server config: isVoting: true, peers: [PeerInfo [id=leader338, address=akka://test/user/leader338, votingState=VOTING], PeerInfo [id=follower339, address=akka://test/user/follower339, votingState=VOTING], PeerInfo [id=follower341, address=akka://test/user/follower341, votingState=NON_VOTING]] 01:05:28,951 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower339 in 54.39 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:28,951 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower340 in 66.08 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:28,952 PM [test-akka.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower340: Recovery completed in 580.2 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:05:28,952 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower339: Recovery completed in 726.0 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [09/16/2025 13:05:28.953] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower341]: org.opendaylight.controller.cluster.common.actor.Monitor@2a148012 01:05:28,953 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower341 with journal batch size 1000 01:05:28,953 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341: SnapshotOffer called. 01:05:28,953 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341: Moving last applied index from -1 to -1 01:05:28,953 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341: Set currentTerm=1, votedFor=null 01:05:28,953 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341: Updated server config: isVoting: false, peers: [PeerInfo [id=leader338, address=akka://test/user/leader338, votingState=VOTING], PeerInfo [id=follower339, address=akka://test/user/follower339, votingState=VOTING], PeerInfo [id=follower340, address=akka://test/user/follower340, votingState=VOTING]] 01:05:28,953 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower341 in 47.53 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:28,954 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower341: Recovery completed in 449.7 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [09/16/2025 13:05:29.055] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader338]: org.opendaylight.controller.cluster.common.actor.Monitor@75dceac0 01:05:29,56 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader338 with journal batch size 1000 01:05:29,56 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338: SnapshotOffer called. 01:05:29,56 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338: Moving last applied index from -1 to -1 01:05:29,57 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338: Set currentTerm=1, votedFor=null 01:05:29,57 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338: Updated server config: isVoting: true, peers: [PeerInfo [id=follower339, address=akka://test/user/follower339, votingState=VOTING], PeerInfo [id=follower340, address=akka://test/user/follower340, votingState=VOTING], PeerInfo [id=follower341, address=akka://test/user/follower341, votingState=NON_VOTING]] 01:05:29,57 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader338 in 118.9 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:29,58 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader338: Recovery completed in 1.029 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:05:29,417 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:05:29,417 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.170.168:25520, Removed) 01:05:29,417 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Follower): Received ElectionTimeout - switching to Candidate 01:05:29,417 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Candidate): Election: Candidate has following voting peers: [follower339, follower340] 01:05:29,417 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338: Set currentTerm=2, votedFor=leader338 01:05:29,417 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Candidate): Starting new election term 2 01:05:29,417 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Candidate): Sending RequestVote [term=2, candidateId=leader338, lastLogIndex=-1, lastLogTerm=-1] to peer follower339 01:05:29,417 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Candidate): Sending RequestVote [term=2, candidateId=leader338, lastLogIndex=-1, lastLogTerm=-1] to peer follower340 01:05:29,417 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:05:29,418 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 01:05:29,418 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339 (Follower): Cluster state: [] 01:05:29,418 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower340 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:05:29,418 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader338, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 01:05:29,418 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower340 (Follower): Cluster state: [] 01:05:29,418 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower339 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader338, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term 01:05:29,418 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower340 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader338, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 01:05:29,418 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339: Set currentTerm=2, votedFor=null 01:05:29,418 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower340 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader338, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term 01:05:29,418 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower340: Set currentTerm=2, votedFor=null 01:05:29,418 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower340 (Follower): In requestVote: RequestVote [term=2, candidateId=leader338, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 01:05:29,418 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower340: Set currentTerm=2, votedFor=leader338 01:05:29,418 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339 (Follower): In requestVote: RequestVote [term=2, candidateId=leader338, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 01:05:29,418 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339: Set currentTerm=2, votedFor=leader338 01:05:29,418 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower340 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true] 01:05:29,418 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true] 01:05:29,419 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2 01:05:29,419 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1 01:05:29,419 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Election: Leader has following peers: [follower339, follower340, follower341] 01:05:29,419 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Checking sendAppendEntries for follower follower339: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:29,419 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Checking sendAppendEntries for follower follower340: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:29,419 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Checking sendAppendEntries for follower follower341: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:29,419 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower339: Last sync leader does not match current leader leader338, need to catch up to -1 01:05:29,419 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 01:05:29,419 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower340: Last sync leader does not match current leader leader338, need to catch up to -1 01:05:29,419 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower341 (Follower): Term 2 in "AppendEntries [leaderId=leader338, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term 01:05:29,419 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341: Set currentTerm=2, votedFor=null [WARN] [09/16/2025 13:05:29.419] [test-akka.actor.default-dispatcher-11] [akka://test/user/follower339] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@64858475 01:05:29,419 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower341: Last sync leader does not match current leader leader338, need to catch up to -1 [WARN] [09/16/2025 13:05:29.419] [test-akka.actor.default-dispatcher-11] [akka://test/user/follower340] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@1ca01ba1 01:05:29,420 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower339 updated: matchIndex: -1, nextIndex: 0 01:05:29,420 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Checking sendAppendEntries for follower follower339: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:29,420 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower340 updated: matchIndex: -1, nextIndex: 0 01:05:29,420 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Checking sendAppendEntries for follower follower340: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:29,420 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower341 updated: matchIndex: -1, nextIndex: 0 [WARN] [09/16/2025 13:05:29.420] [test-akka.actor.default-dispatcher-11] [akka://test/user/follower341] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@244a2cc9 01:05:29,420 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Checking sendAppendEntries for follower follower341: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:29,456 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 01:05:29,456 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting 01:05:29,457 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending 01:05:29,457 PM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting 01:05:29,457 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338: Persist data SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 01:05:29,457 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 01:05:29,457 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 01:05:29,458 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Checking sendAppendEntries for follower follower339: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:29,458 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): sendAppendEntries: 0 is present for follower follower339 01:05:29,458 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Sending AppendEntries to follower follower339: AppendEntries [leaderId=leader338, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]] 01:05:29,458 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339 (Follower): handleAppendEntries: AppendEntries [leaderId=leader338, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]] 01:05:29,458 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339 (Follower): Number of entries to be appended = 1 01:05:29,458 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 01:05:29,458 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339 (Follower): Append entry to log zero 01:05:29,458 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 01:05:29,458 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339 (Follower): Log size is now 1 01:05:29,458 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339 (Follower): handleAppendEntries returning : AppendEntriesReply [term=2, success=true, followerId=follower339, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5] 01:05:29,458 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower339: Lagging 0 entries behind leader leader338 and reached -1 (of expected -1) 01:05:29,458 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Checking sendAppendEntries for follower follower340: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:29,458 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): sendAppendEntries: 0 is present for follower follower340 01:05:29,458 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Sending AppendEntries to follower follower340: AppendEntries [leaderId=leader338, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]] 01:05:29,458 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] [WARN] [09/16/2025 13:05:29.459] [test-akka.actor.default-dispatcher-16] [akka://test/user/follower339] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@59395d24 01:05:29,459 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Checking sendAppendEntries for follower follower341: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:29,459 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): sendAppendEntries: 0 is present for follower follower341 01:05:29,459 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Sending AppendEntries to follower follower341: AppendEntries [leaderId=leader338, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]] 01:05:29,459 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower339 updated: matchIndex: 0, nextIndex: 1 01:05:29,459 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Checking sendAppendEntries for follower follower339: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:29,459 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 01:05:29,459 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 01:05:29,459 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Setting last applied to 0 01:05:29,459 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338: Moving last applied index from -1 to 0 01:05:29,459 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338: Applying state for log index 0 data zero 01:05:29,459 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader338: applyState called: zero 01:05:29,459 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338: Persisting ApplyJournalEntries with index=0 01:05:29,459 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341 (Follower): handleAppendEntries: AppendEntries [leaderId=leader338, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]] 01:05:29,459 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341 (Follower): Number of entries to be appended = 1 01:05:29,459 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 01:05:29,459 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341 (Follower): Append entry to log zero 01:05:29,459 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 01:05:29,460 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341 (Follower): Log size is now 1 01:05:29,460 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341 (Follower): handleAppendEntries returning : AppendEntriesReply [term=2, success=true, followerId=follower341, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5] 01:05:29,460 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower341: Lagging 0 entries behind leader leader338 and reached -1 (of expected -1) 01:05:29,460 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower341 updated: matchIndex: 0, nextIndex: 1 01:05:29,460 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Checking sendAppendEntries for follower follower341: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:29,460 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 01:05:29,460 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341 (Follower): Commit index set to 0 01:05:29,460 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower341: Lagging 0 entries behind leader leader338 and reached 0 (of expected -1) 01:05:29,460 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0 01:05:29,460 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341 (Follower): Setting last applied to 0 01:05:29,460 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341: Moving last applied index from -1 to 0 01:05:29,460 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341: Applying state for log index 0 data zero 01:05:29,460 PM [test-akka.actor.default-dispatcher-11] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower341: applyState called: zero 01:05:29,460 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341: Persisting ApplyJournalEntries with index=0 [WARN] [09/16/2025 13:05:29.461] [test-akka.actor.default-dispatcher-11] [akka://test/user/follower341] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@71ca1099 01:05:29,537 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): sendAppendEntries: 0 is present for follower follower340 01:05:29,537 PM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Sending AppendEntries to follower follower340: AppendEntries [leaderId=leader338, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]] 01:05:29,657 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): sendAppendEntries: 0 is present for follower follower340 01:05:29,657 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Sending AppendEntries to follower follower340: AppendEntries [leaderId=leader338, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]] 01:05:29,657 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339 (Follower): Commit index set to 0 01:05:29,657 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower339: Lagging 0 entries behind leader leader338 and reached 0 (of expected -1) 01:05:29,657 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0 01:05:29,657 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339 (Follower): Setting last applied to 0 01:05:29,657 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339: Moving last applied index from -1 to 0 01:05:29,657 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339: Applying state for log index 0 data zero 01:05:29,657 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower341: Lagging 0 entries behind leader leader338 and reached 0 (of expected -1) 01:05:29,657 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower339: applyState called: zero 01:05:29,658 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339: Persisting ApplyJournalEntries with index=0 01:05:29,658 PM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending 01:05:29,658 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting 01:05:29,658 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending 01:05:29,658 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338: onRequestLeadership RequestLeadership [requestedFollowerId=follower340, replyTo=Actor[akka://test/user/$c#1481609790]] 01:05:29,659 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338: Initiating leader transfer 01:05:29,659 PM [test-akka.actor.default-dispatcher-16] [DEBUG] RaftActorLeadershipTransferCohort - leader338: pauseLeader successfully completed - doing transfer 01:05:29,659 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower340: onLeaderTransitioning: LeaderTransitioning [leaderId=leader338] 01:05:29,659 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Attempting to transfer leadership 01:05:29,659 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Checking sendAppendEntries for follower follower339: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:29,659 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Checking sendAppendEntries for follower follower340: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:29,659 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): sendAppendEntries: 0 is present for follower follower340 01:05:29,659 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower341: onLeaderTransitioning: LeaderTransitioning [leaderId=leader338] 01:05:29,659 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Checking sendAppendEntries for follower follower341: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:05:29,659 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower339: Lagging 0 entries behind leader leader338 and reached 0 (of expected -1) 01:05:29,659 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower341: Lagging 0 entries behind leader leader338 and reached 0 (of expected -1) 01:05:29,660 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower339: onLeaderTransitioning: LeaderTransitioning [leaderId=leader338] 01:05:29,777 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower341: Lagging 0 entries behind leader leader338 and reached 0 (of expected -1) 01:05:29,778 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower339: Lagging 0 entries behind leader leader338 and reached 0 (of expected -1) 01:05:29,898 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower339: Lagging 0 entries behind leader leader338 and reached 0 (of expected -1) 01:05:29,898 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower341: Lagging 0 entries behind leader leader338 and reached 0 (of expected -1) 01:05:30,17 PM [test-akka.actor.default-dispatcher-12] [DEBUG] RaftActorLeadershipTransferCohort - leader338: leader transfer aborted 01:05:30,17 PM [test-akka.actor.default-dispatcher-12] [WARN] RaftActorLeadershipTransferCohort - leader338: Failed to transfer leadership in 358.4 ms 01:05:30,17 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338: LeadershipTransfer request from follower340 failed 01:05:30,17 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader338 (Leader): Leadership transfer expired 01:05:30,18 PM [test-akka.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower341: Lagging 0 entries behind leader leader338 and reached 0 (of expected -1) 01:05:30,18 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower339: Lagging 0 entries behind leader leader338 and reached 0 (of expected -1) 01:05:30,62 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging ending 01:05:30,62 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower339-notifier342#-1739245320] 01:05:30,64 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower339-collector343#1727045726] 01:05:30,64 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower339] 01:05:30,65 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower340-notifier344#456317990] 01:05:30,65 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower340-collector345#-78462474] 01:05:30,65 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower340] 01:05:30,65 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower341-notifier346#-1028032588] 01:05:30,66 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower341-collector347#-1835888117] 01:05:30,66 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower341] 01:05:30,66 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader338-notifier348#1936160504] 01:05:30,66 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader338-collector349#-1597610461] 01:05:30,67 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader338] 01:05:30,67 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$c#1481609790] 01:05:30,68 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown starting 01:05:30,68 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting [WARN] [09/16/2025 13:05:30.070] [test-akka.actor.default-dispatcher-17] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower351]: org.opendaylight.controller.cluster.common.actor.Monitor@60799ee7 01:05:30,70 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower351 with journal batch size 1000 01:05:30,71 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower351: SnapshotOffer called. 01:05:30,71 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower351: Moving last applied index from -1 to -1 01:05:30,71 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower351: Set currentTerm=1, votedFor=null 01:05:30,71 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower351: Updated server config: isVoting: true, peers: [PeerInfo [id=follower353, address=akka://test/user/follower353, votingState=NON_VOTING], PeerInfo [id=follower352, address=akka://test/user/follower352, votingState=VOTING], PeerInfo [id=leader350, address=akka://test/user/leader350, votingState=VOTING]] 01:05:30,71 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower351 in 67.39 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:30,72 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower351: Recovery completed in 1.155 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [09/16/2025 13:05:30.072] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower352]: org.opendaylight.controller.cluster.common.actor.Monitor@6491e723 01:05:30,73 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower352 with journal batch size 1000 01:05:30,73 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352: SnapshotOffer called. 01:05:30,73 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352: Moving last applied index from -1 to -1 01:05:30,73 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352: Set currentTerm=1, votedFor=null 01:05:30,73 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352: Updated server config: isVoting: true, peers: [PeerInfo [id=follower351, address=akka://test/user/follower351, votingState=VOTING], PeerInfo [id=follower353, address=akka://test/user/follower353, votingState=NON_VOTING], PeerInfo [id=leader350, address=akka://test/user/leader350, votingState=VOTING]] 01:05:30,73 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower352 in 41.76 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:30,74 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower352: Recovery completed in 784.5 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [09/16/2025 13:05:30.074] [test-akka.actor.default-dispatcher-17] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/follower353]: org.opendaylight.controller.cluster.common.actor.Monitor@210c7034 01:05:30,75 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower353 with journal batch size 1000 01:05:30,75 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower353: SnapshotOffer called. 01:05:30,75 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower353: Moving last applied index from -1 to -1 01:05:30,75 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower353: Set currentTerm=1, votedFor=null 01:05:30,75 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower353: Updated server config: isVoting: false, peers: [PeerInfo [id=follower351, address=akka://test/user/follower351, votingState=VOTING], PeerInfo [id=follower352, address=akka://test/user/follower352, votingState=VOTING], PeerInfo [id=leader350, address=akka://test/user/leader350, votingState=VOTING]] 01:05:30,76 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower353 in 242.9 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:30,76 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower353: Recovery completed in 906.3 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [09/16/2025 13:05:30.077] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/leader350]: org.opendaylight.controller.cluster.common.actor.Monitor@54c2d475 01:05:30,77 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader350 with journal batch size 1000 01:05:30,78 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350: SnapshotOffer called. 01:05:30,78 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350: Moving last applied index from -1 to -1 01:05:30,78 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350: Set currentTerm=1, votedFor=null 01:05:30,78 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350: Updated server config: isVoting: true, peers: [PeerInfo [id=follower351, address=akka://test/user/follower351, votingState=VOTING], PeerInfo [id=follower353, address=akka://test/user/follower353, votingState=NON_VOTING], PeerInfo [id=follower352, address=akka://test/user/follower352, votingState=VOTING]] 01:05:30,78 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader350 in 67.10 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:05:30,78 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader350: Recovery completed in 465.0 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:05:30,457 PM [test-akka.actor.default-dispatcher-17] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:05:30,457 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(akka://test@10.30.170.168:25520, Removed) 01:05:30,457 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Follower): Received ElectionTimeout - switching to Candidate 01:05:30,457 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Candidate): Election: Candidate has following voting peers: [follower351, follower352] 01:05:30,457 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350: Set currentTerm=2, votedFor=leader350 01:05:30,458 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Candidate): Starting new election term 2 01:05:30,458 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Candidate): Sending RequestVote [term=2, candidateId=leader350, lastLogIndex=-1, lastLogTerm=-1] to peer follower351 01:05:30,458 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Candidate): Sending RequestVote [term=2, candidateId=leader350, lastLogIndex=-1, lastLogTerm=-1] to peer follower352 01:05:30,458 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower351 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:05:30,458 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 01:05:30,458 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower351 (Follower): Cluster state: [] 01:05:30,458 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower351 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader350, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 01:05:30,458 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:05:30,458 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower351 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader350, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term 01:05:30,458 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower351: Set currentTerm=2, votedFor=null 01:05:30,458 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Follower): Cluster state: [] 01:05:30,458 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Follower): Candidate in requestVote:RequestVote [term=2, candidateId=leader350, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 01:05:30,458 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Follower): Term 2 in "RequestVote [term=2, candidateId=leader350, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 1 - updating term 01:05:30,458 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352: Set currentTerm=2, votedFor=null 01:05:30,458 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Follower): In requestVote: RequestVote [term=2, candidateId=leader350, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 01:05:30,458 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352: Set currentTerm=2, votedFor=leader350 01:05:30,458 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true] 01:05:30,459 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower351 (Follower): In requestVote: RequestVote [term=2, candidateId=leader350, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 01:05:30,459 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower351: Set currentTerm=2, votedFor=leader350 01:05:30,459 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower351 (Follower): requestVote returning: RequestVoteReply [term=2, voteGranted=true] 01:05:30,459 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Candidate): RaftRPC message received RequestVoteReply [term=2, voteGranted=true], my term is 2 01:05:30,459 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Candidate): handleRequestVoteReply: RequestVoteReply [term=2, voteGranted=true], current voteCount: 1 01:05:30,459 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Election: Leader has following peers: [follower351, follower353, follower352] 01:05:30,459 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Checking sendAppendEntries for follower follower351: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:30,459 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Checking sendAppendEntries for follower follower353: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:30,459 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Checking sendAppendEntries for follower follower352: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:30,459 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower351: Last sync leader does not match current leader leader350, need to catch up to -1 01:05:30,459 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 01:05:30,459 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower353 (Follower): Term 2 in "AppendEntries [leaderId=leader350, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]]" message is greater than follower's term 1 - updating term 01:05:30,459 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower353: Set currentTerm=2, votedFor=null 01:05:30,459 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower352: Last sync leader does not match current leader leader350, need to catch up to -1 01:05:30,459 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower353: Last sync leader does not match current leader leader350, need to catch up to -1 01:05:30,459 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower351 updated: matchIndex: -1, nextIndex: 0 01:05:30,459 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Checking sendAppendEntries for follower follower351: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:30,459 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower352 updated: matchIndex: -1, nextIndex: 0 [WARN] [09/16/2025 13:05:30.459] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower351] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2410e71c 01:05:30,459 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Checking sendAppendEntries for follower follower352: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [09/16/2025 13:05:30.459] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower352] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2310fabd 01:05:30,459 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower353 updated: matchIndex: -1, nextIndex: 0 01:05:30,459 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Checking sendAppendEntries for follower follower353: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [09/16/2025 13:05:30.460] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower353] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@8db4488 01:05:30,481 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 01:05:30,481 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting 01:05:30,482 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending 01:05:30,482 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower351] 01:05:30,493 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower353] 01:05:30,504 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting 01:05:30,504 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending 01:05:30,504 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350: onRequestLeadership RequestLeadership [requestedFollowerId=follower352, replyTo=Actor[akka://test/user/$d#559609903]] 01:05:30,504 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350: Initiating leader transfer 01:05:30,505 PM [test-akka.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader350: pauseLeader successfully completed - doing transfer 01:05:30,505 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Attempting to transfer leadership 01:05:30,505 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Checking sendAppendEntries for follower follower351: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [09/16/2025 13:05:30.505] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower351] received dead letter from TestActor[akka://test/user/leader350]: LeaderTransitioning [leaderId=leader350] [WARN] [09/16/2025 13:05:30.505] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower353] received dead letter from TestActor[akka://test/user/leader350]: LeaderTransitioning [leaderId=leader350] 01:05:30,505 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352: onLeaderTransitioning: LeaderTransitioning [leaderId=leader350] 01:05:30,505 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Checking sendAppendEntries for follower follower353: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [09/16/2025 13:05:30.505] [test-akka.actor.default-dispatcher-15] [akka://test/user/follower351] received dead letter from TestActor[akka://test/user/leader350]: AppendEntries [leaderId=leader350, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]] 01:05:30,505 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Checking sendAppendEntries for follower follower352: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [09/16/2025 13:05:30.505] [test-akka.actor.default-dispatcher-17] [akka://test/user/follower353] received dead letter from TestActor[akka://test/user/leader350]: AppendEntries [leaderId=leader350, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]] 01:05:30,505 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower352: Lagging 0 entries behind leader leader350 and reached -1 (of expected -1) [WARN] [09/16/2025 13:05:30.505] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower352] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@198b04fb 01:05:30,505 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): tryToCompleteLeadershipTransfer: followerId: follower352, matchIndex: -1, lastIndex: -1, isVoting: true 01:05:30,505 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Follower's log matches - sending ElectionTimeout 01:05:30,505 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Checking sendAppendEntries for follower follower351: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:30,506 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Checking sendAppendEntries for follower follower353: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:30,506 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Checking sendAppendEntries for follower follower352: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:30,506 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Leader transfer complete 01:05:30,506 PM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader350: leader transfer complete - waiting for new leader 01:05:30,506 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower352: Lagging 0 entries behind leader leader350 and reached -1 (of expected -1) 01:05:30,506 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:05:30,506 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Follower): Received TimeoutNow - switching to Candidate 01:05:30,506 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Candidate): Election: Candidate has following voting peers: [follower351, leader350] 01:05:30,506 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352: Set currentTerm=3, votedFor=follower352 01:05:30,506 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Candidate): Starting new election term 3 01:05:30,506 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Candidate): Sending RequestVote [term=3, candidateId=follower352, lastLogIndex=-1, lastLogTerm=-1] to peer follower351 [WARN] [09/16/2025 13:05:30.506] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower351] received dead letter from TestActor[akka://test/user/leader350]: AppendEntries [leaderId=leader350, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]] 01:05:30,506 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Candidate): Sending RequestVote [term=3, candidateId=follower352, lastLogIndex=-1, lastLogTerm=-1] to peer leader350 [WARN] [09/16/2025 13:05:30.506] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower353] received dead letter from TestActor[akka://test/user/leader350]: AppendEntries [leaderId=leader350, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[]] [WARN] [09/16/2025 13:05:30.506] [test-akka.actor.default-dispatcher-12] [akka://test/user/follower351] received dead letter from TestActor[akka://test/user/follower352]: RequestVote [term=3, candidateId=follower352, lastLogIndex=-1, lastLogTerm=-1] 01:05:30,506 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:05:30,507 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Follower) :- Switching from behavior Follower to Candidate, election term: 3 01:05:30,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Cluster state: [] 01:05:30,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Candidate in requestVote:RequestVote [term=3, candidateId=follower352, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 01:05:30,507 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Term 3 in "RequestVote [term=3, candidateId=follower352, lastLogIndex=-1, lastLogTerm=-1]" message is greater than leader's term 2 - switching to Follower 01:05:30,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350: Set currentTerm=3, votedFor=null 01:05:30,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): Leadership transfer in progress - processing RequestVote 01:05:30,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): In requestVote: RequestVote [term=3, candidateId=follower352, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1 01:05:30,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350: Set currentTerm=3, votedFor=follower352 01:05:30,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader): requestVote returning: RequestVoteReply [term=3, voteGranted=true] 01:05:30,507 PM [test-akka.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader350 (Leader) :- Switching from behavior Leader to Follower, election term: 3 01:05:30,507 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Candidate): RaftRPC message received RequestVoteReply [term=3, voteGranted=true], my term is 3 01:05:30,507 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Candidate): handleRequestVoteReply: RequestVoteReply [term=3, voteGranted=true], current voteCount: 1 01:05:30,507 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Leader): Election: Leader has following peers: [follower351, follower353, leader350] 01:05:30,507 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Leader): Checking sendAppendEntries for follower follower351: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:30,508 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Leader): Checking sendAppendEntries for follower follower353: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:30,508 PM [test-akka.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Leader): Checking sendAppendEntries for follower leader350: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:30,508 PM [test-akka.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3 [WARN] [09/16/2025 13:05:30.508] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower351] received dead letter from TestActor[akka://test/user/follower352]: AppendEntries [leaderId=follower352, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]] [WARN] [09/16/2025 13:05:30.508] [test-akka.actor.default-dispatcher-6] [akka://test/user/follower353] received dead letter from TestActor[akka://test/user/follower352]: AppendEntries [leaderId=follower352, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, leaderAddress=null, entries=[]] 01:05:30,508 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - leader350: Last sync leader does not match current leader follower352, need to catch up to -1 01:05:30,508 PM [test-akka.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader350: leader changed to follower352 01:05:30,508 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader350 updated: matchIndex: -1, nextIndex: 0 01:05:30,508 PM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower352 (Leader): Checking sendAppendEntries for follower leader350: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:05:30,508 PM [test-akka.actor.default-dispatcher-6] [INFO] RaftActorLeadershipTransferCohort - leader350: Successfully transferred leadership to follower352 in 3.576 ms 01:05:30,508 PM [test-akka.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader350: Leadership transferred successfully to follower352 [WARN] [09/16/2025 13:05:30.508] [test-akka.actor.default-dispatcher-18] [akka://test/user/leader350] unhandled message from Actor[akka://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@503a24ac 01:05:30,556 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown ending 01:05:30,556 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower351-notifier354#2115991785] 01:05:30,567 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower351-collector355#-592673328] 01:05:30,567 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower352-notifier356#198671048] 01:05:30,568 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower352-collector357#-1845831943] 01:05:30,568 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/follower352] 01:05:30,568 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower353-notifier358#676926252] 01:05:30,568 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/follower353-collector359#47738084] 01:05:30,568 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader350-notifier360#-54085093] 01:05:30,569 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/leader350-collector361#1502011001] 01:05:30,569 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/leader350] 01:05:30,569 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$d#559609903] [INFO] [09/16/2025 13:05:30.570] [main] [CoordinatedShutdown(akka://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 01:05:30,570 PM [test-akka.actor.default-dispatcher-12] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [WARN] [09/16/2025 13:05:30.572] [test-akka.actor.default-dispatcher-18] [akka://test/system/cluster/core/daemon] unhandled message from Actor[akka://test/deadLetters]: Leave(akka://test@10.30.170.168:25520) [INFO] [09/16/2025 13:05:30.572] [test-akka.actor.internal-dispatcher-4] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.168:25520] - Exiting completed 01:05:30,573 PM [test-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://test@10.30.170.168:25520] - Exiting completed [INFO] [09/16/2025 13:05:30.573] [test-akka.actor.internal-dispatcher-4] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.168:25520] - Shutting down... 01:05:30,573 PM [test-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://test@10.30.170.168:25520] - Shutting down... [INFO] [09/16/2025 13:05:30.573] [test-akka.actor.internal-dispatcher-4] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.168:25520] - Successfully shut down 01:05:30,573 PM [test-akka.actor.default-dispatcher-17] [INFO] Cluster - Cluster Node [akka://test@10.30.170.168:25520] - Successfully shut down [INFO] [09/16/2025 13:05:30.574] [test-akka.remote.default-remote-dispatcher-7] [akka://test@10.30.170.168:25520/system/remoting-terminator] Shutting down remote daemon. 01:05:30,574 PM [test-akka.actor.default-dispatcher-12] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 01:05:30,575 PM [test-akka.actor.default-dispatcher-12] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [INFO] [09/16/2025 13:05:30.574] [test-akka.remote.default-remote-dispatcher-7] [akka://test@10.30.170.168:25520/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports. [INFO] [09/16/2025 13:05:30.577] [test-akka.remote.default-remote-dispatcher-7] [akka://test@10.30.170.168:25520/system/remoting-terminator] Remoting shut down. 01:05:30,577 PM [test-akka.actor.default-dispatcher-18] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down. [DEBUG] [09/16/2025 13:05:30.577] [test-akka.actor.internal-dispatcher-10] [EventStream] shutting down: StandardOutLogger