[DEBUG] [01/30/2025 00:06:54.129] [main] [EventStream(pekko://test)] logger log1-TestEventListener started 12:06:54,130 AM [test-pekko.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [01/30/2025 00:06:54.130] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started [DEBUG] [01/30/2025 00:06:54.130] [main] [EventStream(pekko://test)] Default Loggers started 12:06:54,144 AM [test-pekko.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.114:17355] with UID [-198404921203551878] 12:06:54,144 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.114:17355] - Starting up, Pekko version [1.0.3] ... [INFO] [01/30/2025 00:06:54.144] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.114:17355] with UID [-198404921203551878] [INFO] [01/30/2025 00:06:54.144] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.114:17355] - Starting up, Pekko version [1.0.3] ... [INFO] [01/30/2025 00:06:54.147] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.114:17355] - Registered cluster JMX MBean [pekko:type=Cluster] 12:06:54,147 AM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.114:17355] - Registered cluster JMX MBean [pekko:type=Cluster] [INFO] [01/30/2025 00:06:54.147] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.114:17355] - Started up successfully 12:06:54,147 AM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.114:17355] - Started up successfully [INFO] [01/30/2025 00:06:54.148] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.114:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing [INFO] [01/30/2025 00:06:54.148] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.114:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 12:06:54,148 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.114:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing 12:06:54,148 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.114:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 12:06:54,159 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferAborted starting 12:06:54,159 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting [WARN] [01/30/2025 00:06:54.162] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower551]: org.opendaylight.controller.cluster.common.actor.Monitor@6214121 12:06:54,162 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower551] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][01/30/2025 00:06:54.162] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower551] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 12:06:54,165 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower551 with journal batch size 1000 12:06:54,166 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower551: SnapshotOffer called. 12:06:54,166 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower551: Moving last applied index from -1 to -1 12:06:54,166 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower551: Set currentTerm=1, votedFor=null 12:06:54,166 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower551: Updated server config: isVoting: true, peers: [PeerInfo [id=follower553, address=pekko://test/user/follower553, votingState=NON_VOTING], PeerInfo [id=follower552, address=pekko://test/user/follower552, votingState=VOTING], PeerInfo [id=leader550, address=pekko://test/user/leader550, votingState=VOTING]] 12:06:54,166 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower551 in 81.76 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:54,167 AM [test-pekko.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower551: Recovery completed in 749.9 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [01/30/2025 00:06:54.262] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower552]: org.opendaylight.controller.cluster.common.actor.Monitor@6ce3a743 [INFO] [pekkoDeadLetter][01/30/2025 00:06:54.262] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower552] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 12:06:54,262 AM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower552] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 12:06:54,262 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower552 with journal batch size 1000 12:06:54,263 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower552: SnapshotOffer called. 12:06:54,263 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower552: Moving last applied index from -1 to -1 12:06:54,263 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceTermInfoStore - follower552: Set currentTerm=1, votedFor=null 12:06:54,263 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower552: Updated server config: isVoting: true, peers: [PeerInfo [id=follower553, address=pekko://test/user/follower553, votingState=NON_VOTING], PeerInfo [id=leader550, address=pekko://test/user/leader550, votingState=VOTING], PeerInfo [id=follower551, address=pekko://test/user/follower551, votingState=VOTING]] 12:06:54,263 AM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower552 in 166.0 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:54,265 AM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower552: Recovery completed in 1.310 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [01/30/2025 00:06:54.366] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower553]: org.opendaylight.controller.cluster.common.actor.Monitor@7d0b4510 [INFO] [pekkoDeadLetter][01/30/2025 00:06:54.366] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower553] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 12:06:54,366 AM [test-pekko.actor.default-dispatcher-14] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower553] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 12:06:54,366 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower553 with journal batch size 1000 12:06:54,367 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower553: SnapshotOffer called. 12:06:54,367 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower553: Moving last applied index from -1 to -1 12:06:54,367 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower553: Set currentTerm=1, votedFor=null 12:06:54,367 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower553: Updated server config: isVoting: false, peers: [PeerInfo [id=follower552, address=pekko://test/user/follower552, votingState=VOTING], PeerInfo [id=leader550, address=pekko://test/user/leader550, votingState=VOTING], PeerInfo [id=follower551, address=pekko://test/user/follower551, votingState=VOTING]] 12:06:54,367 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower553 in 99.13 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:54,368 AM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower553: Recovery completed in 1.044 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [01/30/2025 00:06:54.468] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader550]: org.opendaylight.controller.cluster.common.actor.Monitor@660fcfb5 [INFO] [pekkoDeadLetter][01/30/2025 00:06:54.468] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader550] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 12:06:54,468 AM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader550] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 12:06:54,468 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader550 with journal batch size 1000 12:06:54,469 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550: SnapshotOffer called. 12:06:54,469 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550: Moving last applied index from -1 to -1 12:06:54,469 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceTermInfoStore - leader550: Set currentTerm=1, votedFor=null 12:06:54,469 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550: Updated server config: isVoting: true, peers: [PeerInfo [id=follower553, address=pekko://test/user/follower553, votingState=NON_VOTING], PeerInfo [id=follower552, address=pekko://test/user/follower552, votingState=VOTING], PeerInfo [id=follower551, address=pekko://test/user/follower551, votingState=VOTING]] 12:06:54,469 AM [test-pekko.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader550 in 124.3 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:54,470 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader550: Recovery completed in 1.066 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:06:54,836 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 12:06:54,836 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.114:17355, Removed) 12:06:54,836 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Follower): Received ElectionTimeout - switching to Candidate 12:06:54,836 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Candidate): Election: Candidate has following voting peers: [follower552, follower551] 12:06:54,836 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceTermInfoStore - leader550: Set currentTerm=2, votedFor=leader550 12:06:54,837 AM [test-pekko.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Candidate): Starting new election term 2 12:06:54,837 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Candidate): Sending RequestVote{term=2, candidateId=leader550, lastLogIndex=-1, lastLogTerm=-1} to peer follower552 12:06:54,837 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Candidate): Sending RequestVote{term=2, candidateId=leader550, lastLogIndex=-1, lastLogTerm=-1} to peer follower551 12:06:54,837 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower552 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:06:54,837 AM [test-pekko.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 12:06:54,837 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower551 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:06:54,837 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower552 (Follower): Cluster state: [] 12:06:54,837 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower552 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader550, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 12:06:54,837 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower552 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader550, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 12:06:54,837 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower551 (Follower): Cluster state: [] 12:06:54,837 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower552: Set currentTerm=2, votedFor=null 12:06:54,837 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower551 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader550, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 12:06:54,837 AM [test-pekko.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower551 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader550, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 12:06:54,837 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PersistenceTermInfoStore - follower551: Set currentTerm=2, votedFor=null 12:06:54,837 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower552 (Follower): In requestVote: RequestVote{term=2, candidateId=leader550, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 12:06:54,837 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower552: Set currentTerm=2, votedFor=leader550 12:06:54,837 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower551 (Follower): In requestVote: RequestVote{term=2, candidateId=leader550, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 12:06:54,837 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower552 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 12:06:54,837 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PersistenceTermInfoStore - follower551: Set currentTerm=2, votedFor=leader550 12:06:54,837 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower551 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 12:06:54,838 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 12:06:54,838 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 12:06:54,838 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Leader): Election: Leader has following peers: [follower553, follower552, follower551] 12:06:54,838 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Leader): Checking sendAppendEntries for follower follower553: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:54,838 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Leader): Checking sendAppendEntries for follower follower552: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:54,838 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Leader): Checking sendAppendEntries for follower follower551: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:54,838 AM [test-pekko.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 12:06:54,839 AM [test-pekko.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower553 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader550, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term 12:06:54,839 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PersistenceTermInfoStore - follower553: Set currentTerm=2, votedFor=null 12:06:54,839 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower553: Last sync leader does not match current leader leader550, need to catch up to -1 12:06:54,839 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower552: Last sync leader does not match current leader leader550, need to catch up to -1 12:06:54,840 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower551: Last sync leader does not match current leader leader550, need to catch up to -1 12:06:54,840 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower553 updated: matchIndex: -1, nextIndex: 0 12:06:54,840 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Leader): Checking sendAppendEntries for follower follower553: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [01/30/2025 00:06:54.840] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower552] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2742ef6b 12:06:54,840 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower552 updated: matchIndex: -1, nextIndex: 0 [WARN] [01/30/2025 00:06:54.840] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower551] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2a88f3bb 12:06:54,840 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Leader): Checking sendAppendEntries for follower follower552: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [INFO] [pekkoDeadLetter][01/30/2025 00:06:54.840] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower552] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower552] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][01/30/2025 00:06:54.840] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower551] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower551] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 12:06:54,840 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower551 updated: matchIndex: -1, nextIndex: 0 12:06:54,840 AM [test-pekko.actor.default-dispatcher-7] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower552] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 12:06:54,840 AM [test-pekko.actor.default-dispatcher-7] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower551] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 12:06:54,840 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Leader): Checking sendAppendEntries for follower follower551: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:54,840 AM [test-pekko.actor.default-dispatcher-15] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower553] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [01/30/2025 00:06:54.840] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower553] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5ad02dac [INFO] [pekkoDeadLetter][01/30/2025 00:06:54.840] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower553] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower553] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 12:06:54,874 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 12:06:54,874 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader550 starting 12:06:54,876 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550: onShutDown 12:06:54,876 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550: Initiating leader transfer 12:06:54,876 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower553: onLeaderTransitioning: LeaderTransitioning [leaderId=leader550] 12:06:54,876 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower551: onLeaderTransitioning: LeaderTransitioning [leaderId=leader550] 12:06:54,876 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower552: onLeaderTransitioning: LeaderTransitioning [leaderId=leader550] 12:06:54,876 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader550: pauseLeader successfully completed - doing transfer 12:06:54,876 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Leader): Attempting to transfer leadership 12:06:54,876 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Leader): Checking sendAppendEntries for follower follower553: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:54,877 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower553: Lagging 0 entries behind leader leader550 and reached -1 (of expected -1) [WARN] [01/30/2025 00:06:54.877] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower553] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@1fd16f39 [INFO] [pekkoDeadLetter][01/30/2025 00:06:54.877] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower553] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower553] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 12:06:54,877 AM [test-pekko.actor.default-dispatcher-17] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower553] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 12:06:54,877 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Leader): Checking sendAppendEntries for follower follower552: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:54,877 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower552: Lagging 0 entries behind leader leader550 and reached -1 (of expected -1) [WARN] [01/30/2025 00:06:54.877] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower552] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@111682b3 [INFO] [pekkoDeadLetter][01/30/2025 00:06:54.877] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower552] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower552] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 12:06:54,877 AM [test-pekko.actor.default-dispatcher-17] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower552] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 12:06:54,877 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Leader): Checking sendAppendEntries for follower follower551: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:54,877 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower551: Lagging 0 entries behind leader leader550 and reached -1 (of expected -1) [WARN] [01/30/2025 00:06:54.877] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower551] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@15290449 [INFO] [pekkoDeadLetter][01/30/2025 00:06:54.877] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower551] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower551] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 12:06:54,877 AM [test-pekko.actor.default-dispatcher-16] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower551] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 12:06:54,956 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower553: Lagging 0 entries behind leader leader550 and reached -1 (of expected -1) 12:06:54,956 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower552: Lagging 0 entries behind leader leader550 and reached -1 (of expected -1) 12:06:54,956 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower551: Lagging 0 entries behind leader leader550 and reached -1 (of expected -1) 12:06:55,76 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower552: Lagging 0 entries behind leader leader550 and reached -1 (of expected -1) 12:06:55,76 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower551: Lagging 0 entries behind leader leader550 and reached -1 (of expected -1) 12:06:55,76 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower553: Lagging 0 entries behind leader leader550 and reached -1 (of expected -1) 12:06:55,196 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader550: leader transfer aborted 12:06:55,196 AM [test-pekko.actor.default-dispatcher-18] [WARN] RaftActorLeadershipTransferCohort - leader550: Failed to transfer leadership in 320.2 ms 12:06:55,196 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550: leader transfer failed - sending PoisonPill 12:06:55,196 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader550 (Leader): Leadership transfer expired 12:06:55,197 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower553: Lagging 0 entries behind leader leader550 and reached -1 (of expected -1) 12:06:55,197 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower552: Lagging 0 entries behind leader leader550 and reached -1 (of expected -1) [WARN] [01/30/2025 00:06:55.197] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/leader550] received dead letter from TestActor[pekko://test/user/follower552]: AppendEntriesReply{term=2, success=true, followerId=follower552, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} [WARN] [01/30/2025 00:06:55.197] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/leader550] received dead letter from TestActor[pekko://test/user/follower553]: AppendEntriesReply{term=2, success=true, followerId=follower553, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 12:06:55,197 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower551: Lagging 0 entries behind leader leader550 and reached -1 (of expected -1) [WARN] [01/30/2025 00:06:55.197] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/leader550] received dead letter from TestActor[pekko://test/user/follower551]: AppendEntriesReply{term=2, success=true, followerId=follower551, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 12:06:55,199 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader550 ending 12:06:55,200 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending 12:06:55,200 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower551-notifier554#-1807341568] 12:06:55,211 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower551-collector555#168958005] 12:06:55,211 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower551] 12:06:55,212 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower552-notifier556#-1407958274] 12:06:55,212 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower552-collector557#-42636909] 12:06:55,212 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower552] 12:06:55,212 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower553-notifier558#289415589] 12:06:55,212 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower553-collector559#-1069654296] 12:06:55,212 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower553] 12:06:55,212 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader550-notifier560#1649322941] 12:06:55,212 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader550-collector561#-189752885] 12:06:55,213 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader550] 12:06:55,214 AM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 starting 12:06:55,214 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting [WARN] [01/30/2025 00:06:55.215] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower563]: org.opendaylight.controller.cluster.common.actor.Monitor@1e3a7fea 12:06:55,216 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower563 with journal batch size 1000 12:06:55,217 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower563: SnapshotOffer called. 12:06:55,217 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower563: Moving last applied index from -1 to -1 12:06:55,217 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - follower563: Set currentTerm=1, votedFor=null 12:06:55,217 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower563: Updated server config: isVoting: true, peers: [PeerInfo [id=leader562, address=pekko://test/user/leader562, votingState=VOTING], PeerInfo [id=follower564, address=pekko://test/user/follower564, votingState=VOTING], PeerInfo [id=follower565, address=pekko://test/user/follower565, votingState=NON_VOTING]] 12:06:55,217 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower563 in 102.0 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:55,218 AM [test-pekko.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower563: Recovery completed in 1.276 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [01/30/2025 00:06:55.218] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower564]: org.opendaylight.controller.cluster.common.actor.Monitor@4329ddc 12:06:55,219 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower564 with journal batch size 1000 12:06:55,219 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564: SnapshotOffer called. 12:06:55,219 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564: Moving last applied index from -1 to -1 12:06:55,219 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower564: Set currentTerm=1, votedFor=null 12:06:55,219 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564: Updated server config: isVoting: true, peers: [PeerInfo [id=leader562, address=pekko://test/user/leader562, votingState=VOTING], PeerInfo [id=follower563, address=pekko://test/user/follower563, votingState=VOTING], PeerInfo [id=follower565, address=pekko://test/user/follower565, votingState=NON_VOTING]] 12:06:55,219 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower564 in 56.35 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:55,220 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower564: Recovery completed in 510.7 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [01/30/2025 00:06:55.222] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower565]: org.opendaylight.controller.cluster.common.actor.Monitor@1ea656fd 12:06:55,222 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower565 with journal batch size 1000 12:06:55,222 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower565: SnapshotOffer called. 12:06:55,222 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower565: Moving last applied index from -1 to -1 12:06:55,222 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower565: Set currentTerm=1, votedFor=null 12:06:55,222 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower565: Updated server config: isVoting: false, peers: [PeerInfo [id=leader562, address=pekko://test/user/leader562, votingState=VOTING], PeerInfo [id=follower564, address=pekko://test/user/follower564, votingState=VOTING], PeerInfo [id=follower563, address=pekko://test/user/follower563, votingState=VOTING]] 12:06:55,222 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower565 in 49.35 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 [WARN] [01/30/2025 00:06:55.223] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader562]: org.opendaylight.controller.cluster.common.actor.Monitor@152ad2bd 12:06:55,223 AM [test-pekko.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader562 with journal batch size 1000 12:06:55,224 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562: SnapshotOffer called. 12:06:55,224 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562: Moving last applied index from -1 to -1 12:06:55,224 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceTermInfoStore - leader562: Set currentTerm=1, votedFor=null 12:06:55,224 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562: Updated server config: isVoting: true, peers: [PeerInfo [id=follower564, address=pekko://test/user/follower564, votingState=VOTING], PeerInfo [id=follower563, address=pekko://test/user/follower563, votingState=VOTING], PeerInfo [id=follower565, address=pekko://test/user/follower565, votingState=NON_VOTING]] 12:06:55,224 AM [test-pekko.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader562 in 40.38 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:55,224 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower565: Recovery completed in 1.302 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:06:55,224 AM [test-pekko.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader562: Recovery completed in 469.4 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:06:55,545 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 12:06:55,545 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.114:17355, Removed) 12:06:55,545 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Follower): Received ElectionTimeout - switching to Candidate 12:06:55,546 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Candidate): Election: Candidate has following voting peers: [follower564, follower563] 12:06:55,546 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PersistenceTermInfoStore - leader562: Set currentTerm=2, votedFor=leader562 12:06:55,546 AM [test-pekko.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Candidate): Starting new election term 2 12:06:55,546 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Candidate): Sending RequestVote{term=2, candidateId=leader562, lastLogIndex=-1, lastLogTerm=-1} to peer follower564 12:06:55,546 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Candidate): Sending RequestVote{term=2, candidateId=leader562, lastLogIndex=-1, lastLogTerm=-1} to peer follower563 12:06:55,546 AM [test-pekko.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 12:06:55,546 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower563 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:06:55,546 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:06:55,546 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower563 (Follower): Cluster state: [] 12:06:55,546 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower563 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader562, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 12:06:55,546 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower563 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader562, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 12:06:55,546 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower563: Set currentTerm=2, votedFor=null 12:06:55,546 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Follower): Cluster state: [] 12:06:55,546 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader562, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 12:06:55,546 AM [test-pekko.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader562, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 12:06:55,546 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower564: Set currentTerm=2, votedFor=null 12:06:55,546 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower563 (Follower): In requestVote: RequestVote{term=2, candidateId=leader562, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 12:06:55,546 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower563: Set currentTerm=2, votedFor=leader562 12:06:55,546 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower563 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 12:06:55,546 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Follower): In requestVote: RequestVote{term=2, candidateId=leader562, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 12:06:55,546 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower564: Set currentTerm=2, votedFor=leader562 12:06:55,547 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 12:06:55,548 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 12:06:55,548 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 12:06:55,548 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Election: Leader has following peers: [follower564, follower563, follower565] 12:06:55,548 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Checking sendAppendEntries for follower follower564: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:55,548 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Checking sendAppendEntries for follower follower563: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:55,548 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Checking sendAppendEntries for follower follower565: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:55,548 AM [test-pekko.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 12:06:55,549 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower565 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader562, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term 12:06:55,549 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower565: Set currentTerm=2, votedFor=null 12:06:55,549 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower563: Last sync leader does not match current leader leader562, need to catch up to -1 12:06:55,549 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower565: Last sync leader does not match current leader leader562, need to catch up to -1 12:06:55,549 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower564: Last sync leader does not match current leader leader562, need to catch up to -1 [WARN] [01/30/2025 00:06:55.549] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/follower563] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2be28a88 12:06:55,549 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower563 updated: matchIndex: -1, nextIndex: 0 12:06:55,550 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Checking sendAppendEntries for follower follower563: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [01/30/2025 00:06:55.549] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower564] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@714b3446 12:06:55,550 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower565 updated: matchIndex: -1, nextIndex: 0 [WARN] [01/30/2025 00:06:55.550] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower565] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@237ac1b4 12:06:55,550 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Checking sendAppendEntries for follower follower565: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:55,550 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower564 updated: matchIndex: -1, nextIndex: 0 12:06:55,550 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Checking sendAppendEntries for follower follower564: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:55,579 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 12:06:55,579 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting 12:06:55,580 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending 12:06:55,580 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting 12:06:55,580 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending 12:06:55,580 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562: onRequestLeadership RequestLeadership [requestedFollowerId=follower564, replyTo=Actor[pekko://test/user/$a#-1387225849]] 12:06:55,582 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562: Initiating leader transfer 12:06:55,582 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower563: onLeaderTransitioning: LeaderTransitioning [leaderId=leader562] 12:06:55,582 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564: onLeaderTransitioning: LeaderTransitioning [leaderId=leader562] 12:06:55,582 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower565: onLeaderTransitioning: LeaderTransitioning [leaderId=leader562] 12:06:55,583 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorLeadershipTransferCohort - leader562: pauseLeader successfully completed - doing transfer 12:06:55,583 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Attempting to transfer leadership 12:06:55,583 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Checking sendAppendEntries for follower follower564: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:55,583 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Checking sendAppendEntries for follower follower563: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:55,583 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Checking sendAppendEntries for follower follower565: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:55,583 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower563: Lagging 0 entries behind leader leader562 and reached -1 (of expected -1) [WARN] [01/30/2025 00:06:55.583] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower563] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@170f19b5 12:06:55,583 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower564: Lagging 0 entries behind leader leader562 and reached -1 (of expected -1) 12:06:55,583 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): tryToCompleteLeadershipTransfer: followerId: follower564, matchIndex: -1, lastIndex: -1, isVoting: true 12:06:55,583 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Follower's log matches - sending ElectionTimeout 12:06:55,583 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Checking sendAppendEntries for follower follower564: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:55,583 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Checking sendAppendEntries for follower follower563: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:55,583 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Checking sendAppendEntries for follower follower565: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:55,583 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Leader transfer complete 12:06:55,583 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader562: leader transfer complete - waiting for new leader [WARN] [01/30/2025 00:06:55.583] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower564] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@404aa3d9 12:06:55,584 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower564: Lagging 0 entries behind leader leader562 and reached -1 (of expected -1) 12:06:55,584 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 12:06:55,584 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Follower): Received TimeoutNow - switching to Candidate 12:06:55,584 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower563: Lagging 0 entries behind leader leader562 and reached -1 (of expected -1) 12:06:55,584 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower565: Lagging 0 entries behind leader leader562 and reached -1 (of expected -1) 12:06:55,584 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower565: Lagging 0 entries behind leader leader562 and reached -1 (of expected -1) [WARN] [01/30/2025 00:06:55.584] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower565] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@12f2e7ea 12:06:55,585 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Candidate): Election: Candidate has following voting peers: [leader562, follower563] 12:06:55,585 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower564: Set currentTerm=3, votedFor=follower564 12:06:55,585 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Candidate): Starting new election term 3 12:06:55,585 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Candidate): Sending RequestVote{term=3, candidateId=follower564, lastLogIndex=-1, lastLogTerm=-1} to peer leader562 12:06:55,585 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Candidate): Sending RequestVote{term=3, candidateId=follower564, lastLogIndex=-1, lastLogTerm=-1} to peer follower563 12:06:55,585 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:06:55,585 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Follower) :- Switching from behavior Follower to Candidate, election term: 3 12:06:55,585 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower563 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:06:55,586 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower563 (Follower): Cluster state: [] 12:06:55,586 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Cluster state: [] 12:06:55,586 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower564, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 12:06:55,586 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower563 (Follower): Candidate in requestVote:RequestVote{term=3, candidateId=follower564, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 12:06:55,586 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower563 (Follower): Term 3 in "RequestVote{term=3, candidateId=follower564, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 2 - updating term 12:06:55,586 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - follower563: Set currentTerm=3, votedFor=null 12:06:55,586 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower564, lastLogIndex=-1, lastLogTerm=-1}" message is greater than leader's term 2 - switching to Follower 12:06:55,586 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower563 (Follower): In requestVote: RequestVote{term=3, candidateId=follower564, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1 12:06:55,586 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - follower563: Set currentTerm=3, votedFor=follower564 12:06:55,586 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower563 (Follower): requestVote returning: RequestVoteReply{term=3, voteGranted=true} 12:06:55,586 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3 12:06:55,586 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1 12:06:55,587 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Leader): Election: Leader has following peers: [leader562, follower563, follower565] 12:06:55,587 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - leader562: Set currentTerm=3, votedFor=null 12:06:55,587 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Leader): Checking sendAppendEntries for follower leader562: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:55,587 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Leader): Checking sendAppendEntries for follower follower563: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:55,587 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Leader): Checking sendAppendEntries for follower follower565: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:55,587 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): Leadership transfer in progress - processing RequestVote 12:06:55,587 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): In requestVote: RequestVote{term=3, candidateId=follower564, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1 12:06:55,587 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3 12:06:55,587 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - leader562: Set currentTerm=3, votedFor=follower564 12:06:55,587 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true} 12:06:55,587 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader562 (Leader) :- Switching from behavior Leader to Follower, election term: 3 12:06:55,587 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower563: Last sync leader does not match current leader follower564, need to catch up to -1 12:06:55,587 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower565 (Follower): Term 3 in "AppendEntries{term=3, leaderId=follower564, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 2 - updating term 12:06:55,587 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower565: Set currentTerm=3, votedFor=null 12:06:55,587 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower563 updated: matchIndex: -1, nextIndex: 0 [WARN] [01/30/2025 00:06:55.587] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower563] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6ddf9046 12:06:55,587 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Leader): Checking sendAppendEntries for follower follower563: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:55,587 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower565: Last sync leader does not match current leader follower564, need to catch up to -1 12:06:55,587 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower565 updated: matchIndex: -1, nextIndex: 0 12:06:55,587 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Leader): Checking sendAppendEntries for follower follower565: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [01/30/2025 00:06:55.588] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower565] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@4fc8d71d 12:06:55,589 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - leader562: Last sync leader does not match current leader follower564, need to catch up to -1 12:06:55,589 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader562 updated: matchIndex: -1, nextIndex: 0 12:06:55,589 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorLeadershipTransferCohort - leader562: leader changed to follower564 12:06:55,589 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower564 (Leader): Checking sendAppendEntries for follower leader562: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:55,589 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorLeadershipTransferCohort - leader562: Successfully transferred leadership to follower564 in 6.411 ms 12:06:55,589 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader562: Leadership transferred successfully to follower564 [WARN] [01/30/2025 00:06:55.589] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/leader562] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@51b60a72 12:06:55,631 AM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 ending 12:06:55,632 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower563-notifier566#1225311080] 12:06:55,643 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower563-collector567#1109917371] 12:06:55,643 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower563] 12:06:55,643 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower564-notifier568#616849882] 12:06:55,643 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower564-collector569#-1404302971] 12:06:55,643 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower564] 12:06:55,644 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower565-notifier570#1837558953] 12:06:55,644 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower565-collector571#-1995927951] 12:06:55,644 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower565] 12:06:55,644 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader562-notifier572#614671455] 12:06:55,644 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader562-collector573#1855026154] 12:06:55,644 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader562] 12:06:55,645 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$a#-1387225849] 12:06:55,646 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown starting 12:06:55,646 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting [WARN] [01/30/2025 00:06:55.648] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower575]: org.opendaylight.controller.cluster.common.actor.Monitor@67155967 12:06:55,648 AM [test-pekko.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower575 with journal batch size 1000 12:06:55,649 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower575: SnapshotOffer called. 12:06:55,649 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower575: Moving last applied index from -1 to -1 12:06:55,649 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - follower575: Set currentTerm=1, votedFor=null 12:06:55,649 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower575: Updated server config: isVoting: true, peers: [PeerInfo [id=leader574, address=pekko://test/user/leader574, votingState=VOTING], PeerInfo [id=follower577, address=pekko://test/user/follower577, votingState=NON_VOTING], PeerInfo [id=follower576, address=pekko://test/user/follower576, votingState=VOTING]] 12:06:55,649 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower575 in 249.4 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 [WARN] [01/30/2025 00:06:55.650] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower576]: org.opendaylight.controller.cluster.common.actor.Monitor@5fc25554 12:06:55,650 AM [test-pekko.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower575: Recovery completed in 1.074 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:06:55,650 AM [test-pekko.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower576 with journal batch size 1000 12:06:55,651 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower576: SnapshotOffer called. 12:06:55,651 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower576: Moving last applied index from -1 to -1 12:06:55,651 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower576: Set currentTerm=1, votedFor=null 12:06:55,651 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower576: Updated server config: isVoting: true, peers: [PeerInfo [id=leader574, address=pekko://test/user/leader574, votingState=VOTING], PeerInfo [id=follower575, address=pekko://test/user/follower575, votingState=VOTING], PeerInfo [id=follower577, address=pekko://test/user/follower577, votingState=NON_VOTING]] 12:06:55,651 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower576 in 67.66 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:55,651 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower576: Recovery completed in 654.0 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:06:55,652 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower577 with journal batch size 1000 [WARN] [01/30/2025 00:06:55.653] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower577]: org.opendaylight.controller.cluster.common.actor.Monitor@40b7eebf 12:06:55,653 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower577: SnapshotOffer called. 12:06:55,653 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower577: Moving last applied index from -1 to -1 12:06:55,653 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower577: Set currentTerm=1, votedFor=null 12:06:55,653 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower577: Updated server config: isVoting: false, peers: [PeerInfo [id=leader574, address=pekko://test/user/leader574, votingState=VOTING], PeerInfo [id=follower575, address=pekko://test/user/follower575, votingState=VOTING], PeerInfo [id=follower576, address=pekko://test/user/follower576, votingState=VOTING]] 12:06:55,653 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower577 in 40.52 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:55,653 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower577: Recovery completed in 555.6 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [01/30/2025 00:06:55.655] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader574]: org.opendaylight.controller.cluster.common.actor.Monitor@1736257 12:06:55,656 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader574 with journal batch size 1000 12:06:55,656 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574: SnapshotOffer called. 12:06:55,656 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574: Moving last applied index from -1 to -1 12:06:55,656 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - leader574: Set currentTerm=1, votedFor=null 12:06:55,656 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574: Updated server config: isVoting: true, peers: [PeerInfo [id=follower575, address=pekko://test/user/follower575, votingState=VOTING], PeerInfo [id=follower577, address=pekko://test/user/follower577, votingState=NON_VOTING], PeerInfo [id=follower576, address=pekko://test/user/follower576, votingState=VOTING]] 12:06:55,656 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader574 in 60.99 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:55,657 AM [test-pekko.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader574: Recovery completed in 545.3 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:06:56,76 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 12:06:56,76 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.114:17355, Removed) 12:06:56,76 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Follower): Received ElectionTimeout - switching to Candidate 12:06:56,76 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Candidate): Election: Candidate has following voting peers: [follower575, follower576] 12:06:56,76 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - leader574: Set currentTerm=2, votedFor=leader574 12:06:56,76 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Candidate): Starting new election term 2 12:06:56,76 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Candidate): Sending RequestVote{term=2, candidateId=leader574, lastLogIndex=-1, lastLogTerm=-1} to peer follower575 12:06:56,76 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Candidate): Sending RequestVote{term=2, candidateId=leader574, lastLogIndex=-1, lastLogTerm=-1} to peer follower576 12:06:56,76 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 12:06:56,76 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower576 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:06:56,76 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower576 (Follower): Cluster state: [] 12:06:56,76 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower576 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader574, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 12:06:56,76 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower576 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader574, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 12:06:56,76 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower576: Set currentTerm=2, votedFor=null 12:06:56,76 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower575 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:06:56,76 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower575 (Follower): Cluster state: [] 12:06:56,76 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower575 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader574, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 12:06:56,76 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower575 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader574, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 12:06:56,77 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower575: Set currentTerm=2, votedFor=null 12:06:56,77 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower575 (Follower): In requestVote: RequestVote{term=2, candidateId=leader574, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 12:06:56,77 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower575: Set currentTerm=2, votedFor=leader574 12:06:56,77 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower575 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 12:06:56,77 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower576 (Follower): In requestVote: RequestVote{term=2, candidateId=leader574, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 12:06:56,77 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower576: Set currentTerm=2, votedFor=leader574 12:06:56,77 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 12:06:56,77 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 12:06:56,77 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower576 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 12:06:56,77 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Leader): Election: Leader has following peers: [follower575, follower577, follower576] 12:06:56,77 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Leader): Checking sendAppendEntries for follower follower575: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:56,77 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Leader): Checking sendAppendEntries for follower follower577: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:56,77 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Leader): Checking sendAppendEntries for follower follower576: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:56,77 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 12:06:56,77 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower577 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader574, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term 12:06:56,77 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - follower577: Set currentTerm=2, votedFor=null 12:06:56,77 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower577: Last sync leader does not match current leader leader574, need to catch up to -1 12:06:56,77 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower577 updated: matchIndex: -1, nextIndex: 0 12:06:56,77 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Leader): Checking sendAppendEntries for follower follower577: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:56,78 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower575: Last sync leader does not match current leader leader574, need to catch up to -1 12:06:56,78 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower575 updated: matchIndex: -1, nextIndex: 0 12:06:56,78 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Leader): Checking sendAppendEntries for follower follower575: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [01/30/2025 00:06:56.078] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower575] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@76abd25a [WARN] [01/30/2025 00:06:56.078] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower577] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@714e6322 12:06:56,79 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower576: Last sync leader does not match current leader leader574, need to catch up to -1 12:06:56,79 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower576 updated: matchIndex: -1, nextIndex: 0 12:06:56,79 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Leader): Checking sendAppendEntries for follower follower576: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [01/30/2025 00:06:56.079] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower576] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@19ee2db9 12:06:56,115 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 12:06:56,115 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting 12:06:56,117 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending 12:06:56,117 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower576 starting 12:06:56,117 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower576: onShutDown 12:06:56,118 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower576 ending 12:06:56,118 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting 12:06:56,118 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending 12:06:56,118 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574: onRequestLeadership RequestLeadership [requestedFollowerId=follower576, replyTo=Actor[pekko://test/user/$b#382447020]] 12:06:56,118 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574: Initiating leader transfer 12:06:56,118 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower575: onLeaderTransitioning: LeaderTransitioning [leaderId=leader574] 12:06:56,118 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader574: pauseLeader successfully completed - doing transfer 12:06:56,118 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Leader): Attempting to transfer leadership 12:06:56,119 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Leader): Checking sendAppendEntries for follower follower575: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [01/30/2025 00:06:56.118] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower576] received dead letter from TestActor[pekko://test/user/leader574]: LeaderTransitioning [leaderId=leader574] 12:06:56,119 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Leader): Checking sendAppendEntries for follower follower577: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:56,119 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Leader): Checking sendAppendEntries for follower follower576: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:56,119 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower575: Lagging 0 entries behind leader leader574 and reached -1 (of expected -1) [WARN] [01/30/2025 00:06:56.119] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/follower576] received dead letter from TestActor[pekko://test/user/leader574]: AppendEntries{term=2, leaderId=leader574, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} [WARN] [01/30/2025 00:06:56.119] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/follower575] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@43c756de 12:06:56,119 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower577: Lagging 0 entries behind leader leader574 and reached -1 (of expected -1) 12:06:56,119 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower577: onLeaderTransitioning: LeaderTransitioning [leaderId=leader574] [WARN] [01/30/2025 00:06:56.119] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/follower577] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5b5e665e [WARN] [01/30/2025 00:06:56.197] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower576] received dead letter from TestActor[pekko://test/user/leader574]: AppendEntries{term=2, leaderId=leader574, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 12:06:56,316 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower575: Lagging 0 entries behind leader leader574 and reached -1 (of expected -1) 12:06:56,317 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower577: Lagging 0 entries behind leader leader574 and reached -1 (of expected -1) [WARN] [01/30/2025 00:06:56.317] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower576] received dead letter from TestActor[pekko://test/user/leader574]: AppendEntries{term=2, leaderId=leader574, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 12:06:56,435 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorLeadershipTransferCohort - leader574: leader transfer aborted 12:06:56,435 AM [test-pekko.actor.default-dispatcher-15] [WARN] RaftActorLeadershipTransferCohort - leader574: Failed to transfer leadership in 317.1 ms 12:06:56,436 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574: LeadershipTransfer request from follower576 failed 12:06:56,436 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader574 (Leader): Leadership transfer expired 12:06:56,437 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower577: Lagging 0 entries behind leader leader574 and reached -1 (of expected -1) 12:06:56,437 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower575: Lagging 0 entries behind leader leader574 and reached -1 (of expected -1) [WARN] [01/30/2025 00:06:56.437] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/follower576] received dead letter from TestActor[pekko://test/user/leader574]: AppendEntries{term=2, leaderId=leader574, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 12:06:56,477 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown ending 12:06:56,477 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower575-notifier578#-268431783] 12:06:56,488 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower575-collector579#1296912583] 12:06:56,488 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower575] 12:06:56,488 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower576-notifier580#1861103701] 12:06:56,488 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower576-collector581#-1690645717] 12:06:56,488 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower576] 12:06:56,488 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower577-notifier582#-984839189] 12:06:56,489 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower577-collector583#-1952275659] 12:06:56,489 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower577] 12:06:56,489 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader574-notifier584#-398170424] 12:06:56,489 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader574-collector585#-695118983] 12:06:56,489 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader574] 12:06:56,489 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$b#382447020] 12:06:56,490 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown starting 12:06:56,490 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting [WARN] [01/30/2025 00:06:56.492] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower587]: org.opendaylight.controller.cluster.common.actor.Monitor@43b468e7 12:06:56,493 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower587 with journal batch size 1000 12:06:56,493 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587: SnapshotOffer called. 12:06:56,493 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587: Moving last applied index from -1 to -1 12:06:56,493 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower587: Set currentTerm=1, votedFor=null 12:06:56,493 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587: Updated server config: isVoting: true, peers: [PeerInfo [id=leader586, address=pekko://test/user/leader586, votingState=VOTING], PeerInfo [id=follower589, address=pekko://test/user/follower589, votingState=NON_VOTING], PeerInfo [id=follower588, address=pekko://test/user/follower588, votingState=VOTING]] 12:06:56,493 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower587 in 111.4 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:56,494 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower587: Recovery completed in 883.0 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [01/30/2025 00:06:56.497] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower588]: org.opendaylight.controller.cluster.common.actor.Monitor@5b5c42c 12:06:56,497 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower588 with journal batch size 1000 12:06:56,498 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588: SnapshotOffer called. 12:06:56,498 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588: Moving last applied index from -1 to -1 12:06:56,498 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower588: Set currentTerm=1, votedFor=null 12:06:56,498 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588: Updated server config: isVoting: true, peers: [PeerInfo [id=leader586, address=pekko://test/user/leader586, votingState=VOTING], PeerInfo [id=follower589, address=pekko://test/user/follower589, votingState=NON_VOTING], PeerInfo [id=follower587, address=pekko://test/user/follower587, votingState=VOTING]] 12:06:56,498 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower588 in 66.05 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:56,499 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower588: Recovery completed in 671.8 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [01/30/2025 00:06:56.599] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower589]: org.opendaylight.controller.cluster.common.actor.Monitor@59adceb0 12:06:56,600 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower589 with journal batch size 1000 12:06:56,601 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower589: SnapshotOffer called. 12:06:56,601 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower589: Moving last applied index from -1 to -1 12:06:56,601 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceTermInfoStore - follower589: Set currentTerm=1, votedFor=null 12:06:56,601 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower589: Updated server config: isVoting: false, peers: [PeerInfo [id=leader586, address=pekko://test/user/leader586, votingState=VOTING], PeerInfo [id=follower588, address=pekko://test/user/follower588, votingState=VOTING], PeerInfo [id=follower587, address=pekko://test/user/follower587, votingState=VOTING]] 12:06:56,601 AM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower589 in 92.61 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:56,602 AM [test-pekko.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower589: Recovery completed in 947.7 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [01/30/2025 00:06:56.604] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader586]: org.opendaylight.controller.cluster.common.actor.Monitor@52b25b07 12:06:56,605 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader586 with journal batch size 1000 12:06:56,605 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586: SnapshotOffer called. 12:06:56,605 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586: Moving last applied index from -1 to -1 12:06:56,605 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - leader586: Set currentTerm=1, votedFor=null 12:06:56,605 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586: Updated server config: isVoting: true, peers: [PeerInfo [id=follower589, address=pekko://test/user/follower589, votingState=NON_VOTING], PeerInfo [id=follower588, address=pekko://test/user/follower588, votingState=VOTING], PeerInfo [id=follower587, address=pekko://test/user/follower587, votingState=VOTING]] 12:06:56,605 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader586 in 70.05 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:56,606 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader586: Recovery completed in 604.3 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:06:56,986 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 12:06:56,986 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.114:17355, Removed) 12:06:56,986 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Follower): Received ElectionTimeout - switching to Candidate 12:06:56,986 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Candidate): Election: Candidate has following voting peers: [follower588, follower587] 12:06:56,986 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - leader586: Set currentTerm=2, votedFor=leader586 12:06:56,986 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Candidate): Starting new election term 2 12:06:56,986 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Candidate): Sending RequestVote{term=2, candidateId=leader586, lastLogIndex=-1, lastLogTerm=-1} to peer follower588 12:06:56,986 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Candidate): Sending RequestVote{term=2, candidateId=leader586, lastLogIndex=-1, lastLogTerm=-1} to peer follower587 12:06:56,987 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:06:56,987 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:06:56,987 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Follower): Cluster state: [] 12:06:56,987 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): Cluster state: [] 12:06:56,987 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader586, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 12:06:56,987 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader586, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 12:06:56,987 AM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader586, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 12:06:56,987 AM [test-pekko.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader586, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 12:06:56,987 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceTermInfoStore - follower587: Set currentTerm=2, votedFor=null 12:06:56,987 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower588: Set currentTerm=2, votedFor=null 12:06:56,987 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Follower): In requestVote: RequestVote{term=2, candidateId=leader586, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 12:06:56,987 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceTermInfoStore - follower587: Set currentTerm=2, votedFor=leader586 12:06:56,987 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): In requestVote: RequestVote{term=2, candidateId=leader586, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 12:06:56,987 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower588: Set currentTerm=2, votedFor=leader586 12:06:56,987 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 12:06:56,987 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 12:06:56,988 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 12:06:56,989 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 12:06:56,989 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 12:06:56,989 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Election: Leader has following peers: [follower589, follower588, follower587] 12:06:56,989 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Checking sendAppendEntries for follower follower589: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:56,989 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Checking sendAppendEntries for follower follower588: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:56,989 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Checking sendAppendEntries for follower follower587: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:56,989 AM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 12:06:56,989 AM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower589 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader586, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term 12:06:56,989 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceTermInfoStore - follower589: Set currentTerm=2, votedFor=null 12:06:56,989 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower589: Last sync leader does not match current leader leader586, need to catch up to -1 12:06:56,989 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower588: Last sync leader does not match current leader leader586, need to catch up to -1 12:06:56,990 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower587: Last sync leader does not match current leader leader586, need to catch up to -1 12:06:56,990 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower589 updated: matchIndex: -1, nextIndex: 0 12:06:56,990 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Checking sendAppendEntries for follower follower589: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:56,990 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower588 updated: matchIndex: -1, nextIndex: 0 12:06:56,990 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Checking sendAppendEntries for follower follower588: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:56,990 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower587 updated: matchIndex: -1, nextIndex: 0 12:06:56,990 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Checking sendAppendEntries for follower follower587: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [01/30/2025 00:06:56.990] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/follower588] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@12bafc19 [WARN] [01/30/2025 00:06:56.990] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/follower587] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@3d53fb42 [WARN] [01/30/2025 00:06:56.991] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower589] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6613fe2f 12:06:57,11 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 12:06:57,11 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting 12:06:57,11 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586: Persist data SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 12:06:57,11 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 12:06:57,11 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 12:06:57,11 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Checking sendAppendEntries for follower follower589: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:57,11 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): sendAppendEntries: 0 is present for follower follower589 12:06:57,12 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Sending AppendEntries to follower follower589: AppendEntries{term=2, leaderId=leader586, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 12:06:57,12 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower589 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader586, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 12:06:57,12 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower589 (Follower): Number of entries to be appended = 1 12:06:57,12 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower589 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 12:06:57,12 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower589 (Follower): Append entry to log zero 12:06:57,12 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower589: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 12:06:57,12 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower589 (Follower): Log size is now 1 12:06:57,12 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower589 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower589, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 12:06:57,12 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower589: Lagging 0 entries behind leader leader586 and reached -1 (of expected -1) 12:06:57,13 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower589: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] [WARN] [01/30/2025 00:06:57.013] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower589] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6f81e501 12:06:57,13 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Checking sendAppendEntries for follower follower588: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:57,13 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): sendAppendEntries: 0 is present for follower follower588 12:06:57,13 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Sending AppendEntries to follower follower588: AppendEntries{term=2, leaderId=leader586, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 12:06:57,13 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Checking sendAppendEntries for follower follower587: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:57,13 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): sendAppendEntries: 0 is present for follower follower587 12:06:57,13 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Sending AppendEntries to follower follower587: AppendEntries{term=2, leaderId=leader586, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 12:06:57,13 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader586, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 12:06:57,13 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Follower): Number of entries to be appended = 1 12:06:57,13 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 12:06:57,13 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Follower): Append entry to log zero 12:06:57,13 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 12:06:57,13 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Follower): Log size is now 1 12:06:57,13 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower587, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 12:06:57,14 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower587: Lagging 0 entries behind leader leader586 and reached -1 (of expected -1) 12:06:57,14 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] [WARN] [01/30/2025 00:06:57.014] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower587] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6b280e22 12:06:57,15 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower589 updated: matchIndex: 0, nextIndex: 1 12:06:57,15 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Checking sendAppendEntries for follower follower589: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:57,15 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower587 updated: matchIndex: 0, nextIndex: 1 12:06:57,15 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Checking sendAppendEntries for follower follower587: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:57,15 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 12:06:57,15 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 12:06:57,15 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Setting last applied to 0 12:06:57,15 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586: Moving last applied index from -1 to 0 12:06:57,15 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586: Applying state for log index 0 data zero 12:06:57,15 AM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader586: applyState called: zero 12:06:57,16 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceEntryStore - leader586: Persisting ApplyJournalEntries with index=0 12:06:57,106 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): sendAppendEntries: 0 is present for follower follower588 12:06:57,106 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Sending AppendEntries to follower follower588: AppendEntries{term=2, leaderId=leader586, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 12:06:57,226 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): sendAppendEntries: 0 is present for follower follower588 12:06:57,226 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Sending AppendEntries to follower follower588: AppendEntries{term=2, leaderId=leader586, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 12:06:57,226 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower589 (Follower): Commit index set to 0 12:06:57,226 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower589: Lagging 0 entries behind leader leader586 and reached 0 (of expected -1) 12:06:57,226 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower589 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0 12:06:57,226 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower589 (Follower): Setting last applied to 0 12:06:57,226 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower589: Moving last applied index from -1 to 0 12:06:57,226 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower589: Applying state for log index 0 data zero 12:06:57,227 AM [test-pekko.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower589: applyState called: zero 12:06:57,227 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceEntryStore - follower589: Persisting ApplyJournalEntries with index=0 12:06:57,227 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Follower): Commit index set to 0 12:06:57,227 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower587: Lagging 0 entries behind leader leader586 and reached 0 (of expected -1) 12:06:57,227 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0 12:06:57,227 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Follower): Setting last applied to 0 12:06:57,227 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587: Moving last applied index from -1 to 0 12:06:57,227 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587: Applying state for log index 0 data zero 12:06:57,227 AM [test-pekko.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower587: applyState called: zero 12:06:57,227 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceEntryStore - follower587: Persisting ApplyJournalEntries with index=0 12:06:57,262 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending 12:06:57,262 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 starting 12:06:57,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586: onShutDown 12:06:57,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586: Initiating leader transfer 12:06:57,263 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower589: onLeaderTransitioning: LeaderTransitioning [leaderId=leader586] 12:06:57,263 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587: onLeaderTransitioning: LeaderTransitioning [leaderId=leader586] 12:06:57,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorLeadershipTransferCohort - leader586: pauseLeader successfully completed - doing transfer 12:06:57,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Attempting to transfer leadership 12:06:57,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Checking sendAppendEntries for follower follower589: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:57,263 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower589: Lagging 0 entries behind leader leader586 and reached 0 (of expected -1) 12:06:57,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Checking sendAppendEntries for follower follower588: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:57,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): sendAppendEntries: 0 is present for follower follower588 12:06:57,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Checking sendAppendEntries for follower follower587: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:57,263 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower587: Lagging 0 entries behind leader leader586 and reached 0 (of expected -1) 12:06:57,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): tryToCompleteLeadershipTransfer: followerId: follower589, matchIndex: 0, lastIndex: 0, isVoting: false 12:06:57,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): tryToCompleteLeadershipTransfer: followerId: follower587, matchIndex: 0, lastIndex: 0, isVoting: true 12:06:57,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Follower's log matches - sending ElectionTimeout 12:06:57,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Checking sendAppendEntries for follower follower589: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:57,263 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower589: Lagging 0 entries behind leader leader586 and reached 0 (of expected -1) 12:06:57,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Checking sendAppendEntries for follower follower588: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:57,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): sendAppendEntries: 0 is present for follower follower588 12:06:57,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Checking sendAppendEntries for follower follower587: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:57,263 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower587: Lagging 0 entries behind leader leader586 and reached 0 (of expected -1) 12:06:57,263 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 12:06:57,263 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Follower): Received TimeoutNow - switching to Candidate 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Candidate): Election: Candidate has following voting peers: [leader586, follower588] 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PersistenceTermInfoStore - follower587: Set currentTerm=3, votedFor=follower587 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Candidate): Starting new election term 3 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Candidate): Sending RequestVote{term=3, candidateId=follower587, lastLogIndex=0, lastLogTerm=2} to peer leader586 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Candidate): Sending RequestVote{term=3, candidateId=follower587, lastLogIndex=0, lastLogTerm=2} to peer follower588 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Follower) :- Switching from behavior Follower to Candidate, election term: 3 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): Cluster state: [] 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): Candidate in requestVote:RequestVote{term=3, candidateId=follower587, lastLogIndex=0, lastLogTerm=2} with higher term appears reachable, updating term. 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): Term 3 in "RequestVote{term=3, candidateId=follower587, lastLogIndex=0, lastLogTerm=2}" message is greater than follower's term 2 - updating term 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PersistenceTermInfoStore - follower588: Set currentTerm=3, votedFor=null 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): In requestVote: RequestVote{term=3, candidateId=follower587, lastLogIndex=0, lastLogTerm=2} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PersistenceTermInfoStore - follower588: Set currentTerm=3, votedFor=follower587 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): requestVote returning: RequestVoteReply{term=3, voteGranted=true} 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Leader): Election: Leader has following peers: [leader586, follower589, follower588] 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Leader): Checking sendAppendEntries for follower leader586: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:57,264 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Leader): Checking sendAppendEntries for follower follower589: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:57,265 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Leader): Checking sendAppendEntries for follower follower588: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:57,265 AM [test-pekko.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3 12:06:57,265 AM [test-pekko.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower589 (Follower): Term 3 in "AppendEntries{term=3, leaderId=follower587, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 2 - updating term 12:06:57,265 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PersistenceTermInfoStore - follower589: Set currentTerm=3, votedFor=null 12:06:57,265 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower589: Last sync leader does not match current leader follower587, need to catch up to -1 12:06:57,265 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower589 updated: matchIndex: 0, nextIndex: 1 12:06:57,265 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Leader): Checking sendAppendEntries for follower follower589: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:57,265 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower589: Lagging 0 entries behind leader follower587 and reached 0 (of expected -1) [WARN] [01/30/2025 00:06:57.265] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower589] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@48ae2090 [WARN] [01/30/2025 00:06:57.265] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower589] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@59e2d463 12:06:57,265 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Leader transfer complete 12:06:57,265 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorLeadershipTransferCohort - leader586: leader transfer complete - waiting for new leader 12:06:57,265 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:06:57,265 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Cluster state: [] 12:06:57,265 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower587, lastLogIndex=0, lastLogTerm=2} with higher term appears reachable, updating term. 12:06:57,265 AM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower587, lastLogIndex=0, lastLogTerm=2}" message is greater than leader's term 2 - switching to Follower 12:06:57,265 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceTermInfoStore - leader586: Set currentTerm=3, votedFor=null 12:06:57,265 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): Leadership transfer in progress - processing RequestVote 12:06:57,265 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): In requestVote: RequestVote{term=3, candidateId=follower587, lastLogIndex=0, lastLogTerm=2} - currentTerm: 3, votedFor: null, lastIndex: 0, lastTerm: 2 12:06:57,265 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceTermInfoStore - leader586: Set currentTerm=3, votedFor=follower587 12:06:57,265 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true} 12:06:57,266 AM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader586 (Leader) :- Switching from behavior Leader to Follower, election term: 3 12:06:57,266 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - leader586: Last sync leader does not match current leader follower587, need to catch up to -1 12:06:57,266 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader586: leader changed to follower587 12:06:57,266 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader586 updated: matchIndex: 0, nextIndex: 1 12:06:57,266 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorLeadershipTransferCohort - leader586: Successfully transferred leadership to follower587 in 3.063 ms 12:06:57,266 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader586: leader transfer succeeded - sending PoisonPill 12:06:57,266 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Leader): Checking sendAppendEntries for follower leader586: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 [WARN] [01/30/2025 00:06:57.266] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/leader586] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@66cdd3dd 12:06:57,266 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - leader586: Lagging 0 entries behind leader follower587 and reached 0 (of expected -1) [WARN] [01/30/2025 00:06:57.266] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/leader586] received dead letter: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@4828e06c 12:06:57,776 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower589: Lagging 0 entries behind leader follower587 and reached 0 (of expected -1) [WARN] [01/30/2025 00:06:57.776] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/leader586] received dead letter from TestActor[pekko://test/user/follower587]: AppendEntries{term=3, leaderId=follower587, prevLogIndex=0, prevLogTerm=2, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 12:06:57,776 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower588: Last sync leader does not match current leader follower587, need to catch up to -1 [WARN] [01/30/2025 00:06:57.776] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower588] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@71f3e407 12:06:57,777 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Leader): sendAppendEntries: 0 is present for follower follower588 12:06:57,777 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Leader): Sending AppendEntries to follower follower588: AppendEntries{term=3, leaderId=follower587, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 12:06:57,777 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): handleAppendEntries: AppendEntries{term=3, leaderId=follower587, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 12:06:57,777 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): Number of entries to be appended = 1 12:06:57,777 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 12:06:57,777 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): Append entry to log zero 12:06:57,777 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 12:06:57,777 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): Log size is now 1 12:06:57,777 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): Commit index set to 0 12:06:57,777 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): handleAppendEntries returning : AppendEntriesReply{term=3, success=true, followerId=follower588, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 12:06:57,777 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower588: Lagging 0 entries behind leader follower587 and reached 0 (of expected -1) 12:06:57,777 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0 12:06:57,777 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588 (Follower): Setting last applied to 0 12:06:57,777 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588: Moving last applied index from -1 to 0 12:06:57,777 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588: Applying state for log index 0 data zero 12:06:57,777 AM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower588: applyState called: zero 12:06:57,778 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 12:06:57,778 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceEntryStore - follower588: Persisting ApplyJournalEntries with index=0 [WARN] [01/30/2025 00:06:57.778] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower588] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@7326ce68 12:06:57,779 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower588 updated: matchIndex: 0, nextIndex: 1 12:06:57,779 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower587 (Leader): Checking sendAppendEntries for follower follower588: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:57,817 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588: onLeaderTransitioning: LeaderTransitioning [leaderId=leader586] 12:06:57,818 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 ending 12:06:57,818 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower588 starting 12:06:57,818 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower588: onShutDown 12:06:57,819 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower588 ending 12:06:57,819 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending 12:06:57,819 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower587-notifier590#1049713118] 12:06:57,830 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower587-collector591#-502446128] 12:06:57,831 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower587] 12:06:57,832 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower588-notifier592#1925730556] 12:06:57,832 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower588-collector593#151630847] 12:06:57,832 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower588] 12:06:57,833 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower589-notifier594#-1344963888] 12:06:57,833 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower589-collector595#1047504030] 12:06:57,833 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower589] 12:06:57,834 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader586-notifier596#7543461] 12:06:57,834 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader586-collector597#1141601103] 12:06:57,835 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader586] 12:06:57,836 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers starting [WARN] [01/30/2025 00:06:57.837] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader598]: org.opendaylight.controller.cluster.common.actor.Monitor@7df37b64 12:06:57,838 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader598 with journal batch size 1000 12:06:57,839 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader598: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:06:57,840 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 12:06:57,840 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader598 (Follower): Received TimeoutNow - switching to Candidate 12:06:57,840 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader598 (Candidate): Election: Candidate has following voting peers: [] 12:06:57,840 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - leader598: Set currentTerm=1, votedFor=leader598 12:06:57,840 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader598 (Candidate): Starting new election term 1 12:06:57,840 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader598 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:06:57,841 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader598 (Candidate): Received ElectionTimeout 12:06:57,841 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader598 (Leader): Election: Leader has following peers: [] 12:06:57,841 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader598 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:06:57,841 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader598 starting 12:06:57,842 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader598: onShutDown 12:06:57,842 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader598 ending 12:06:57,842 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers ending 12:06:57,842 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader598-collector602#176258928] 12:06:57,853 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader598] 12:06:57,853 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging starting 12:06:57,853 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting [WARN] [01/30/2025 00:06:57.855] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower604]: org.opendaylight.controller.cluster.common.actor.Monitor@70947afb 12:06:57,865 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower604 with journal batch size 1000 12:06:57,866 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604: SnapshotOffer called. 12:06:57,866 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604: Moving last applied index from -1 to -1 12:06:57,866 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower604: Set currentTerm=1, votedFor=null 12:06:57,867 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604: Updated server config: isVoting: true, peers: [PeerInfo [id=follower605, address=pekko://test/user/follower605, votingState=VOTING], PeerInfo [id=follower606, address=pekko://test/user/follower606, votingState=NON_VOTING], PeerInfo [id=leader603, address=pekko://test/user/leader603, votingState=VOTING]] 12:06:57,867 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower604 in 183.7 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:57,868 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower604: Recovery completed in 1.063 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [01/30/2025 00:06:57.868] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower605]: org.opendaylight.controller.cluster.common.actor.Monitor@435b5e7f 12:06:57,870 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower605 with journal batch size 1000 12:06:57,870 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower605: SnapshotOffer called. 12:06:57,870 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower605: Moving last applied index from -1 to -1 12:06:57,870 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PersistenceTermInfoStore - follower605: Set currentTerm=1, votedFor=null 12:06:57,870 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower605: Updated server config: isVoting: true, peers: [PeerInfo [id=follower604, address=pekko://test/user/follower604, votingState=VOTING], PeerInfo [id=follower606, address=pekko://test/user/follower606, votingState=NON_VOTING], PeerInfo [id=leader603, address=pekko://test/user/leader603, votingState=VOTING]] 12:06:57,870 AM [test-pekko.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower605 in 60.46 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:57,871 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower605: Recovery completed in 629.5 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [01/30/2025 00:06:57.871] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower606]: org.opendaylight.controller.cluster.common.actor.Monitor@4dc03402 12:06:57,871 AM [test-pekko.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower606 with journal batch size 1000 12:06:57,871 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower606: SnapshotOffer called. 12:06:57,871 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower606: Moving last applied index from -1 to -1 12:06:57,871 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PersistenceTermInfoStore - follower606: Set currentTerm=1, votedFor=null 12:06:57,871 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower606: Updated server config: isVoting: false, peers: [PeerInfo [id=follower605, address=pekko://test/user/follower605, votingState=VOTING], PeerInfo [id=follower604, address=pekko://test/user/follower604, votingState=VOTING], PeerInfo [id=leader603, address=pekko://test/user/leader603, votingState=VOTING]] 12:06:57,871 AM [test-pekko.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower606 in 30.96 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:57,872 AM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower606: Recovery completed in 554.4 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [01/30/2025 00:06:57.872] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader603]: org.opendaylight.controller.cluster.common.actor.Monitor@ec1a07a 12:06:57,872 AM [test-pekko.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader603 with journal batch size 1000 12:06:57,873 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603: SnapshotOffer called. 12:06:57,873 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603: Moving last applied index from -1 to -1 12:06:57,873 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceTermInfoStore - leader603: Set currentTerm=1, votedFor=null 12:06:57,873 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603: Updated server config: isVoting: true, peers: [PeerInfo [id=follower605, address=pekko://test/user/follower605, votingState=VOTING], PeerInfo [id=follower604, address=pekko://test/user/follower604, votingState=VOTING], PeerInfo [id=follower606, address=pekko://test/user/follower606, votingState=NON_VOTING]] 12:06:57,873 AM [test-pekko.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader603 in 29.21 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:57,873 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader603: Recovery completed in 459.4 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:06:58,256 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 12:06:58,256 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.114:17355, Removed) 12:06:58,256 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Follower): Received ElectionTimeout - switching to Candidate 12:06:58,256 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Candidate): Election: Candidate has following voting peers: [follower605, follower604] 12:06:58,256 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceTermInfoStore - leader603: Set currentTerm=2, votedFor=leader603 12:06:58,256 AM [test-pekko.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Candidate): Starting new election term 2 12:06:58,256 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Candidate): Sending RequestVote{term=2, candidateId=leader603, lastLogIndex=-1, lastLogTerm=-1} to peer follower605 12:06:58,256 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Candidate): Sending RequestVote{term=2, candidateId=leader603, lastLogIndex=-1, lastLogTerm=-1} to peer follower604 12:06:58,257 AM [test-pekko.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 12:06:58,257 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower605 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:06:58,257 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower605 (Follower): Cluster state: [] 12:06:58,257 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower605 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader603, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 12:06:58,257 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower605 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader603, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 12:06:58,257 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower605: Set currentTerm=2, votedFor=null 12:06:58,257 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:06:58,257 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604 (Follower): Cluster state: [] 12:06:58,257 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader603, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 12:06:58,257 AM [test-pekko.actor.default-dispatcher-5] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower604 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader603, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 12:06:58,257 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceTermInfoStore - follower604: Set currentTerm=2, votedFor=null 12:06:58,257 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower605 (Follower): In requestVote: RequestVote{term=2, candidateId=leader603, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 12:06:58,257 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604 (Follower): In requestVote: RequestVote{term=2, candidateId=leader603, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 12:06:58,257 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower605: Set currentTerm=2, votedFor=leader603 12:06:58,257 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceTermInfoStore - follower604: Set currentTerm=2, votedFor=leader603 12:06:58,257 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 12:06:58,257 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower605 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 12:06:58,258 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 12:06:58,258 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 12:06:58,258 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Election: Leader has following peers: [follower605, follower604, follower606] 12:06:58,258 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Checking sendAppendEntries for follower follower605: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:58,258 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Checking sendAppendEntries for follower follower604: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:58,258 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Checking sendAppendEntries for follower follower606: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:58,258 AM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 12:06:58,258 AM [test-pekko.actor.default-dispatcher-6] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower606 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader603, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term 12:06:58,258 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PersistenceTermInfoStore - follower606: Set currentTerm=2, votedFor=null 12:06:58,259 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower606: Last sync leader does not match current leader leader603, need to catch up to -1 12:06:58,259 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower606 updated: matchIndex: -1, nextIndex: 0 12:06:58,259 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Checking sendAppendEntries for follower follower606: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:58,260 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower605: Last sync leader does not match current leader leader603, need to catch up to -1 12:06:58,260 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower604: Last sync leader does not match current leader leader603, need to catch up to -1 12:06:58,260 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower605 updated: matchIndex: -1, nextIndex: 0 12:06:58,260 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Checking sendAppendEntries for follower follower605: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [01/30/2025 00:06:58.260] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower606] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@533f60d5 12:06:58,260 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower604 updated: matchIndex: -1, nextIndex: 0 12:06:58,260 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Checking sendAppendEntries for follower follower604: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [01/30/2025 00:06:58.260] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower605] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@ca27b65 [WARN] [01/30/2025 00:06:58.260] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower604] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@fe3d8fb 12:06:58,277 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 12:06:58,277 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting 12:06:58,277 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending 12:06:58,277 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting 12:06:58,277 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603: Persist data SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 12:06:58,277 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 12:06:58,277 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 12:06:58,277 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Checking sendAppendEntries for follower follower605: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:58,277 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): sendAppendEntries: 0 is present for follower follower605 12:06:58,277 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Sending AppendEntries to follower follower605: AppendEntries{term=2, leaderId=leader603, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 12:06:58,277 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Checking sendAppendEntries for follower follower604: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:58,277 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): sendAppendEntries: 0 is present for follower follower604 12:06:58,277 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Sending AppendEntries to follower follower604: AppendEntries{term=2, leaderId=leader603, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 12:06:58,277 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Checking sendAppendEntries for follower follower606: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:58,277 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): sendAppendEntries: 0 is present for follower follower606 12:06:58,277 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Sending AppendEntries to follower follower606: AppendEntries{term=2, leaderId=leader603, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 12:06:58,277 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader603, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 12:06:58,277 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604 (Follower): Number of entries to be appended = 1 12:06:58,277 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 12:06:58,277 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604 (Follower): Append entry to log zero 12:06:58,277 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 12:06:58,277 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower606 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader603, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 12:06:58,278 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604 (Follower): Log size is now 1 12:06:58,278 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower606 (Follower): Number of entries to be appended = 1 12:06:58,278 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower606 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 12:06:58,278 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower604, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 12:06:58,278 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower606 (Follower): Append entry to log zero 12:06:58,278 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower606: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 12:06:58,278 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower604: Lagging 0 entries behind leader leader603 and reached -1 (of expected -1) 12:06:58,278 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower606 (Follower): Log size is now 1 12:06:58,278 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower604 updated: matchIndex: 0, nextIndex: 1 12:06:58,278 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower606 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower606, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 12:06:58,278 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower606: Lagging 0 entries behind leader leader603 and reached -1 (of expected -1) 12:06:58,278 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Checking sendAppendEntries for follower follower604: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:58,278 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower606 updated: matchIndex: 0, nextIndex: 1 12:06:58,278 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Checking sendAppendEntries for follower follower606: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:58,278 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 12:06:58,278 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 12:06:58,278 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Setting last applied to 0 12:06:58,278 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603: Moving last applied index from -1 to 0 12:06:58,278 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603: Applying state for log index 0 data zero 12:06:58,278 AM [test-pekko.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader603: applyState called: zero 12:06:58,278 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 12:06:58,278 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PersistenceEntryStore - leader603: Persisting ApplyJournalEntries with index=0 12:06:58,278 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower606: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] [WARN] [01/30/2025 00:06:58.278] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower604] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@4bc1b4b9 [WARN] [01/30/2025 00:06:58.278] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower606] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@542797f7 12:06:58,375 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): sendAppendEntries: 0 is present for follower follower605 12:06:58,376 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Sending AppendEntries to follower follower605: AppendEntries{term=2, leaderId=leader603, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 12:06:58,496 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): sendAppendEntries: 0 is present for follower follower605 12:06:58,496 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Sending AppendEntries to follower follower605: AppendEntries{term=2, leaderId=leader603, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 12:06:58,497 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604 (Follower): Commit index set to 0 12:06:58,497 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower604: Lagging 0 entries behind leader leader603 and reached 0 (of expected -1) 12:06:58,497 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0 12:06:58,497 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604 (Follower): Setting last applied to 0 12:06:58,497 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604: Moving last applied index from -1 to 0 12:06:58,497 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower606 (Follower): Commit index set to 0 12:06:58,497 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604: Applying state for log index 0 data zero 12:06:58,497 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower606: Lagging 0 entries behind leader leader603 and reached 0 (of expected -1) 12:06:58,497 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower606 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0 12:06:58,497 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower606 (Follower): Setting last applied to 0 12:06:58,497 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower606: Moving last applied index from -1 to 0 12:06:58,497 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower606: Applying state for log index 0 data zero 12:06:58,497 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower604: applyState called: zero 12:06:58,497 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceEntryStore - follower604: Persisting ApplyJournalEntries with index=0 12:06:58,497 AM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower606: applyState called: zero 12:06:58,497 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceEntryStore - follower606: Persisting ApplyJournalEntries with index=0 12:06:58,529 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending 12:06:58,529 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting 12:06:58,529 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603: onRequestLeadership RequestLeadership [requestedFollowerId=follower605, replyTo=Actor[pekko://test/user/$c#-1226617049]] 12:06:58,529 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603: Initiating leader transfer 12:06:58,529 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower605: onLeaderTransitioning: LeaderTransitioning [leaderId=leader603] 12:06:58,529 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader603: pauseLeader successfully completed - doing transfer 12:06:58,529 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Attempting to transfer leadership 12:06:58,529 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower604: onLeaderTransitioning: LeaderTransitioning [leaderId=leader603] 12:06:58,529 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Checking sendAppendEntries for follower follower605: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:58,529 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): sendAppendEntries: 0 is present for follower follower605 12:06:58,529 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Checking sendAppendEntries for follower follower604: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:58,529 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower606: onLeaderTransitioning: LeaderTransitioning [leaderId=leader603] 12:06:58,529 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Checking sendAppendEntries for follower follower606: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:06:58,529 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower604: Lagging 0 entries behind leader leader603 and reached 0 (of expected -1) 12:06:58,529 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower606: Lagging 0 entries behind leader leader603 and reached 0 (of expected -1) 12:06:58,529 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending 12:06:58,736 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower604: Lagging 0 entries behind leader leader603 and reached 0 (of expected -1) 12:06:58,736 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower606: Lagging 0 entries behind leader leader603 and reached 0 (of expected -1) 12:06:58,856 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorLeadershipTransferCohort - leader603: leader transfer aborted 12:06:58,856 AM [test-pekko.actor.default-dispatcher-14] [WARN] RaftActorLeadershipTransferCohort - leader603: Failed to transfer leadership in 326.9 ms 12:06:58,856 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603: LeadershipTransfer request from follower605 failed 12:06:58,856 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader603 (Leader): Leadership transfer expired 12:06:58,856 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower604: Lagging 0 entries behind leader leader603 and reached 0 (of expected -1) 12:06:58,856 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower606: Lagging 0 entries behind leader leader603 and reached 0 (of expected -1) 12:06:58,882 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging ending 12:06:58,882 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower604-notifier607#1379854484] 12:06:58,893 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower604-collector608#728586399] 12:06:58,894 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower604] 12:06:58,894 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower605-notifier609#1758228651] 12:06:58,894 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower605-collector610#344133175] 12:06:58,894 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower605] 12:06:58,895 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower606-notifier611#384622901] 12:06:58,895 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower606-collector612#1780999610] 12:06:58,895 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower606] 12:06:58,895 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader603-notifier613#1492228510] 12:06:58,896 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader603-collector614#-189605391] 12:06:58,896 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader603] 12:06:58,896 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$c#-1226617049] 12:06:58,897 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown starting 12:06:58,897 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting [WARN] [01/30/2025 00:06:58.899] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower616]: org.opendaylight.controller.cluster.common.actor.Monitor@7d6a26ec 12:06:58,900 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower616 with journal batch size 1000 12:06:58,900 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower616: SnapshotOffer called. 12:06:58,901 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower616: Moving last applied index from -1 to -1 12:06:58,901 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceTermInfoStore - follower616: Set currentTerm=1, votedFor=null 12:06:58,901 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower616: Updated server config: isVoting: true, peers: [PeerInfo [id=follower618, address=pekko://test/user/follower618, votingState=NON_VOTING], PeerInfo [id=follower617, address=pekko://test/user/follower617, votingState=VOTING], PeerInfo [id=leader615, address=pekko://test/user/leader615, votingState=VOTING]] 12:06:58,901 AM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower616 in 104.0 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:58,902 AM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower616: Recovery completed in 1.194 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [01/30/2025 00:06:58.902] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower617]: org.opendaylight.controller.cluster.common.actor.Monitor@6973d53d 12:06:58,903 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower617 with journal batch size 1000 12:06:58,903 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617: SnapshotOffer called. 12:06:58,903 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617: Moving last applied index from -1 to -1 12:06:58,903 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - follower617: Set currentTerm=1, votedFor=null 12:06:58,903 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617: Updated server config: isVoting: true, peers: [PeerInfo [id=follower616, address=pekko://test/user/follower616, votingState=VOTING], PeerInfo [id=follower618, address=pekko://test/user/follower618, votingState=NON_VOTING], PeerInfo [id=leader615, address=pekko://test/user/leader615, votingState=VOTING]] 12:06:58,903 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower617 in 57.48 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:58,904 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower617: Recovery completed in 628.4 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [01/30/2025 00:06:58.906] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower618]: org.opendaylight.controller.cluster.common.actor.Monitor@3f4b1a89 12:06:58,906 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for follower618 with journal batch size 1000 12:06:58,907 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower618: SnapshotOffer called. 12:06:58,907 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower618: Moving last applied index from -1 to -1 12:06:58,907 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower618: Set currentTerm=1, votedFor=null 12:06:58,907 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower618: Updated server config: isVoting: false, peers: [PeerInfo [id=follower616, address=pekko://test/user/follower616, votingState=VOTING], PeerInfo [id=follower617, address=pekko://test/user/follower617, votingState=VOTING], PeerInfo [id=leader615, address=pekko://test/user/leader615, votingState=VOTING]] 12:06:58,907 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for follower618 in 90.90 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:58,908 AM [test-pekko.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower618: Recovery completed in 735.3 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [01/30/2025 00:06:58.913] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader615]: org.opendaylight.controller.cluster.common.actor.Monitor@79d65ba5 12:06:58,913 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Starting recovery for leader615 with journal batch size 1000 12:06:58,913 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615: SnapshotOffer called. 12:06:58,913 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615: Moving last applied index from -1 to -1 12:06:58,913 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - leader615: Set currentTerm=1, votedFor=null 12:06:58,913 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615: Updated server config: isVoting: true, peers: [PeerInfo [id=follower616, address=pekko://test/user/follower616, votingState=VOTING], PeerInfo [id=follower618, address=pekko://test/user/follower618, votingState=NON_VOTING], PeerInfo [id=follower617, address=pekko://test/user/follower617, votingState=VOTING]] 12:06:58,913 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - Recovery snapshot applied for leader615 in 46.51 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:06:58,914 AM [test-pekko.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader615: Recovery completed in 399.3 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:06:59,275 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 12:06:59,275 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.114:17355, Removed) 12:06:59,275 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Follower): Received ElectionTimeout - switching to Candidate 12:06:59,275 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Candidate): Election: Candidate has following voting peers: [follower616, follower617] 12:06:59,276 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - leader615: Set currentTerm=2, votedFor=leader615 12:06:59,276 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Candidate): Starting new election term 2 12:06:59,276 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Candidate): Sending RequestVote{term=2, candidateId=leader615, lastLogIndex=-1, lastLogTerm=-1} to peer follower616 12:06:59,276 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Candidate): Sending RequestVote{term=2, candidateId=leader615, lastLogIndex=-1, lastLogTerm=-1} to peer follower617 12:06:59,276 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 12:06:59,276 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower616 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:06:59,276 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:06:59,276 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Follower): Cluster state: [] 12:06:59,276 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader615, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 12:06:59,276 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower616 (Follower): Cluster state: [] 12:06:59,276 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader615, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 12:06:59,276 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower617: Set currentTerm=2, votedFor=null 12:06:59,276 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower616 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader615, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 12:06:59,276 AM [test-pekko.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower616 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader615, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 12:06:59,276 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower616: Set currentTerm=2, votedFor=null 12:06:59,276 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Follower): In requestVote: RequestVote{term=2, candidateId=leader615, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 12:06:59,276 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower617: Set currentTerm=2, votedFor=leader615 12:06:59,276 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 12:06:59,276 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower616 (Follower): In requestVote: RequestVote{term=2, candidateId=leader615, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 12:06:59,276 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower616: Set currentTerm=2, votedFor=leader615 12:06:59,276 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower616 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 12:06:59,277 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 12:06:59,277 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 12:06:59,278 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Election: Leader has following peers: [follower616, follower618, follower617] 12:06:59,278 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Checking sendAppendEntries for follower follower616: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:59,278 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Checking sendAppendEntries for follower follower618: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:59,278 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Checking sendAppendEntries for follower follower617: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:59,278 AM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 12:06:59,278 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower616: Last sync leader does not match current leader leader615, need to catch up to -1 12:06:59,278 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower617: Last sync leader does not match current leader leader615, need to catch up to -1 12:06:59,278 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower618 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader615, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term 12:06:59,278 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower618: Set currentTerm=2, votedFor=null 12:06:59,278 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower616 updated: matchIndex: -1, nextIndex: 0 12:06:59,278 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Checking sendAppendEntries for follower follower616: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [01/30/2025 00:06:59.278] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower617] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@4b6c9e4d [WARN] [01/30/2025 00:06:59.278] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower616] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5accf398 12:06:59,278 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower618: Last sync leader does not match current leader leader615, need to catch up to -1 12:06:59,278 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower617 updated: matchIndex: -1, nextIndex: 0 12:06:59,278 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Checking sendAppendEntries for follower follower617: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:59,278 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower618 updated: matchIndex: -1, nextIndex: 0 12:06:59,278 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Checking sendAppendEntries for follower follower618: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [01/30/2025 00:06:59.279] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower618] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@639dd2aa 12:06:59,317 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 12:06:59,317 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting 12:06:59,317 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending 12:06:59,317 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower616] 12:06:59,329 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower618] 12:06:59,339 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting 12:06:59,339 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending 12:06:59,339 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615: onRequestLeadership RequestLeadership [requestedFollowerId=follower617, replyTo=Actor[pekko://test/user/$d#1460256551]] 12:06:59,339 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615: Initiating leader transfer [WARN] [01/30/2025 00:06:59.340] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower616] received dead letter from TestActor[pekko://test/user/leader615]: LeaderTransitioning [leaderId=leader615] [WARN] [01/30/2025 00:06:59.340] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower618] received dead letter from TestActor[pekko://test/user/leader615]: LeaderTransitioning [leaderId=leader615] 12:06:59,340 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617: onLeaderTransitioning: LeaderTransitioning [leaderId=leader615] 12:06:59,340 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader615: pauseLeader successfully completed - doing transfer 12:06:59,340 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Attempting to transfer leadership 12:06:59,340 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Checking sendAppendEntries for follower follower616: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:59,340 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Checking sendAppendEntries for follower follower618: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:59,340 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Checking sendAppendEntries for follower follower617: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [01/30/2025 00:06:59.340] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower616] received dead letter from TestActor[pekko://test/user/leader615]: AppendEntries{term=2, leaderId=leader615, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} [WARN] [01/30/2025 00:06:59.340] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower618] received dead letter from TestActor[pekko://test/user/leader615]: AppendEntries{term=2, leaderId=leader615, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 12:06:59,340 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower617: Lagging 0 entries behind leader leader615 and reached -1 (of expected -1) [WARN] [01/30/2025 00:06:59.340] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower617] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5018e61e 12:06:59,341 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): tryToCompleteLeadershipTransfer: followerId: follower617, matchIndex: -1, lastIndex: -1, isVoting: true 12:06:59,341 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Follower's log matches - sending ElectionTimeout 12:06:59,341 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Checking sendAppendEntries for follower follower616: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:59,341 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Checking sendAppendEntries for follower follower618: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [01/30/2025 00:06:59.341] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower616] received dead letter from TestActor[pekko://test/user/leader615]: AppendEntries{term=2, leaderId=leader615, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} [WARN] [01/30/2025 00:06:59.341] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower618] received dead letter from TestActor[pekko://test/user/leader615]: AppendEntries{term=2, leaderId=leader615, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 12:06:59,341 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Checking sendAppendEntries for follower follower617: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:59,341 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Leader transfer complete 12:06:59,341 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorLeadershipTransferCohort - leader615: leader transfer complete - waiting for new leader 12:06:59,341 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower617: Lagging 0 entries behind leader leader615 and reached -1 (of expected -1) 12:06:59,341 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 12:06:59,341 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Follower): Received TimeoutNow - switching to Candidate 12:06:59,341 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Candidate): Election: Candidate has following voting peers: [follower616, leader615] 12:06:59,341 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PersistenceTermInfoStore - follower617: Set currentTerm=3, votedFor=follower617 12:06:59,341 AM [test-pekko.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Candidate): Starting new election term 3 12:06:59,341 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Candidate): Sending RequestVote{term=3, candidateId=follower617, lastLogIndex=-1, lastLogTerm=-1} to peer follower616 [WARN] [01/30/2025 00:06:59.342] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower616] received dead letter from TestActor[pekko://test/user/follower617]: RequestVote{term=3, candidateId=follower617, lastLogIndex=-1, lastLogTerm=-1} 12:06:59,342 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Candidate): Sending RequestVote{term=3, candidateId=follower617, lastLogIndex=-1, lastLogTerm=-1} to peer leader615 12:06:59,342 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:06:59,342 AM [test-pekko.actor.default-dispatcher-17] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Follower) :- Switching from behavior Follower to Candidate, election term: 3 12:06:59,342 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Cluster state: [] 12:06:59,342 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower617, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 12:06:59,342 AM [test-pekko.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower617, lastLogIndex=-1, lastLogTerm=-1}" message is greater than leader's term 2 - switching to Follower 12:06:59,342 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - leader615: Set currentTerm=3, votedFor=null 12:06:59,342 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): Leadership transfer in progress - processing RequestVote 12:06:59,342 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): In requestVote: RequestVote{term=3, candidateId=follower617, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1 12:06:59,342 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - leader615: Set currentTerm=3, votedFor=follower617 12:06:59,342 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true} 12:06:59,342 AM [test-pekko.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - leader615 (Leader) :- Switching from behavior Leader to Follower, election term: 3 12:06:59,343 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3 12:06:59,343 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1 12:06:59,343 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Leader): Election: Leader has following peers: [follower616, follower618, leader615] 12:06:59,343 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Leader): Checking sendAppendEntries for follower follower616: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:59,343 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Leader): Checking sendAppendEntries for follower follower618: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:59,343 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Leader): Checking sendAppendEntries for follower leader615: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [01/30/2025 00:06:59.343] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower616] received dead letter from TestActor[pekko://test/user/follower617]: AppendEntries{term=3, leaderId=follower617, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 12:06:59,343 AM [test-pekko.actor.default-dispatcher-16] [INFO] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3 [WARN] [01/30/2025 00:06:59.343] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower618] received dead letter from TestActor[pekko://test/user/follower617]: AppendEntries{term=3, leaderId=follower617, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 12:06:59,343 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - leader615: Last sync leader does not match current leader follower617, need to catch up to -1 12:06:59,344 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader615 updated: matchIndex: -1, nextIndex: 0 12:06:59,344 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader615: leader changed to follower617 12:06:59,344 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - follower617 (Leader): Checking sendAppendEntries for follower leader615: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:06:59,344 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorLeadershipTransferCohort - leader615: Successfully transferred leadership to follower617 in 4.320 ms 12:06:59,344 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractRaftActorIntegrationTest$TestRaftActor - leader615: Leadership transferred successfully to follower617 [WARN] [01/30/2025 00:06:59.344] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/leader615] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2c79d159 12:06:59,390 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown ending 12:06:59,390 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower616-notifier619#-2131515811] 12:06:59,401 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower616-collector620#1702512833] 12:06:59,401 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower617-notifier621#-364283080] 12:06:59,401 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower617-collector622#143058957] 12:06:59,401 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower617] 12:06:59,402 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower618-notifier623#-1606850627] 12:06:59,402 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower618-collector624#1458847681] 12:06:59,402 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader615-notifier625#1698253957] 12:06:59,402 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader615-collector626#-505111707] 12:06:59,402 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader615] 12:06:59,402 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$d#1460256551] [INFO] [01/30/2025 00:06:59.403] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 12:06:59,403 AM [test-pekko.actor.default-dispatcher-17] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 12:06:59,407 AM [test-pekko.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.114:17355] - Exiting completed 12:06:59,407 AM [test-pekko.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.114:17355] - Shutting down... 12:06:59,407 AM [test-pekko.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.114:17355] - Successfully shut down 12:06:59,407 AM [test-pekko.actor.default-dispatcher-18] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 12:06:59,407 AM [test-pekko.actor.default-dispatcher-18] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [WARN] [01/30/2025 00:06:59.407] [test-pekko.actor.default-dispatcher-17] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.170.114:17355) [INFO] [01/30/2025 00:06:59.404] [test-pekko.actor.internal-dispatcher-10] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.114:17355] - Exiting completed [INFO] [01/30/2025 00:06:59.405] [test-pekko.actor.internal-dispatcher-10] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.114:17355] - Shutting down... [INFO] [01/30/2025 00:06:59.405] [test-pekko.actor.internal-dispatcher-10] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.114:17355] - Successfully shut down [INFO] [01/30/2025 00:06:59.406] [test-pekko.remote.default-remote-dispatcher-9] [pekko://test@10.30.170.114:17355/system/remoting-terminator] Shutting down remote daemon. [INFO] [01/30/2025 00:06:59.406] [test-pekko.remote.default-remote-dispatcher-9] [pekko://test@10.30.170.114:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports. [WARN] [01/30/2025 00:06:59.408] [test-pekko.actor.default-dispatcher-17] [pekko://test/system/deadLetterListener] received dead letter: UnhandledMessage(Leave(pekko://test@10.30.170.114:17355),Actor[pekko://test/deadLetters],Actor[pekko://test/system/cluster/core/daemon#-1795534887]) [INFO] [01/30/2025 00:06:59.408] [test-pekko.remote.default-remote-dispatcher-8] [pekko://test@10.30.170.114:17355/system/remoting-terminator] Remoting shut down. 12:06:59,408 AM [test-pekko.actor.default-dispatcher-17] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down. [DEBUG] [01/30/2025 00:06:59.408] [test-pekko.actor.internal-dispatcher-2] [EventStream] shutting down: StandardOutLogger