[DEBUG] [02/03/2025 17:31:49.227] [main] [EventStream(pekko://test)] logger log1-TestEventListener started 05:31:49,233 PM [test-pekko.actor.default-dispatcher-4] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [02/03/2025 17:31:49.233] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started [DEBUG] [02/03/2025 17:31:49.233] [main] [EventStream(pekko://test)] Default Loggers started [INFO] [02/03/2025 17:31:49.248] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.87:17355] with UID [8179726494672564690] [INFO] [02/03/2025 17:31:49.249] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.87:17355] - Starting up, Pekko version [1.0.3] ... 05:31:49,249 PM [test-pekko.actor.default-dispatcher-4] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.87:17355] with UID [8179726494672564690] 05:31:49,249 PM [test-pekko.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.87:17355] - Starting up, Pekko version [1.0.3] ... [INFO] [02/03/2025 17:31:49.251] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.87:17355] - Registered cluster JMX MBean [pekko:type=Cluster] [INFO] [02/03/2025 17:31:49.251] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.87:17355] - Started up successfully 05:31:49,251 PM [test-pekko.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.87:17355] - Registered cluster JMX MBean [pekko:type=Cluster] 05:31:49,251 PM [test-pekko.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.87:17355] - Started up successfully [INFO] [02/03/2025 17:31:49.251] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.87:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing [INFO] [02/03/2025 17:31:49.251] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.87:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 05:31:49,251 PM [test-pekko.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.87:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing 05:31:49,251 PM [test-pekko.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.87:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 05:31:49,261 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferAborted starting 05:31:49,261 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting [WARN] [02/03/2025 17:31:49.264] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower550]: org.opendaylight.controller.cluster.common.actor.Monitor@2d87ec6 [INFO] [pekkoDeadLetter][02/03/2025 17:31:49.264] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower550] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 05:31:49,264 PM [test-pekko.actor.default-dispatcher-7] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower550] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 05:31:49,266 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower550: Starting recovery with journal batch size 1000 05:31:49,268 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorRecoverySupport - follower550: SnapshotOffer called. 05:31:49,268 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorContextImpl - follower550: Moving last applied index from -1 to -1 05:31:49,268 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceTermInfoStore - follower550: Set currentTerm=1, votedFor=null 05:31:49,268 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorContextImpl - follower550: Updated server config: isVoting: true, peers: [PeerInfo [id=follower552, address=pekko://test/user/follower552, votingState=NON_VOTING], PeerInfo [id=leader549, address=pekko://test/user/leader549, votingState=VOTING], PeerInfo [id=follower551, address=pekko://test/user/follower551, votingState=VOTING]] 05:31:49,268 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower550 in 135.9 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:49,269 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - follower550: Recovery completed in 691.0 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:49,269 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower550: Set currentTerm=1, votedFor=null 05:31:49,269 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - follower550: Local TermInfo store seeded with TermInfo{term=1} 05:31:49,269 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - follower550: Snapshot capture initiated after recovery due to migrated messages 05:31:49,269 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - follower550: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:49,269 PM [test-pekko.actor.default-dispatcher-7] [INFO] SnapshotManager - follower550: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:49,269 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - follower550: lastSequenceNumber prior to capture: 0 05:31:49,270 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorSnapshotMessageSupport - follower550: CaptureSnapshotReply received by actor 05:31:49,270 PM [test-pekko.actor.default-dispatcher-7] [INFO] SnapshotManager - follower550: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=follower552, isVoting=false], ServerInfo[peerId=leader549, isVoting=true], ServerInfo[peerId=follower551, isVoting=true], ServerInfo[peerId=follower550, isVoting=true]]}] 05:31:49,270 PM [test-pekko.actor.default-dispatcher-7] [INFO] SnapshotManager - follower550: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:49,270 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorSnapshotMessageSupport - follower550: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:49,270 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - follower550: Snapshot success - sequence number: -1 05:31:49,270 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorSnapshotMessageSupport - follower550: SnapshotComplete received 05:31:49,270 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower550: handled a snapshot response 05:31:49,270 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower550: handled a journal response [WARN] [02/03/2025 17:31:49.364] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower551]: org.opendaylight.controller.cluster.common.actor.Monitor@3d32940a [INFO] [pekkoDeadLetter][02/03/2025 17:31:49.364] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower551] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 05:31:49,364 PM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower551] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 05:31:49,364 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - follower551: Starting recovery with journal batch size 1000 05:31:49,365 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorRecoverySupport - follower551: SnapshotOffer called. 05:31:49,365 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorContextImpl - follower551: Moving last applied index from -1 to -1 05:31:49,365 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceTermInfoStore - follower551: Set currentTerm=1, votedFor=null 05:31:49,365 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorContextImpl - follower551: Updated server config: isVoting: true, peers: [PeerInfo [id=follower552, address=pekko://test/user/follower552, votingState=NON_VOTING], PeerInfo [id=leader549, address=pekko://test/user/leader549, votingState=VOTING], PeerInfo [id=follower550, address=pekko://test/user/follower550, votingState=VOTING]] 05:31:49,365 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower551 in 134.0 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 [WARN] [02/03/2025 17:31:49.367] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower552]: org.opendaylight.controller.cluster.common.actor.Monitor@2265480a [INFO] [pekkoDeadLetter][02/03/2025 17:31:49.367] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower552] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 05:31:49,367 PM [test-pekko.actor.default-dispatcher-7] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower552] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 05:31:49,367 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - follower551: Recovery completed in 2.200 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:49,367 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower551: Set currentTerm=1, votedFor=null 05:31:49,368 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - follower551: Local TermInfo store seeded with TermInfo{term=1} 05:31:49,368 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - follower551: Snapshot capture initiated after recovery due to migrated messages 05:31:49,368 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - follower551: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:49,368 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower552: Starting recovery with journal batch size 1000 05:31:49,368 PM [test-pekko.actor.default-dispatcher-7] [INFO] SnapshotManager - follower551: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:49,368 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - follower551: lastSequenceNumber prior to capture: 0 05:31:49,369 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorSnapshotMessageSupport - follower551: CaptureSnapshotReply received by actor 05:31:49,369 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - follower551: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=follower552, isVoting=false], ServerInfo[peerId=leader549, isVoting=true], ServerInfo[peerId=follower550, isVoting=true], ServerInfo[peerId=follower551, isVoting=true]]}] 05:31:49,369 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - follower551: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:49,369 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorSnapshotMessageSupport - follower551: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:49,369 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SnapshotManager - follower551: Snapshot success - sequence number: -1 05:31:49,369 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorSnapshotMessageSupport - follower551: SnapshotComplete received 05:31:49,369 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorRecoverySupport - follower552: SnapshotOffer called. 05:31:49,369 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorContextImpl - follower552: Moving last applied index from -1 to -1 05:31:49,369 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceTermInfoStore - follower552: Set currentTerm=1, votedFor=null 05:31:49,369 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorContextImpl - follower552: Updated server config: isVoting: false, peers: [PeerInfo [id=leader549, address=pekko://test/user/leader549, votingState=VOTING], PeerInfo [id=follower551, address=pekko://test/user/follower551, votingState=VOTING], PeerInfo [id=follower550, address=pekko://test/user/follower550, votingState=VOTING]] 05:31:49,369 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower551: handled a snapshot response 05:31:49,369 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower551: handled a journal response 05:31:49,369 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower552 in 105.1 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:49,370 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - follower552: Recovery completed in 949.3 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:49,370 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PersistenceTermInfoStore - follower552: Set currentTerm=1, votedFor=null 05:31:49,370 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - follower552: Local TermInfo store seeded with TermInfo{term=1} 05:31:49,370 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - follower552: Snapshot capture initiated after recovery due to migrated messages 05:31:49,370 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SnapshotManager - follower552: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:49,370 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - follower552: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:49,370 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SnapshotManager - follower552: lastSequenceNumber prior to capture: 0 05:31:49,371 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorSnapshotMessageSupport - follower552: CaptureSnapshotReply received by actor 05:31:49,371 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - follower552: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=leader549, isVoting=true], ServerInfo[peerId=follower551, isVoting=true], ServerInfo[peerId=follower550, isVoting=true], ServerInfo[peerId=follower552, isVoting=false]]}] 05:31:49,372 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - follower552: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:49,372 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorSnapshotMessageSupport - follower552: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:49,372 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SnapshotManager - follower552: Snapshot success - sequence number: -1 05:31:49,372 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorSnapshotMessageSupport - follower552: SnapshotComplete received 05:31:49,372 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower552: handled a snapshot response 05:31:49,372 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower552: handled a journal response 05:31:49,469 PM [test-pekko.actor.default-dispatcher-4] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader549] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [02/03/2025 17:31:49.469] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader549]: org.opendaylight.controller.cluster.common.actor.Monitor@7c0a7622 05:31:49,469 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - leader549: Starting recovery with journal batch size 1000 [INFO] [pekkoDeadLetter][02/03/2025 17:31:49.469] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader549] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 05:31:49,469 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorRecoverySupport - leader549: SnapshotOffer called. 05:31:49,469 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorContextImpl - leader549: Moving last applied index from -1 to -1 05:31:49,469 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - leader549: Set currentTerm=1, votedFor=null 05:31:49,469 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorContextImpl - leader549: Updated server config: isVoting: true, peers: [PeerInfo [id=follower552, address=pekko://test/user/follower552, votingState=NON_VOTING], PeerInfo [id=follower551, address=pekko://test/user/follower551, votingState=VOTING], PeerInfo [id=follower550, address=pekko://test/user/follower550, votingState=VOTING]] 05:31:49,470 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for leader549 in 85.85 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:49,470 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - leader549: Recovery completed in 730.3 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:49,470 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - leader549: Set currentTerm=1, votedFor=null 05:31:49,470 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - leader549: Local TermInfo store seeded with TermInfo{term=1} 05:31:49,470 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - leader549: Snapshot capture initiated after recovery due to migrated messages 05:31:49,470 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - leader549: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:49,470 PM [test-pekko.actor.default-dispatcher-7] [INFO] SnapshotManager - leader549: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:49,470 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - leader549: lastSequenceNumber prior to capture: 0 05:31:49,473 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorSnapshotMessageSupport - leader549: CaptureSnapshotReply received by actor 05:31:49,473 PM [test-pekko.actor.default-dispatcher-7] [INFO] SnapshotManager - leader549: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=follower552, isVoting=false], ServerInfo[peerId=follower551, isVoting=true], ServerInfo[peerId=follower550, isVoting=true], ServerInfo[peerId=leader549, isVoting=true]]}] 05:31:49,473 PM [test-pekko.actor.default-dispatcher-7] [INFO] SnapshotManager - leader549: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:49,473 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorSnapshotMessageSupport - leader549: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:49,473 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - leader549: Snapshot success - sequence number: -1 05:31:49,473 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorSnapshotMessageSupport - leader549: SnapshotComplete received 05:31:49,473 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader549: handled a snapshot response 05:31:49,473 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader549: handled a journal response 05:31:49,795 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 05:31:49,795 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - leader549 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.87:17355, Removed) 05:31:49,795 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - leader549 (Follower): Received ElectionTimeout - switching to Candidate 05:31:49,795 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader549 (Candidate): Election: Candidate has following voting peers: [follower551, follower550] 05:31:49,795 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - leader549: Set currentTerm=2, votedFor=leader549 05:31:49,795 PM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - leader549 (Candidate): Starting new election term 2 05:31:49,795 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader549 (Candidate): Sending RequestVote{term=2, candidateId=leader549, lastLogIndex=-1, lastLogTerm=-1} to peer follower551 05:31:49,795 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader549 (Candidate): Sending RequestVote{term=2, candidateId=leader549, lastLogIndex=-1, lastLogTerm=-1} to peer follower550 05:31:49,795 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower551 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 05:31:49,795 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - leader549 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 05:31:49,795 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower551 (Follower): Cluster state: [] 05:31:49,795 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower551 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader549, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 05:31:49,795 PM [test-pekko.actor.default-dispatcher-14] [INFO] Follower - follower551 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader549, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 05:31:49,795 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceTermInfoStore - follower551: Set currentTerm=2, votedFor=null 05:31:49,795 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorBehavior - follower550 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 05:31:49,795 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower551 (Follower): In requestVote: RequestVote{term=2, candidateId=leader549, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 05:31:49,795 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceTermInfoStore - follower551: Set currentTerm=2, votedFor=leader549 05:31:49,795 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower551 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 05:31:49,796 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorBehavior - follower550 (Follower): Cluster state: [] 05:31:49,796 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorBehavior - follower550 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader549, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 05:31:49,796 PM [test-pekko.actor.default-dispatcher-4] [INFO] Follower - follower550 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader549, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 05:31:49,796 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PersistenceTermInfoStore - follower550: Set currentTerm=2, votedFor=null 05:31:49,796 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorBehavior - follower550 (Follower): In requestVote: RequestVote{term=2, candidateId=leader549, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 05:31:49,796 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PersistenceTermInfoStore - follower550: Set currentTerm=2, votedFor=leader549 05:31:49,796 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorBehavior - follower550 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 05:31:49,796 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - leader549 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 05:31:49,796 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - leader549 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 05:31:49,797 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader549 (Leader): Election: Leader has following peers: [follower552, follower551, follower550] 05:31:49,797 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader549 (Leader): Checking sendAppendEntries for follower follower552: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:49,797 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader549 (Leader): Checking sendAppendEntries for follower follower551: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:49,797 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader549 (Leader): Checking sendAppendEntries for follower follower550: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:49,797 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorBehavior - leader549 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 05:31:49,797 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower551: Last sync leader does not match current leader leader549, need to catch up to -1 05:31:49,797 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower550: Last sync leader does not match current leader leader549, need to catch up to -1 [WARN] [02/03/2025 17:31:49.797] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/follower551] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@1f577e3b [INFO] [pekkoDeadLetter][02/03/2025 17:31:49.797] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/follower551] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower551] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 05:31:49,798 PM [test-pekko.actor.default-dispatcher-5] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower551] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [02/03/2025 17:31:49.798] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower550] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@29e0e2ee [INFO] [pekkoDeadLetter][02/03/2025 17:31:49.798] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower550] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower550] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 05:31:49,798 PM [test-pekko.actor.default-dispatcher-14] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower550] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 05:31:49,797 PM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower552 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader549, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term 05:31:49,798 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader549 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower551 updated: matchIndex: -1, nextIndex: 0 05:31:49,798 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower552: Set currentTerm=2, votedFor=null 05:31:49,798 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader549 (Leader): Checking sendAppendEntries for follower follower551: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:49,798 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower552: Last sync leader does not match current leader leader549, need to catch up to -1 05:31:49,798 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader549 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower550 updated: matchIndex: -1, nextIndex: 0 05:31:49,798 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader549 (Leader): Checking sendAppendEntries for follower follower550: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:49,798 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader549 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower552 updated: matchIndex: -1, nextIndex: 0 05:31:49,798 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader549 (Leader): Checking sendAppendEntries for follower follower552: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [02/03/2025 17:31:49.799] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower552] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@4c283332 05:31:49,799 PM [test-pekko.actor.default-dispatcher-18] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower552] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][02/03/2025 17:31:49.799] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower552] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower552] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 05:31:49,820 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 05:31:49,820 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader549 starting 05:31:49,822 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader549: onShutDown 05:31:49,822 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader549: Initiating leader transfer 05:31:49,823 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader549: pauseLeader successfully completed - doing transfer 05:31:49,823 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Leader - leader549 (Leader): Attempting to transfer leadership 05:31:49,823 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader549 (Leader): Checking sendAppendEntries for follower follower552: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:49,823 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader549 (Leader): Checking sendAppendEntries for follower follower551: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:49,823 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader549 (Leader): Checking sendAppendEntries for follower follower550: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:49,823 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower552: Lagging 0 entries behind leader leader549 and reached -1 (of expected -1) 05:31:49,823 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower552: onLeaderTransitioning: LeaderTransitioning [leaderId=leader549] 05:31:49,823 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower551: Lagging 0 entries behind leader leader549 and reached -1 (of expected -1) 05:31:49,823 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower551: onLeaderTransitioning: LeaderTransitioning [leaderId=leader549] 05:31:49,823 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower550: Lagging 0 entries behind leader leader549 and reached -1 (of expected -1) 05:31:49,823 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower550: onLeaderTransitioning: LeaderTransitioning [leaderId=leader549] [WARN] [02/03/2025 17:31:49.824] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower552] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@67804825 [WARN] [02/03/2025 17:31:49.824] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower551] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@ccb115d [WARN] [02/03/2025 17:31:49.824] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower550] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2dffc993 [INFO] [pekkoDeadLetter][02/03/2025 17:31:49.824] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower552] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower552] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][02/03/2025 17:31:49.824] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower551] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower551] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 05:31:49,824 PM [test-pekko.actor.default-dispatcher-7] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower552] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 05:31:49,824 PM [test-pekko.actor.default-dispatcher-7] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower551] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][02/03/2025 17:31:49.824] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower550] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower550] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 05:31:49,824 PM [test-pekko.actor.default-dispatcher-4] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower550] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 05:31:49,914 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SyncStatusTracker - follower552: Lagging 0 entries behind leader leader549 and reached -1 (of expected -1) 05:31:49,914 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower551: Lagging 0 entries behind leader leader549 and reached -1 (of expected -1) 05:31:49,914 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SyncStatusTracker - follower550: Lagging 0 entries behind leader leader549 and reached -1 (of expected -1) 05:31:50,35 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower552: Lagging 0 entries behind leader leader549 and reached -1 (of expected -1) 05:31:50,35 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower551: Lagging 0 entries behind leader leader549 and reached -1 (of expected -1) 05:31:50,35 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower550: Lagging 0 entries behind leader leader549 and reached -1 (of expected -1) 05:31:50,154 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader549: leader transfer aborted 05:31:50,154 PM [test-pekko.actor.default-dispatcher-7] [WARN] RaftActorLeadershipTransferCohort - leader549: Failed to transfer leadership in 331.7 ms 05:31:50,154 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader549: leader transfer failed - sending PoisonPill 05:31:50,154 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Leader - leader549 (Leader): Leadership transfer expired 05:31:50,155 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower551: Lagging 0 entries behind leader leader549 and reached -1 (of expected -1) 05:31:50,155 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower550: Lagging 0 entries behind leader leader549 and reached -1 (of expected -1) 05:31:50,155 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower552: Lagging 0 entries behind leader leader549 and reached -1 (of expected -1) [WARN] [02/03/2025 17:31:50.155] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/leader549] received dead letter from TestActor[pekko://test/user/follower550]: AppendEntriesReply{term=2, success=true, followerId=follower550, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} [WARN] [02/03/2025 17:31:50.155] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/leader549] received dead letter from TestActor[pekko://test/user/follower552]: AppendEntriesReply{term=2, success=true, followerId=follower552, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 05:31:50,157 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader549 ending 05:31:50,158 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending 05:31:50,158 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower550-notifier553#-1488324910] 05:31:50,169 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower550-collector554#1825714938] 05:31:50,170 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower550] 05:31:50,170 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower551-notifier555#-953943866] 05:31:50,170 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower551-collector556#845832915] 05:31:50,170 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower551] 05:31:50,171 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower552-notifier557#1708741779] 05:31:50,171 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower552-collector558#1989516880] 05:31:50,171 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower552] 05:31:50,171 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader549-notifier559#-1346372310] 05:31:50,171 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader549-collector560#951451594] 05:31:50,171 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader549] 05:31:50,172 PM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 starting 05:31:50,172 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting [WARN] [02/03/2025 17:31:50.175] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower562]: org.opendaylight.controller.cluster.common.actor.Monitor@7993907a 05:31:50,176 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower562: Starting recovery with journal batch size 1000 05:31:50,176 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorRecoverySupport - follower562: SnapshotOffer called. 05:31:50,176 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorContextImpl - follower562: Moving last applied index from -1 to -1 05:31:50,176 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower562: Set currentTerm=1, votedFor=null 05:31:50,176 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorContextImpl - follower562: Updated server config: isVoting: true, peers: [PeerInfo [id=follower564, address=pekko://test/user/follower564, votingState=NON_VOTING], PeerInfo [id=follower563, address=pekko://test/user/follower563, votingState=VOTING], PeerInfo [id=leader561, address=pekko://test/user/leader561, votingState=VOTING]] 05:31:50,176 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower562 in 104.4 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:50,177 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorRecoverySupport - follower562: Recovery completed in 905.4 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:50,177 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower562: Set currentTerm=1, votedFor=null 05:31:50,177 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorRecoverySupport - follower562: Local TermInfo store seeded with TermInfo{term=1} 05:31:50,177 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorRecoverySupport - follower562: Snapshot capture initiated after recovery due to migrated messages 05:31:50,177 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - follower562: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:50,177 PM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - follower562: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:50,178 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - follower562: lastSequenceNumber prior to capture: 0 05:31:50,178 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorSnapshotMessageSupport - follower562: CaptureSnapshotReply received by actor 05:31:50,179 PM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - follower562: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=follower564, isVoting=false], ServerInfo[peerId=follower563, isVoting=true], ServerInfo[peerId=leader561, isVoting=true], ServerInfo[peerId=follower562, isVoting=true]]}] 05:31:50,179 PM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - follower562: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:50,179 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorSnapshotMessageSupport - follower562: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:50,179 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - follower562: Snapshot success - sequence number: -1 05:31:50,179 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorSnapshotMessageSupport - follower562: SnapshotComplete received 05:31:50,179 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower562: handled a snapshot response 05:31:50,179 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower562: handled a journal response [WARN] [02/03/2025 17:31:50.276] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower563]: org.opendaylight.controller.cluster.common.actor.Monitor@16b92722 05:31:50,277 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower563: Starting recovery with journal batch size 1000 05:31:50,278 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorRecoverySupport - follower563: SnapshotOffer called. 05:31:50,278 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorContextImpl - follower563: Moving last applied index from -1 to -1 05:31:50,278 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower563: Set currentTerm=1, votedFor=null 05:31:50,278 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorContextImpl - follower563: Updated server config: isVoting: true, peers: [PeerInfo [id=follower564, address=pekko://test/user/follower564, votingState=NON_VOTING], PeerInfo [id=leader561, address=pekko://test/user/leader561, votingState=VOTING], PeerInfo [id=follower562, address=pekko://test/user/follower562, votingState=VOTING]] 05:31:50,278 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower563 in 75.65 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:50,279 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorRecoverySupport - follower563: Recovery completed in 1.027 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:50,279 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower563: Set currentTerm=1, votedFor=null 05:31:50,279 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorRecoverySupport - follower563: Local TermInfo store seeded with TermInfo{term=1} 05:31:50,279 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorRecoverySupport - follower563: Snapshot capture initiated after recovery due to migrated messages 05:31:50,279 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - follower563: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:50,279 PM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - follower563: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:50,279 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - follower563: lastSequenceNumber prior to capture: 0 [WARN] [02/03/2025 17:31:50.279] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower564]: org.opendaylight.controller.cluster.common.actor.Monitor@d153909 05:31:50,280 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - follower564: Starting recovery with journal batch size 1000 05:31:50,280 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorSnapshotMessageSupport - follower563: CaptureSnapshotReply received by actor 05:31:50,280 PM [test-pekko.actor.default-dispatcher-14] [INFO] SnapshotManager - follower563: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=follower564, isVoting=false], ServerInfo[peerId=leader561, isVoting=true], ServerInfo[peerId=follower562, isVoting=true], ServerInfo[peerId=follower563, isVoting=true]]}] 05:31:50,280 PM [test-pekko.actor.default-dispatcher-14] [INFO] SnapshotManager - follower563: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:50,281 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorSnapshotMessageSupport - follower563: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:50,281 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - follower563: Snapshot success - sequence number: -1 05:31:50,281 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorSnapshotMessageSupport - follower563: SnapshotComplete received 05:31:50,281 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower563: handled a journal response [WARN] [02/03/2025 17:31:50.281] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader561]: org.opendaylight.controller.cluster.common.actor.Monitor@6240d284 05:31:50,281 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorRecoverySupport - follower564: SnapshotOffer called. 05:31:50,281 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorContextImpl - follower564: Moving last applied index from -1 to -1 05:31:50,281 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower564: Set currentTerm=1, votedFor=null 05:31:50,282 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorContextImpl - follower564: Updated server config: isVoting: false, peers: [PeerInfo [id=follower563, address=pekko://test/user/follower563, votingState=VOTING], PeerInfo [id=leader561, address=pekko://test/user/leader561, votingState=VOTING], PeerInfo [id=follower562, address=pekko://test/user/follower562, votingState=VOTING]] 05:31:50,282 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower564 in 103.7 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:50,282 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - leader561: Starting recovery with journal batch size 1000 05:31:50,282 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower563: handled a snapshot response 05:31:50,282 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorRecoverySupport - leader561: SnapshotOffer called. 05:31:50,282 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorContextImpl - leader561: Moving last applied index from -1 to -1 05:31:50,282 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - leader561: Set currentTerm=1, votedFor=null 05:31:50,282 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorContextImpl - leader561: Updated server config: isVoting: true, peers: [PeerInfo [id=follower564, address=pekko://test/user/follower564, votingState=NON_VOTING], PeerInfo [id=follower563, address=pekko://test/user/follower563, votingState=VOTING], PeerInfo [id=follower562, address=pekko://test/user/follower562, votingState=VOTING]] 05:31:50,282 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - follower564: Recovery completed in 842.7 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:50,282 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PersistenceTermInfoStore - follower564: Set currentTerm=1, votedFor=null 05:31:50,282 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for leader561 in 57.27 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:50,282 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - follower564: Local TermInfo store seeded with TermInfo{term=1} 05:31:50,283 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - follower564: Snapshot capture initiated after recovery due to migrated messages 05:31:50,283 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SnapshotManager - follower564: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:50,283 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - follower564: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:50,283 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SnapshotManager - follower564: lastSequenceNumber prior to capture: 0 05:31:50,283 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorRecoverySupport - leader561: Recovery completed in 454.9 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:50,283 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceTermInfoStore - leader561: Set currentTerm=1, votedFor=null 05:31:50,283 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorRecoverySupport - leader561: Local TermInfo store seeded with TermInfo{term=1} 05:31:50,283 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorRecoverySupport - leader561: Snapshot capture initiated after recovery due to migrated messages 05:31:50,283 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SnapshotManager - leader561: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:50,283 PM [test-pekko.actor.default-dispatcher-14] [INFO] SnapshotManager - leader561: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:50,283 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SnapshotManager - leader561: lastSequenceNumber prior to capture: 0 05:31:50,284 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorSnapshotMessageSupport - follower564: CaptureSnapshotReply received by actor 05:31:50,284 PM [test-pekko.actor.default-dispatcher-18] [INFO] SnapshotManager - follower564: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=follower563, isVoting=true], ServerInfo[peerId=leader561, isVoting=true], ServerInfo[peerId=follower562, isVoting=true], ServerInfo[peerId=follower564, isVoting=false]]}] 05:31:50,284 PM [test-pekko.actor.default-dispatcher-18] [INFO] SnapshotManager - follower564: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:50,284 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorSnapshotMessageSupport - follower564: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:50,284 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - follower564: Snapshot success - sequence number: -1 05:31:50,284 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorSnapshotMessageSupport - leader561: CaptureSnapshotReply received by actor 05:31:50,284 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorSnapshotMessageSupport - follower564: SnapshotComplete received 05:31:50,284 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower564: handled a journal response 05:31:50,284 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - leader561: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=follower564, isVoting=false], ServerInfo[peerId=follower563, isVoting=true], ServerInfo[peerId=follower562, isVoting=true], ServerInfo[peerId=leader561, isVoting=true]]}] 05:31:50,284 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - leader561: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:50,285 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - follower564: handled a snapshot response 05:31:50,285 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorSnapshotMessageSupport - leader561: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:50,285 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SnapshotManager - leader561: Snapshot success - sequence number: -1 05:31:50,285 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorSnapshotMessageSupport - leader561: SnapshotComplete received 05:31:50,285 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - leader561: handled a journal response 05:31:50,285 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - leader561: handled a snapshot response 05:31:50,675 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 05:31:50,675 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader561 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.87:17355, Removed) 05:31:50,675 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader561 (Follower): Received ElectionTimeout - switching to Candidate 05:31:50,675 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader561 (Candidate): Election: Candidate has following voting peers: [follower563, follower562] 05:31:50,675 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - leader561: Set currentTerm=2, votedFor=leader561 05:31:50,675 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader561 (Candidate): Starting new election term 2 05:31:50,675 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader561 (Candidate): Sending RequestVote{term=2, candidateId=leader561, lastLogIndex=-1, lastLogTerm=-1} to peer follower563 05:31:50,675 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader561 (Candidate): Sending RequestVote{term=2, candidateId=leader561, lastLogIndex=-1, lastLogTerm=-1} to peer follower562 05:31:50,675 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader561 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 05:31:50,676 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower563 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 05:31:50,676 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower563 (Follower): Cluster state: [] 05:31:50,676 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower563 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader561, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 05:31:50,676 PM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower563 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader561, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 05:31:50,676 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower563: Set currentTerm=2, votedFor=null 05:31:50,676 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower563 (Follower): In requestVote: RequestVote{term=2, candidateId=leader561, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 05:31:50,676 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower563: Set currentTerm=2, votedFor=leader561 05:31:50,676 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower563 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 05:31:50,676 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower562 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 05:31:50,676 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower562 (Follower): Cluster state: [] 05:31:50,676 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower562 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader561, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 05:31:50,676 PM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower562 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader561, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 05:31:50,676 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower562: Set currentTerm=2, votedFor=null 05:31:50,676 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower562 (Follower): In requestVote: RequestVote{term=2, candidateId=leader561, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 05:31:50,676 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower562: Set currentTerm=2, votedFor=leader561 05:31:50,676 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower562 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 05:31:50,677 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader561 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 05:31:50,677 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader561 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 05:31:50,677 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader561 (Leader): Election: Leader has following peers: [follower564, follower563, follower562] 05:31:50,677 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader561 (Leader): Checking sendAppendEntries for follower follower564: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:50,677 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader561 (Leader): Checking sendAppendEntries for follower follower563: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:50,677 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader561 (Leader): Checking sendAppendEntries for follower follower562: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:50,677 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader561 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 05:31:50,677 PM [test-pekko.actor.default-dispatcher-4] [INFO] Follower - follower564 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader561, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term 05:31:50,677 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PersistenceTermInfoStore - follower564: Set currentTerm=2, votedFor=null 05:31:50,677 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower562: Last sync leader does not match current leader leader561, need to catch up to -1 05:31:50,677 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SyncStatusTracker - follower564: Last sync leader does not match current leader leader561, need to catch up to -1 05:31:50,677 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower563: Last sync leader does not match current leader leader561, need to catch up to -1 [WARN] [02/03/2025 17:31:50.677] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower562] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@738b4c8e 05:31:50,678 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader561 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower562 updated: matchIndex: -1, nextIndex: 0 05:31:50,678 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader561 (Leader): Checking sendAppendEntries for follower follower562: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [02/03/2025 17:31:50.678] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower563] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@79d64161 05:31:50,678 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader561 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower564 updated: matchIndex: -1, nextIndex: 0 05:31:50,678 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader561 (Leader): Checking sendAppendEntries for follower follower564: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:50,678 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader561 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower563 updated: matchIndex: -1, nextIndex: 0 05:31:50,678 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader561 (Leader): Checking sendAppendEntries for follower follower563: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [02/03/2025 17:31:50.678] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower564] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2ab6bc99 05:31:50,686 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 05:31:50,686 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting 05:31:50,687 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending 05:31:50,687 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting 05:31:50,687 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending 05:31:50,688 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader561: onRequestLeadership RequestLeadership [requestedFollowerId=follower563, replyTo=Actor[pekko://test/user/$a#1326700673]] 05:31:50,689 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader561: Initiating leader transfer 05:31:50,689 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower564: onLeaderTransitioning: LeaderTransitioning [leaderId=leader561] 05:31:50,689 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower563: onLeaderTransitioning: LeaderTransitioning [leaderId=leader561] 05:31:50,690 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader561: pauseLeader successfully completed - doing transfer 05:31:50,690 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Leader - leader561 (Leader): Attempting to transfer leadership 05:31:50,690 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower562: onLeaderTransitioning: LeaderTransitioning [leaderId=leader561] 05:31:50,690 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader561 (Leader): Checking sendAppendEntries for follower follower564: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:50,690 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader561 (Leader): Checking sendAppendEntries for follower follower563: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:50,690 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower564: Lagging 0 entries behind leader leader561 and reached -1 (of expected -1) 05:31:50,690 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower563: Lagging 0 entries behind leader leader561 and reached -1 (of expected -1) 05:31:50,690 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader561 (Leader): Checking sendAppendEntries for follower follower562: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [02/03/2025 17:31:50.690] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/follower564] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5b2b874a [WARN] [02/03/2025 17:31:50.690] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/follower563] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@51ee7d88 05:31:50,690 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower562: Lagging 0 entries behind leader leader561 and reached -1 (of expected -1) [WARN] [02/03/2025 17:31:50.690] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower562] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@9beb8e7 05:31:50,690 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Leader - leader561 (Leader): tryToCompleteLeadershipTransfer: followerId: follower563, matchIndex: -1, lastIndex: -1, isVoting: true 05:31:50,690 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Leader - leader561 (Leader): Follower's log matches - sending ElectionTimeout 05:31:50,690 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader561 (Leader): Checking sendAppendEntries for follower follower564: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:50,690 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader561 (Leader): Checking sendAppendEntries for follower follower563: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:50,691 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower564: Lagging 0 entries behind leader leader561 and reached -1 (of expected -1) 05:31:50,691 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower563: Lagging 0 entries behind leader leader561 and reached -1 (of expected -1) 05:31:50,691 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader561 (Leader): Checking sendAppendEntries for follower follower562: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:50,691 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SyncStatusTracker - follower562: Lagging 0 entries behind leader leader561 and reached -1 (of expected -1) 05:31:50,691 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 05:31:50,691 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower563 (Follower): Received TimeoutNow - switching to Candidate 05:31:50,691 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - follower563 (Candidate): Election: Candidate has following voting peers: [leader561, follower562] 05:31:50,691 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceTermInfoStore - follower563: Set currentTerm=3, votedFor=follower563 05:31:50,691 PM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - follower563 (Candidate): Starting new election term 3 05:31:50,691 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - follower563 (Candidate): Sending RequestVote{term=3, candidateId=follower563, lastLogIndex=-1, lastLogTerm=-1} to peer leader561 05:31:50,691 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - follower563 (Candidate): Sending RequestVote{term=3, candidateId=follower563, lastLogIndex=-1, lastLogTerm=-1} to peer follower562 05:31:50,691 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - follower563 (Follower) :- Switching from behavior Follower to Candidate, election term: 3 05:31:50,691 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower562 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 05:31:50,691 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower562 (Follower): Cluster state: [] 05:31:50,691 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower562 (Follower): Candidate in requestVote:RequestVote{term=3, candidateId=follower563, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 05:31:50,691 PM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - follower562 (Follower): Term 3 in "RequestVote{term=3, candidateId=follower563, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 2 - updating term 05:31:50,691 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower562: Set currentTerm=3, votedFor=null 05:31:50,691 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower562 (Follower): In requestVote: RequestVote{term=3, candidateId=follower563, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1 05:31:50,691 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower562: Set currentTerm=3, votedFor=follower563 05:31:50,692 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower562 (Follower): requestVote returning: RequestVoteReply{term=3, voteGranted=true} 05:31:50,692 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - follower563 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3 05:31:50,692 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - follower563 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1 05:31:50,693 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - follower563 (Leader): Election: Leader has following peers: [follower564, leader561, follower562] 05:31:50,693 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - follower563 (Leader): Checking sendAppendEntries for follower follower564: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:50,693 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - follower563 (Leader): Checking sendAppendEntries for follower leader561: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:50,693 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - follower563 (Leader): Checking sendAppendEntries for follower follower562: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:50,693 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - follower563 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3 05:31:50,693 PM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - follower564 (Follower): Term 3 in "AppendEntries{term=3, leaderId=follower563, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 2 - updating term 05:31:50,693 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower564: Set currentTerm=3, votedFor=null 05:31:50,693 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower562: Last sync leader does not match current leader follower563, need to catch up to -1 05:31:50,693 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - follower563 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower562 updated: matchIndex: -1, nextIndex: 0 05:31:50,693 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower564: Last sync leader does not match current leader follower563, need to catch up to -1 05:31:50,693 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - follower563 (Leader): Checking sendAppendEntries for follower follower562: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [02/03/2025 17:31:50.693] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower562] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@68a64731 05:31:50,693 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - follower563 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower564 updated: matchIndex: -1, nextIndex: 0 05:31:50,693 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - follower563 (Leader): Checking sendAppendEntries for follower follower564: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:50,693 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Leader - leader561 (Leader): Leader transfer complete 05:31:50,693 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader561: leader transfer complete - waiting for new leader [WARN] [02/03/2025 17:31:50.693] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower564] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5cbe8aa9 05:31:50,694 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader561 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 05:31:50,694 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader561 (Leader): Cluster state: [] 05:31:50,694 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader561 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower563, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 05:31:50,694 PM [test-pekko.actor.default-dispatcher-5] [INFO] AbstractLeader - leader561 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower563, lastLogIndex=-1, lastLogTerm=-1}" message is greater than leader's term 2 - switching to Follower 05:31:50,694 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceTermInfoStore - leader561: Set currentTerm=3, votedFor=null 05:31:50,694 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader561 (Leader): Leadership transfer in progress - processing RequestVote 05:31:50,694 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader561 (Leader): In requestVote: RequestVote{term=3, candidateId=follower563, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1 05:31:50,694 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceTermInfoStore - leader561: Set currentTerm=3, votedFor=follower563 05:31:50,694 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader561 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true} 05:31:50,694 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader561 (Leader) :- Switching from behavior Leader to Follower, election term: 3 05:31:50,694 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - leader561: Last sync leader does not match current leader follower563, need to catch up to -1 05:31:50,694 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorLeadershipTransferCohort - leader561: leader changed to follower563 05:31:50,694 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - follower563 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader561 updated: matchIndex: -1, nextIndex: 0 05:31:50,694 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorLeadershipTransferCohort - leader561: Successfully transferred leadership to follower563 in 5.165 ms 05:31:50,695 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - follower563 (Leader): Checking sendAppendEntries for follower leader561: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:50,695 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader561: Leadership transferred successfully to follower563 [WARN] [02/03/2025 17:31:50.695] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/leader561] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@1ccee9c4 05:31:50,739 PM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 ending 05:31:50,739 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower562-notifier565#323462073] 05:31:50,740 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower562-collector566#1745241672] 05:31:50,740 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower562] 05:31:50,740 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower563-notifier567#-1394782386] 05:31:50,741 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower563-collector568#-1791186919] 05:31:50,741 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower563] 05:31:50,741 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower564-notifier569#-2017600142] 05:31:50,741 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower564-collector570#423986880] 05:31:50,741 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower564] 05:31:50,741 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader561-notifier571#-1887829414] 05:31:50,742 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader561-collector572#1687339293] 05:31:50,742 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader561] 05:31:50,742 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$a#1326700673] 05:31:50,746 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown starting 05:31:50,746 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting [WARN] [02/03/2025 17:31:50.747] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower574]: org.opendaylight.controller.cluster.common.actor.Monitor@2c9f5d66 05:31:50,748 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower574: Starting recovery with journal batch size 1000 05:31:50,749 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorRecoverySupport - follower574: SnapshotOffer called. 05:31:50,749 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorContextImpl - follower574: Moving last applied index from -1 to -1 05:31:50,749 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - follower574: Set currentTerm=1, votedFor=null 05:31:50,749 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorContextImpl - follower574: Updated server config: isVoting: true, peers: [PeerInfo [id=leader573, address=pekko://test/user/leader573, votingState=VOTING], PeerInfo [id=follower575, address=pekko://test/user/follower575, votingState=VOTING], PeerInfo [id=follower576, address=pekko://test/user/follower576, votingState=NON_VOTING]] 05:31:50,749 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower574 in 126.2 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:50,750 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorRecoverySupport - follower574: Recovery completed in 805.8 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:50,750 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - follower574: Set currentTerm=1, votedFor=null 05:31:50,750 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorRecoverySupport - follower574: Local TermInfo store seeded with TermInfo{term=1} 05:31:50,750 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorRecoverySupport - follower574: Snapshot capture initiated after recovery due to migrated messages 05:31:50,750 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - follower574: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:50,750 PM [test-pekko.actor.default-dispatcher-18] [INFO] SnapshotManager - follower574: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:50,750 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - follower574: lastSequenceNumber prior to capture: 0 05:31:50,751 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorSnapshotMessageSupport - follower574: CaptureSnapshotReply received by actor 05:31:50,751 PM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - follower574: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=leader573, isVoting=true], ServerInfo[peerId=follower575, isVoting=true], ServerInfo[peerId=follower576, isVoting=false], ServerInfo[peerId=follower574, isVoting=true]]}] 05:31:50,751 PM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - follower574: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:50,751 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorSnapshotMessageSupport - follower574: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:50,751 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - follower574: Snapshot success - sequence number: -1 05:31:50,751 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorSnapshotMessageSupport - follower574: SnapshotComplete received 05:31:50,751 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower574: handled a snapshot response 05:31:50,751 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower574: handled a journal response 05:31:50,751 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower575: Starting recovery with journal batch size 1000 [WARN] [02/03/2025 17:31:50.750] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower575]: org.opendaylight.controller.cluster.common.actor.Monitor@5f9a28dd 05:31:50,752 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorRecoverySupport - follower575: SnapshotOffer called. 05:31:50,752 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorContextImpl - follower575: Moving last applied index from -1 to -1 05:31:50,752 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - follower575: Set currentTerm=1, votedFor=null 05:31:50,752 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorContextImpl - follower575: Updated server config: isVoting: true, peers: [PeerInfo [id=leader573, address=pekko://test/user/leader573, votingState=VOTING], PeerInfo [id=follower574, address=pekko://test/user/follower574, votingState=VOTING], PeerInfo [id=follower576, address=pekko://test/user/follower576, votingState=NON_VOTING]] 05:31:50,752 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower575 in 41.43 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:50,752 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorRecoverySupport - follower575: Recovery completed in 391.5 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:50,752 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - follower575: Set currentTerm=1, votedFor=null [WARN] [02/03/2025 17:31:50.752] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower576]: org.opendaylight.controller.cluster.common.actor.Monitor@47821d51 05:31:50,752 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorRecoverySupport - follower575: Local TermInfo store seeded with TermInfo{term=1} 05:31:50,752 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorRecoverySupport - follower575: Snapshot capture initiated after recovery due to migrated messages 05:31:50,752 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - follower575: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:50,752 PM [test-pekko.actor.default-dispatcher-18] [INFO] SnapshotManager - follower575: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:50,752 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - follower575: lastSequenceNumber prior to capture: 0 05:31:50,752 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - follower576: Starting recovery with journal batch size 1000 05:31:50,753 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorSnapshotMessageSupport - follower575: CaptureSnapshotReply received by actor 05:31:50,753 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorRecoverySupport - follower576: SnapshotOffer called. 05:31:50,753 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorContextImpl - follower576: Moving last applied index from -1 to -1 05:31:50,753 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PersistenceTermInfoStore - follower576: Set currentTerm=1, votedFor=null 05:31:50,753 PM [test-pekko.actor.default-dispatcher-18] [INFO] SnapshotManager - follower575: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=leader573, isVoting=true], ServerInfo[peerId=follower574, isVoting=true], ServerInfo[peerId=follower576, isVoting=false], ServerInfo[peerId=follower575, isVoting=true]]}] 05:31:50,753 PM [test-pekko.actor.default-dispatcher-18] [INFO] SnapshotManager - follower575: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:50,753 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorContextImpl - follower576: Updated server config: isVoting: false, peers: [PeerInfo [id=leader573, address=pekko://test/user/leader573, votingState=VOTING], PeerInfo [id=follower575, address=pekko://test/user/follower575, votingState=VOTING], PeerInfo [id=follower574, address=pekko://test/user/follower574, votingState=VOTING]] 05:31:50,753 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorSnapshotMessageSupport - follower575: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:50,753 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - follower575: Snapshot success - sequence number: -1 05:31:50,753 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower576 in 76.20 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:50,753 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorSnapshotMessageSupport - follower575: SnapshotComplete received 05:31:50,753 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower575: handled a snapshot response 05:31:50,753 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower575: handled a journal response 05:31:50,753 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorRecoverySupport - follower576: Recovery completed in 577.6 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:50,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower576: Set currentTerm=1, votedFor=null 05:31:50,754 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorRecoverySupport - follower576: Local TermInfo store seeded with TermInfo{term=1} 05:31:50,754 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorRecoverySupport - follower576: Snapshot capture initiated after recovery due to migrated messages 05:31:50,754 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - follower576: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. [WARN] [02/03/2025 17:31:50.754] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader573]: org.opendaylight.controller.cluster.common.actor.Monitor@50ec612a 05:31:50,754 PM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - follower576: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:50,754 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - follower576: lastSequenceNumber prior to capture: 0 05:31:50,754 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorSnapshotMessageSupport - follower576: CaptureSnapshotReply received by actor 05:31:50,754 PM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - follower576: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=leader573, isVoting=true], ServerInfo[peerId=follower575, isVoting=true], ServerInfo[peerId=follower574, isVoting=true], ServerInfo[peerId=follower576, isVoting=false]]}] 05:31:50,754 PM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - follower576: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:50,755 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - leader573: Starting recovery with journal batch size 1000 05:31:50,755 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorSnapshotMessageSupport - follower576: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:50,755 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - follower576: Snapshot success - sequence number: -1 05:31:50,755 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - follower576: SnapshotComplete received 05:31:50,755 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower576: handled a snapshot response 05:31:50,755 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower576: handled a journal response 05:31:50,755 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorRecoverySupport - leader573: SnapshotOffer called. 05:31:50,755 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorContextImpl - leader573: Moving last applied index from -1 to -1 05:31:50,755 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - leader573: Set currentTerm=1, votedFor=null 05:31:50,755 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorContextImpl - leader573: Updated server config: isVoting: true, peers: [PeerInfo [id=follower575, address=pekko://test/user/follower575, votingState=VOTING], PeerInfo [id=follower574, address=pekko://test/user/follower574, votingState=VOTING], PeerInfo [id=follower576, address=pekko://test/user/follower576, votingState=NON_VOTING]] 05:31:50,755 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for leader573 in 44.59 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:50,755 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorRecoverySupport - leader573: Recovery completed in 489.5 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:50,755 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - leader573: Set currentTerm=1, votedFor=null 05:31:50,756 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorRecoverySupport - leader573: Local TermInfo store seeded with TermInfo{term=1} 05:31:50,756 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorRecoverySupport - leader573: Snapshot capture initiated after recovery due to migrated messages 05:31:50,756 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - leader573: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:50,756 PM [test-pekko.actor.default-dispatcher-18] [INFO] SnapshotManager - leader573: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:50,756 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - leader573: lastSequenceNumber prior to capture: 0 05:31:50,756 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorSnapshotMessageSupport - leader573: CaptureSnapshotReply received by actor 05:31:50,756 PM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - leader573: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=follower575, isVoting=true], ServerInfo[peerId=follower574, isVoting=true], ServerInfo[peerId=follower576, isVoting=false], ServerInfo[peerId=leader573, isVoting=true]]}] 05:31:50,756 PM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - leader573: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:50,756 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorSnapshotMessageSupport - leader573: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:50,756 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - leader573: Snapshot success - sequence number: -1 05:31:50,756 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorSnapshotMessageSupport - leader573: SnapshotComplete received 05:31:50,756 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader573: handled a snapshot response 05:31:50,756 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader573: handled a journal response 05:31:51,144 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 05:31:51,144 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader573 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.87:17355, Removed) 05:31:51,144 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader573 (Follower): Received ElectionTimeout - switching to Candidate 05:31:51,144 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader573 (Candidate): Election: Candidate has following voting peers: [follower575, follower574] 05:31:51,144 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceTermInfoStore - leader573: Set currentTerm=2, votedFor=leader573 05:31:51,144 PM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - leader573 (Candidate): Starting new election term 2 05:31:51,145 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader573 (Candidate): Sending RequestVote{term=2, candidateId=leader573, lastLogIndex=-1, lastLogTerm=-1} to peer follower575 05:31:51,145 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader573 (Candidate): Sending RequestVote{term=2, candidateId=leader573, lastLogIndex=-1, lastLogTerm=-1} to peer follower574 05:31:51,145 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader573 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 05:31:51,145 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower575 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 05:31:51,145 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower574 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 05:31:51,145 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower575 (Follower): Cluster state: [] 05:31:51,145 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower574 (Follower): Cluster state: [] 05:31:51,145 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower574 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader573, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 05:31:51,145 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower575 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader573, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 05:31:51,145 PM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - follower574 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader573, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 05:31:51,145 PM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower575 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader573, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 05:31:51,145 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower574: Set currentTerm=2, votedFor=null 05:31:51,145 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower575: Set currentTerm=2, votedFor=null 05:31:51,145 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower575 (Follower): In requestVote: RequestVote{term=2, candidateId=leader573, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 05:31:51,145 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower575: Set currentTerm=2, votedFor=leader573 05:31:51,145 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower574 (Follower): In requestVote: RequestVote{term=2, candidateId=leader573, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 05:31:51,145 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower574: Set currentTerm=2, votedFor=leader573 05:31:51,145 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower575 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 05:31:51,145 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower574 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 05:31:51,146 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader573 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 05:31:51,146 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader573 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 05:31:51,146 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader573 (Leader): Election: Leader has following peers: [follower575, follower574, follower576] 05:31:51,146 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader573 (Leader): Checking sendAppendEntries for follower follower575: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:51,146 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader573 (Leader): Checking sendAppendEntries for follower follower574: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:51,146 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader573 (Leader): Checking sendAppendEntries for follower follower576: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:51,146 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader573 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 05:31:51,146 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SyncStatusTracker - follower575: Last sync leader does not match current leader leader573, need to catch up to -1 05:31:51,146 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader573 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower575 updated: matchIndex: -1, nextIndex: 0 05:31:51,147 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader573 (Leader): Checking sendAppendEntries for follower follower575: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:51,147 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower574: Last sync leader does not match current leader leader573, need to catch up to -1 05:31:51,147 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader573 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower574 updated: matchIndex: -1, nextIndex: 0 05:31:51,147 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader573 (Leader): Checking sendAppendEntries for follower follower574: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:51,147 PM [test-pekko.actor.default-dispatcher-14] [INFO] Follower - follower576 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader573, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term 05:31:51,147 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceTermInfoStore - follower576: Set currentTerm=2, votedFor=null [WARN] [02/03/2025 17:31:51.147] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/follower575] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@538f3668 [WARN] [02/03/2025 17:31:51.147] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/follower574] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@109f2396 05:31:51,147 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower576: Last sync leader does not match current leader leader573, need to catch up to -1 05:31:51,147 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader573 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower576 updated: matchIndex: -1, nextIndex: 0 05:31:51,147 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader573 (Leader): Checking sendAppendEntries for follower follower576: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [02/03/2025 17:31:51.148] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower576] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@1d8993e1 05:31:51,158 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 05:31:51,158 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting 05:31:51,159 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending 05:31:51,159 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower575 starting 05:31:51,159 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower575: onShutDown 05:31:51,159 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower575 ending 05:31:51,159 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting 05:31:51,159 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending 05:31:51,159 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader573: onRequestLeadership RequestLeadership [requestedFollowerId=follower575, replyTo=Actor[pekko://test/user/$b#-1273929460]] 05:31:51,160 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader573: Initiating leader transfer 05:31:51,160 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader573: pauseLeader successfully completed - doing transfer 05:31:51,160 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader573 (Leader): Attempting to transfer leadership 05:31:51,160 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader573 (Leader): Checking sendAppendEntries for follower follower575: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:51,160 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader573 (Leader): Checking sendAppendEntries for follower follower574: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:51,160 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader573 (Leader): Checking sendAppendEntries for follower follower576: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:51,160 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower576: onLeaderTransitioning: LeaderTransitioning [leaderId=leader573] [WARN] [02/03/2025 17:31:51.160] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower575] received dead letter from TestActor[pekko://test/user/leader573]: LeaderTransitioning [leaderId=leader573] 05:31:51,160 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower576: Lagging 0 entries behind leader leader573 and reached -1 (of expected -1) [WARN] [02/03/2025 17:31:51.160] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower575] received dead letter from TestActor[pekko://test/user/leader573]: AppendEntries{term=2, leaderId=leader573, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} [WARN] [02/03/2025 17:31:51.160] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower576] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@517250fa 05:31:51,160 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower574: Lagging 0 entries behind leader leader573 and reached -1 (of expected -1) 05:31:51,161 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower574: onLeaderTransitioning: LeaderTransitioning [leaderId=leader573] [WARN] [02/03/2025 17:31:51.161] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower574] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@13df5e1f [WARN] [02/03/2025 17:31:51.264] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower575] received dead letter from TestActor[pekko://test/user/leader573]: AppendEntries{term=2, leaderId=leader573, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 05:31:51,265 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower574: Lagging 0 entries behind leader leader573 and reached -1 (of expected -1) 05:31:51,265 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower576: Lagging 0 entries behind leader leader573 and reached -1 (of expected -1) [WARN] [02/03/2025 17:31:51.385] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower575] received dead letter from TestActor[pekko://test/user/leader573]: AppendEntries{term=2, leaderId=leader573, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 05:31:51,385 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower574: Lagging 0 entries behind leader leader573 and reached -1 (of expected -1) 05:31:51,386 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower576: Lagging 0 entries behind leader leader573 and reached -1 (of expected -1) 05:31:51,504 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader573: leader transfer aborted 05:31:51,504 PM [test-pekko.actor.default-dispatcher-7] [WARN] RaftActorLeadershipTransferCohort - leader573: Failed to transfer leadership in 344.4 ms 05:31:51,504 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader573: LeadershipTransfer request from follower575 failed 05:31:51,505 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Leader - leader573 (Leader): Leadership transfer expired 05:31:51,505 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower574: Lagging 0 entries behind leader leader573 and reached -1 (of expected -1) [WARN] [02/03/2025 17:31:51.505] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower575] received dead letter from TestActor[pekko://test/user/leader573]: AppendEntries{term=2, leaderId=leader573, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 05:31:51,506 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower576: Lagging 0 entries behind leader leader573 and reached -1 (of expected -1) 05:31:51,512 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown ending 05:31:51,512 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower574-notifier577#1257897217] 05:31:51,523 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower574-collector578#-1211761289] 05:31:51,524 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower574] 05:31:51,524 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower575-notifier579#872459367] 05:31:51,524 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower575-collector580#-1616374456] 05:31:51,525 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower575] 05:31:51,525 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower576-notifier581#-1604904423] 05:31:51,525 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower576-collector582#-644018270] 05:31:51,525 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower576] 05:31:51,525 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader573-notifier583#-399433526] 05:31:51,526 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader573-collector584#-1542045114] 05:31:51,526 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader573] 05:31:51,526 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$b#-1273929460] 05:31:51,527 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown starting 05:31:51,527 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting [WARN] [02/03/2025 17:31:51.530] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower586]: org.opendaylight.controller.cluster.common.actor.Monitor@7cfabea0 05:31:51,530 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - follower586: Starting recovery with journal batch size 1000 05:31:51,531 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorRecoverySupport - follower586: SnapshotOffer called. 05:31:51,531 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorContextImpl - follower586: Moving last applied index from -1 to -1 05:31:51,531 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - follower586: Set currentTerm=1, votedFor=null 05:31:51,531 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorContextImpl - follower586: Updated server config: isVoting: true, peers: [PeerInfo [id=leader585, address=pekko://test/user/leader585, votingState=VOTING], PeerInfo [id=follower588, address=pekko://test/user/follower588, votingState=NON_VOTING], PeerInfo [id=follower587, address=pekko://test/user/follower587, votingState=VOTING]] [WARN] [02/03/2025 17:31:51.532] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower587]: org.opendaylight.controller.cluster.common.actor.Monitor@60a5f678 05:31:51,533 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower587: Starting recovery with journal batch size 1000 05:31:51,531 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower586 in 229.5 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:51,533 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorRecoverySupport - follower587: SnapshotOffer called. 05:31:51,534 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorContextImpl - follower587: Moving last applied index from -1 to -1 05:31:51,534 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower587: Set currentTerm=1, votedFor=null 05:31:51,534 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorRecoverySupport - follower586: Recovery completed in 2.799 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:51,534 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorContextImpl - follower587: Updated server config: isVoting: true, peers: [PeerInfo [id=leader585, address=pekko://test/user/leader585, votingState=VOTING], PeerInfo [id=follower586, address=pekko://test/user/follower586, votingState=VOTING], PeerInfo [id=follower588, address=pekko://test/user/follower588, votingState=NON_VOTING]] 05:31:51,534 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceTermInfoStore - follower586: Set currentTerm=1, votedFor=null 05:31:51,534 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorRecoverySupport - follower586: Local TermInfo store seeded with TermInfo{term=1} 05:31:51,534 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorRecoverySupport - follower586: Snapshot capture initiated after recovery due to migrated messages 05:31:51,534 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - follower586: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:51,534 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower587 in 81.16 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:51,534 PM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - follower586: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:51,534 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - follower586: lastSequenceNumber prior to capture: 0 [WARN] [02/03/2025 17:31:51.535] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower588]: org.opendaylight.controller.cluster.common.actor.Monitor@7a0e45af 05:31:51,535 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - follower587: Recovery completed in 1.117 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:51,535 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower587: Set currentTerm=1, votedFor=null 05:31:51,535 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - follower587: Local TermInfo store seeded with TermInfo{term=1} 05:31:51,535 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - follower587: Snapshot capture initiated after recovery due to migrated messages 05:31:51,535 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - follower587: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:51,535 PM [test-pekko.actor.default-dispatcher-7] [INFO] SnapshotManager - follower587: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:51,535 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - follower587: lastSequenceNumber prior to capture: 0 05:31:51,535 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower588: Starting recovery with journal batch size 1000 05:31:51,535 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorRecoverySupport - follower588: SnapshotOffer called. 05:31:51,535 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorContextImpl - follower588: Moving last applied index from -1 to -1 05:31:51,535 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceTermInfoStore - follower588: Set currentTerm=1, votedFor=null 05:31:51,535 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorContextImpl - follower588: Updated server config: isVoting: false, peers: [PeerInfo [id=leader585, address=pekko://test/user/leader585, votingState=VOTING], PeerInfo [id=follower586, address=pekko://test/user/follower586, votingState=VOTING], PeerInfo [id=follower587, address=pekko://test/user/follower587, votingState=VOTING]] 05:31:51,535 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower588 in 76.24 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:51,536 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - follower587: CaptureSnapshotReply received by actor 05:31:51,536 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorSnapshotMessageSupport - follower586: CaptureSnapshotReply received by actor 05:31:51,536 PM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - follower587: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=leader585, isVoting=true], ServerInfo[peerId=follower586, isVoting=true], ServerInfo[peerId=follower588, isVoting=false], ServerInfo[peerId=follower587, isVoting=true]]}] 05:31:51,536 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorRecoverySupport - follower588: Recovery completed in 569.8 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:51,536 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PersistenceTermInfoStore - follower588: Set currentTerm=1, votedFor=null 05:31:51,536 PM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - follower587: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:51,536 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorRecoverySupport - follower588: Local TermInfo store seeded with TermInfo{term=1} 05:31:51,536 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorRecoverySupport - follower588: Snapshot capture initiated after recovery due to migrated messages 05:31:51,536 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - follower588: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:51,536 PM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - follower586: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=leader585, isVoting=true], ServerInfo[peerId=follower588, isVoting=false], ServerInfo[peerId=follower587, isVoting=true], ServerInfo[peerId=follower586, isVoting=true]]}] 05:31:51,536 PM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - follower588: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:51,536 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - follower588: lastSequenceNumber prior to capture: 0 05:31:51,536 PM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - follower586: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:51,536 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorSnapshotMessageSupport - follower587: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:51,536 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorSnapshotMessageSupport - follower586: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:51,536 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SnapshotManager - follower587: Snapshot success - sequence number: -1 05:31:51,536 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - follower586: Snapshot success - sequence number: -1 05:31:51,536 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - follower586: SnapshotComplete received 05:31:51,536 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorSnapshotMessageSupport - follower587: SnapshotComplete received 05:31:51,537 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower586: handled a snapshot response 05:31:51,537 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower587: handled a snapshot response 05:31:51,537 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - follower588: CaptureSnapshotReply received by actor 05:31:51,537 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower586: handled a journal response 05:31:51,537 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - follower587: handled a journal response 05:31:51,537 PM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - follower588: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=leader585, isVoting=true], ServerInfo[peerId=follower586, isVoting=true], ServerInfo[peerId=follower587, isVoting=true], ServerInfo[peerId=follower588, isVoting=false]]}] 05:31:51,537 PM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - follower588: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:51,537 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorSnapshotMessageSupport - follower588: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:51,537 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - follower588: Snapshot success - sequence number: -1 05:31:51,537 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorSnapshotMessageSupport - follower588: SnapshotComplete received 05:31:51,537 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower588: handled a journal response 05:31:51,537 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower588: handled a snapshot response [WARN] [02/03/2025 17:31:51.538] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader585]: org.opendaylight.controller.cluster.common.actor.Monitor@2acf8577 05:31:51,539 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader585: Starting recovery with journal batch size 1000 05:31:51,539 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorRecoverySupport - leader585: SnapshotOffer called. 05:31:51,539 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorContextImpl - leader585: Moving last applied index from -1 to -1 05:31:51,539 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - leader585: Set currentTerm=1, votedFor=null 05:31:51,539 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorContextImpl - leader585: Updated server config: isVoting: true, peers: [PeerInfo [id=follower586, address=pekko://test/user/follower586, votingState=VOTING], PeerInfo [id=follower588, address=pekko://test/user/follower588, votingState=NON_VOTING], PeerInfo [id=follower587, address=pekko://test/user/follower587, votingState=VOTING]] 05:31:51,539 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for leader585 in 43.62 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:51,539 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorRecoverySupport - leader585: Recovery completed in 478.9 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:51,539 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - leader585: Set currentTerm=1, votedFor=null 05:31:51,539 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorRecoverySupport - leader585: Local TermInfo store seeded with TermInfo{term=1} 05:31:51,539 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorRecoverySupport - leader585: Snapshot capture initiated after recovery due to migrated messages 05:31:51,539 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - leader585: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:51,539 PM [test-pekko.actor.default-dispatcher-18] [INFO] SnapshotManager - leader585: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:51,539 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - leader585: lastSequenceNumber prior to capture: 0 05:31:51,540 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - leader585: CaptureSnapshotReply received by actor 05:31:51,540 PM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader585: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=follower586, isVoting=true], ServerInfo[peerId=follower588, isVoting=false], ServerInfo[peerId=follower587, isVoting=true], ServerInfo[peerId=leader585, isVoting=true]]}] 05:31:51,540 PM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader585: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:51,540 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorSnapshotMessageSupport - leader585: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:51,540 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - leader585: Snapshot success - sequence number: -1 05:31:51,540 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - leader585: SnapshotComplete received 05:31:51,541 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader585: handled a snapshot response 05:31:51,541 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader585: handled a journal response 05:31:51,904 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 05:31:51,904 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - leader585 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.87:17355, Removed) 05:31:51,904 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - leader585 (Follower): Received ElectionTimeout - switching to Candidate 05:31:51,904 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader585 (Candidate): Election: Candidate has following voting peers: [follower586, follower587] 05:31:51,904 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - leader585: Set currentTerm=2, votedFor=leader585 05:31:51,904 PM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - leader585 (Candidate): Starting new election term 2 05:31:51,904 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader585 (Candidate): Sending RequestVote{term=2, candidateId=leader585, lastLogIndex=-1, lastLogTerm=-1} to peer follower586 05:31:51,904 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader585 (Candidate): Sending RequestVote{term=2, candidateId=leader585, lastLogIndex=-1, lastLogTerm=-1} to peer follower587 05:31:51,904 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower586 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 05:31:51,904 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower587 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 05:31:51,904 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower586 (Follower): Cluster state: [] 05:31:51,904 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower587 (Follower): Cluster state: [] 05:31:51,904 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower586 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader585, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 05:31:51,904 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower587 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader585, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 05:31:51,904 PM [test-pekko.actor.default-dispatcher-18] [INFO] Follower - follower586 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader585, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 05:31:51,905 PM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower587 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader585, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 05:31:51,905 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - follower586: Set currentTerm=2, votedFor=null 05:31:51,905 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower587: Set currentTerm=2, votedFor=null 05:31:51,905 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower587 (Follower): In requestVote: RequestVote{term=2, candidateId=leader585, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 05:31:51,905 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower586 (Follower): In requestVote: RequestVote{term=2, candidateId=leader585, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 05:31:51,905 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower587: Set currentTerm=2, votedFor=leader585 05:31:51,905 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - follower586: Set currentTerm=2, votedFor=leader585 05:31:51,905 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower587 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 05:31:51,905 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower586 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 05:31:51,905 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - leader585 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 05:31:51,906 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader585 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 05:31:51,906 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader585 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 05:31:51,906 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader585 (Leader): Election: Leader has following peers: [follower586, follower588, follower587] 05:31:51,906 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader585 (Leader): Checking sendAppendEntries for follower follower586: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:51,906 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader585 (Leader): Checking sendAppendEntries for follower follower588: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:51,906 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader585 (Leader): Checking sendAppendEntries for follower follower587: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:51,906 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader585 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 05:31:51,906 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower586: Last sync leader does not match current leader leader585, need to catch up to -1 05:31:51,906 PM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower588 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader585, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term 05:31:51,906 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower588: Set currentTerm=2, votedFor=null 05:31:51,907 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader585 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower586 updated: matchIndex: -1, nextIndex: 0 05:31:51,907 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower587: Last sync leader does not match current leader leader585, need to catch up to -1 05:31:51,907 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader585 (Leader): Checking sendAppendEntries for follower follower586: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:51,907 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower588: Last sync leader does not match current leader leader585, need to catch up to -1 [WARN] [02/03/2025 17:31:51.907] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower586] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@1a39cce4 05:31:51,907 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader585 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower587 updated: matchIndex: -1, nextIndex: 0 05:31:51,907 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader585 (Leader): Checking sendAppendEntries for follower follower587: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:51,907 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader585 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower588 updated: matchIndex: -1, nextIndex: 0 05:31:51,907 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader585 (Leader): Checking sendAppendEntries for follower follower588: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [02/03/2025 17:31:51.907] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower587] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@38bf7d64 [WARN] [02/03/2025 17:31:51.907] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower588] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@32954752 05:31:51,943 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 05:31:51,943 PM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting 05:31:51,943 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader585: Persist data SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 05:31:51,943 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader585: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 05:31:51,943 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader585 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 05:31:51,943 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader585 (Leader): Checking sendAppendEntries for follower follower586: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:51,943 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader585 (Leader): sendAppendEntries: 0 is present for follower follower586 05:31:51,943 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader585 (Leader): Sending AppendEntries to follower follower586: AppendEntries{term=2, leaderId=leader585, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 05:31:51,943 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader585 (Leader): Checking sendAppendEntries for follower follower588: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:51,943 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader585 (Leader): sendAppendEntries: 0 is present for follower follower588 05:31:51,943 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader585 (Leader): Sending AppendEntries to follower follower588: AppendEntries{term=2, leaderId=leader585, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 05:31:51,944 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader585 (Leader): Checking sendAppendEntries for follower follower587: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:51,944 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader585 (Leader): sendAppendEntries: 0 is present for follower follower587 05:31:51,944 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader585 (Leader): Sending AppendEntries to follower follower587: AppendEntries{term=2, leaderId=leader585, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 05:31:51,944 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower588 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader585, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 05:31:51,944 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower588 (Follower): Number of entries to be appended = 1 05:31:51,944 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower588 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 05:31:51,944 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower588 (Follower): Append entry to log zero 05:31:51,944 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower588: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 05:31:51,944 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower588 (Follower): Log size is now 1 05:31:51,944 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower588 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower588, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 05:31:51,944 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower588: Lagging 0 entries behind leader leader585 and reached -1 (of expected -1) 05:31:51,944 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader585 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower588 updated: matchIndex: 0, nextIndex: 1 05:31:51,944 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower586 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader585, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 05:31:51,944 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower586 (Follower): Number of entries to be appended = 1 05:31:51,944 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower586 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 05:31:51,944 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower586 (Follower): Append entry to log zero 05:31:51,944 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - follower586: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 05:31:51,944 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader585 (Leader): Checking sendAppendEntries for follower follower588: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:51,944 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower586 (Follower): Log size is now 1 05:31:51,944 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader585: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 05:31:51,945 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower588: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] [WARN] [02/03/2025 17:31:51.945] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower588] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@744721a 05:31:51,944 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower586 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower586, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 05:31:51,946 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader585 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower586 updated: matchIndex: 0, nextIndex: 1 05:31:51,946 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader585 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 05:31:51,946 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader585 (Leader): Setting last applied to 0 05:31:51,946 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorContextImpl - leader585: Moving last applied index from -1 to 0 05:31:51,946 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader585: Applying state for log index 0 data zero 05:31:51,946 PM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader585: applyState called: zero 05:31:51,946 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader585 (Leader): Checking sendAppendEntries for follower follower586: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:51,946 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader585: Persisting ApplyJournalEntries with index=0 05:31:51,946 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower586: Lagging 0 entries behind leader leader585 and reached -1 (of expected -1) 05:31:51,947 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower586: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 05:31:51,947 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower586 (Follower): Commit index set to 0 05:31:51,947 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower586: Lagging 0 entries behind leader leader585 and reached 0 (of expected -1) 05:31:51,947 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower586 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0 05:31:51,947 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower586 (Follower): Setting last applied to 0 05:31:51,947 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorContextImpl - follower586: Moving last applied index from -1 to 0 05:31:51,947 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower586: Applying state for log index 0 data zero 05:31:51,947 PM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower586: applyState called: zero 05:31:51,947 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower586: Persisting ApplyJournalEntries with index=0 [WARN] [02/03/2025 17:31:51.947] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower586] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@23135305 05:31:52,24 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader585 (Leader): sendAppendEntries: 0 is present for follower follower587 05:31:52,24 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader585 (Leader): Sending AppendEntries to follower follower587: AppendEntries{term=2, leaderId=leader585, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 05:31:52,145 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader585 (Leader): sendAppendEntries: 0 is present for follower follower587 05:31:52,145 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader585 (Leader): Sending AppendEntries to follower follower587: AppendEntries{term=2, leaderId=leader585, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 05:31:52,145 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower586: Lagging 0 entries behind leader leader585 and reached 0 (of expected -1) 05:31:52,145 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - follower588 (Follower): Commit index set to 0 05:31:52,145 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SyncStatusTracker - follower588: Lagging 0 entries behind leader leader585 and reached 0 (of expected -1) 05:31:52,145 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - follower588 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0 05:31:52,145 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorBehavior - follower588 (Follower): Setting last applied to 0 05:31:52,145 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorContextImpl - follower588: Moving last applied index from -1 to 0 05:31:52,145 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - follower588: Applying state for log index 0 data zero 05:31:52,145 PM [test-pekko.actor.default-dispatcher-4] [INFO] MockRaftActor - follower588: applyState called: zero 05:31:52,145 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - follower588: Persisting ApplyJournalEntries with index=0 05:31:52,195 PM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending 05:31:52,195 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 starting 05:31:52,195 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader585: onShutDown 05:31:52,195 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader585: Initiating leader transfer 05:31:52,195 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - follower586: onLeaderTransitioning: LeaderTransitioning [leaderId=leader585] 05:31:52,195 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader585: pauseLeader successfully completed - doing transfer 05:31:52,195 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader585 (Leader): Attempting to transfer leadership 05:31:52,195 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower588: onLeaderTransitioning: LeaderTransitioning [leaderId=leader585] 05:31:52,195 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader585 (Leader): Checking sendAppendEntries for follower follower586: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:52,195 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader585 (Leader): Checking sendAppendEntries for follower follower588: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:52,195 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader585 (Leader): Checking sendAppendEntries for follower follower587: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:52,195 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader585 (Leader): sendAppendEntries: 0 is present for follower follower587 05:31:52,196 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower586: Lagging 0 entries behind leader leader585 and reached 0 (of expected -1) 05:31:52,196 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower588: Lagging 0 entries behind leader leader585 and reached 0 (of expected -1) 05:31:52,196 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader585 (Leader): tryToCompleteLeadershipTransfer: followerId: follower586, matchIndex: 0, lastIndex: 0, isVoting: true 05:31:52,196 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader585 (Leader): Follower's log matches - sending ElectionTimeout 05:31:52,196 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader585 (Leader): Checking sendAppendEntries for follower follower586: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:52,196 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader585 (Leader): Checking sendAppendEntries for follower follower588: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:52,196 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader585 (Leader): Checking sendAppendEntries for follower follower587: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:52,196 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower586: Lagging 0 entries behind leader leader585 and reached 0 (of expected -1) 05:31:52,196 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader585 (Leader): sendAppendEntries: 0 is present for follower follower587 05:31:52,196 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader585 (Leader): Leader transfer complete 05:31:52,196 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader585: leader transfer complete - waiting for new leader 05:31:52,196 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 05:31:52,196 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower588: Lagging 0 entries behind leader leader585 and reached 0 (of expected -1) 05:31:52,196 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower586 (Follower): Received TimeoutNow - switching to Candidate 05:31:52,196 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower586 (Candidate): Election: Candidate has following voting peers: [leader585, follower587] 05:31:52,196 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - follower586: Set currentTerm=3, votedFor=follower586 05:31:52,196 PM [test-pekko.actor.default-dispatcher-18] [INFO] Candidate - follower586 (Candidate): Starting new election term 3 05:31:52,196 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower586 (Candidate): Sending RequestVote{term=3, candidateId=follower586, lastLogIndex=0, lastLogTerm=2} to peer leader585 05:31:52,196 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower586 (Candidate): Sending RequestVote{term=3, candidateId=follower586, lastLogIndex=0, lastLogTerm=2} to peer follower587 05:31:52,196 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - leader585 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 05:31:52,196 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - follower586 (Follower) :- Switching from behavior Follower to Candidate, election term: 3 05:31:52,196 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower587 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 05:31:52,196 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - leader585 (Leader): Cluster state: [] 05:31:52,196 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - leader585 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower586, lastLogIndex=0, lastLogTerm=2} with higher term appears reachable, updating term. 05:31:52,196 PM [test-pekko.actor.default-dispatcher-14] [INFO] AbstractLeader - leader585 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower586, lastLogIndex=0, lastLogTerm=2}" message is greater than leader's term 2 - switching to Follower 05:31:52,196 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower587 (Follower): Cluster state: [] 05:31:52,196 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceTermInfoStore - leader585: Set currentTerm=3, votedFor=null 05:31:52,196 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower587 (Follower): Candidate in requestVote:RequestVote{term=3, candidateId=follower586, lastLogIndex=0, lastLogTerm=2} with higher term appears reachable, updating term. 05:31:52,196 PM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower587 (Follower): Term 3 in "RequestVote{term=3, candidateId=follower586, lastLogIndex=0, lastLogTerm=2}" message is greater than follower's term 2 - updating term 05:31:52,196 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PersistenceTermInfoStore - follower587: Set currentTerm=3, votedFor=null 05:31:52,196 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader585 (Leader): Leadership transfer in progress - processing RequestVote 05:31:52,196 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - leader585 (Leader): In requestVote: RequestVote{term=3, candidateId=follower586, lastLogIndex=0, lastLogTerm=2} - currentTerm: 3, votedFor: null, lastIndex: 0, lastTerm: 2 05:31:52,197 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PersistenceTermInfoStore - leader585: Set currentTerm=3, votedFor=follower586 05:31:52,197 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower587 (Follower): In requestVote: RequestVote{term=3, candidateId=follower586, lastLogIndex=0, lastLogTerm=2} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1 05:31:52,197 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PersistenceTermInfoStore - follower587: Set currentTerm=3, votedFor=follower586 05:31:52,197 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - leader585 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true} 05:31:52,197 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower587 (Follower): requestVote returning: RequestVoteReply{term=3, voteGranted=true} 05:31:52,197 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader585 (Leader) :- Switching from behavior Leader to Follower, election term: 3 05:31:52,198 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - follower586 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3 05:31:52,198 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - follower586 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1 05:31:52,198 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - follower586 (Leader): Election: Leader has following peers: [leader585, follower588, follower587] 05:31:52,198 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - follower586 (Leader): Checking sendAppendEntries for follower leader585: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:52,198 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - follower586 (Leader): Checking sendAppendEntries for follower follower588: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:52,198 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - follower586 (Leader): Checking sendAppendEntries for follower follower587: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:52,198 PM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower588 (Follower): Term 3 in "AppendEntries{term=3, leaderId=follower586, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 2 - updating term 05:31:52,198 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - follower586 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3 05:31:52,198 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower588: Set currentTerm=3, votedFor=null 05:31:52,198 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower588: Last sync leader does not match current leader follower586, need to catch up to -1 05:31:52,198 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - follower586 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower588 updated: matchIndex: 0, nextIndex: 1 05:31:52,198 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - follower586 (Leader): Checking sendAppendEntries for follower follower588: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:52,199 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - follower586 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader585 updated: matchIndex: 0, nextIndex: 1 05:31:52,199 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - follower586 (Leader): Checking sendAppendEntries for follower leader585: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:52,199 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - leader585: Last sync leader does not match current leader follower586, need to catch up to -1 05:31:52,199 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader585: leader changed to follower586 [WARN] [02/03/2025 17:31:52.199] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower588] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@19927307 05:31:52,199 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower588: Lagging 0 entries behind leader follower586 and reached 0 (of expected -1) [WARN] [02/03/2025 17:31:52.199] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower588] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@4cdbff02 05:31:52,199 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorLeadershipTransferCohort - leader585: Successfully transferred leadership to follower586 in 3.822 ms 05:31:52,199 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader585: leader transfer succeeded - sending PoisonPill 05:31:52,200 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - leader585: Lagging 0 entries behind leader follower586 and reached 0 (of expected -1) [WARN] [02/03/2025 17:31:52.200] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/leader585] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@443f4649 [WARN] [02/03/2025 17:31:52.200] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/leader585] received dead letter: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@57619307 [WARN] [02/03/2025 17:31:52.714] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/leader585] received dead letter from TestActor[pekko://test/user/follower586]: AppendEntries{term=3, leaderId=follower586, prevLogIndex=0, prevLogTerm=2, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 05:31:52,715 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SyncStatusTracker - follower588: Lagging 0 entries behind leader follower586 and reached 0 (of expected -1) 05:31:52,715 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SyncStatusTracker - follower587: Last sync leader does not match current leader follower586, need to catch up to -1 05:31:52,715 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - follower586 (Leader): sendAppendEntries: 0 is present for follower follower587 05:31:52,715 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - follower586 (Leader): Sending AppendEntries to follower follower587: AppendEntries{term=3, leaderId=follower586, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} [WARN] [02/03/2025 17:31:52.715] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/follower587] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@226d602e 05:31:52,715 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - follower587 (Follower): handleAppendEntries: AppendEntries{term=3, leaderId=follower586, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 05:31:52,715 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - follower587 (Follower): Number of entries to be appended = 1 05:31:52,715 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - follower587 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 05:31:52,715 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - follower587 (Follower): Append entry to log zero 05:31:52,715 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] ReplicatedLogImpl - follower587: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 05:31:52,715 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - follower587 (Follower): Log size is now 1 05:31:52,715 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - follower587 (Follower): Commit index set to 0 05:31:52,715 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - follower587 (Follower): handleAppendEntries returning : AppendEntriesReply{term=3, success=true, followerId=follower587, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 05:31:52,715 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SyncStatusTracker - follower587: Lagging 0 entries behind leader follower586 and reached 0 (of expected -1) 05:31:52,715 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - follower587 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0 05:31:52,715 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorBehavior - follower587 (Follower): Setting last applied to 0 05:31:52,715 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorContextImpl - follower587: Moving last applied index from -1 to 0 05:31:52,715 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - follower587: Applying state for log index 0 data zero 05:31:52,716 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - follower586 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower587 updated: matchIndex: 0, nextIndex: 1 05:31:52,716 PM [test-pekko.actor.default-dispatcher-4] [INFO] MockRaftActor - follower587: applyState called: zero 05:31:52,716 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - follower586 (Leader): Checking sendAppendEntries for follower follower587: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:52,716 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower587: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 05:31:52,717 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower587: Persisting ApplyJournalEntries with index=0 [WARN] [02/03/2025 17:31:52.717] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower587] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@26ea72c3 05:31:52,752 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower587: onLeaderTransitioning: LeaderTransitioning [leaderId=leader585] 05:31:52,753 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 ending 05:31:52,753 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower587 starting 05:31:52,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower587: onShutDown 05:31:52,753 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower587 ending 05:31:52,753 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending 05:31:52,753 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower586-notifier589#-133714290] 05:31:52,764 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower586-collector590#867532716] 05:31:52,764 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower586] 05:31:52,765 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower587-notifier591#-741988023] 05:31:52,765 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower587-collector592#-1036390703] 05:31:52,765 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower587] 05:31:52,765 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower588-notifier593#1357732099] 05:31:52,765 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower588-collector594#515572614] 05:31:52,765 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower588] 05:31:52,766 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader585-notifier595#1790810425] 05:31:52,766 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader585-collector596#1108405020] 05:31:52,766 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader585] 05:31:52,767 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers starting [WARN] [02/03/2025 17:31:52.768] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader597]: org.opendaylight.controller.cluster.common.actor.Monitor@76139541 05:31:52,768 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader597: Starting recovery with journal batch size 1000 05:31:52,769 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - leader597: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:52,769 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - leader597: Set currentTerm=0, votedFor=null 05:31:52,770 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - leader597: Local TermInfo store seeded with TermInfo{term=0} 05:31:52,770 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - leader597: Snapshot capture initiated after recovery due to migrated messages 05:31:52,770 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - leader597: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:52,770 PM [test-pekko.actor.default-dispatcher-7] [INFO] SnapshotManager - leader597: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:52,770 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - leader597: lastSequenceNumber prior to capture: 0 05:31:52,771 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - leader597: CaptureSnapshotReply received by actor 05:31:52,771 PM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader597: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=0, electionVotedFor=null, ServerConfigPayload=null] 05:31:52,771 PM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader597: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:52,771 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 05:31:52,771 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader597 (Follower): Received TimeoutNow - switching to Candidate 05:31:52,771 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader597 (Candidate): Election: Candidate has following voting peers: [] 05:31:52,771 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - leader597: Set currentTerm=1, votedFor=leader597 05:31:52,771 PM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader597 (Candidate): Starting new election term 1 05:31:52,771 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader597 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 05:31:52,772 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader597 (Candidate): Received ElectionTimeout 05:31:52,772 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader597 (Leader): Election: Leader has following peers: [] 05:31:52,772 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader597 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 05:31:52,772 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorSnapshotMessageSupport - leader597: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:52,772 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - leader597: Snapshot success - sequence number: -1 05:31:52,772 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - leader597: SnapshotComplete received 05:31:52,772 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - leader597: handled a snapshot response 05:31:52,772 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - leader597: handled a journal response 05:31:52,821 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader597 starting 05:31:52,821 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader597: onShutDown 05:31:52,822 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader597 ending 05:31:52,822 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers ending 05:31:52,822 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader597-collector601#62045145] 05:31:52,833 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader597] 05:31:52,834 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging starting 05:31:52,834 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting [WARN] [02/03/2025 17:31:52.836] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower603]: org.opendaylight.controller.cluster.common.actor.Monitor@75d80069 05:31:52,836 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower603: Starting recovery with journal batch size 1000 05:31:52,837 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorRecoverySupport - follower603: SnapshotOffer called. 05:31:52,837 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorContextImpl - follower603: Moving last applied index from -1 to -1 05:31:52,837 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower603: Set currentTerm=1, votedFor=null 05:31:52,837 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorContextImpl - follower603: Updated server config: isVoting: true, peers: [PeerInfo [id=follower605, address=pekko://test/user/follower605, votingState=NON_VOTING], PeerInfo [id=follower604, address=pekko://test/user/follower604, votingState=VOTING], PeerInfo [id=leader602, address=pekko://test/user/leader602, votingState=VOTING]] 05:31:52,837 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower603 in 85.50 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:52,838 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorRecoverySupport - follower603: Recovery completed in 929.7 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:52,838 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower603: Set currentTerm=1, votedFor=null 05:31:52,838 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorRecoverySupport - follower603: Local TermInfo store seeded with TermInfo{term=1} 05:31:52,838 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorRecoverySupport - follower603: Snapshot capture initiated after recovery due to migrated messages 05:31:52,838 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - follower603: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:52,838 PM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - follower603: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:52,838 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - follower603: lastSequenceNumber prior to capture: 0 [WARN] [02/03/2025 17:31:52.839] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower604]: org.opendaylight.controller.cluster.common.actor.Monitor@2c57bab5 05:31:52,839 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActor - follower604: Starting recovery with journal batch size 1000 05:31:52,839 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorSnapshotMessageSupport - follower603: CaptureSnapshotReply received by actor 05:31:52,839 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorRecoverySupport - follower604: SnapshotOffer called. 05:31:52,840 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorContextImpl - follower604: Moving last applied index from -1 to -1 05:31:52,839 PM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - follower603: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=follower605, isVoting=false], ServerInfo[peerId=follower604, isVoting=true], ServerInfo[peerId=leader602, isVoting=true], ServerInfo[peerId=follower603, isVoting=true]]}] 05:31:52,840 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PersistenceTermInfoStore - follower604: Set currentTerm=1, votedFor=null 05:31:52,840 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorContextImpl - follower604: Updated server config: isVoting: true, peers: [PeerInfo [id=follower605, address=pekko://test/user/follower605, votingState=NON_VOTING], PeerInfo [id=leader602, address=pekko://test/user/leader602, votingState=VOTING], PeerInfo [id=follower603, address=pekko://test/user/follower603, votingState=VOTING]] 05:31:52,840 PM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - follower603: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:52,840 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower604 in 64.60 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:52,840 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorSnapshotMessageSupport - follower603: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:52,840 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - follower603: Snapshot success - sequence number: -1 05:31:52,840 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorSnapshotMessageSupport - follower603: SnapshotComplete received 05:31:52,840 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - follower603: handled a snapshot response 05:31:52,840 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower603: handled a journal response 05:31:52,840 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorRecoverySupport - follower604: Recovery completed in 971.3 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:52,841 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PersistenceTermInfoStore - follower604: Set currentTerm=1, votedFor=null 05:31:52,841 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorRecoverySupport - follower604: Local TermInfo store seeded with TermInfo{term=1} 05:31:52,841 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorRecoverySupport - follower604: Snapshot capture initiated after recovery due to migrated messages 05:31:52,841 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - follower604: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:52,841 PM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - follower604: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:52,841 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - follower604: lastSequenceNumber prior to capture: 0 05:31:52,842 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - follower604: CaptureSnapshotReply received by actor 05:31:52,842 PM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - follower604: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=follower605, isVoting=false], ServerInfo[peerId=leader602, isVoting=true], ServerInfo[peerId=follower603, isVoting=true], ServerInfo[peerId=follower604, isVoting=true]]}] 05:31:52,842 PM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - follower604: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:52,842 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorSnapshotMessageSupport - follower604: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:52,842 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - follower604: Snapshot success - sequence number: -1 05:31:52,842 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - follower604: SnapshotComplete received 05:31:52,842 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - follower604: handled a snapshot response [WARN] [02/03/2025 17:31:52.843] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower605]: org.opendaylight.controller.cluster.common.actor.Monitor@c81d7c6 05:31:52,843 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - follower605: Starting recovery with journal batch size 1000 05:31:52,844 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower604: handled a journal response 05:31:52,844 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorRecoverySupport - follower605: SnapshotOffer called. 05:31:52,844 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorContextImpl - follower605: Moving last applied index from -1 to -1 05:31:52,844 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower605: Set currentTerm=1, votedFor=null 05:31:52,844 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorContextImpl - follower605: Updated server config: isVoting: false, peers: [PeerInfo [id=follower604, address=pekko://test/user/follower604, votingState=VOTING], PeerInfo [id=leader602, address=pekko://test/user/leader602, votingState=VOTING], PeerInfo [id=follower603, address=pekko://test/user/follower603, votingState=VOTING]] 05:31:52,844 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower605 in 51.26 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:52,844 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - follower605: Recovery completed in 448.7 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:52,844 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PersistenceTermInfoStore - follower605: Set currentTerm=1, votedFor=null 05:31:52,844 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - follower605: Local TermInfo store seeded with TermInfo{term=1} 05:31:52,844 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - follower605: Snapshot capture initiated after recovery due to migrated messages 05:31:52,844 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SnapshotManager - follower605: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:52,844 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - follower605: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:52,844 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SnapshotManager - follower605: lastSequenceNumber prior to capture: 0 05:31:52,845 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorSnapshotMessageSupport - follower605: CaptureSnapshotReply received by actor 05:31:52,845 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - follower605: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=follower604, isVoting=true], ServerInfo[peerId=leader602, isVoting=true], ServerInfo[peerId=follower603, isVoting=true], ServerInfo[peerId=follower605, isVoting=false]]}] 05:31:52,845 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - follower605: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:52,845 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorSnapshotMessageSupport - follower605: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:52,845 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SnapshotManager - follower605: Snapshot success - sequence number: -1 05:31:52,846 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorSnapshotMessageSupport - follower605: SnapshotComplete received 05:31:52,846 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - follower605: handled a snapshot response 05:31:52,846 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - follower605: handled a journal response [WARN] [02/03/2025 17:31:52.847] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader602]: org.opendaylight.controller.cluster.common.actor.Monitor@7d791f24 05:31:52,847 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActor - leader602: Starting recovery with journal batch size 1000 05:31:52,847 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorRecoverySupport - leader602: SnapshotOffer called. 05:31:52,847 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorContextImpl - leader602: Moving last applied index from -1 to -1 05:31:52,847 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PersistenceTermInfoStore - leader602: Set currentTerm=1, votedFor=null 05:31:52,847 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorContextImpl - leader602: Updated server config: isVoting: true, peers: [PeerInfo [id=follower605, address=pekko://test/user/follower605, votingState=NON_VOTING], PeerInfo [id=follower604, address=pekko://test/user/follower604, votingState=VOTING], PeerInfo [id=follower603, address=pekko://test/user/follower603, votingState=VOTING]] 05:31:52,847 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for leader602 in 31.07 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:52,848 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - leader602: Recovery completed in 385.1 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:52,848 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - leader602: Set currentTerm=1, votedFor=null 05:31:52,848 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - leader602: Local TermInfo store seeded with TermInfo{term=1} 05:31:52,848 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - leader602: Snapshot capture initiated after recovery due to migrated messages 05:31:52,848 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - leader602: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:52,848 PM [test-pekko.actor.default-dispatcher-7] [INFO] SnapshotManager - leader602: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:52,848 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - leader602: lastSequenceNumber prior to capture: 0 05:31:52,849 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorSnapshotMessageSupport - leader602: CaptureSnapshotReply received by actor 05:31:52,849 PM [test-pekko.actor.default-dispatcher-7] [INFO] SnapshotManager - leader602: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=follower605, isVoting=false], ServerInfo[peerId=follower604, isVoting=true], ServerInfo[peerId=follower603, isVoting=true], ServerInfo[peerId=leader602, isVoting=true]]}] 05:31:52,849 PM [test-pekko.actor.default-dispatcher-7] [INFO] SnapshotManager - leader602: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:52,849 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorSnapshotMessageSupport - leader602: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:52,849 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - leader602: Snapshot success - sequence number: -1 05:31:52,849 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorSnapshotMessageSupport - leader602: SnapshotComplete received 05:31:52,849 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader602: handled a snapshot response 05:31:52,849 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader602: handled a journal response 05:31:53,265 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 05:31:53,265 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - leader602 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.87:17355, Removed) 05:31:53,265 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - leader602 (Follower): Received ElectionTimeout - switching to Candidate 05:31:53,265 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - leader602 (Candidate): Election: Candidate has following voting peers: [follower604, follower603] 05:31:53,265 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PersistenceTermInfoStore - leader602: Set currentTerm=2, votedFor=leader602 05:31:53,265 PM [test-pekko.actor.default-dispatcher-4] [INFO] Candidate - leader602 (Candidate): Starting new election term 2 05:31:53,265 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - leader602 (Candidate): Sending RequestVote{term=2, candidateId=leader602, lastLogIndex=-1, lastLogTerm=-1} to peer follower604 05:31:53,265 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - leader602 (Candidate): Sending RequestVote{term=2, candidateId=leader602, lastLogIndex=-1, lastLogTerm=-1} to peer follower603 05:31:53,265 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower604 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 05:31:53,265 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorBehavior - leader602 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 05:31:53,265 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower603 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 05:31:53,265 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower603 (Follower): Cluster state: [] 05:31:53,265 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower603 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader602, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 05:31:53,265 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower604 (Follower): Cluster state: [] 05:31:53,265 PM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower603 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader602, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 05:31:53,265 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower604 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader602, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 05:31:53,265 PM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - follower604 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader602, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 05:31:53,266 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower604: Set currentTerm=2, votedFor=null 05:31:53,266 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower603: Set currentTerm=2, votedFor=null 05:31:53,266 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower603 (Follower): In requestVote: RequestVote{term=2, candidateId=leader602, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 05:31:53,266 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower603: Set currentTerm=2, votedFor=leader602 05:31:53,266 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower604 (Follower): In requestVote: RequestVote{term=2, candidateId=leader602, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 05:31:53,266 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - follower604: Set currentTerm=2, votedFor=leader602 05:31:53,266 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower603 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 05:31:53,266 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower604 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 05:31:53,267 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader602 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 05:31:53,267 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader602 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 05:31:53,267 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader602 (Leader): Election: Leader has following peers: [follower605, follower604, follower603] 05:31:53,267 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader602 (Leader): Checking sendAppendEntries for follower follower605: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:53,267 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader602 (Leader): Checking sendAppendEntries for follower follower604: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:53,267 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader602 (Leader): Checking sendAppendEntries for follower follower603: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:53,267 PM [test-pekko.actor.default-dispatcher-4] [INFO] Follower - follower605 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader602, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term 05:31:53,267 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PersistenceTermInfoStore - follower605: Set currentTerm=2, votedFor=null 05:31:53,267 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader602 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 05:31:53,267 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SyncStatusTracker - follower605: Last sync leader does not match current leader leader602, need to catch up to -1 05:31:53,267 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower603: Last sync leader does not match current leader leader602, need to catch up to -1 05:31:53,267 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader602 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower605 updated: matchIndex: -1, nextIndex: 0 05:31:53,267 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader602 (Leader): Checking sendAppendEntries for follower follower605: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:53,268 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader602 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower603 updated: matchIndex: -1, nextIndex: 0 05:31:53,268 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader602 (Leader): Checking sendAppendEntries for follower follower603: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:53,268 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower604: Last sync leader does not match current leader leader602, need to catch up to -1 05:31:53,268 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader602 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower604 updated: matchIndex: -1, nextIndex: 0 05:31:53,268 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader602 (Leader): Checking sendAppendEntries for follower follower604: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [02/03/2025 17:31:53.268] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/follower603] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@17d5b416 [WARN] [02/03/2025 17:31:53.268] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/follower605] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6ddb6771 [WARN] [02/03/2025 17:31:53.268] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/follower604] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6a07bfef 05:31:53,303 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 05:31:53,303 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting 05:31:53,303 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending 05:31:53,303 PM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting 05:31:53,303 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader602: Persist data SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 05:31:53,304 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader602: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 05:31:53,304 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 05:31:53,304 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): Checking sendAppendEntries for follower follower605: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:53,304 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): sendAppendEntries: 0 is present for follower follower605 05:31:53,304 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): Sending AppendEntries to follower follower605: AppendEntries{term=2, leaderId=leader602, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 05:31:53,304 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): Checking sendAppendEntries for follower follower604: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:53,304 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): sendAppendEntries: 0 is present for follower follower604 05:31:53,304 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): Sending AppendEntries to follower follower604: AppendEntries{term=2, leaderId=leader602, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 05:31:53,304 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): Checking sendAppendEntries for follower follower603: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:53,304 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): sendAppendEntries: 0 is present for follower follower603 05:31:53,304 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): Sending AppendEntries to follower follower603: AppendEntries{term=2, leaderId=leader602, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 05:31:53,304 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - follower605 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader602, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 05:31:53,304 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower603 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader602, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 05:31:53,304 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - follower605 (Follower): Number of entries to be appended = 1 05:31:53,304 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - follower605 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 05:31:53,304 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower603 (Follower): Number of entries to be appended = 1 05:31:53,304 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - follower605 (Follower): Append entry to log zero 05:31:53,304 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower603 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 05:31:53,304 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] ReplicatedLogImpl - follower605: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 05:31:53,304 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower603 (Follower): Append entry to log zero 05:31:53,304 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower603: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 05:31:53,304 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - follower605 (Follower): Log size is now 1 05:31:53,304 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower603 (Follower): Log size is now 1 05:31:53,304 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - follower605 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower605, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 05:31:53,304 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SyncStatusTracker - follower605: Lagging 0 entries behind leader leader602 and reached -1 (of expected -1) 05:31:53,304 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower603 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower603, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 05:31:53,304 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower603: Lagging 0 entries behind leader leader602 and reached -1 (of expected -1) 05:31:53,305 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower603: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 05:31:53,305 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] ReplicatedLogImpl - follower605: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] 05:31:53,305 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower605 updated: matchIndex: 0, nextIndex: 1 05:31:53,305 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): Checking sendAppendEntries for follower follower605: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 [WARN] [02/03/2025 17:31:53.305] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower603] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@43adea05 05:31:53,305 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower603 updated: matchIndex: 0, nextIndex: 1 05:31:53,305 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): Checking sendAppendEntries for follower follower603: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:53,305 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader602: persist complete SimpleReplicatedLogEntry [index=0, term=2, payload=zero] [WARN] [02/03/2025 17:31:53.305] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower605] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@52f81de1 05:31:53,305 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 05:31:53,305 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - leader602 (Leader): Setting last applied to 0 05:31:53,305 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorContextImpl - leader602: Moving last applied index from -1 to 0 05:31:53,305 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader602: Applying state for log index 0 data zero 05:31:53,305 PM [test-pekko.actor.default-dispatcher-7] [INFO] MockRaftActor - leader602: applyState called: zero 05:31:53,306 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader602: Persisting ApplyJournalEntries with index=0 05:31:53,384 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): sendAppendEntries: 0 is present for follower follower604 05:31:53,384 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): Sending AppendEntries to follower follower604: AppendEntries{term=2, leaderId=leader602, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 05:31:53,504 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): sendAppendEntries: 0 is present for follower follower604 05:31:53,505 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader602 (Leader): Sending AppendEntries to follower follower604: AppendEntries{term=2, leaderId=leader602, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[SimpleReplicatedLogEntry [index=0, term=2, payload=zero]]} 05:31:53,505 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower605 (Follower): Commit index set to 0 05:31:53,505 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower605: Lagging 0 entries behind leader leader602 and reached 0 (of expected -1) 05:31:53,505 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower605 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0 05:31:53,505 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower605 (Follower): Setting last applied to 0 05:31:53,505 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorContextImpl - follower605: Moving last applied index from -1 to 0 05:31:53,505 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower605: Applying state for log index 0 data zero 05:31:53,505 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower603 (Follower): Commit index set to 0 05:31:53,505 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower603: Lagging 0 entries behind leader leader602 and reached 0 (of expected -1) 05:31:53,505 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower603 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0 05:31:53,505 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower605: applyState called: zero 05:31:53,505 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower603 (Follower): Setting last applied to 0 05:31:53,505 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorContextImpl - follower603: Moving last applied index from -1 to 0 05:31:53,505 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower603: Applying state for log index 0 data zero 05:31:53,505 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower605: Persisting ApplyJournalEntries with index=0 05:31:53,505 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower603: applyState called: zero 05:31:53,505 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower603: Persisting ApplyJournalEntries with index=0 05:31:53,556 PM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending 05:31:53,556 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting 05:31:53,556 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending 05:31:53,556 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - leader602: onRequestLeadership RequestLeadership [requestedFollowerId=follower604, replyTo=Actor[pekko://test/user/$c#-790747029]] 05:31:53,556 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - leader602: Initiating leader transfer 05:31:53,556 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower605: onLeaderTransitioning: LeaderTransitioning [leaderId=leader602] 05:31:53,556 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower604: onLeaderTransitioning: LeaderTransitioning [leaderId=leader602] 05:31:53,556 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower603: onLeaderTransitioning: LeaderTransitioning [leaderId=leader602] 05:31:53,556 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorLeadershipTransferCohort - leader602: pauseLeader successfully completed - doing transfer 05:31:53,556 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Leader - leader602 (Leader): Attempting to transfer leadership 05:31:53,556 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader602 (Leader): Checking sendAppendEntries for follower follower605: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:53,556 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader602 (Leader): Checking sendAppendEntries for follower follower604: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:53,556 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader602 (Leader): sendAppendEntries: 0 is present for follower follower604 05:31:53,556 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader602 (Leader): Checking sendAppendEntries for follower follower603: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 05:31:53,556 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower605: Lagging 0 entries behind leader leader602 and reached 0 (of expected -1) 05:31:53,556 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower603: Lagging 0 entries behind leader leader602 and reached 0 (of expected -1) 05:31:53,744 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower605: Lagging 0 entries behind leader leader602 and reached 0 (of expected -1) 05:31:53,744 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower603: Lagging 0 entries behind leader leader602 and reached 0 (of expected -1) 05:31:53,864 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorLeadershipTransferCohort - leader602: leader transfer aborted 05:31:53,864 PM [test-pekko.actor.default-dispatcher-15] [WARN] RaftActorLeadershipTransferCohort - leader602: Failed to transfer leadership in 308.4 ms 05:31:53,864 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader602: LeadershipTransfer request from follower604 failed 05:31:53,864 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Leader - leader602 (Leader): Leadership transfer expired 05:31:53,865 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower603: Lagging 0 entries behind leader leader602 and reached 0 (of expected -1) 05:31:53,865 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower605: Lagging 0 entries behind leader leader602 and reached 0 (of expected -1) 05:31:53,909 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging ending 05:31:53,909 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower603-notifier606#554493558] 05:31:53,920 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower603-collector607#-2027072006] 05:31:53,920 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower603] 05:31:53,920 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower604-notifier608#-1875604329] 05:31:53,920 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower604-collector609#-230562674] 05:31:53,921 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower604] 05:31:53,921 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower605-notifier610#2137070470] 05:31:53,921 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower605-collector611#-1110984846] 05:31:53,923 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower605] 05:31:53,923 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader602-notifier612#-500786649] 05:31:53,924 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader602-collector613#-375025277] 05:31:53,924 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader602] 05:31:53,924 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$c#-790747029] 05:31:53,925 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown starting 05:31:53,925 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting [WARN] [02/03/2025 17:31:53.935] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower615]: org.opendaylight.controller.cluster.common.actor.Monitor@2f49f8bb 05:31:53,935 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActor - follower615: Starting recovery with journal batch size 1000 05:31:53,936 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorRecoverySupport - follower615: SnapshotOffer called. 05:31:53,936 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorContextImpl - follower615: Moving last applied index from -1 to -1 05:31:53,936 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PersistenceTermInfoStore - follower615: Set currentTerm=1, votedFor=null 05:31:53,936 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorContextImpl - follower615: Updated server config: isVoting: true, peers: [PeerInfo [id=follower616, address=pekko://test/user/follower616, votingState=VOTING], PeerInfo [id=follower617, address=pekko://test/user/follower617, votingState=NON_VOTING], PeerInfo [id=leader614, address=pekko://test/user/leader614, votingState=VOTING]] 05:31:53,936 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower615 in 58.47 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:53,936 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorRecoverySupport - follower615: Recovery completed in 723.2 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:53,936 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceTermInfoStore - follower615: Set currentTerm=1, votedFor=null 05:31:53,937 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorRecoverySupport - follower615: Local TermInfo store seeded with TermInfo{term=1} 05:31:53,937 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorRecoverySupport - follower615: Snapshot capture initiated after recovery due to migrated messages [WARN] [02/03/2025 17:31:53.937] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower616]: org.opendaylight.controller.cluster.common.actor.Monitor@352f0b53 05:31:53,937 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - follower615: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:53,937 PM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - follower615: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:53,937 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - follower615: lastSequenceNumber prior to capture: 0 05:31:53,937 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActor - follower616: Starting recovery with journal batch size 1000 05:31:53,937 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorRecoverySupport - follower616: SnapshotOffer called. 05:31:53,937 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorContextImpl - follower616: Moving last applied index from -1 to -1 05:31:53,937 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PersistenceTermInfoStore - follower616: Set currentTerm=1, votedFor=null 05:31:53,938 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorContextImpl - follower616: Updated server config: isVoting: true, peers: [PeerInfo [id=follower615, address=pekko://test/user/follower615, votingState=VOTING], PeerInfo [id=follower617, address=pekko://test/user/follower617, votingState=NON_VOTING], PeerInfo [id=leader614, address=pekko://test/user/leader614, votingState=VOTING]] 05:31:53,938 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower616 in 69.90 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:53,938 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorSnapshotMessageSupport - follower615: CaptureSnapshotReply received by actor 05:31:53,938 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - follower615: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=follower616, isVoting=true], ServerInfo[peerId=follower617, isVoting=false], ServerInfo[peerId=leader614, isVoting=true], ServerInfo[peerId=follower615, isVoting=true]]}] 05:31:53,938 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - follower615: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:53,938 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - follower616: Recovery completed in 679.9 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:53,938 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PersistenceTermInfoStore - follower616: Set currentTerm=1, votedFor=null 05:31:53,938 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - follower616: Local TermInfo store seeded with TermInfo{term=1} 05:31:53,938 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - follower616: Snapshot capture initiated after recovery due to migrated messages 05:31:53,938 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SnapshotManager - follower616: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:53,938 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - follower616: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:53,938 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorSnapshotMessageSupport - follower615: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:53,938 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - follower615: Snapshot success - sequence number: -1 05:31:53,938 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - follower615: SnapshotComplete received 05:31:53,938 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SnapshotManager - follower616: lastSequenceNumber prior to capture: 0 05:31:53,939 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower615: handled a snapshot response 05:31:53,939 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower615: handled a journal response [WARN] [02/03/2025 17:31:53.939] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower617]: org.opendaylight.controller.cluster.common.actor.Monitor@7ddd376b 05:31:53,939 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower617: Starting recovery with journal batch size 1000 05:31:53,939 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorSnapshotMessageSupport - follower616: CaptureSnapshotReply received by actor 05:31:53,939 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorRecoverySupport - follower617: SnapshotOffer called. 05:31:53,939 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorContextImpl - follower617: Moving last applied index from -1 to -1 05:31:53,939 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower617: Set currentTerm=1, votedFor=null 05:31:53,939 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorContextImpl - follower617: Updated server config: isVoting: false, peers: [PeerInfo [id=follower616, address=pekko://test/user/follower616, votingState=VOTING], PeerInfo [id=follower615, address=pekko://test/user/follower615, votingState=VOTING], PeerInfo [id=leader614, address=pekko://test/user/leader614, votingState=VOTING]] 05:31:53,939 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for follower617 in 30.86 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:53,939 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - follower616: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=follower615, isVoting=true], ServerInfo[peerId=follower617, isVoting=false], ServerInfo[peerId=leader614, isVoting=true], ServerInfo[peerId=follower616, isVoting=true]]}] 05:31:53,939 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - follower616: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:53,939 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorSnapshotMessageSupport - follower616: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:53,939 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - follower616: Snapshot success - sequence number: -1 05:31:53,939 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - follower616: SnapshotComplete received 05:31:53,940 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower616: handled a snapshot response 05:31:53,940 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - follower617: Recovery completed in 404.5 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:53,940 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower616: handled a journal response 05:31:53,940 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PersistenceTermInfoStore - follower617: Set currentTerm=1, votedFor=null 05:31:53,940 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - follower617: Local TermInfo store seeded with TermInfo{term=1} 05:31:53,940 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorRecoverySupport - follower617: Snapshot capture initiated after recovery due to migrated messages 05:31:53,940 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SnapshotManager - follower617: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:53,940 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - follower617: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:53,940 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SnapshotManager - follower617: lastSequenceNumber prior to capture: 0 05:31:53,940 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorSnapshotMessageSupport - follower617: CaptureSnapshotReply received by actor 05:31:53,940 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - follower617: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=follower616, isVoting=true], ServerInfo[peerId=follower615, isVoting=true], ServerInfo[peerId=leader614, isVoting=true], ServerInfo[peerId=follower617, isVoting=false]]}] 05:31:53,940 PM [test-pekko.actor.default-dispatcher-4] [INFO] SnapshotManager - follower617: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:53,941 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorSnapshotMessageSupport - follower617: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:53,941 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - follower617: Snapshot success - sequence number: -1 05:31:53,941 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorSnapshotMessageSupport - follower617: SnapshotComplete received 05:31:53,941 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower617: handled a snapshot response 05:31:53,941 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower617: handled a journal response [WARN] [02/03/2025 17:31:53.941] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader614]: org.opendaylight.controller.cluster.common.actor.Monitor@600f4a6b 05:31:53,942 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - leader614: Starting recovery with journal batch size 1000 05:31:53,942 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorRecoverySupport - leader614: SnapshotOffer called. 05:31:53,942 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorContextImpl - leader614: Moving last applied index from -1 to -1 05:31:53,942 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PersistenceTermInfoStore - leader614: Set currentTerm=1, votedFor=null 05:31:53,942 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorContextImpl - leader614: Updated server config: isVoting: true, peers: [PeerInfo [id=follower616, address=pekko://test/user/follower616, votingState=VOTING], PeerInfo [id=follower615, address=pekko://test/user/follower615, votingState=VOTING], PeerInfo [id=follower617, address=pekko://test/user/follower617, votingState=NON_VOTING]] 05:31:53,942 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorRecoverySupport - Recovery snapshot applied for leader614 in 96.96 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 05:31:53,943 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - leader614: Recovery completed in 526.3 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 05:31:53,943 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - leader614: Set currentTerm=1, votedFor=null 05:31:53,943 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - leader614: Local TermInfo store seeded with TermInfo{term=1} 05:31:53,943 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorRecoverySupport - leader614: Snapshot capture initiated after recovery due to migrated messages 05:31:53,943 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - leader614: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 05:31:53,943 PM [test-pekko.actor.default-dispatcher-7] [INFO] SnapshotManager - leader614: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 05:31:53,943 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - leader614: lastSequenceNumber prior to capture: 0 05:31:53,943 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorSnapshotMessageSupport - leader614: CaptureSnapshotReply received by actor 05:31:53,943 PM [test-pekko.actor.default-dispatcher-7] [INFO] SnapshotManager - leader614: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=MockSnapshotState [state=[]], electionTerm=1, electionVotedFor=null, ServerConfigPayload=ClusterConfig{serverInfo=[ServerInfo[peerId=follower616, isVoting=true], ServerInfo[peerId=follower615, isVoting=true], ServerInfo[peerId=follower617, isVoting=false], ServerInfo[peerId=leader614, isVoting=true]]}] 05:31:53,944 PM [test-pekko.actor.default-dispatcher-7] [INFO] SnapshotManager - leader614: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 05:31:53,944 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorSnapshotMessageSupport - leader614: SaveSnapshotSuccess received for snapshot, sequenceNr: -1 05:31:53,944 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - leader614: Snapshot success - sequence number: -1 05:31:53,944 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorSnapshotMessageSupport - leader614: SnapshotComplete received 05:31:53,944 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader614: handled a journal response 05:31:53,944 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader614: handled a snapshot response 05:31:54,324 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 05:31:54,324 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - leader614 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.87:17355, Removed) 05:31:54,324 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - leader614 (Follower): Received ElectionTimeout - switching to Candidate 05:31:54,324 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader614 (Candidate): Election: Candidate has following voting peers: [follower616, follower615] 05:31:54,324 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PersistenceTermInfoStore - leader614: Set currentTerm=2, votedFor=leader614 05:31:54,324 PM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - leader614 (Candidate): Starting new election term 2 05:31:54,325 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader614 (Candidate): Sending RequestVote{term=2, candidateId=leader614, lastLogIndex=-1, lastLogTerm=-1} to peer follower616 05:31:54,325 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader614 (Candidate): Sending RequestVote{term=2, candidateId=leader614, lastLogIndex=-1, lastLogTerm=-1} to peer follower615 05:31:54,325 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower616 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 05:31:54,325 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - leader614 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 05:31:54,325 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower616 (Follower): Cluster state: [] 05:31:54,325 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower616 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader614, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 05:31:54,325 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorBehavior - follower615 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 05:31:54,325 PM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower616 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader614, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 05:31:54,325 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PersistenceTermInfoStore - follower616: Set currentTerm=2, votedFor=null 05:31:54,325 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorBehavior - follower615 (Follower): Cluster state: [] 05:31:54,325 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorBehavior - follower615 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader614, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 05:31:54,325 PM [test-pekko.actor.default-dispatcher-4] [INFO] Follower - follower615 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader614, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term 05:31:54,325 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PersistenceTermInfoStore - follower615: Set currentTerm=2, votedFor=null 05:31:54,325 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower616 (Follower): In requestVote: RequestVote{term=2, candidateId=leader614, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 05:31:54,325 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PersistenceTermInfoStore - follower616: Set currentTerm=2, votedFor=leader614 05:31:54,325 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower616 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 05:31:54,325 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorBehavior - follower615 (Follower): In requestVote: RequestVote{term=2, candidateId=leader614, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1 05:31:54,325 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PersistenceTermInfoStore - follower615: Set currentTerm=2, votedFor=leader614 05:31:54,325 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorBehavior - follower615 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 05:31:54,326 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader614 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 05:31:54,326 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader614 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 05:31:54,326 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader614 (Leader): Election: Leader has following peers: [follower616, follower615, follower617] 05:31:54,326 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader614 (Leader): Checking sendAppendEntries for follower follower616: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:54,326 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader614 (Leader): Checking sendAppendEntries for follower follower615: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:54,326 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader614 (Leader): Checking sendAppendEntries for follower follower617: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:54,326 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - leader614 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 05:31:54,326 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower616: Last sync leader does not match current leader leader614, need to catch up to -1 05:31:54,326 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower615: Last sync leader does not match current leader leader614, need to catch up to -1 05:31:54,327 PM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower617 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader614, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term 05:31:54,327 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PersistenceTermInfoStore - follower617: Set currentTerm=2, votedFor=null [WARN] [02/03/2025 17:31:54.327] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower616] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@152b7adf 05:31:54,327 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower617: Last sync leader does not match current leader leader614, need to catch up to -1 [WARN] [02/03/2025 17:31:54.327] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower615] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@62820585 05:31:54,326 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader614 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower616 updated: matchIndex: -1, nextIndex: 0 05:31:54,327 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader614 (Leader): Checking sendAppendEntries for follower follower616: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [02/03/2025 17:31:54.327] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower617] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@390f4f9c 05:31:54,328 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader614 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower615 updated: matchIndex: -1, nextIndex: 0 05:31:54,328 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader614 (Leader): Checking sendAppendEntries for follower follower615: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:54,328 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader614 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower617 updated: matchIndex: -1, nextIndex: 0 05:31:54,328 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader614 (Leader): Checking sendAppendEntries for follower follower617: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:54,346 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting 05:31:54,346 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting 05:31:54,346 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending 05:31:54,346 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower615] 05:31:54,347 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower617] 05:31:54,348 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting 05:31:54,348 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending 05:31:54,348 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader614: onRequestLeadership RequestLeadership [requestedFollowerId=follower616, replyTo=Actor[pekko://test/user/$d#-500076199]] 05:31:54,348 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader614: Initiating leader transfer 05:31:54,348 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower616: onLeaderTransitioning: LeaderTransitioning [leaderId=leader614] 05:31:54,348 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader614: pauseLeader successfully completed - doing transfer 05:31:54,348 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Leader - leader614 (Leader): Attempting to transfer leadership [WARN] [02/03/2025 17:31:54.348] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower615] received dead letter from TestActor[pekko://test/user/leader614]: LeaderTransitioning [leaderId=leader614] [WARN] [02/03/2025 17:31:54.348] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower617] received dead letter from TestActor[pekko://test/user/leader614]: LeaderTransitioning [leaderId=leader614] 05:31:54,348 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader614 (Leader): Checking sendAppendEntries for follower follower616: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:54,348 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader614 (Leader): Checking sendAppendEntries for follower follower615: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:54,348 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower616: Lagging 0 entries behind leader leader614 and reached -1 (of expected -1) 05:31:54,348 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader614 (Leader): Checking sendAppendEntries for follower follower617: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [02/03/2025 17:31:54.348] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower615] received dead letter from TestActor[pekko://test/user/leader614]: AppendEntries{term=2, leaderId=leader614, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} [WARN] [02/03/2025 17:31:54.348] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower617] received dead letter from TestActor[pekko://test/user/leader614]: AppendEntries{term=2, leaderId=leader614, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} [WARN] [02/03/2025 17:31:54.348] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower616] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@2d35febc 05:31:54,348 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Leader - leader614 (Leader): tryToCompleteLeadershipTransfer: followerId: follower616, matchIndex: -1, lastIndex: -1, isVoting: true 05:31:54,348 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Leader - leader614 (Leader): Follower's log matches - sending ElectionTimeout 05:31:54,348 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader614 (Leader): Checking sendAppendEntries for follower follower616: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:54,348 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader614 (Leader): Checking sendAppendEntries for follower follower615: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:54,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower616: Lagging 0 entries behind leader leader614 and reached -1 (of expected -1) 05:31:54,349 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader614 (Leader): Checking sendAppendEntries for follower follower617: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:54,349 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Leader - leader614 (Leader): Leader transfer complete 05:31:54,349 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader614: leader transfer complete - waiting for new leader 05:31:54,349 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 05:31:54,349 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower616 (Follower): Received TimeoutNow - switching to Candidate 05:31:54,349 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - follower616 (Candidate): Election: Candidate has following voting peers: [follower615, leader614] 05:31:54,349 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PersistenceTermInfoStore - follower616: Set currentTerm=3, votedFor=follower616 05:31:54,349 PM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - follower616 (Candidate): Starting new election term 3 05:31:54,349 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - follower616 (Candidate): Sending RequestVote{term=3, candidateId=follower616, lastLogIndex=-1, lastLogTerm=-1} to peer follower615 05:31:54,349 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - follower616 (Candidate): Sending RequestVote{term=3, candidateId=follower616, lastLogIndex=-1, lastLogTerm=-1} to peer leader614 05:31:54,349 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - follower616 (Follower) :- Switching from behavior Follower to Candidate, election term: 3 05:31:54,349 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader614 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 05:31:54,349 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader614 (Leader): Cluster state: [] 05:31:54,349 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader614 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower616, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 05:31:54,349 PM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractLeader - leader614 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower616, lastLogIndex=-1, lastLogTerm=-1}" message is greater than leader's term 2 - switching to Follower 05:31:54,349 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - leader614: Set currentTerm=3, votedFor=null 05:31:54,349 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader614 (Leader): Leadership transfer in progress - processing RequestVote [WARN] [02/03/2025 17:31:54.349] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/follower615] received dead letter from TestActor[pekko://test/user/leader614]: AppendEntries{term=2, leaderId=leader614, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 05:31:54,349 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader614 (Leader): In requestVote: RequestVote{term=3, candidateId=follower616, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1 05:31:54,349 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PersistenceTermInfoStore - leader614: Set currentTerm=3, votedFor=follower616 [WARN] [02/03/2025 17:31:54.349] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/follower617] received dead letter from TestActor[pekko://test/user/leader614]: AppendEntries{term=2, leaderId=leader614, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 05:31:54,349 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader614 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true} [WARN] [02/03/2025 17:31:54.349] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/follower615] received dead letter from TestActor[pekko://test/user/follower616]: RequestVote{term=3, candidateId=follower616, lastLogIndex=-1, lastLogTerm=-1} 05:31:54,349 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader614 (Leader) :- Switching from behavior Leader to Follower, election term: 3 05:31:54,350 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower616 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3 05:31:54,350 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower616 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1 05:31:54,350 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower616 (Leader): Election: Leader has following peers: [follower615, follower617, leader614] 05:31:54,350 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower616 (Leader): Checking sendAppendEntries for follower follower615: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:54,350 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower616 (Leader): Checking sendAppendEntries for follower follower617: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [02/03/2025 17:31:54.350] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/follower615] received dead letter from TestActor[pekko://test/user/follower616]: AppendEntries{term=3, leaderId=follower616, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 05:31:54,350 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower616 (Leader): Checking sendAppendEntries for follower leader614: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [02/03/2025 17:31:54.350] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/follower617] received dead letter from TestActor[pekko://test/user/follower616]: AppendEntries{term=3, leaderId=follower616, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 05:31:54,350 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - follower616 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3 05:31:54,350 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SyncStatusTracker - leader614: Last sync leader does not match current leader follower616, need to catch up to -1 05:31:54,350 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActorLeadershipTransferCohort - leader614: leader changed to follower616 05:31:54,350 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower616 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader614 updated: matchIndex: -1, nextIndex: 0 05:31:54,350 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower616 (Leader): Checking sendAppendEntries for follower leader614: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 05:31:54,350 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorLeadershipTransferCohort - leader614: Successfully transferred leadership to follower616 in 2.460 ms 05:31:54,350 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - leader614: Leadership transferred successfully to follower616 [WARN] [02/03/2025 17:31:54.351] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/leader614] unhandled message from Actor[pekko://test/deadLetters]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@4ffb23f3 05:31:54,399 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown ending 05:31:54,399 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower615-notifier618#1827303014] 05:31:54,399 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower615-collector619#-240885937] 05:31:54,399 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower616-notifier620#392328428] 05:31:54,400 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower616-collector621#1512102347] 05:31:54,400 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower616] 05:31:54,400 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower617-notifier622#1257862214] 05:31:54,400 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower617-collector623#-558813532] 05:31:54,400 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader614-notifier624#75213462] 05:31:54,400 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader614-collector625#225559575] 05:31:54,400 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader614] 05:31:54,401 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$d#-500076199] [INFO] [02/03/2025 17:31:54.402] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 05:31:54,402 PM [test-pekko.actor.default-dispatcher-7] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [WARN] [02/03/2025 17:31:54.402] [test-pekko.actor.default-dispatcher-7] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.170.87:17355) [INFO] [02/03/2025 17:31:54.403] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.87:17355] - Exiting completed [INFO] [02/03/2025 17:31:54.403] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.87:17355] - Shutting down... 05:31:54,403 PM [test-pekko.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.87:17355] - Exiting completed 05:31:54,403 PM [test-pekko.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.87:17355] - Shutting down... [INFO] [02/03/2025 17:31:54.403] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.87:17355] - Successfully shut down 05:31:54,404 PM [test-pekko.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.87:17355] - Successfully shut down [INFO] [02/03/2025 17:31:54.405] [test-pekko.remote.default-remote-dispatcher-6] [pekko://test@10.30.170.87:17355/system/remoting-terminator] Shutting down remote daemon. 05:31:54,405 PM [test-pekko.actor.default-dispatcher-18] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. [INFO] [02/03/2025 17:31:54.405] [test-pekko.remote.default-remote-dispatcher-6] [pekko://test@10.30.170.87:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports. 05:31:54,405 PM [test-pekko.actor.default-dispatcher-5] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [INFO] [02/03/2025 17:31:54.407] [test-pekko.remote.default-remote-dispatcher-6] [pekko://test@10.30.170.87:17355/system/remoting-terminator] Remoting shut down. 05:31:54,407 PM [test-pekko.actor.default-dispatcher-7] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.