[DEBUG] [06/25/2025 18:23:31.813] [main] [EventStream(pekko://test)] logger log1-TestEventListener started
06:23:31,813 PM [test-pekko.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started
[DEBUG] [06/25/2025 18:23:31.813] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started
[DEBUG] [06/25/2025 18:23:31.813] [main] [EventStream(pekko://test)] Default Loggers started
[INFO] [06/25/2025 18:23:31.826] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.98:17355] with UID [1295608472252967932]
06:23:31,826 PM [test-pekko.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.98:17355] with UID [1295608472252967932]
[INFO] [06/25/2025 18:23:31.827] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.98:17355] - Starting up, Pekko version [1.0.3] ...
06:23:31,827 PM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.98:17355] - Starting up, Pekko version [1.0.3] ...
[INFO] [06/25/2025 18:23:31.829] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.98:17355] - Registered cluster JMX MBean [pekko:type=Cluster]
[INFO] [06/25/2025 18:23:31.829] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.98:17355] - Started up successfully
06:23:31,829 PM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.98:17355] - Registered cluster JMX MBean [pekko:type=Cluster]
06:23:31,829 PM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.98:17355] - Started up successfully
[INFO] [06/25/2025 18:23:31.830] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.98:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing
[INFO] [06/25/2025 18:23:31.830] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.98:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining
06:23:31,830 PM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.98:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing
06:23:31,830 PM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.98:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining
06:23:31,839 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferAborted starting
06:23:31,839 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [06/25/2025 18:23:31.841] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower284]: org.opendaylight.controller.cluster.common.actor.Monitor@32bffe64
[INFO] [pekkoDeadLetter][06/25/2025 18:23:31.841] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower284] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
06:23:31,843 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower284: Starting recovery with journal batch size 1000
06:23:31,843 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower284: started executor
06:23:31,843 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower284: started executor
06:23:31,844 PM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower284] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
06:23:31,845 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/follower284/TermInfo.properties does not exist
06:23:31,845 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower284: no eligible files found
06:23:31,845 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower284: SnapshotOffer called.
06:23:31,845 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower284: initializing from snapshot taken at 2025-06-25T18:23:31.839Z
06:23:31,845 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower284: Set currentTerm=1, votedFor=null
06:23:31,845 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - follower284: Updated server config: isVoting: true, peers: [PeerInfo [id=follower285, address=pekko://test/user/follower285, votingState=VOTING], PeerInfo [id=leader283, address=pekko://test/user/leader283, votingState=VOTING], PeerInfo [id=follower286, address=pekko://test/user/follower286, votingState=NON_VOTING]]
06:23:31,846 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - Recovery snapshot applied for follower284 in 244.2 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:31,846 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower284: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:31.839Z
06:23:31,846 PM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower284: support() called
06:23:31,846 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower284: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/follower284/snapshot-00000000685C3EA3-32021FC0.tmp
06:23:31,849 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower284: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/follower284/snapshot-00000000685C3EA3-32021FC0.v1
06:23:31,849 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower284: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/follower284/snapshot-00000000685C3EA3-32021FC0.v1
06:23:31,849 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower284: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:31.839Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/follower284/snapshot-00000000685C3EA3-32021FC0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:31,849 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower284: local snapshot saved in 2.983 ms, deleting Pekko-persisted snapshots
06:23:31,849 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower284: Recovery completed in 4.020 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:31,851 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower284: Set currentTerm=1, votedFor=null
06:23:31,851 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower284: Local TermInfo store seeded with TermInfo{term=1}
06:23:31,851 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower284: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@18cdc49d
06:23:31,851 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower284: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:31,945 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower285: Starting recovery with journal batch size 1000
06:23:31,945 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower285: started executor
06:23:31,945 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower285: started executor
[WARN] [06/25/2025 18:23:31.945] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower285]: org.opendaylight.controller.cluster.common.actor.Monitor@27476f7
[INFO] [pekkoDeadLetter][06/25/2025 18:23:31.945] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower285] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
06:23:31,946 PM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower285] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
06:23:31,946 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/follower285/TermInfo.properties does not exist
06:23:31,946 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower285: no eligible files found
06:23:31,946 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower285: SnapshotOffer called.
06:23:31,946 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower285: initializing from snapshot taken at 2025-06-25T18:23:31.839Z
06:23:31,946 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower285: Set currentTerm=1, votedFor=null
06:23:31,946 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - follower285: Updated server config: isVoting: true, peers: [PeerInfo [id=follower284, address=pekko://test/user/follower284, votingState=VOTING], PeerInfo [id=leader283, address=pekko://test/user/leader283, votingState=VOTING], PeerInfo [id=follower286, address=pekko://test/user/follower286, votingState=NON_VOTING]]
06:23:31,946 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - Recovery snapshot applied for follower285 in 54.47 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:31,946 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower285: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:31.839Z
06:23:31,946 PM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower285: support() called
06:23:31,947 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower285: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/follower285/snapshot-00000000685C3EA3-32021FC0.tmp
06:23:31,950 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower285: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/follower285/snapshot-00000000685C3EA3-32021FC0.v1
06:23:31,950 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower285: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/follower285/snapshot-00000000685C3EA3-32021FC0.v1
06:23:31,950 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower285: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:31.839Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/follower285/snapshot-00000000685C3EA3-32021FC0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:31,951 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower285: local snapshot saved in 4.179 ms, deleting Pekko-persisted snapshots
06:23:31,951 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower285: Recovery completed in 4.900 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:31,953 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower285: Set currentTerm=1, votedFor=null
06:23:31,953 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower285: Local TermInfo store seeded with TermInfo{term=1}
06:23:31,953 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower285: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@2ab06ec5
06:23:31,953 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower285: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
[WARN] [06/25/2025 18:23:32.046] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower286]: org.opendaylight.controller.cluster.common.actor.Monitor@69c7ac08
[INFO] [pekkoDeadLetter][06/25/2025 18:23:32.046] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower286] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
06:23:32,48 PM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower286] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
06:23:32,49 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower286: Starting recovery with journal batch size 1000
06:23:32,49 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower286: started executor
06:23:32,49 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower286: started executor
06:23:32,49 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/follower286/TermInfo.properties does not exist
06:23:32,49 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower286: no eligible files found
06:23:32,49 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower286: SnapshotOffer called.
06:23:32,49 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower286: initializing from snapshot taken at 2025-06-25T18:23:31.839Z
06:23:32,49 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower286: Set currentTerm=1, votedFor=null
06:23:32,49 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PeerInfos - follower286: Updated server config: isVoting: false, peers: [PeerInfo [id=follower285, address=pekko://test/user/follower285, votingState=VOTING], PeerInfo [id=follower284, address=pekko://test/user/follower284, votingState=VOTING], PeerInfo [id=leader283, address=pekko://test/user/leader283, votingState=VOTING]]
06:23:32,50 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - Recovery snapshot applied for follower286 in 66.07 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:32,50 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower286: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:31.839Z
06:23:32,50 PM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower286: support() called
06:23:32,50 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower286: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/follower286/snapshot-00000000685C3EA3-32021FC0.tmp
06:23:32,52 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower286: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/follower286/snapshot-00000000685C3EA3-32021FC0.v1
06:23:32,52 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower286: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/follower286/snapshot-00000000685C3EA3-32021FC0.v1
06:23:32,52 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower286: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:31.839Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/follower286/snapshot-00000000685C3EA3-32021FC0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:32,52 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower286: local snapshot saved in 2.686 ms, deleting Pekko-persisted snapshots
06:23:32,53 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower286: Recovery completed in 3.631 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:32,56 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower286: Set currentTerm=1, votedFor=null
06:23:32,56 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower286: Local TermInfo store seeded with TermInfo{term=1}
06:23:32,56 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower286: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@1fcfcc17
06:23:32,56 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower286: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
[WARN] [06/25/2025 18:23:32.148] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader283]: org.opendaylight.controller.cluster.common.actor.Monitor@5c23a776
06:23:32,149 PM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader283] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[INFO] [pekkoDeadLetter][06/25/2025 18:23:32.149] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader283] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
06:23:32,150 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader283: Starting recovery with journal batch size 1000
06:23:32,150 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader283: started executor
06:23:32,150 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader283: started executor
06:23:32,151 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/leader283/TermInfo.properties does not exist
06:23:32,151 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader283: no eligible files found
06:23:32,151 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader283: SnapshotOffer called.
06:23:32,151 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader283: initializing from snapshot taken at 2025-06-25T18:23:31.839Z
06:23:32,151 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader283: Set currentTerm=1, votedFor=null
06:23:32,151 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - leader283: Updated server config: isVoting: true, peers: [PeerInfo [id=follower285, address=pekko://test/user/follower285, votingState=VOTING], PeerInfo [id=follower284, address=pekko://test/user/follower284, votingState=VOTING], PeerInfo [id=follower286, address=pekko://test/user/follower286, votingState=NON_VOTING]]
06:23:32,151 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for leader283 in 96.79 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:32,151 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader283: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:31.839Z
06:23:32,151 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader283: support() called
06:23:32,152 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader283: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/leader283/snapshot-00000000685C3EA3-32021FC0.tmp
06:23:32,159 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader283: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/leader283/snapshot-00000000685C3EA3-32021FC0.v1
06:23:32,159 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader283: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/leader283/snapshot-00000000685C3EA3-32021FC0.v1
06:23:32,160 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader283: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:31.839Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15985395720075318921/leader283/snapshot-00000000685C3EA3-32021FC0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:32,160 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader283: local snapshot saved in 8.673 ms, deleting Pekko-persisted snapshots
06:23:32,163 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader283: Recovery completed in 11.61 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:32,165 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader283: Set currentTerm=1, votedFor=null
06:23:32,165 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader283: Local TermInfo store seeded with TermInfo{term=1}
06:23:32,165 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader283: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@1538543e
06:23:32,166 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader283: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:32,573 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
06:23:32,573 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader283 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.98:17355, Removed)
06:23:32,573 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader283 (Follower): Received ElectionTimeout - switching to Candidate
06:23:32,573 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader283 (Candidate): Election: Candidate has following voting peers: [follower285, follower284]
06:23:32,664 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader283: Set currentTerm=2, votedFor=leader283
06:23:32,664 PM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader283 (Candidate): Starting new election term 2
06:23:32,664 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader283 (Candidate): Sending RequestVote{term=2, candidateId=leader283, lastLogIndex=-1, lastLogTerm=-1} to peer follower285
06:23:32,664 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader283 (Candidate): Sending RequestVote{term=2, candidateId=leader283, lastLogIndex=-1, lastLogTerm=-1} to peer follower284
06:23:32,665 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader283 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
06:23:32,665 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower284 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
06:23:32,665 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower284 (Follower): Cluster state: []
06:23:32,665 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower284 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader283, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
06:23:32,665 PM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - follower284 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader283, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
06:23:32,665 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower285 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
06:23:32,665 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower285 (Follower): Cluster state: []
06:23:32,665 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower285 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader283, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
06:23:32,665 PM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower285 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader283, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
06:23:32,670 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower284: Set currentTerm=2, votedFor=null
06:23:32,670 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower284 (Follower): In requestVote: RequestVote{term=2, candidateId=leader283, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
06:23:32,670 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower285: Set currentTerm=2, votedFor=null
06:23:32,670 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower285 (Follower): In requestVote: RequestVote{term=2, candidateId=leader283, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
06:23:32,673 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower284: Set currentTerm=2, votedFor=leader283
06:23:32,673 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower284 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
06:23:32,673 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader283 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
06:23:32,674 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader283 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
06:23:32,674 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader283 (Leader): Election: Leader has following peers: [follower285, follower284, follower286]
06:23:32,674 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader283 (Leader): Checking sendAppendEntries for follower follower285: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:32,674 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader283 (Leader): Checking sendAppendEntries for follower follower284: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:32,674 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader283 (Leader): Checking sendAppendEntries for follower follower286: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:32,674 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader283 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
06:23:32,674 PM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - follower286 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader283, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
06:23:32,674 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader283 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower284 updated: matchIndex: -1, nextIndex: 0
06:23:32,674 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader283 (Leader): Checking sendAppendEntries for follower follower284: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:32,674 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower284: Last sync leader does not match current leader leader283, need to catch up to -1
[WARN] [06/25/2025 18:23:32.675] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower284] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower284, initialSyncDone=false]
[INFO] [pekkoDeadLetter][06/25/2025 18:23:32.675] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower284] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower284] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
06:23:32,675 PM [test-pekko.actor.default-dispatcher-11] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower284] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
06:23:32,675 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower285: Set currentTerm=2, votedFor=leader283
06:23:32,675 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower285 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
06:23:32,675 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower285: Last sync leader does not match current leader leader283, need to catch up to -1
06:23:32,675 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader283 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower285 updated: matchIndex: -1, nextIndex: 0
06:23:32,675 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader283 (Leader): Checking sendAppendEntries for follower follower285: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/25/2025 18:23:32.675] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower285] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower285, initialSyncDone=false]
[INFO] [pekkoDeadLetter][06/25/2025 18:23:32.675] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower285] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower285] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
06:23:32,675 PM [test-pekko.actor.default-dispatcher-15] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower285] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
06:23:32,677 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower286: Set currentTerm=2, votedFor=null
06:23:32,677 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower286: Last sync leader does not match current leader leader283, need to catch up to -1
06:23:32,677 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader283 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower286 updated: matchIndex: -1, nextIndex: 0
06:23:32,677 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader283 (Leader): Checking sendAppendEntries for follower follower286: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/25/2025 18:23:32.678] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower286] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower286, initialSyncDone=false]
[INFO] [pekkoDeadLetter][06/25/2025 18:23:32.678] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower286] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower286] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
06:23:32,678 PM [test-pekko.actor.default-dispatcher-6] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower286] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
06:23:32,716 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
06:23:32,716 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader283 starting
06:23:32,718 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader283: onShutDown
06:23:32,719 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader283: Initiating leader transfer
06:23:32,719 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorLeadershipTransferCohort - leader283: pauseLeader successfully completed - doing transfer
06:23:32,719 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Leader - leader283 (Leader): Attempting to transfer leadership
06:23:32,719 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower285: onLeaderTransitioning: LeaderTransitioning [leaderId=leader283]
06:23:32,719 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader283 (Leader): Checking sendAppendEntries for follower follower285: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:32,719 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower284: onLeaderTransitioning: LeaderTransitioning [leaderId=leader283]
06:23:32,719 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower286: onLeaderTransitioning: LeaderTransitioning [leaderId=leader283]
06:23:32,719 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader283 (Leader): Checking sendAppendEntries for follower follower284: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:32,719 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader283 (Leader): Checking sendAppendEntries for follower follower286: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:32,719 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower284: Lagging 0 entries behind leader leader283 and reached -1 (of expected -1)
06:23:32,720 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower286: Lagging 0 entries behind leader leader283 and reached -1 (of expected -1)
[WARN] [06/25/2025 18:23:32.720] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower284] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower284, initialSyncDone=true]
[WARN] [06/25/2025 18:23:32.720] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower286] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower286, initialSyncDone=true]
[INFO] [pekkoDeadLetter][06/25/2025 18:23:32.720] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower286] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower286] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
06:23:32,720 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower285: Lagging 0 entries behind leader leader283 and reached -1 (of expected -1)
[INFO] [pekkoDeadLetter][06/25/2025 18:23:32.720] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower284] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower284] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[WARN] [06/25/2025 18:23:32.720] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower285] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower285, initialSyncDone=true]
06:23:32,720 PM [test-pekko.actor.default-dispatcher-16] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower286] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
06:23:32,721 PM [test-pekko.actor.default-dispatcher-16] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower284] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[INFO] [pekkoDeadLetter][06/25/2025 18:23:32.721] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower285] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower285] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
06:23:32,721 PM [test-pekko.actor.default-dispatcher-6] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower285] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
06:23:32,794 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower285: Lagging 0 entries behind leader leader283 and reached -1 (of expected -1)
06:23:32,794 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower284: Lagging 0 entries behind leader leader283 and reached -1 (of expected -1)
06:23:32,794 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower286: Lagging 0 entries behind leader leader283 and reached -1 (of expected -1)
06:23:32,913 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower285: Lagging 0 entries behind leader leader283 and reached -1 (of expected -1)
06:23:32,913 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower284: Lagging 0 entries behind leader leader283 and reached -1 (of expected -1)
06:23:32,913 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower286: Lagging 0 entries behind leader leader283 and reached -1 (of expected -1)
06:23:33,33 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorLeadershipTransferCohort - leader283: leader transfer aborted
06:23:33,33 PM [test-pekko.actor.default-dispatcher-15] [WARN] RaftActorLeadershipTransferCohort - leader283: Failed to transfer leadership in 314.2 ms
06:23:33,33 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader283: leader transfer failed - sending PoisonPill
06:23:33,33 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Leader - leader283 (Leader): Leadership transfer expired
06:23:33,34 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower285: Lagging 0 entries behind leader leader283 and reached -1 (of expected -1)
06:23:33,34 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower284: Lagging 0 entries behind leader leader283 and reached -1 (of expected -1)
06:23:33,34 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower286: Lagging 0 entries behind leader leader283 and reached -1 (of expected -1)
06:23:33,34 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader283: stopped executor with 0 remaining tasks
06:23:33,34 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader283: stopped executor with 0 remaining tasks
[WARN] [06/25/2025 18:23:33.035] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/leader283] received dead letter from TestActor[pekko://test/user/follower285]: AppendEntriesReply{term=2, success=true, followerId=follower285, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
[WARN] [06/25/2025 18:23:33.035] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/leader283] received dead letter from TestActor[pekko://test/user/follower284]: AppendEntriesReply{term=2, success=true, followerId=follower284, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
[WARN] [06/25/2025 18:23:33.035] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/leader283] received dead letter from TestActor[pekko://test/user/follower286]: AppendEntriesReply{term=2, success=true, followerId=follower286, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
06:23:33,36 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader283 ending
06:23:33,38 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending
06:23:33,38 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower284-notifier287#-1549871374]
06:23:33,50 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower284-collector288#275724911]
06:23:33,51 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower284]
06:23:33,51 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower284: stopped executor with 0 remaining tasks
06:23:33,51 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower284: stopped executor with 0 remaining tasks
06:23:33,51 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower285-notifier289#751609667]
06:23:33,51 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower285-collector290#679921375]
06:23:33,52 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower285]
06:23:33,52 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower285: stopped executor with 0 remaining tasks
06:23:33,52 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower285: stopped executor with 0 remaining tasks
06:23:33,52 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower286-notifier291#882227723]
06:23:33,52 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower286-collector292#1824783757]
06:23:33,52 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower286]
06:23:33,52 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower286: stopped executor with 0 remaining tasks
06:23:33,52 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower286: stopped executor with 0 remaining tasks
06:23:33,53 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader283-notifier293#-1047467964]
06:23:33,53 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader283-collector294#-1571762050]
06:23:33,53 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader283]
06:23:33,55 PM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 starting
06:23:33,55 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [06/25/2025 18:23:33.058] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower296]: org.opendaylight.controller.cluster.common.actor.Monitor@1810e5e0
06:23:33,59 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower296: Starting recovery with journal batch size 1000
06:23:33,59 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower296: started executor
06:23:33,59 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower296: started executor
06:23:33,60 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/follower296/TermInfo.properties does not exist
06:23:33,61 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower296: no eligible files found
06:23:33,61 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - follower296: SnapshotOffer called.
06:23:33,61 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - follower296: initializing from snapshot taken at 2025-06-25T18:23:33.055Z
06:23:33,61 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower296: Set currentTerm=1, votedFor=null
06:23:33,61 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - follower296: Updated server config: isVoting: true, peers: [PeerInfo [id=follower298, address=pekko://test/user/follower298, votingState=NON_VOTING], PeerInfo [id=leader295, address=pekko://test/user/leader295, votingState=VOTING], PeerInfo [id=follower297, address=pekko://test/user/follower297, votingState=VOTING]]
06:23:33,61 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - Recovery snapshot applied for follower296 in 146.4 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:33,61 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower296: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:33.055Z
06:23:33,61 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower296: support() called
[WARN] [06/25/2025 18:23:33.061] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower297]: org.opendaylight.controller.cluster.common.actor.Monitor@3b0041f5
06:23:33,62 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower296: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/follower296/snapshot-00000000685C3EA5-03473BC0.tmp
06:23:33,62 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower297: Starting recovery with journal batch size 1000
06:23:33,62 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower297: started executor
06:23:33,62 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower297: started executor
06:23:33,63 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/follower297/TermInfo.properties does not exist
06:23:33,63 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower297: no eligible files found
06:23:33,63 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower297: SnapshotOffer called.
06:23:33,63 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower297: initializing from snapshot taken at 2025-06-25T18:23:33.055Z
06:23:33,63 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower297: Set currentTerm=1, votedFor=null
06:23:33,63 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - follower297: Updated server config: isVoting: true, peers: [PeerInfo [id=follower296, address=pekko://test/user/follower296, votingState=VOTING], PeerInfo [id=follower298, address=pekko://test/user/follower298, votingState=NON_VOTING], PeerInfo [id=leader295, address=pekko://test/user/leader295, votingState=VOTING]]
06:23:33,63 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - Recovery snapshot applied for follower297 in 57.09 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:33,63 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower297: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:33.055Z
06:23:33,63 PM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower297: support() called
06:23:33,63 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower297: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/follower297/snapshot-00000000685C3EA5-03473BC0.tmp
[WARN] [06/25/2025 18:23:33.065] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower298]: org.opendaylight.controller.cluster.common.actor.Monitor@35c7a8e5
06:23:33,65 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower298: Starting recovery with journal batch size 1000
06:23:33,65 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower298: started executor
06:23:33,65 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower298: started executor
06:23:33,66 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/follower298/TermInfo.properties does not exist
06:23:33,66 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower298: no eligible files found
06:23:33,66 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower298: SnapshotOffer called.
06:23:33,66 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower298: initializing from snapshot taken at 2025-06-25T18:23:33.055Z
06:23:33,66 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower298: Set currentTerm=1, votedFor=null
06:23:33,67 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - follower298: Updated server config: isVoting: false, peers: [PeerInfo [id=follower296, address=pekko://test/user/follower296, votingState=VOTING], PeerInfo [id=leader295, address=pekko://test/user/leader295, votingState=VOTING], PeerInfo [id=follower297, address=pekko://test/user/follower297, votingState=VOTING]]
06:23:33,67 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower297: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/follower297/snapshot-00000000685C3EA5-03473BC0.v1
06:23:33,67 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower297: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/follower297/snapshot-00000000685C3EA5-03473BC0.v1
06:23:33,67 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for follower298 in 103.7 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:33,67 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower298: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:33.055Z
06:23:33,67 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower298: support() called
06:23:33,67 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower297: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:33.055Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/follower297/snapshot-00000000685C3EA5-03473BC0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:33,67 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower297: local snapshot saved in 3.940 ms, deleting Pekko-persisted snapshots
06:23:33,67 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower298: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/follower298/snapshot-00000000685C3EA5-03473BC0.tmp
06:23:33,68 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower296: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/follower296/snapshot-00000000685C3EA5-03473BC0.v1
06:23:33,68 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower296: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/follower296/snapshot-00000000685C3EA5-03473BC0.v1
06:23:33,68 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower296: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:33.055Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/follower296/snapshot-00000000685C3EA5-03473BC0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:33,68 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower297: Recovery completed in 5.063 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:33,68 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower296: local snapshot saved in 6.725 ms, deleting Pekko-persisted snapshots
06:23:33,69 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower296: Recovery completed in 8.078 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:33,69 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower298: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/follower298/snapshot-00000000685C3EA5-03473BC0.v1
06:23:33,69 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower298: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/follower298/snapshot-00000000685C3EA5-03473BC0.v1
06:23:33,69 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower298: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:33.055Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/follower298/snapshot-00000000685C3EA5-03473BC0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:33,69 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower298: local snapshot saved in 2.521 ms, deleting Pekko-persisted snapshots
[WARN] [06/25/2025 18:23:33.070] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader295]: org.opendaylight.controller.cluster.common.actor.Monitor@449fcc50
06:23:33,70 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - leader295: Starting recovery with journal batch size 1000
06:23:33,70 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader295: started executor
06:23:33,70 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader295: started executor
06:23:33,71 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower298: Recovery completed in 4.160 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:33,72 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/leader295/TermInfo.properties does not exist
06:23:33,72 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader295: no eligible files found
06:23:33,72 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - leader295: SnapshotOffer called.
06:23:33,72 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - leader295: initializing from snapshot taken at 2025-06-25T18:23:33.055Z
06:23:33,72 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader295: Set currentTerm=1, votedFor=null
06:23:33,72 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PeerInfos - leader295: Updated server config: isVoting: true, peers: [PeerInfo [id=follower296, address=pekko://test/user/follower296, votingState=VOTING], PeerInfo [id=follower298, address=pekko://test/user/follower298, votingState=NON_VOTING], PeerInfo [id=follower297, address=pekko://test/user/follower297, votingState=VOTING]]
06:23:33,72 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - Recovery snapshot applied for leader295 in 81.19 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:33,72 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader295: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:33.055Z
06:23:33,72 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader295: support() called
06:23:33,72 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower297: Set currentTerm=1, votedFor=null
06:23:33,72 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower297: Local TermInfo store seeded with TermInfo{term=1}
06:23:33,72 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower297: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@56e36406
06:23:33,72 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader295: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/leader295/snapshot-00000000685C3EA5-03473BC0.tmp
06:23:33,73 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower297: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:33,73 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower296: Set currentTerm=1, votedFor=null
06:23:33,73 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower296: Local TermInfo store seeded with TermInfo{term=1}
06:23:33,73 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower296: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@fc5eac
06:23:33,73 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower296: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:33,74 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower298: Set currentTerm=1, votedFor=null
06:23:33,74 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower298: Local TermInfo store seeded with TermInfo{term=1}
06:23:33,74 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower298: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@75263bd5
06:23:33,74 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader295: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/leader295/snapshot-00000000685C3EA5-03473BC0.v1
06:23:33,74 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader295: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/leader295/snapshot-00000000685C3EA5-03473BC0.v1
06:23:33,74 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower298: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:33,74 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader295: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:33.055Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6168315406456836330/leader295/snapshot-00000000685C3EA5-03473BC0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:33,75 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader295: local snapshot saved in 2.455 ms, deleting Pekko-persisted snapshots
06:23:33,75 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader295: Recovery completed in 3.380 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:33,77 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader295: Set currentTerm=1, votedFor=null
06:23:33,77 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader295: Local TermInfo store seeded with TermInfo{term=1}
06:23:33,77 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader295: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@f45fedc
06:23:33,77 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader295: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:33,453 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
06:23:33,453 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader295 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.98:17355, Removed)
06:23:33,453 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader295 (Follower): Received ElectionTimeout - switching to Candidate
06:23:33,453 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader295 (Candidate): Election: Candidate has following voting peers: [follower296, follower297]
06:23:33,457 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader295: Set currentTerm=2, votedFor=leader295
06:23:33,457 PM [test-pekko.actor.default-dispatcher-6] [INFO] Candidate - leader295 (Candidate): Starting new election term 2
06:23:33,457 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader295 (Candidate): Sending RequestVote{term=2, candidateId=leader295, lastLogIndex=-1, lastLogTerm=-1} to peer follower296
06:23:33,457 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader295 (Candidate): Sending RequestVote{term=2, candidateId=leader295, lastLogIndex=-1, lastLogTerm=-1} to peer follower297
06:23:33,457 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader295 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
06:23:33,457 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower296 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
06:23:33,457 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower297 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
06:23:33,457 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower296 (Follower): Cluster state: []
06:23:33,457 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower296 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader295, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
06:23:33,457 PM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower296 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader295, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
06:23:33,457 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower297 (Follower): Cluster state: []
06:23:33,457 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower297 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader295, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
06:23:33,457 PM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower297 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader295, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
06:23:33,459 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower296: Set currentTerm=2, votedFor=null
06:23:33,459 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower297: Set currentTerm=2, votedFor=null
06:23:33,459 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower296 (Follower): In requestVote: RequestVote{term=2, candidateId=leader295, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
06:23:33,459 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower297 (Follower): In requestVote: RequestVote{term=2, candidateId=leader295, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
06:23:33,461 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower297: Set currentTerm=2, votedFor=leader295
06:23:33,461 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower297 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
06:23:33,461 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader295 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
06:23:33,461 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader295 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
06:23:33,461 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader295 (Leader): Election: Leader has following peers: [follower296, follower298, follower297]
06:23:33,461 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader295 (Leader): Checking sendAppendEntries for follower follower296: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:33,461 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader295 (Leader): Checking sendAppendEntries for follower follower298: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:33,461 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader295 (Leader): Checking sendAppendEntries for follower follower297: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:33,461 PM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader295 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
06:23:33,461 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower296: Set currentTerm=2, votedFor=leader295
06:23:33,461 PM [test-pekko.actor.default-dispatcher-11] [INFO] Follower - follower298 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader295, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
06:23:33,461 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower296 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
06:23:33,462 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower296: Last sync leader does not match current leader leader295, need to catch up to -1
06:23:33,462 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader295 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower296 updated: matchIndex: -1, nextIndex: 0
06:23:33,462 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader295 (Leader): Checking sendAppendEntries for follower follower296: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/25/2025 18:23:33.462] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower296] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower296, initialSyncDone=false]
06:23:33,462 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower297: Last sync leader does not match current leader leader295, need to catch up to -1
06:23:33,462 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader295 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower297 updated: matchIndex: -1, nextIndex: 0
06:23:33,462 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader295 (Leader): Checking sendAppendEntries for follower follower297: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/25/2025 18:23:33.462] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower297] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower297, initialSyncDone=false]
06:23:33,463 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower298: Set currentTerm=2, votedFor=null
06:23:33,463 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower298: Last sync leader does not match current leader leader295, need to catch up to -1
06:23:33,463 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader295 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower298 updated: matchIndex: -1, nextIndex: 0
[WARN] [06/25/2025 18:23:33.463] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower298] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower298, initialSyncDone=false]
06:23:33,463 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader295 (Leader): Checking sendAppendEntries for follower follower298: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:33,482 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
06:23:33,482 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
06:23:33,483 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
06:23:33,483 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
06:23:33,483 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
06:23:33,483 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader295: onRequestLeadership RequestLeadership [requestedFollowerId=follower297, replyTo=Actor[pekko://test/user/$a#430479976]]
06:23:33,485 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader295: Initiating leader transfer
06:23:33,485 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower296: onLeaderTransitioning: LeaderTransitioning [leaderId=leader295]
06:23:33,485 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower297: onLeaderTransitioning: LeaderTransitioning [leaderId=leader295]
06:23:33,485 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader295: pauseLeader successfully completed - doing transfer
06:23:33,485 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader295 (Leader): Attempting to transfer leadership
06:23:33,485 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower298: onLeaderTransitioning: LeaderTransitioning [leaderId=leader295]
06:23:33,485 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader295 (Leader): Checking sendAppendEntries for follower follower296: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:33,485 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader295 (Leader): Checking sendAppendEntries for follower follower298: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:33,485 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower296: Lagging 0 entries behind leader leader295 and reached -1 (of expected -1)
06:23:33,485 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader295 (Leader): Checking sendAppendEntries for follower follower297: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:33,485 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower298: Lagging 0 entries behind leader leader295 and reached -1 (of expected -1)
06:23:33,486 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower297: Lagging 0 entries behind leader leader295 and reached -1 (of expected -1)
[WARN] [06/25/2025 18:23:33.486] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower298] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower298, initialSyncDone=true]
[WARN] [06/25/2025 18:23:33.486] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower297] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower297, initialSyncDone=true]
[WARN] [06/25/2025 18:23:33.486] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower296] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower296, initialSyncDone=true]
06:23:33,486 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader295 (Leader): tryToCompleteLeadershipTransfer: followerId: follower297, matchIndex: -1, lastIndex: -1, isVoting: true
06:23:33,486 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader295 (Leader): Follower's log matches - sending ElectionTimeout
06:23:33,486 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader295 (Leader): Checking sendAppendEntries for follower follower296: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:33,486 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader295 (Leader): Checking sendAppendEntries for follower follower298: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:33,486 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower296: Lagging 0 entries behind leader leader295 and reached -1 (of expected -1)
06:23:33,486 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower298: Lagging 0 entries behind leader leader295 and reached -1 (of expected -1)
06:23:33,486 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader295 (Leader): Checking sendAppendEntries for follower follower297: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:33,486 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower297: Lagging 0 entries behind leader leader295 and reached -1 (of expected -1)
06:23:33,486 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader295 (Leader): Leader transfer complete
06:23:33,486 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader295: leader transfer complete - waiting for new leader
06:23:33,486 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
06:23:33,487 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower297 (Follower): Received TimeoutNow - switching to Candidate
06:23:33,487 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - follower297 (Candidate): Election: Candidate has following voting peers: [follower296, leader295]
06:23:33,489 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower297: Set currentTerm=3, votedFor=follower297
06:23:33,489 PM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - follower297 (Candidate): Starting new election term 3
06:23:33,489 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - follower297 (Candidate): Sending RequestVote{term=3, candidateId=follower297, lastLogIndex=-1, lastLogTerm=-1} to peer follower296
06:23:33,489 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - follower297 (Candidate): Sending RequestVote{term=3, candidateId=follower297, lastLogIndex=-1, lastLogTerm=-1} to peer leader295
06:23:33,489 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower296 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
06:23:33,489 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader295 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
06:23:33,489 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader295 (Leader): Cluster state: []
06:23:33,489 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower296 (Follower): Cluster state: []
06:23:33,489 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader295 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower297, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
06:23:33,489 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower296 (Follower): Candidate in requestVote:RequestVote{term=3, candidateId=follower297, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
06:23:33,489 PM [test-pekko.actor.default-dispatcher-11] [INFO] AbstractLeader - leader295 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower297, lastLogIndex=-1, lastLogTerm=-1}" message is greater than leader's term 2 - switching to Follower
06:23:33,489 PM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower296 (Follower): Term 3 in "RequestVote{term=3, candidateId=follower297, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 2 - updating term
06:23:33,489 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - follower297 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
06:23:33,491 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader295: Set currentTerm=3, votedFor=null
06:23:33,491 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader295 (Leader): Leadership transfer in progress - processing RequestVote
06:23:33,491 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader295 (Leader): In requestVote: RequestVote{term=3, candidateId=follower297, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
06:23:33,492 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower296: Set currentTerm=3, votedFor=null
06:23:33,492 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower296 (Follower): In requestVote: RequestVote{term=3, candidateId=follower297, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
06:23:33,493 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader295: Set currentTerm=3, votedFor=follower297
06:23:33,493 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader295 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
06:23:33,493 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - follower297 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3
06:23:33,493 PM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader295 (Leader) :- Switching from behavior Leader to Follower, election term: 3
06:23:33,493 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower296: Set currentTerm=3, votedFor=follower297
06:23:33,493 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower296 (Follower): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
06:23:33,493 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - follower297 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1
06:23:33,494 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower297 (Leader): Election: Leader has following peers: [follower296, follower298, leader295]
06:23:33,494 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower297 (Leader): Checking sendAppendEntries for follower follower296: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:33,494 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower297 (Leader): Checking sendAppendEntries for follower follower298: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:33,494 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower297 (Leader): Checking sendAppendEntries for follower leader295: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:33,494 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower296: Last sync leader does not match current leader follower297, need to catch up to -1
06:23:33,494 PM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower298 (Follower): Term 3 in "AppendEntries{term=3, leaderId=follower297, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 2 - updating term
06:23:33,494 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - follower297 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
06:23:33,494 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - leader295: Last sync leader does not match current leader follower297, need to catch up to -1
06:23:33,494 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorLeadershipTransferCohort - leader295: leader changed to follower297
06:23:33,494 PM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorLeadershipTransferCohort - leader295: Successfully transferred leadership to follower297 in 9.142 ms
06:23:33,494 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader295: Leadership transferred successfully to follower297
06:23:33,494 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower297 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower296 updated: matchIndex: -1, nextIndex: 0
06:23:33,494 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower297 (Leader): Checking sendAppendEntries for follower follower296: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/25/2025 18:23:33.495] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/leader295] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=leader295, initialSyncDone=false]
06:23:33,495 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower297 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader295 updated: matchIndex: -1, nextIndex: 0
06:23:33,495 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower297 (Leader): Checking sendAppendEntries for follower leader295: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/25/2025 18:23:33.495] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower296] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower296, initialSyncDone=false]
06:23:33,496 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower298: Set currentTerm=3, votedFor=null
06:23:33,496 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower298: Last sync leader does not match current leader follower297, need to catch up to -1
06:23:33,496 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower297 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower298 updated: matchIndex: -1, nextIndex: 0
[WARN] [06/25/2025 18:23:33.496] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower298] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower298, initialSyncDone=false]
06:23:33,496 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower297 (Leader): Checking sendAppendEntries for follower follower298: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:33,534 PM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 ending
06:23:33,534 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower296-notifier299#1786138997]
06:23:33,545 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower296-collector300#1530799532]
06:23:33,546 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower296]
06:23:33,546 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower296: stopped executor with 0 remaining tasks
06:23:33,546 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower296: stopped executor with 0 remaining tasks
06:23:33,546 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower297-notifier301#-1547187545]
06:23:33,546 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower297-collector302#679887298]
06:23:33,546 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower297]
06:23:33,547 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower297: stopped executor with 0 remaining tasks
06:23:33,547 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower297: stopped executor with 0 remaining tasks
06:23:33,547 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower298-notifier303#-1910622387]
06:23:33,547 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower298-collector304#782758966]
06:23:33,547 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower298]
06:23:33,547 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower298: stopped executor with 0 remaining tasks
06:23:33,547 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower298: stopped executor with 0 remaining tasks
06:23:33,547 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader295-notifier305#-624719193]
06:23:33,547 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader295-collector306#1047745308]
06:23:33,548 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader295]
06:23:33,548 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader295: stopped executor with 0 remaining tasks
06:23:33,548 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader295: stopped executor with 0 remaining tasks
06:23:33,548 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$a#430479976]
06:23:33,550 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown starting
06:23:33,550 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [06/25/2025 18:23:33.552] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower308]: org.opendaylight.controller.cluster.common.actor.Monitor@431e03bf
06:23:33,553 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - follower308: Starting recovery with journal batch size 1000
06:23:33,553 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower308: started executor
06:23:33,553 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower308: started executor
06:23:33,553 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/follower308/TermInfo.properties does not exist
06:23:33,554 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower308: no eligible files found
06:23:33,554 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - follower308: SnapshotOffer called.
06:23:33,554 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - follower308: initializing from snapshot taken at 2025-06-25T18:23:33.550Z
06:23:33,554 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower308: Set currentTerm=1, votedFor=null
06:23:33,554 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PeerInfos - follower308: Updated server config: isVoting: true, peers: [PeerInfo [id=follower309, address=pekko://test/user/follower309, votingState=VOTING], PeerInfo [id=follower310, address=pekko://test/user/follower310, votingState=NON_VOTING], PeerInfo [id=leader307, address=pekko://test/user/leader307, votingState=VOTING]]
06:23:33,554 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - Recovery snapshot applied for follower308 in 66.68 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:33,554 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower308: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:33.550Z
06:23:33,554 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower308: support() called
06:23:33,554 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower308: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/follower308/snapshot-00000000685C3EA5-20C85580.tmp
[WARN] [06/25/2025 18:23:33.555] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower309]: org.opendaylight.controller.cluster.common.actor.Monitor@6631c130
06:23:33,555 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower309: Starting recovery with journal batch size 1000
06:23:33,555 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower309: started executor
06:23:33,555 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower309: started executor
06:23:33,556 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/follower309/TermInfo.properties does not exist
06:23:33,556 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower309: no eligible files found
06:23:33,556 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - follower309: SnapshotOffer called.
06:23:33,556 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - follower309: initializing from snapshot taken at 2025-06-25T18:23:33.550Z
06:23:33,556 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower309: Set currentTerm=1, votedFor=null
06:23:33,556 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower308: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/follower308/snapshot-00000000685C3EA5-20C85580.v1
06:23:33,556 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - follower309: Updated server config: isVoting: true, peers: [PeerInfo [id=follower308, address=pekko://test/user/follower308, votingState=VOTING], PeerInfo [id=follower310, address=pekko://test/user/follower310, votingState=NON_VOTING], PeerInfo [id=leader307, address=pekko://test/user/leader307, votingState=VOTING]]
06:23:33,556 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - Recovery snapshot applied for follower309 in 60.35 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:33,556 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower309: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:33.550Z
06:23:33,556 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower309: support() called
06:23:33,557 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower308: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/follower308/snapshot-00000000685C3EA5-20C85580.v1
06:23:33,557 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower309: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/follower309/snapshot-00000000685C3EA5-20C85580.tmp
06:23:33,557 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower308: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:33.550Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/follower308/snapshot-00000000685C3EA5-20C85580.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:33,557 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower308: local snapshot saved in 2.920 ms, deleting Pekko-persisted snapshots
06:23:33,557 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower308: Recovery completed in 3.729 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:33,559 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower309: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/follower309/snapshot-00000000685C3EA5-20C85580.v1
06:23:33,559 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower309: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/follower309/snapshot-00000000685C3EA5-20C85580.v1
06:23:33,559 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower309: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:33.550Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/follower309/snapshot-00000000685C3EA5-20C85580.v1, size=275, entryCompress=NONE, stateCompress=NONE}
[WARN] [06/25/2025 18:23:33.559] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower310]: org.opendaylight.controller.cluster.common.actor.Monitor@22dd3551
06:23:33,559 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower309: local snapshot saved in 2.614 ms, deleting Pekko-persisted snapshots
06:23:33,559 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower308: Set currentTerm=1, votedFor=null
06:23:33,559 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower308: Local TermInfo store seeded with TermInfo{term=1}
06:23:33,559 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower308: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@66a4c988
06:23:33,560 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower309: Recovery completed in 3.767 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:33,560 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower308: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:33,560 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower310: Starting recovery with journal batch size 1000
06:23:33,561 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower310: started executor
06:23:33,561 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower310: started executor
06:23:33,561 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower309: Set currentTerm=1, votedFor=null
06:23:33,561 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower309: Local TermInfo store seeded with TermInfo{term=1}
06:23:33,561 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower309: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@3fb60ba8
06:23:33,562 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower309: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:33,562 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/follower310/TermInfo.properties does not exist
06:23:33,562 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower310: no eligible files found
06:23:33,562 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower310: SnapshotOffer called.
06:23:33,562 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower310: initializing from snapshot taken at 2025-06-25T18:23:33.550Z
06:23:33,562 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower310: Set currentTerm=1, votedFor=null
06:23:33,562 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - follower310: Updated server config: isVoting: false, peers: [PeerInfo [id=follower308, address=pekko://test/user/follower308, votingState=VOTING], PeerInfo [id=follower309, address=pekko://test/user/follower309, votingState=VOTING], PeerInfo [id=leader307, address=pekko://test/user/leader307, votingState=VOTING]]
06:23:33,562 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for follower310 in 141.4 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:33,563 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower310: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:33.550Z
06:23:33,563 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower310: support() called
06:23:33,563 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower310: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/follower310/snapshot-00000000685C3EA5-20C85580.tmp
[WARN] [06/25/2025 18:23:33.563] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader307]: org.opendaylight.controller.cluster.common.actor.Monitor@6b44ec07
06:23:33,564 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader307: Starting recovery with journal batch size 1000
06:23:33,564 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader307: started executor
06:23:33,564 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader307: started executor
06:23:33,565 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower310: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/follower310/snapshot-00000000685C3EA5-20C85580.v1
06:23:33,565 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/leader307/TermInfo.properties does not exist
06:23:33,565 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower310: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/follower310/snapshot-00000000685C3EA5-20C85580.v1
06:23:33,565 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader307: no eligible files found
06:23:33,565 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - leader307: SnapshotOffer called.
06:23:33,565 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - leader307: initializing from snapshot taken at 2025-06-25T18:23:33.550Z
06:23:33,565 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader307: Set currentTerm=1, votedFor=null
06:23:33,565 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - leader307: Updated server config: isVoting: true, peers: [PeerInfo [id=follower308, address=pekko://test/user/follower308, votingState=VOTING], PeerInfo [id=follower309, address=pekko://test/user/follower309, votingState=VOTING], PeerInfo [id=follower310, address=pekko://test/user/follower310, votingState=NON_VOTING]]
06:23:33,565 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower310: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:33.550Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/follower310/snapshot-00000000685C3EA5-20C85580.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:33,565 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower310: local snapshot saved in 2.701 ms, deleting Pekko-persisted snapshots
06:23:33,565 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - Recovery snapshot applied for leader307 in 69.35 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:33,565 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader307: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:33.550Z
06:23:33,566 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader307: support() called
06:23:33,566 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader307: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/leader307/snapshot-00000000685C3EA5-20C85580.tmp
06:23:33,566 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower310: Recovery completed in 4.240 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:33,568 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader307: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/leader307/snapshot-00000000685C3EA5-20C85580.v1
06:23:33,568 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader307: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/leader307/snapshot-00000000685C3EA5-20C85580.v1
06:23:33,568 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader307: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:33.550Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest9410020184778901778/leader307/snapshot-00000000685C3EA5-20C85580.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:33,568 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader307: local snapshot saved in 2.473 ms, deleting Pekko-persisted snapshots
06:23:33,568 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower310: Set currentTerm=1, votedFor=null
06:23:33,568 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower310: Local TermInfo store seeded with TermInfo{term=1}
06:23:33,568 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower310: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@6bbe68bd
06:23:33,569 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader307: Recovery completed in 3.425 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:33,569 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower310: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:33,570 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader307: Set currentTerm=1, votedFor=null
06:23:33,570 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader307: Local TermInfo store seeded with TermInfo{term=1}
06:23:33,570 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader307: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@eff7e29
06:23:33,571 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader307: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:33,923 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
06:23:33,923 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader307 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.98:17355, Removed)
06:23:33,923 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader307 (Follower): Received ElectionTimeout - switching to Candidate
06:23:33,923 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader307 (Candidate): Election: Candidate has following voting peers: [follower308, follower309]
06:23:33,970 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader307: Set currentTerm=2, votedFor=leader307
06:23:33,970 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader307 (Candidate): Starting new election term 2
06:23:33,970 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader307 (Candidate): Sending RequestVote{term=2, candidateId=leader307, lastLogIndex=-1, lastLogTerm=-1} to peer follower308
06:23:33,970 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader307 (Candidate): Sending RequestVote{term=2, candidateId=leader307, lastLogIndex=-1, lastLogTerm=-1} to peer follower309
06:23:33,970 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower309 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
06:23:33,970 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower309 (Follower): Cluster state: []
06:23:33,970 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower309 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader307, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
06:23:33,970 PM [test-pekko.actor.default-dispatcher-11] [INFO] Follower - follower309 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader307, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
06:23:33,970 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower308 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
06:23:33,970 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower308 (Follower): Cluster state: []
06:23:33,970 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower308 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader307, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
06:23:33,970 PM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower308 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader307, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
06:23:33,970 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader307 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
06:23:33,998 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower309: Set currentTerm=2, votedFor=null
06:23:33,999 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower309 (Follower): In requestVote: RequestVote{term=2, candidateId=leader307, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
06:23:33,999 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower308: Set currentTerm=2, votedFor=null
06:23:34,0 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower308 (Follower): In requestVote: RequestVote{term=2, candidateId=leader307, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
06:23:34,102 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower309: Set currentTerm=2, votedFor=leader307
06:23:34,103 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower309 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
06:23:34,103 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader307 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
06:23:34,103 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader307 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
06:23:34,103 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader307 (Leader): Election: Leader has following peers: [follower308, follower309, follower310]
06:23:34,103 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader307 (Leader): Checking sendAppendEntries for follower follower308: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:34,103 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader307 (Leader): Checking sendAppendEntries for follower follower309: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:34,103 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader307 (Leader): Checking sendAppendEntries for follower follower310: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:34,103 PM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader307 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
06:23:34,103 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower309: Last sync leader does not match current leader leader307, need to catch up to -1
06:23:34,104 PM [test-pekko.actor.default-dispatcher-11] [INFO] Follower - follower310 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader307, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
06:23:34,104 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader307 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower309 updated: matchIndex: -1, nextIndex: 0
06:23:34,104 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader307 (Leader): Checking sendAppendEntries for follower follower309: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/25/2025 18:23:34.104] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower309] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower309, initialSyncDone=false]
06:23:34,122 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
06:23:34,122 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
06:23:34,123 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
06:23:34,123 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower309 starting
06:23:34,123 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower309: onShutDown
06:23:34,124 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower309: stopped executor with 0 remaining tasks
06:23:34,124 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower309: stopped executor with 0 remaining tasks
06:23:34,124 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower309 ending
06:23:34,124 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
06:23:34,124 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
06:23:34,124 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader307: onRequestLeadership RequestLeadership [requestedFollowerId=follower309, replyTo=Actor[pekko://test/user/$b#-1994352343]]
06:23:34,124 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader307: Initiating leader transfer
[WARN] [06/25/2025 18:23:34.124] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower309] received dead letter from TestActor[pekko://test/user/leader307]: LeaderTransitioning [leaderId=leader307]
06:23:34,124 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorLeadershipTransferCohort - leader307: pauseLeader successfully completed - doing transfer
06:23:34,124 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Leader - leader307 (Leader): Attempting to transfer leadership
06:23:34,125 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader307 (Leader): Checking sendAppendEntries for follower follower308: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:34,125 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader307 (Leader): Checking sendAppendEntries for follower follower309: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:34,125 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader307 (Leader): Checking sendAppendEntries for follower follower310: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/25/2025 18:23:34.125] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower309] received dead letter from TestActor[pekko://test/user/leader307]: AppendEntries{term=2, leaderId=leader307, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
06:23:34,131 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower308: Set currentTerm=2, votedFor=leader307
06:23:34,131 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower308 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
06:23:34,131 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower308: Last sync leader does not match current leader leader307, need to catch up to -1
06:23:34,132 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower308: Lagging 0 entries behind leader leader307 and reached -1 (of expected -1)
06:23:34,132 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower308: onLeaderTransitioning: LeaderTransitioning [leaderId=leader307]
06:23:34,132 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader307 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower308 updated: matchIndex: -1, nextIndex: 0
[WARN] [06/25/2025 18:23:34.132] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower308] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower308, initialSyncDone=false]
06:23:34,132 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader307 (Leader): Checking sendAppendEntries for follower follower308: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/25/2025 18:23:34.132] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower308] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower308, initialSyncDone=true]
[WARN] [06/25/2025 18:23:34.223] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower309] received dead letter from TestActor[pekko://test/user/leader307]: AppendEntries{term=2, leaderId=leader307, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
06:23:34,223 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower310: Set currentTerm=2, votedFor=null
06:23:34,224 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower310: Last sync leader does not match current leader leader307, need to catch up to -1
06:23:34,224 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower310: Lagging 0 entries behind leader leader307 and reached -1 (of expected -1)
06:23:34,224 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader307 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower310 updated: matchIndex: -1, nextIndex: 0
06:23:34,224 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader307 (Leader): Checking sendAppendEntries for follower follower310: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:34,224 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower310: Lagging 0 entries behind leader leader307 and reached -1 (of expected -1)
06:23:34,224 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower310: onLeaderTransitioning: LeaderTransitioning [leaderId=leader307]
[WARN] [06/25/2025 18:23:34.224] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower310] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower310, initialSyncDone=false]
[WARN] [06/25/2025 18:23:34.224] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower310] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower310, initialSyncDone=true]
06:23:34,343 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower308: Lagging 0 entries behind leader leader307 and reached -1 (of expected -1)
[WARN] [06/25/2025 18:23:34.343] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower309] received dead letter from TestActor[pekko://test/user/leader307]: AppendEntries{term=2, leaderId=leader307, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
06:23:34,344 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower310: Lagging 0 entries behind leader leader307 and reached -1 (of expected -1)
06:23:34,463 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorLeadershipTransferCohort - leader307: leader transfer aborted
06:23:34,463 PM [test-pekko.actor.default-dispatcher-11] [WARN] RaftActorLeadershipTransferCohort - leader307: Failed to transfer leadership in 338.7 ms
06:23:34,463 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader307: LeadershipTransfer request from follower309 failed
06:23:34,464 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Leader - leader307 (Leader): Leadership transfer expired
06:23:34,464 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower310: Lagging 0 entries behind leader leader307 and reached -1 (of expected -1)
[WARN] [06/25/2025 18:23:34.464] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower309] received dead letter from TestActor[pekko://test/user/leader307]: AppendEntries{term=2, leaderId=leader307, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
06:23:34,464 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower308: Lagging 0 entries behind leader leader307 and reached -1 (of expected -1)
06:23:34,476 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown ending
06:23:34,476 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower308-notifier311#1416161125]
06:23:34,487 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower308-collector312#762636307]
06:23:34,488 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower308]
06:23:34,488 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower308: stopped executor with 0 remaining tasks
06:23:34,488 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower308: stopped executor with 0 remaining tasks
06:23:34,488 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower309-notifier313#2088097652]
06:23:34,488 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower309-collector314#-257741241]
06:23:34,488 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower309]
06:23:34,489 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower310-notifier315#725752952]
06:23:34,489 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower310-collector316#-624899613]
06:23:34,489 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower310]
06:23:34,489 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower310: stopped executor with 0 remaining tasks
06:23:34,489 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower310: stopped executor with 0 remaining tasks
06:23:34,489 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader307-notifier317#2103036263]
06:23:34,489 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader307-collector318#878763002]
06:23:34,489 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader307]
06:23:34,490 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader307: stopped executor with 0 remaining tasks
06:23:34,490 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader307: stopped executor with 0 remaining tasks
06:23:34,490 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$b#-1994352343]
06:23:34,491 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown starting
06:23:34,491 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [06/25/2025 18:23:34.493] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower320]: org.opendaylight.controller.cluster.common.actor.Monitor@79ae15c7
06:23:34,494 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower320: Starting recovery with journal batch size 1000
06:23:34,494 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower320: started executor
06:23:34,494 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower320: started executor
06:23:34,495 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/follower320/TermInfo.properties does not exist
06:23:34,495 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower320: no eligible files found
06:23:34,495 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower320: SnapshotOffer called.
06:23:34,495 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower320: initializing from snapshot taken at 2025-06-25T18:23:34.491Z
06:23:34,495 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower320: Set currentTerm=1, votedFor=null
06:23:34,495 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PeerInfos - follower320: Updated server config: isVoting: true, peers: [PeerInfo [id=follower322, address=pekko://test/user/follower322, votingState=NON_VOTING], PeerInfo [id=leader319, address=pekko://test/user/leader319, votingState=VOTING], PeerInfo [id=follower321, address=pekko://test/user/follower321, votingState=VOTING]]
06:23:34,495 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - Recovery snapshot applied for follower320 in 67.82 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:34,496 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower320: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:34.491Z
06:23:34,496 PM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower320: support() called
06:23:34,496 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower320: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/follower320/snapshot-00000000685C3EA6-1D4410C0.tmp
[WARN] [06/25/2025 18:23:34.496] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower321]: org.opendaylight.controller.cluster.common.actor.Monitor@5cf85851
06:23:34,497 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower321: Starting recovery with journal batch size 1000
06:23:34,497 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower321: started executor
06:23:34,497 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower321: started executor
06:23:34,498 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/follower321/TermInfo.properties does not exist
06:23:34,498 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower321: no eligible files found
06:23:34,498 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower321: SnapshotOffer called.
06:23:34,498 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower321: initializing from snapshot taken at 2025-06-25T18:23:34.491Z
06:23:34,498 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower321: Set currentTerm=1, votedFor=null
06:23:34,498 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - follower321: Updated server config: isVoting: true, peers: [PeerInfo [id=follower322, address=pekko://test/user/follower322, votingState=NON_VOTING], PeerInfo [id=leader319, address=pekko://test/user/leader319, votingState=VOTING], PeerInfo [id=follower320, address=pekko://test/user/follower320, votingState=VOTING]]
06:23:34,499 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for follower321 in 106.9 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:34,499 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower321: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:34.491Z
06:23:34,499 PM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower321: support() called
06:23:34,499 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower321: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/follower321/snapshot-00000000685C3EA6-1D4410C0.tmp
06:23:34,499 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower320: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/follower320/snapshot-00000000685C3EA6-1D4410C0.v1
06:23:34,499 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower320: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/follower320/snapshot-00000000685C3EA6-1D4410C0.v1
[WARN] [06/25/2025 18:23:34.499] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower322]: org.opendaylight.controller.cluster.common.actor.Monitor@14074b87
06:23:34,499 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower320: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:34.491Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/follower320/snapshot-00000000685C3EA6-1D4410C0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:34,499 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower320: local snapshot saved in 3.878 ms, deleting Pekko-persisted snapshots
06:23:34,500 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower320: Recovery completed in 4.865 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:34,502 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower321: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/follower321/snapshot-00000000685C3EA6-1D4410C0.v1
06:23:34,502 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower322: Starting recovery with journal batch size 1000
06:23:34,502 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower320: Set currentTerm=1, votedFor=null
06:23:34,502 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower320: Local TermInfo store seeded with TermInfo{term=1}
06:23:34,502 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower320: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@3b17a9ff
06:23:34,502 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower321: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/follower321/snapshot-00000000685C3EA6-1D4410C0.v1
06:23:34,502 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower322: started executor
06:23:34,502 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower321: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:34.491Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/follower321/snapshot-00000000685C3EA6-1D4410C0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:34,502 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower321: local snapshot saved in 3.293 ms, deleting Pekko-persisted snapshots
06:23:34,502 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower320: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:34,502 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower322: started executor
06:23:34,503 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower321: Recovery completed in 4.179 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:34,503 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/follower322/TermInfo.properties does not exist
06:23:34,503 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower322: no eligible files found
06:23:34,503 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower322: SnapshotOffer called.
06:23:34,503 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower322: initializing from snapshot taken at 2025-06-25T18:23:34.491Z
06:23:34,503 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower322: Set currentTerm=1, votedFor=null
06:23:34,503 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - follower322: Updated server config: isVoting: false, peers: [PeerInfo [id=leader319, address=pekko://test/user/leader319, votingState=VOTING], PeerInfo [id=follower321, address=pekko://test/user/follower321, votingState=VOTING], PeerInfo [id=follower320, address=pekko://test/user/follower320, votingState=VOTING]]
06:23:34,504 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for follower322 in 114.7 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:34,504 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower322: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:34.491Z
06:23:34,504 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower322: support() called
06:23:34,504 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower321: Set currentTerm=1, votedFor=null
06:23:34,504 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower321: Local TermInfo store seeded with TermInfo{term=1}
06:23:34,504 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower321: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@7df2583
[WARN] [06/25/2025 18:23:34.504] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader319]: org.opendaylight.controller.cluster.common.actor.Monitor@2b93f0ae
06:23:34,505 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower322: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/follower322/snapshot-00000000685C3EA6-1D4410C0.tmp
06:23:34,505 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower321: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:34,505 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - leader319: Starting recovery with journal batch size 1000
06:23:34,505 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader319: started executor
06:23:34,505 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader319: started executor
06:23:34,508 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/leader319/TermInfo.properties does not exist
06:23:34,508 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader319: no eligible files found
06:23:34,508 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - leader319: SnapshotOffer called.
06:23:34,508 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - leader319: initializing from snapshot taken at 2025-06-25T18:23:34.491Z
06:23:34,508 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader319: Set currentTerm=1, votedFor=null
06:23:34,508 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PeerInfos - leader319: Updated server config: isVoting: true, peers: [PeerInfo [id=follower322, address=pekko://test/user/follower322, votingState=NON_VOTING], PeerInfo [id=follower321, address=pekko://test/user/follower321, votingState=VOTING], PeerInfo [id=follower320, address=pekko://test/user/follower320, votingState=VOTING]]
06:23:34,508 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - Recovery snapshot applied for leader319 in 50.85 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:34,508 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader319: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:34.491Z
06:23:34,508 PM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader319: support() called
06:23:34,509 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader319: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/leader319/snapshot-00000000685C3EA6-1D4410C0.tmp
06:23:34,510 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower322: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/follower322/snapshot-00000000685C3EA6-1D4410C0.v1
06:23:34,510 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower322: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/follower322/snapshot-00000000685C3EA6-1D4410C0.v1
06:23:34,510 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower322: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:34.491Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/follower322/snapshot-00000000685C3EA6-1D4410C0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:34,510 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower322: local snapshot saved in 6.120 ms, deleting Pekko-persisted snapshots
06:23:34,511 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader319: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/leader319/snapshot-00000000685C3EA6-1D4410C0.v1
06:23:34,511 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader319: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/leader319/snapshot-00000000685C3EA6-1D4410C0.v1
06:23:34,511 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower322: Recovery completed in 7.958 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:34,511 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader319: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:34.491Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16544650825592234007/leader319/snapshot-00000000685C3EA6-1D4410C0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:34,511 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader319: local snapshot saved in 2.799 ms, deleting Pekko-persisted snapshots
06:23:34,512 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader319: Recovery completed in 3.584 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:34,513 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower322: Set currentTerm=1, votedFor=null
06:23:34,513 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower322: Local TermInfo store seeded with TermInfo{term=1}
06:23:34,513 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower322: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@84cff49
06:23:34,514 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower322: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:34,514 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader319: Set currentTerm=1, votedFor=null
06:23:34,514 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader319: Local TermInfo store seeded with TermInfo{term=1}
06:23:34,514 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader319: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@57da2a82
06:23:34,514 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader319: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:34,892 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
06:23:34,892 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader319 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.98:17355, Removed)
06:23:34,892 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader319 (Follower): Received ElectionTimeout - switching to Candidate
06:23:34,892 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader319 (Candidate): Election: Candidate has following voting peers: [follower321, follower320]
06:23:34,897 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader319: Set currentTerm=2, votedFor=leader319
06:23:34,897 PM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - leader319 (Candidate): Starting new election term 2
06:23:34,897 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader319 (Candidate): Sending RequestVote{term=2, candidateId=leader319, lastLogIndex=-1, lastLogTerm=-1} to peer follower321
06:23:34,897 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader319 (Candidate): Sending RequestVote{term=2, candidateId=leader319, lastLogIndex=-1, lastLogTerm=-1} to peer follower320
06:23:34,897 PM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader319 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
06:23:34,897 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower321 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
06:23:34,897 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower320 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
06:23:34,897 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower320 (Follower): Cluster state: []
06:23:34,897 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower320 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader319, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
06:23:34,897 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower321 (Follower): Cluster state: []
06:23:34,897 PM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - follower320 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader319, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
06:23:34,897 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower321 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader319, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
06:23:34,897 PM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - follower321 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader319, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
06:23:34,899 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower320: Set currentTerm=2, votedFor=null
06:23:34,900 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower320 (Follower): In requestVote: RequestVote{term=2, candidateId=leader319, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
06:23:34,901 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower321: Set currentTerm=2, votedFor=null
06:23:34,901 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower321 (Follower): In requestVote: RequestVote{term=2, candidateId=leader319, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
06:23:34,904 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower320: Set currentTerm=2, votedFor=leader319
06:23:34,904 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower320 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
06:23:34,904 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader319 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
06:23:34,904 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader319 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
06:23:34,904 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader319 (Leader): Election: Leader has following peers: [follower322, follower321, follower320]
06:23:34,904 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader319 (Leader): Checking sendAppendEntries for follower follower322: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:34,904 PM [test-pekko.actor.default-dispatcher-11] [INFO] Follower - follower322 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader319, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
06:23:34,904 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader319 (Leader): Checking sendAppendEntries for follower follower321: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:34,904 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader319 (Leader): Checking sendAppendEntries for follower follower320: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:34,904 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader319 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
06:23:34,904 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower320: Last sync leader does not match current leader leader319, need to catch up to -1
06:23:34,905 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader319 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower320 updated: matchIndex: -1, nextIndex: 0
06:23:34,905 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader319 (Leader): Checking sendAppendEntries for follower follower320: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/25/2025 18:23:34.905] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower320] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower320, initialSyncDone=false]
06:23:34,905 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower321: Set currentTerm=2, votedFor=leader319
06:23:34,905 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower321 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
06:23:34,905 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower321: Last sync leader does not match current leader leader319, need to catch up to -1
06:23:34,905 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader319 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower321 updated: matchIndex: -1, nextIndex: 0
[WARN] [06/25/2025 18:23:34.905] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower321] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower321, initialSyncDone=false]
06:23:34,906 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader319 (Leader): Checking sendAppendEntries for follower follower321: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:34,906 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower322: Set currentTerm=2, votedFor=null
06:23:34,906 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower322: Last sync leader does not match current leader leader319, need to catch up to -1
06:23:34,906 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader319 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower322 updated: matchIndex: -1, nextIndex: 0
06:23:34,906 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader319 (Leader): Checking sendAppendEntries for follower follower322: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/25/2025 18:23:34.906] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower322] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower322, initialSyncDone=false]
06:23:34,918 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
06:23:34,918 PM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting
06:23:34,918 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader319: Persist data index=0 term=2 command=zero
06:23:34,918 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader319: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
06:23:34,918 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader319 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
06:23:34,918 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader319 (Leader): Checking sendAppendEntries for follower follower322: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:34,918 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader319 (Leader): sendAppendEntries: 0 is present for follower follower322
06:23:34,918 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader319 (Leader): Sending AppendEntries to follower follower322: AppendEntries{term=2, leaderId=leader319, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
06:23:34,918 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader319 (Leader): Checking sendAppendEntries for follower follower321: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:34,918 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader319 (Leader): sendAppendEntries: 0 is present for follower follower321
06:23:34,918 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader319 (Leader): Sending AppendEntries to follower follower321: AppendEntries{term=2, leaderId=leader319, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
06:23:34,918 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower322 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader319, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
06:23:34,918 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower322 (Follower): Number of entries to be appended = 1
06:23:34,918 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower322 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
06:23:34,918 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader319 (Leader): Checking sendAppendEntries for follower follower320: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:34,918 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower322 (Follower): Append entry to log zero
06:23:34,918 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader319 (Leader): sendAppendEntries: 0 is present for follower follower320
06:23:34,919 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower322: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
06:23:34,919 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader319 (Leader): Sending AppendEntries to follower follower320: AppendEntries{term=2, leaderId=leader319, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
06:23:34,919 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower322 (Follower): Log size is now 1
06:23:34,919 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower322 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower322, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
06:23:34,919 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower322: Lagging 0 entries behind leader leader319 and reached -1 (of expected -1)
06:23:34,919 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower320 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader319, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
06:23:34,919 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower320 (Follower): Number of entries to be appended = 1
06:23:34,919 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower320 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
06:23:34,919 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower320 (Follower): Append entry to log zero
06:23:34,919 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower320: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
06:23:34,919 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower320 (Follower): Log size is now 1
06:23:34,919 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower320 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower320, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
06:23:34,919 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower320: Lagging 0 entries behind leader leader319 and reached -1 (of expected -1)
06:23:34,920 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader319 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower322 updated: matchIndex: 0, nextIndex: 1
06:23:34,920 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader319 (Leader): Checking sendAppendEntries for follower follower322: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:34,920 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader319 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower320 updated: matchIndex: 0, nextIndex: 1
06:23:34,920 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader319 (Leader): Checking sendAppendEntries for follower follower320: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:34,920 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader319: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
06:23:34,920 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader319 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
06:23:34,920 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader319 (Leader): Setting last applied to 0
06:23:34,920 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader319: Moving last applied index from -1 to 0
06:23:34,920 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader319: Applying state for log index 0 data zero
06:23:34,920 PM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader319: applyState called: zero
06:23:34,920 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower322: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
06:23:34,920 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower320: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
06:23:34,920 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader319: Persisting ApplyJournalEntries with index=0
[WARN] [06/25/2025 18:23:34.921] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower320] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower320, initialSyncDone=true]
[WARN] [06/25/2025 18:23:34.921] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower322] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower322, initialSyncDone=true]
06:23:35,23 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader319 (Leader): sendAppendEntries: 0 is present for follower follower321
06:23:35,23 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower322 (Follower): Commit index set to 0
06:23:35,23 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower322: Lagging 0 entries behind leader leader319 and reached 0 (of expected -1)
06:23:35,23 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower322 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
06:23:35,23 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower322 (Follower): Setting last applied to 0
06:23:35,23 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader319 (Leader): Sending AppendEntries to follower follower321: AppendEntries{term=2, leaderId=leader319, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
06:23:35,23 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower322: Moving last applied index from -1 to 0
06:23:35,23 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower322: Applying state for log index 0 data zero
06:23:35,23 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower322: applyState called: zero
06:23:35,24 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower320 (Follower): Commit index set to 0
06:23:35,24 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower322: Persisting ApplyJournalEntries with index=0
06:23:35,24 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower320: Lagging 0 entries behind leader leader319 and reached 0 (of expected -1)
06:23:35,24 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower320 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
06:23:35,24 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower320 (Follower): Setting last applied to 0
06:23:35,24 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower320: Moving last applied index from -1 to 0
06:23:35,24 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower320: Applying state for log index 0 data zero
06:23:35,24 PM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower320: applyState called: zero
06:23:35,24 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower320: Persisting ApplyJournalEntries with index=0
06:23:35,69 PM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending
06:23:35,69 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 starting
06:23:35,69 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader319: onShutDown
06:23:35,69 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader319: Initiating leader transfer
06:23:35,70 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower320: onLeaderTransitioning: LeaderTransitioning [leaderId=leader319]
06:23:35,70 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorLeadershipTransferCohort - leader319: pauseLeader successfully completed - doing transfer
06:23:35,70 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Leader - leader319 (Leader): Attempting to transfer leadership
06:23:35,70 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower322: onLeaderTransitioning: LeaderTransitioning [leaderId=leader319]
06:23:35,70 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader319 (Leader): Checking sendAppendEntries for follower follower322: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:35,70 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader319 (Leader): Checking sendAppendEntries for follower follower321: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:35,70 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader319 (Leader): sendAppendEntries: 0 is present for follower follower321
06:23:35,70 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader319 (Leader): Checking sendAppendEntries for follower follower320: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:35,70 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower322: Lagging 0 entries behind leader leader319 and reached 0 (of expected -1)
06:23:35,70 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Leader - leader319 (Leader): tryToCompleteLeadershipTransfer: followerId: follower322, matchIndex: 0, lastIndex: 0, isVoting: false
06:23:35,70 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower320: Lagging 0 entries behind leader leader319 and reached 0 (of expected -1)
06:23:35,70 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Leader - leader319 (Leader): tryToCompleteLeadershipTransfer: followerId: follower320, matchIndex: 0, lastIndex: 0, isVoting: true
06:23:35,70 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Leader - leader319 (Leader): Follower's log matches - sending ElectionTimeout
06:23:35,70 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader319 (Leader): Checking sendAppendEntries for follower follower322: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:35,70 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader319 (Leader): Checking sendAppendEntries for follower follower321: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:35,70 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader319 (Leader): sendAppendEntries: 0 is present for follower follower321
06:23:35,70 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader319 (Leader): Checking sendAppendEntries for follower follower320: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:35,70 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower322: Lagging 0 entries behind leader leader319 and reached 0 (of expected -1)
06:23:35,71 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Leader - leader319 (Leader): Leader transfer complete
06:23:35,71 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower320: Lagging 0 entries behind leader leader319 and reached 0 (of expected -1)
06:23:35,71 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorLeadershipTransferCohort - leader319: leader transfer complete - waiting for new leader
06:23:35,71 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
06:23:35,71 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower320 (Follower): Received TimeoutNow - switching to Candidate
06:23:35,71 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - follower320 (Candidate): Election: Candidate has following voting peers: [leader319, follower321]
06:23:35,74 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower320: Set currentTerm=3, votedFor=follower320
06:23:35,74 PM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - follower320 (Candidate): Starting new election term 3
06:23:35,74 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - follower320 (Candidate): Sending RequestVote{term=3, candidateId=follower320, lastLogIndex=0, lastLogTerm=2} to peer leader319
06:23:35,74 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - follower320 (Candidate): Sending RequestVote{term=3, candidateId=follower320, lastLogIndex=0, lastLogTerm=2} to peer follower321
06:23:35,74 PM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - follower320 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
06:23:35,74 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader319 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
06:23:35,74 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower321 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
06:23:35,74 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader319 (Leader): Cluster state: []
06:23:35,74 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader319 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower320, lastLogIndex=0, lastLogTerm=2} with higher term appears reachable, updating term.
06:23:35,74 PM [test-pekko.actor.default-dispatcher-6] [INFO] AbstractLeader - leader319 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower320, lastLogIndex=0, lastLogTerm=2}" message is greater than leader's term 2 - switching to Follower
06:23:35,74 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower321 (Follower): Cluster state: []
06:23:35,74 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower321 (Follower): Candidate in requestVote:RequestVote{term=3, candidateId=follower320, lastLogIndex=0, lastLogTerm=2} with higher term appears reachable, updating term.
06:23:35,74 PM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower321 (Follower): Term 3 in "RequestVote{term=3, candidateId=follower320, lastLogIndex=0, lastLogTerm=2}" message is greater than follower's term 2 - updating term
06:23:35,78 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower321: Set currentTerm=3, votedFor=null
06:23:35,78 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower321 (Follower): In requestVote: RequestVote{term=3, candidateId=follower320, lastLogIndex=0, lastLogTerm=2} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
06:23:35,80 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader319: Set currentTerm=3, votedFor=null
06:23:35,80 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader319 (Leader): Leadership transfer in progress - processing RequestVote
06:23:35,80 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader319 (Leader): In requestVote: RequestVote{term=3, candidateId=follower320, lastLogIndex=0, lastLogTerm=2} - currentTerm: 3, votedFor: null, lastIndex: 0, lastTerm: 2
06:23:35,81 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower321: Set currentTerm=3, votedFor=follower320
06:23:35,81 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower321 (Follower): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
06:23:35,81 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - follower320 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3
06:23:35,81 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - follower320 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1
06:23:35,81 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower320 (Leader): Election: Leader has following peers: [follower322, leader319, follower321]
06:23:35,81 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower320 (Leader): Checking sendAppendEntries for follower follower322: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:35,81 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower320 (Leader): Checking sendAppendEntries for follower leader319: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:35,81 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower320 (Leader): Checking sendAppendEntries for follower follower321: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:35,81 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - follower320 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
06:23:35,81 PM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower322 (Follower): Term 3 in "AppendEntries{term=3, leaderId=follower320, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 2 - updating term
06:23:35,83 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader319: Set currentTerm=3, votedFor=follower320
06:23:35,83 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader319 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
06:23:35,83 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader319 (Leader) :- Switching from behavior Leader to Follower, election term: 3
06:23:35,83 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower322: Set currentTerm=3, votedFor=null
06:23:35,83 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower322: Last sync leader does not match current leader follower320, need to catch up to -1
06:23:35,83 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower320 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower322 updated: matchIndex: 0, nextIndex: 1
06:23:35,83 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower320 (Leader): Checking sendAppendEntries for follower follower322: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:35,84 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower322: Lagging 0 entries behind leader follower320 and reached 0 (of expected -1)
[WARN] [06/25/2025 18:23:35.084] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower322] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower322, initialSyncDone=false]
[WARN] [06/25/2025 18:23:35.084] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower322] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower322, initialSyncDone=true]
06:23:35,84 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - leader319: Last sync leader does not match current leader follower320, need to catch up to -1
06:23:35,84 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader319: leader changed to follower320
06:23:35,84 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower320 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader319 updated: matchIndex: 0, nextIndex: 1
06:23:35,84 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower320 (Leader): Checking sendAppendEntries for follower leader319: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:35,84 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorLeadershipTransferCohort - leader319: Successfully transferred leadership to follower320 in 14.68 ms
06:23:35,84 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader319: leader transfer succeeded - sending PoisonPill
06:23:35,84 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - leader319: Lagging 0 entries behind leader follower320 and reached 0 (of expected -1)
[WARN] [06/25/2025 18:23:35.084] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/leader319] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=leader319, initialSyncDone=false]
06:23:35,85 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader319: stopped executor with 0 remaining tasks
06:23:35,85 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader319: stopped executor with 0 remaining tasks
[WARN] [06/25/2025 18:23:35.085] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/leader319] received dead letter: FollowerInitialSyncUpStatus[memberId=leader319, initialSyncDone=true]
[WARN] [06/25/2025 18:23:35.593] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/leader319] received dead letter from TestActor[pekko://test/user/follower320]: AppendEntries{term=3, leaderId=follower320, prevLogIndex=0, prevLogTerm=2, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
06:23:35,593 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower322: Lagging 0 entries behind leader follower320 and reached 0 (of expected -1)
06:23:35,593 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower321: Last sync leader does not match current leader follower320, need to catch up to -1
06:23:35,593 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - follower320 (Leader): sendAppendEntries: 0 is present for follower follower321
06:23:35,594 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - follower320 (Leader): Sending AppendEntries to follower follower321: AppendEntries{term=3, leaderId=follower320, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
[WARN] [06/25/2025 18:23:35.594] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower321] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower321, initialSyncDone=false]
06:23:35,594 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower321 (Follower): handleAppendEntries: AppendEntries{term=3, leaderId=follower320, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
06:23:35,594 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower321 (Follower): Number of entries to be appended = 1
06:23:35,594 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower321 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
06:23:35,594 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower321 (Follower): Append entry to log zero
06:23:35,594 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower321: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=false} 
06:23:35,594 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower321 (Follower): Log size is now 1
06:23:35,594 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower321 (Follower): Commit index set to 0
06:23:35,594 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower321 (Follower): handleAppendEntries returning : AppendEntriesReply{term=3, success=true, followerId=follower321, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
06:23:35,594 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower321: Lagging 0 entries behind leader follower320 and reached 0 (of expected -1)
06:23:35,594 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower321 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
06:23:35,594 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower321 (Follower): Setting last applied to 0
06:23:35,594 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower321: Moving last applied index from -1 to 0
06:23:35,594 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower320 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower321 updated: matchIndex: 0, nextIndex: 1
06:23:35,594 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower321: Applying state for log index 0 data zero
06:23:35,594 PM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower321: applyState called: zero
06:23:35,594 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower320 (Leader): Checking sendAppendEntries for follower follower321: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:35,594 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower321: Persisting ApplyJournalEntries with index=0
06:23:35,595 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower321: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
[WARN] [06/25/2025 18:23:35.595] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower321] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower321, initialSyncDone=true]
06:23:35,624 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower321: onLeaderTransitioning: LeaderTransitioning [leaderId=leader319]
06:23:35,625 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 ending
06:23:35,625 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower321 starting
06:23:35,625 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower321: onShutDown
06:23:35,625 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower321: stopped executor with 0 remaining tasks
06:23:35,625 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower321: stopped executor with 0 remaining tasks
06:23:35,626 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower321 ending
06:23:35,626 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending
06:23:35,626 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower320-notifier323#1241067865]
06:23:35,637 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower320-collector324#-435343835]
06:23:35,637 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower320]
06:23:35,637 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower320: stopped executor with 0 remaining tasks
06:23:35,637 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower320: stopped executor with 0 remaining tasks
06:23:35,637 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower321-notifier325#1208972293]
06:23:35,637 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower321-collector326#1228234510]
06:23:35,638 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower321]
06:23:35,638 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower322-notifier327#-1572011074]
06:23:35,642 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower322-collector328#-1691040712]
06:23:35,642 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower322]
06:23:35,642 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower322: stopped executor with 0 remaining tasks
06:23:35,642 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower322: stopped executor with 0 remaining tasks
06:23:35,644 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader319-notifier329#-1758328608]
06:23:35,644 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader319-collector330#630837097]
06:23:35,644 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader319]
06:23:35,646 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers starting
[WARN] [06/25/2025 18:23:35.649] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader331]: org.opendaylight.controller.cluster.common.actor.Monitor@3d5d03c8
06:23:35,649 PM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - leader331: Starting recovery with journal batch size 1000
06:23:35,649 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader331: started executor
06:23:35,649 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader331: started executor
06:23:35,651 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest14919054220787088529/leader331/TermInfo.properties does not exist
06:23:35,651 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader331: no eligible files found
06:23:35,651 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader331: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:35,655 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader331: Set currentTerm=0, votedFor=null
06:23:35,655 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader331: Local TermInfo store seeded with TermInfo{term=0}
06:23:35,655 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader331: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@7ab4328b
06:23:35,656 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
06:23:35,656 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader331 (Follower): Received TimeoutNow - switching to Candidate
06:23:35,656 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader331 (Candidate): Election: Candidate has following voting peers: []
06:23:35,659 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader331: Set currentTerm=1, votedFor=leader331
06:23:35,659 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader331 (Candidate): Starting new election term 1
06:23:35,659 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader331 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
06:23:35,659 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader331 (Candidate): Received ElectionTimeout
06:23:35,659 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader331 (Leader): Election: Leader has following peers: []
06:23:35,659 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader331 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
06:23:35,659 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader331 starting
06:23:35,659 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader331: onShutDown
06:23:35,660 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader331: stopped executor with 0 remaining tasks
06:23:35,660 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader331: stopped executor with 0 remaining tasks
06:23:35,660 PM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader331 ending
06:23:35,660 PM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers ending
06:23:35,660 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader331-collector335#1426806327]
06:23:35,661 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader331]
06:23:35,662 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging starting
06:23:35,662 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [06/25/2025 18:23:35.664] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower337]: org.opendaylight.controller.cluster.common.actor.Monitor@132d1472
06:23:35,664 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower337: Starting recovery with journal batch size 1000
06:23:35,664 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower337: started executor
06:23:35,664 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower337: started executor
06:23:35,665 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/follower337/TermInfo.properties does not exist
06:23:35,665 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower337: no eligible files found
06:23:35,665 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - follower337: SnapshotOffer called.
06:23:35,665 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - follower337: initializing from snapshot taken at 2025-06-25T18:23:35.662Z
06:23:35,665 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower337: Set currentTerm=1, votedFor=null
06:23:35,665 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - follower337: Updated server config: isVoting: true, peers: [PeerInfo [id=follower339, address=pekko://test/user/follower339, votingState=NON_VOTING], PeerInfo [id=follower338, address=pekko://test/user/follower338, votingState=VOTING], PeerInfo [id=leader336, address=pekko://test/user/leader336, votingState=VOTING]]
06:23:35,665 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - Recovery snapshot applied for follower337 in 110.4 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:35,666 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower337: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:35.662Z
06:23:35,666 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower337: support() called
06:23:35,666 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower337: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/follower337/snapshot-00000000685C3EA7-27755180.tmp
[WARN] [06/25/2025 18:23:35.666] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower338]: org.opendaylight.controller.cluster.common.actor.Monitor@22afb90e
06:23:35,667 PM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - follower338: Starting recovery with journal batch size 1000
06:23:35,667 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower338: started executor
06:23:35,667 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower338: started executor
06:23:35,668 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/follower338/TermInfo.properties does not exist
06:23:35,668 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower338: no eligible files found
06:23:35,668 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower338: SnapshotOffer called.
06:23:35,668 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower338: initializing from snapshot taken at 2025-06-25T18:23:35.662Z
06:23:35,668 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower338: Set currentTerm=1, votedFor=null
06:23:35,668 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - follower338: Updated server config: isVoting: true, peers: [PeerInfo [id=follower337, address=pekko://test/user/follower337, votingState=VOTING], PeerInfo [id=follower339, address=pekko://test/user/follower339, votingState=NON_VOTING], PeerInfo [id=leader336, address=pekko://test/user/leader336, votingState=VOTING]]
06:23:35,668 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower337: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/follower337/snapshot-00000000685C3EA7-27755180.v1
06:23:35,668 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - Recovery snapshot applied for follower338 in 63.35 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:35,668 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower338: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:35.662Z
06:23:35,668 PM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower338: support() called
06:23:35,668 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower337: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/follower337/snapshot-00000000685C3EA7-27755180.v1
06:23:35,668 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower337: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:35.662Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/follower337/snapshot-00000000685C3EA7-27755180.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:35,668 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower338: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/follower338/snapshot-00000000685C3EA7-27755180.tmp
06:23:35,668 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower337: local snapshot saved in 2.630 ms, deleting Pekko-persisted snapshots
[WARN] [06/25/2025 18:23:35.669] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower339]: org.opendaylight.controller.cluster.common.actor.Monitor@480c9f31
06:23:35,669 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower339: Starting recovery with journal batch size 1000
06:23:35,670 PM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower337: Recovery completed in 4.225 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:35,670 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower339: started executor
06:23:35,670 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower339: started executor
06:23:35,671 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/follower339/TermInfo.properties does not exist
06:23:35,672 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower339: no eligible files found
06:23:35,672 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower338: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/follower338/snapshot-00000000685C3EA7-27755180.v1
06:23:35,672 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower338: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/follower338/snapshot-00000000685C3EA7-27755180.v1
[WARN] [06/25/2025 18:23:35.672] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader336]: org.opendaylight.controller.cluster.common.actor.Monitor@73c3cb8e
06:23:35,672 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower338: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:35.662Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/follower338/snapshot-00000000685C3EA7-27755180.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:35,672 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower338: local snapshot saved in 3.791 ms, deleting Pekko-persisted snapshots
06:23:35,672 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower337: Set currentTerm=1, votedFor=null
06:23:35,672 PM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower337: Local TermInfo store seeded with TermInfo{term=1}
06:23:35,672 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader336: Starting recovery with journal batch size 1000
06:23:35,672 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower337: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@3a44df61
06:23:35,672 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader336: started executor
06:23:35,672 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader336: started executor
06:23:35,673 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower337: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:35,673 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/leader336/TermInfo.properties does not exist
06:23:35,673 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader336: no eligible files found
06:23:35,673 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - leader336: SnapshotOffer called.
06:23:35,673 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - leader336: initializing from snapshot taken at 2025-06-25T18:23:35.662Z
06:23:35,673 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader336: Set currentTerm=1, votedFor=null
06:23:35,673 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - leader336: Updated server config: isVoting: true, peers: [PeerInfo [id=follower337, address=pekko://test/user/follower337, votingState=VOTING], PeerInfo [id=follower339, address=pekko://test/user/follower339, votingState=NON_VOTING], PeerInfo [id=follower338, address=pekko://test/user/follower338, votingState=VOTING]]
06:23:35,673 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for leader336 in 39.00 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:35,673 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader336: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:35.662Z
06:23:35,673 PM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader336: support() called
06:23:35,673 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader336: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/leader336/snapshot-00000000685C3EA7-27755180.tmp
06:23:35,676 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader336: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/leader336/snapshot-00000000685C3EA7-27755180.v1
06:23:35,676 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader336: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/leader336/snapshot-00000000685C3EA7-27755180.v1
06:23:35,676 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader336: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:35.662Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/leader336/snapshot-00000000685C3EA7-27755180.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:35,676 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader336: local snapshot saved in 2.678 ms, deleting Pekko-persisted snapshots
06:23:35,672 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower339: SnapshotOffer called.
06:23:35,676 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower339: initializing from snapshot taken at 2025-06-25T18:23:35.662Z
06:23:35,676 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower339: Set currentTerm=1, votedFor=null
06:23:35,676 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower338: Recovery completed in 8.225 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:35,676 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PeerInfos - follower339: Updated server config: isVoting: false, peers: [PeerInfo [id=follower337, address=pekko://test/user/follower337, votingState=VOTING], PeerInfo [id=follower338, address=pekko://test/user/follower338, votingState=VOTING], PeerInfo [id=leader336, address=pekko://test/user/leader336, votingState=VOTING]]
06:23:35,676 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - Recovery snapshot applied for follower339 in 174.5 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:35,676 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower339: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:35.662Z
06:23:35,677 PM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower339: support() called
06:23:35,677 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader336: Recovery completed in 4.028 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:35,677 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower339: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/follower339/snapshot-00000000685C3EA7-27755180.tmp
06:23:35,679 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower338: Set currentTerm=1, votedFor=null
06:23:35,679 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower338: Local TermInfo store seeded with TermInfo{term=1}
06:23:35,679 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower338: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@115343bd
06:23:35,679 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower338: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:35,680 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader336: Set currentTerm=1, votedFor=null
06:23:35,680 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower339: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/follower339/snapshot-00000000685C3EA7-27755180.v1
06:23:35,680 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader336: Local TermInfo store seeded with TermInfo{term=1}
06:23:35,680 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader336: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@60c8495
06:23:35,680 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower339: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/follower339/snapshot-00000000685C3EA7-27755180.v1
06:23:35,680 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower339: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:35.662Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest248855252120926821/follower339/snapshot-00000000685C3EA7-27755180.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:35,681 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower339: local snapshot saved in 3.706 ms, deleting Pekko-persisted snapshots
06:23:35,681 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader336: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:35,681 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower339: Recovery completed in 5.219 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:35,684 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower339: Set currentTerm=1, votedFor=null
06:23:35,684 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower339: Local TermInfo store seeded with TermInfo{term=1}
06:23:35,684 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower339: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@2e371eb9
06:23:35,684 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower339: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:36,63 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
06:23:36,63 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader336 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.98:17355, Removed)
06:23:36,63 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader336 (Follower): Received ElectionTimeout - switching to Candidate
06:23:36,63 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader336 (Candidate): Election: Candidate has following voting peers: [follower337, follower338]
06:23:36,76 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader336: Set currentTerm=2, votedFor=leader336
06:23:36,76 PM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader336 (Candidate): Starting new election term 2
06:23:36,76 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader336 (Candidate): Sending RequestVote{term=2, candidateId=leader336, lastLogIndex=-1, lastLogTerm=-1} to peer follower337
06:23:36,76 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader336 (Candidate): Sending RequestVote{term=2, candidateId=leader336, lastLogIndex=-1, lastLogTerm=-1} to peer follower338
06:23:36,76 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower337 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
06:23:36,76 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader336 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
06:23:36,76 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower337 (Follower): Cluster state: []
06:23:36,76 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower337 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader336, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
06:23:36,76 PM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower337 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader336, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
06:23:36,76 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower338 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
06:23:36,76 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower338 (Follower): Cluster state: []
06:23:36,76 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower338 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader336, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
06:23:36,76 PM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - follower338 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader336, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
06:23:36,117 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower337: Set currentTerm=2, votedFor=null
06:23:36,117 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower337 (Follower): In requestVote: RequestVote{term=2, candidateId=leader336, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
06:23:36,140 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower338: Set currentTerm=2, votedFor=null
06:23:36,140 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower338 (Follower): In requestVote: RequestVote{term=2, candidateId=leader336, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
06:23:36,161 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower337: Set currentTerm=2, votedFor=leader336
06:23:36,161 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower337 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
06:23:36,161 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader336 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
06:23:36,161 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader336 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
06:23:36,161 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader336 (Leader): Election: Leader has following peers: [follower337, follower339, follower338]
06:23:36,161 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader336 (Leader): Checking sendAppendEntries for follower follower337: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:36,161 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader336 (Leader): Checking sendAppendEntries for follower follower339: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:36,161 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader336 (Leader): Checking sendAppendEntries for follower follower338: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:36,161 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader336 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
06:23:36,161 PM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower339 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader336, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
06:23:36,162 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader336 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower337 updated: matchIndex: -1, nextIndex: 0
06:23:36,162 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader336 (Leader): Checking sendAppendEntries for follower follower337: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:36,162 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower337: Last sync leader does not match current leader leader336, need to catch up to -1
[WARN] [06/25/2025 18:23:36.162] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower337] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower337, initialSyncDone=false]
06:23:36,185 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
06:23:36,185 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
06:23:36,186 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
06:23:36,186 PM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting
06:23:36,186 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader336: Persist data index=0 term=2 command=zero
06:23:36,186 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader336: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
06:23:36,187 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
06:23:36,187 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): Checking sendAppendEntries for follower follower337: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:36,187 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): sendAppendEntries: 0 is present for follower follower337
06:23:36,187 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): Sending AppendEntries to follower follower337: AppendEntries{term=2, leaderId=leader336, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
06:23:36,187 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower337 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader336, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
06:23:36,187 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower337 (Follower): Number of entries to be appended = 1
06:23:36,187 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower337 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
06:23:36,187 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower337 (Follower): Append entry to log zero
06:23:36,187 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower337: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
06:23:36,187 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower337 (Follower): Log size is now 1
06:23:36,187 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower337 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower337, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
06:23:36,187 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower337: Lagging 0 entries behind leader leader336 and reached -1 (of expected -1)
06:23:36,187 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): Checking sendAppendEntries for follower follower339: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:36,187 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): Checking sendAppendEntries for follower follower338: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:36,187 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower337 updated: matchIndex: 0, nextIndex: 1
06:23:36,187 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): Checking sendAppendEntries for follower follower337: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:36,189 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower337: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
[WARN] [06/25/2025 18:23:36.189] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower337] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower337, initialSyncDone=true]
06:23:36,189 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader336: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
06:23:36,189 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader336 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
06:23:36,189 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader336 (Leader): Setting last applied to 0
06:23:36,189 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader336: Moving last applied index from -1 to 0
06:23:36,189 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader336: Applying state for log index 0 data zero
06:23:36,189 PM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader336: applyState called: zero
06:23:36,189 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader336: Persisting ApplyJournalEntries with index=0
06:23:36,189 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower338: Set currentTerm=2, votedFor=leader336
06:23:36,189 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower338 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
06:23:36,213 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower339: Set currentTerm=2, votedFor=null
06:23:36,213 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower339: Last sync leader does not match current leader leader336, need to catch up to -1
06:23:36,213 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower339: Lagging 0 entries behind leader leader336 and reached -1 (of expected -1)
06:23:36,213 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower339 updated: matchIndex: -1, nextIndex: 0
06:23:36,214 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): Checking sendAppendEntries for follower follower339: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:36,214 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): sendAppendEntries: 0 is present for follower follower339
[WARN] [06/25/2025 18:23:36.214] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower339] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower339, initialSyncDone=false]
[WARN] [06/25/2025 18:23:36.214] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower339] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower339, initialSyncDone=true]
06:23:36,214 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): Sending AppendEntries to follower follower339: AppendEntries{term=2, leaderId=leader336, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
06:23:36,214 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): sendAppendEntries: 0 is present for follower follower339
06:23:36,214 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower339 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader336, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
06:23:36,214 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower339 (Follower): Number of entries to be appended = 1
06:23:36,214 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower339 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
06:23:36,214 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower339 (Follower): Append entry to log zero
06:23:36,214 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower339: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=false} 
06:23:36,214 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower339 (Follower): Log size is now 1
06:23:36,214 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower339 (Follower): Commit index set to 0
06:23:36,214 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower339 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower339, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
06:23:36,214 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower339: Lagging 0 entries behind leader leader336 and reached 0 (of expected -1)
06:23:36,214 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower339 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
06:23:36,214 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower339 (Follower): Setting last applied to 0
06:23:36,214 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower339: Moving last applied index from -1 to 0
06:23:36,214 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower339: Applying state for log index 0 data zero
06:23:36,214 PM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower339: applyState called: zero
06:23:36,214 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower339 updated: matchIndex: 0, nextIndex: 1
06:23:36,214 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): Checking sendAppendEntries for follower follower339: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:36,214 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower339: Persisting ApplyJournalEntries with index=0
06:23:36,215 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower339: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
06:23:36,393 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower339: Lagging 0 entries behind leader leader336 and reached 0 (of expected -1)
06:23:36,393 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower337 (Follower): Commit index set to 0
06:23:36,393 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower337: Lagging 0 entries behind leader leader336 and reached 0 (of expected -1)
06:23:36,393 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower337 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
06:23:36,393 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower337 (Follower): Setting last applied to 0
06:23:36,393 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower337: Moving last applied index from -1 to 0
06:23:36,393 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower337: Applying state for log index 0 data zero
06:23:36,394 PM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower337: applyState called: zero
06:23:36,394 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower337: Persisting ApplyJournalEntries with index=0
06:23:36,439 PM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending
06:23:36,439 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
06:23:36,439 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
06:23:36,439 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader336: onRequestLeadership RequestLeadership [requestedFollowerId=follower338, replyTo=Actor[pekko://test/user/$c#934001098]]
06:23:36,440 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader336: Initiating leader transfer
06:23:36,440 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower337: onLeaderTransitioning: LeaderTransitioning [leaderId=leader336]
06:23:36,440 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower339: onLeaderTransitioning: LeaderTransitioning [leaderId=leader336]
06:23:36,440 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorLeadershipTransferCohort - leader336: pauseLeader successfully completed - doing transfer
06:23:36,440 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Leader - leader336 (Leader): Attempting to transfer leadership
06:23:36,440 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower338: onLeaderTransitioning: LeaderTransitioning [leaderId=leader336]
06:23:36,440 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): Checking sendAppendEntries for follower follower337: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:36,441 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): Checking sendAppendEntries for follower follower339: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:36,441 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower337: Lagging 0 entries behind leader leader336 and reached 0 (of expected -1)
06:23:36,441 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower339: Lagging 0 entries behind leader leader336 and reached 0 (of expected -1)
06:23:36,441 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader336 (Leader): Checking sendAppendEntries for follower follower338: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
06:23:36,633 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower339: Lagging 0 entries behind leader leader336 and reached 0 (of expected -1)
06:23:36,633 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower337: Lagging 0 entries behind leader leader336 and reached 0 (of expected -1)
06:23:36,753 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorLeadershipTransferCohort - leader336: leader transfer aborted
06:23:36,753 PM [test-pekko.actor.default-dispatcher-12] [WARN] RaftActorLeadershipTransferCohort - leader336: Failed to transfer leadership in 313.5 ms
06:23:36,753 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader336: LeadershipTransfer request from follower338 failed
06:23:36,753 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Leader - leader336 (Leader): Leadership transfer expired
06:23:36,754 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower337: Lagging 0 entries behind leader leader336 and reached 0 (of expected -1)
06:23:36,754 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower339: Lagging 0 entries behind leader leader336 and reached 0 (of expected -1)
06:23:36,793 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging ending
06:23:36,793 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower337-notifier340#-1429559006]
06:23:36,804 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower337-collector341#2024610351]
06:23:36,804 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower337]
06:23:36,804 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower337: stopped executor with 0 remaining tasks
06:23:36,804 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower337: stopped executor with 0 remaining tasks
06:23:36,805 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower338-notifier342#-1514825338]
06:23:36,805 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower338-collector343#-32874255]
06:23:36,805 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower338]
06:23:36,805 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower338: stopped executor with 0 remaining tasks
06:23:36,805 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower338: stopped executor with 0 remaining tasks
06:23:36,805 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower339-notifier344#1294734268]
06:23:36,805 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower339-collector345#-2049200564]
06:23:36,805 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower339]
06:23:36,805 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower339: stopped executor with 0 remaining tasks
06:23:36,805 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower339: stopped executor with 0 remaining tasks
06:23:36,805 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader336-notifier346#1888558110]
06:23:36,806 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader336-collector347#-1040751131]
06:23:36,806 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader336]
06:23:36,806 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader336: stopped executor with 0 remaining tasks
06:23:36,806 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader336: stopped executor with 0 remaining tasks
06:23:36,806 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$c#934001098]
06:23:36,807 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown starting
06:23:36,807 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [06/25/2025 18:23:36.810] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower349]: org.opendaylight.controller.cluster.common.actor.Monitor@6a83162c
06:23:36,810 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower349: Starting recovery with journal batch size 1000
06:23:36,810 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower349: started executor
06:23:36,810 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower349: started executor
06:23:36,812 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/follower349/TermInfo.properties does not exist
06:23:36,812 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower349: no eligible files found
06:23:36,812 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower349: SnapshotOffer called.
06:23:36,812 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower349: initializing from snapshot taken at 2025-06-25T18:23:36.807Z
06:23:36,812 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower349: Set currentTerm=1, votedFor=null
06:23:36,812 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PeerInfos - follower349: Updated server config: isVoting: true, peers: [PeerInfo [id=leader348, address=pekko://test/user/leader348, votingState=VOTING], PeerInfo [id=follower351, address=pekko://test/user/follower351, votingState=NON_VOTING], PeerInfo [id=follower350, address=pekko://test/user/follower350, votingState=VOTING]]
06:23:36,812 PM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - Recovery snapshot applied for follower349 in 94.89 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:36,813 PM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower349: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:36.807Z
06:23:36,813 PM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower349: support() called
06:23:36,813 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower349: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/follower349/snapshot-00000000685C3EA8-3019D7C0.tmp
[WARN] [06/25/2025 18:23:36.815] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower350]: org.opendaylight.controller.cluster.common.actor.Monitor@51f54c69
06:23:36,816 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower350: Starting recovery with journal batch size 1000
06:23:36,816 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower350: started executor
06:23:36,816 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower350: started executor
06:23:36,817 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/follower350/TermInfo.properties does not exist
06:23:36,817 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower350: no eligible files found
06:23:36,817 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower350: SnapshotOffer called.
06:23:36,817 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower350: initializing from snapshot taken at 2025-06-25T18:23:36.807Z
06:23:36,817 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower350: Set currentTerm=1, votedFor=null
06:23:36,817 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - follower350: Updated server config: isVoting: true, peers: [PeerInfo [id=leader348, address=pekko://test/user/leader348, votingState=VOTING], PeerInfo [id=follower349, address=pekko://test/user/follower349, votingState=VOTING], PeerInfo [id=follower351, address=pekko://test/user/follower351, votingState=NON_VOTING]]
06:23:36,817 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for follower350 in 98.91 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:36,817 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower350: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:36.807Z
06:23:36,818 PM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower350: support() called
06:23:36,818 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower350: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/follower350/snapshot-00000000685C3EA8-3019D7C0.tmp
06:23:36,948 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower349: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/follower349/snapshot-00000000685C3EA8-3019D7C0.v1
06:23:36,948 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower349: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/follower349/snapshot-00000000685C3EA8-3019D7C0.v1
06:23:36,949 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower349: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:36.807Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/follower349/snapshot-00000000685C3EA8-3019D7C0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:36,949 PM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower349: local snapshot saved in 136.2 ms, deleting Pekko-persisted snapshots
06:23:36,951 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower349: Recovery completed in 138.2 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:37,110 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower350: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/follower350/snapshot-00000000685C3EA8-3019D7C0.v1
06:23:37,110 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower350: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/follower350/snapshot-00000000685C3EA8-3019D7C0.v1
06:23:37,110 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower350: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:36.807Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/follower350/snapshot-00000000685C3EA8-3019D7C0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:37,110 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower350: local snapshot saved in 292.7 ms, deleting Pekko-persisted snapshots
[WARN] [06/25/2025 18:23:37.111] [test-pekko.actor.default-dispatcher-18] [pekko://test/deadLetters] received dead letter: ActorIdentity(,Some(TestActor[pekko://test/user/follower350]))
06:23:37,111 PM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower350: Recovery completed in 294.3 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:37,129 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower349: Set currentTerm=1, votedFor=null
06:23:37,129 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower349: Local TermInfo store seeded with TermInfo{term=1}
06:23:37,129 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower349: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@661ad1c9
06:23:37,129 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower349: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:37,141 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower350: Set currentTerm=1, votedFor=null
06:23:37,141 PM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower350: Local TermInfo store seeded with TermInfo{term=1}
06:23:37,141 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower350: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@b7dfe8b
06:23:37,142 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower350: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:37,145 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower351: Starting recovery with journal batch size 1000
06:23:37,145 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower351: started executor
06:23:37,145 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower351: started executor
[WARN] [06/25/2025 18:23:37.145] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower351]: org.opendaylight.controller.cluster.common.actor.Monitor@389f4bf8
06:23:37,146 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/follower351/TermInfo.properties does not exist
06:23:37,146 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower351: no eligible files found
06:23:37,146 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower351: SnapshotOffer called.
06:23:37,146 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower351: initializing from snapshot taken at 2025-06-25T18:23:36.807Z
06:23:37,146 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower351: Set currentTerm=1, votedFor=null
06:23:37,146 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - follower351: Updated server config: isVoting: false, peers: [PeerInfo [id=leader348, address=pekko://test/user/leader348, votingState=VOTING], PeerInfo [id=follower349, address=pekko://test/user/follower349, votingState=VOTING], PeerInfo [id=follower350, address=pekko://test/user/follower350, votingState=VOTING]]
06:23:37,146 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for follower351 in 82.79 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:37,147 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower351: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:36.807Z
06:23:37,147 PM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower351: support() called
06:23:37,147 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower351: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/follower351/snapshot-00000000685C3EA8-3019D7C0.tmp
[WARN] [06/25/2025 18:23:37.148] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader348]: org.opendaylight.controller.cluster.common.actor.Monitor@cf4f51b
06:23:37,149 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader348: Starting recovery with journal batch size 1000
06:23:37,149 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader348: started executor
06:23:37,149 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader348: started executor
06:23:37,150 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/leader348/TermInfo.properties does not exist
06:23:37,150 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader348: no eligible files found
06:23:37,150 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader348: SnapshotOffer called.
06:23:37,150 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader348: initializing from snapshot taken at 2025-06-25T18:23:36.807Z
06:23:37,150 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader348: Set currentTerm=1, votedFor=null
06:23:37,150 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - leader348: Updated server config: isVoting: true, peers: [PeerInfo [id=follower349, address=pekko://test/user/follower349, votingState=VOTING], PeerInfo [id=follower351, address=pekko://test/user/follower351, votingState=NON_VOTING], PeerInfo [id=follower350, address=pekko://test/user/follower350, votingState=VOTING]]
06:23:37,150 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for leader348 in 76.74 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
06:23:37,150 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader348: migrating from Pekko persistent-snapshot taken at 2025-06-25T18:23:36.807Z
06:23:37,150 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader348: support() called
06:23:37,150 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader348: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/leader348/snapshot-00000000685C3EA8-3019D7C0.tmp
06:23:37,239 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader348: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/leader348/snapshot-00000000685C3EA8-3019D7C0.v1
06:23:37,240 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader348: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/leader348/snapshot-00000000685C3EA8-3019D7C0.v1
06:23:37,240 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader348: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:36.807Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/leader348/snapshot-00000000685C3EA8-3019D7C0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:37,240 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader348: local snapshot saved in 89.82 ms, deleting Pekko-persisted snapshots
06:23:37,242 PM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader348: Recovery completed in 91.90 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:37,242 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower351: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/follower351/snapshot-00000000685C3EA8-3019D7C0.v1
06:23:37,242 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower351: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/follower351/snapshot-00000000685C3EA8-3019D7C0.v1
06:23:37,243 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower351: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-25T18:23:36.807Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest13252138686338891625/follower351/snapshot-00000000685C3EA8-3019D7C0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
06:23:37,243 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower351: local snapshot saved in 96.13 ms, deleting Pekko-persisted snapshots
06:23:37,244 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower351: Recovery completed in 97.32 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
06:23:37,248 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader348: Set currentTerm=1, votedFor=null
06:23:37,248 PM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader348: Local TermInfo store seeded with TermInfo{term=1}
06:23:37,248 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader348: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@7250e743
06:23:37,249 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader348: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:37,249 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower351: Set currentTerm=1, votedFor=null
06:23:37,249 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower351: Local TermInfo store seeded with TermInfo{term=1}
06:23:37,249 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower351: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@48923d0b
06:23:37,250 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower351: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
06:23:37,622 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
06:23:37,623 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - leader348 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.98:17355, Removed)
06:23:37,623 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - leader348 (Follower): Received ElectionTimeout - switching to Candidate
06:23:37,623 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader348 (Candidate): Election: Candidate has following voting peers: [follower349, follower350]
06:23:37,627 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader348: Set currentTerm=2, votedFor=leader348
06:23:37,627 PM [test-pekko.actor.default-dispatcher-17] [INFO] Candidate - leader348 (Candidate): Starting new election term 2
06:23:37,627 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader348 (Candidate): Sending RequestVote{term=2, candidateId=leader348, lastLogIndex=-1, lastLogTerm=-1} to peer follower349
06:23:37,627 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader348 (Candidate): Sending RequestVote{term=2, candidateId=leader348, lastLogIndex=-1, lastLogTerm=-1} to peer follower350
06:23:37,627 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader348 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
06:23:37,627 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower349 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
06:23:37,627 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower349 (Follower): Cluster state: []
06:23:37,627 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower349 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader348, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
06:23:37,627 PM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower349 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader348, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
06:23:37,628 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower350 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
06:23:37,628 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower350 (Follower): Cluster state: []
06:23:37,628 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower350 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader348, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
06:23:37,628 PM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower350 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader348, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
06:23:37,629 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower349: Set currentTerm=2, votedFor=null
06:23:37,629 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower349 (Follower): In requestVote: RequestVote{term=2, candidateId=leader348, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
06:23:37,630 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower350: Set currentTerm=2, votedFor=null
06:23:37,630 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower350 (Follower): In requestVote: RequestVote{term=2, candidateId=leader348, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
06:23:37,631 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower349: Set currentTerm=2, votedFor=leader348
06:23:37,631 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower349 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
06:23:37,631 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader348 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
06:23:37,631 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader348 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
06:23:37,632 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader348 (Leader): Election: Leader has following peers: [follower349, follower351, follower350]
06:23:37,632 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader348 (Leader): Checking sendAppendEntries for follower follower349: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:37,632 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader348 (Leader): Checking sendAppendEntries for follower follower351: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:37,632 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower349: Last sync leader does not match current leader leader348, need to catch up to -1
06:23:37,632 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader348 (Leader): Checking sendAppendEntries for follower follower350: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:37,632 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader348 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
06:23:37,632 PM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower351 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader348, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
[WARN] [06/25/2025 18:23:37.632] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower349] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower349, initialSyncDone=false]
06:23:37,632 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader348 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower349 updated: matchIndex: -1, nextIndex: 0
06:23:37,632 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader348 (Leader): Checking sendAppendEntries for follower follower349: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:37,632 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower350: Set currentTerm=2, votedFor=leader348
06:23:37,632 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower350 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
06:23:37,633 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower350: Last sync leader does not match current leader leader348, need to catch up to -1
06:23:37,633 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader348 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower350 updated: matchIndex: -1, nextIndex: 0
06:23:37,633 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader348 (Leader): Checking sendAppendEntries for follower follower350: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/25/2025 18:23:37.633] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower350] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower350, initialSyncDone=false]
06:23:37,634 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower351: Set currentTerm=2, votedFor=null
06:23:37,634 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower351: Last sync leader does not match current leader leader348, need to catch up to -1
06:23:37,634 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader348 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower351 updated: matchIndex: -1, nextIndex: 0
06:23:37,634 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader348 (Leader): Checking sendAppendEntries for follower follower351: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/25/2025 18:23:37.634] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower351] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower351, initialSyncDone=false]
06:23:37,652 PM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
06:23:37,652 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
06:23:37,652 PM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
06:23:37,652 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower349]
06:23:37,663 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower349: stopped executor with 0 remaining tasks
06:23:37,663 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower349: stopped executor with 0 remaining tasks
06:23:37,663 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower351]
06:23:37,674 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower351: stopped executor with 0 remaining tasks
06:23:37,674 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower351: stopped executor with 0 remaining tasks
06:23:37,674 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
06:23:37,674 PM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
06:23:37,674 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader348: onRequestLeadership RequestLeadership [requestedFollowerId=follower350, replyTo=Actor[pekko://test/user/$d#-1484312722]]
06:23:37,674 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader348: Initiating leader transfer
[WARN] [06/25/2025 18:23:37.675] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower349] received dead letter from TestActor[pekko://test/user/leader348]: LeaderTransitioning [leaderId=leader348]
[WARN] [06/25/2025 18:23:37.675] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower351] received dead letter from TestActor[pekko://test/user/leader348]: LeaderTransitioning [leaderId=leader348]
06:23:37,675 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorLeadershipTransferCohort - leader348: pauseLeader successfully completed - doing transfer
06:23:37,675 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower350: onLeaderTransitioning: LeaderTransitioning [leaderId=leader348]
06:23:37,675 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Leader - leader348 (Leader): Attempting to transfer leadership
06:23:37,675 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader348 (Leader): Checking sendAppendEntries for follower follower349: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:37,675 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader348 (Leader): Checking sendAppendEntries for follower follower351: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/25/2025 18:23:37.675] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower349] received dead letter from TestActor[pekko://test/user/leader348]: AppendEntries{term=2, leaderId=leader348, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
06:23:37,675 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader348 (Leader): Checking sendAppendEntries for follower follower350: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/25/2025 18:23:37.675] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower351] received dead letter from TestActor[pekko://test/user/leader348]: AppendEntries{term=2, leaderId=leader348, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
06:23:37,675 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower350: Lagging 0 entries behind leader leader348 and reached -1 (of expected -1)
[WARN] [06/25/2025 18:23:37.675] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower350] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower350, initialSyncDone=true]
06:23:37,675 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Leader - leader348 (Leader): tryToCompleteLeadershipTransfer: followerId: follower350, matchIndex: -1, lastIndex: -1, isVoting: true
06:23:37,675 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Leader - leader348 (Leader): Follower's log matches - sending ElectionTimeout
06:23:37,675 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader348 (Leader): Checking sendAppendEntries for follower follower349: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/25/2025 18:23:37.676] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower349] received dead letter from TestActor[pekko://test/user/leader348]: AppendEntries{term=2, leaderId=leader348, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
06:23:37,676 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader348 (Leader): Checking sendAppendEntries for follower follower351: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/25/2025 18:23:37.676] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower351] received dead letter from TestActor[pekko://test/user/leader348]: AppendEntries{term=2, leaderId=leader348, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
06:23:37,676 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader348 (Leader): Checking sendAppendEntries for follower follower350: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:37,676 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Leader - leader348 (Leader): Leader transfer complete
06:23:37,676 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower350: Lagging 0 entries behind leader leader348 and reached -1 (of expected -1)
06:23:37,676 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorLeadershipTransferCohort - leader348: leader transfer complete - waiting for new leader
06:23:37,676 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
06:23:37,676 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower350 (Follower): Received TimeoutNow - switching to Candidate
06:23:37,676 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower350 (Candidate): Election: Candidate has following voting peers: [leader348, follower349]
06:23:37,680 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower350: Set currentTerm=3, votedFor=follower350
06:23:37,680 PM [test-pekko.actor.default-dispatcher-18] [INFO] Candidate - follower350 (Candidate): Starting new election term 3
06:23:37,680 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower350 (Candidate): Sending RequestVote{term=3, candidateId=follower350, lastLogIndex=-1, lastLogTerm=-1} to peer leader348
06:23:37,680 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower350 (Candidate): Sending RequestVote{term=3, candidateId=follower350, lastLogIndex=-1, lastLogTerm=-1} to peer follower349
06:23:37,680 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - follower350 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
06:23:37,680 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader348 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
06:23:37,680 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader348 (Leader): Cluster state: []
06:23:37,680 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader348 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower350, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
06:23:37,680 PM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractLeader - leader348 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower350, lastLogIndex=-1, lastLogTerm=-1}" message is greater than leader's term 2 - switching to Follower
[WARN] [06/25/2025 18:23:37.681] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower349] received dead letter from TestActor[pekko://test/user/follower350]: RequestVote{term=3, candidateId=follower350, lastLogIndex=-1, lastLogTerm=-1}
06:23:37,683 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader348: Set currentTerm=3, votedFor=null
06:23:37,683 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader348 (Leader): Leadership transfer in progress - processing RequestVote
06:23:37,683 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader348 (Leader): In requestVote: RequestVote{term=3, candidateId=follower350, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
06:23:37,684 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader348: Set currentTerm=3, votedFor=follower350
06:23:37,684 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader348 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
06:23:37,684 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader348 (Leader) :- Switching from behavior Leader to Follower, election term: 3
06:23:37,684 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower350 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3
06:23:37,684 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower350 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1
06:23:37,684 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower350 (Leader): Election: Leader has following peers: [leader348, follower349, follower351]
06:23:37,684 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower350 (Leader): Checking sendAppendEntries for follower leader348: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:37,684 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower350 (Leader): Checking sendAppendEntries for follower follower349: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:37,684 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower350 (Leader): Checking sendAppendEntries for follower follower351: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:37,684 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - follower350 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
06:23:37,685 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - leader348: Last sync leader does not match current leader follower350, need to catch up to -1
06:23:37,685 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader348: leader changed to follower350
06:23:37,685 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorLeadershipTransferCohort - leader348: Successfully transferred leadership to follower350 in 10.16 ms
06:23:37,685 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader348: Leadership transferred successfully to follower350
[WARN] [06/25/2025 18:23:37.685] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower349] received dead letter from TestActor[pekko://test/user/follower350]: AppendEntries{term=3, leaderId=follower350, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
[WARN] [06/25/2025 18:23:37.685] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower351] received dead letter from TestActor[pekko://test/user/follower350]: AppendEntries{term=3, leaderId=follower350, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
[WARN] [06/25/2025 18:23:37.685] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/leader348] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=leader348, initialSyncDone=false]
06:23:37,685 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower350 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader348 updated: matchIndex: -1, nextIndex: 0
06:23:37,685 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower350 (Leader): Checking sendAppendEntries for follower leader348: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
06:23:37,725 PM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown ending
06:23:37,725 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower349-notifier352#-1388378343]
06:23:37,736 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower349-collector353#939929654]
06:23:37,736 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower350-notifier354#1065312646]
06:23:37,736 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower350-collector355#811453846]
06:23:37,737 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower350]
06:23:37,737 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower350: stopped executor with 0 remaining tasks
06:23:37,737 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower350: stopped executor with 0 remaining tasks
06:23:37,737 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower351-notifier356#-446569677]
06:23:37,737 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower351-collector357#1705315182]
06:23:37,737 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader348-notifier358#-29659443]
06:23:37,737 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader348-collector359#-1989743889]
06:23:37,737 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader348]
06:23:37,737 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader348: stopped executor with 0 remaining tasks
06:23:37,737 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader348: stopped executor with 0 remaining tasks
06:23:37,737 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$d#-1484312722]
[INFO] [06/25/2025 18:23:37.738] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
06:23:37,739 PM [test-pekko.actor.default-dispatcher-18] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
[WARN] [06/25/2025 18:23:37.740] [test-pekko.actor.default-dispatcher-6] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.170.98:17355)
[INFO] [06/25/2025 18:23:37.740] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.98:17355] - Exiting completed
[INFO] [06/25/2025 18:23:37.740] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.98:17355] - Shutting down...
[INFO] [06/25/2025 18:23:37.740] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.98:17355] - Successfully shut down
06:23:37,741 PM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.98:17355] - Exiting completed
06:23:37,741 PM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.98:17355] - Shutting down...
06:23:37,741 PM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.98:17355] - Successfully shut down
[INFO] [06/25/2025 18:23:37.741] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.170.98:17355/system/remoting-terminator] Shutting down remote daemon.
[INFO] [06/25/2025 18:23:37.741] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.170.98:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports.
06:23:37,742 PM [test-pekko.actor.default-dispatcher-16] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
06:23:37,742 PM [test-pekko.actor.default-dispatcher-16] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
06:23:37,743 PM [test-pekko.actor.default-dispatcher-6] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[INFO] [06/25/2025 18:23:37.743] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.170.98:17355/system/remoting-terminator] Remoting shut down.
[DEBUG] [06/25/2025 18:23:37.743] [test-pekko.actor.internal-dispatcher-2] [EventStream] shutting down: StandardOutLogger