[DEBUG] [06/30/2025 09:09:03.577] [main] [EventStream(pekko://test)] logger log1-TestEventListener started
09:09:03,578 AM [test-pekko.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started
[DEBUG] [06/30/2025 09:09:03.578] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started
[DEBUG] [06/30/2025 09:09:03.578] [main] [EventStream(pekko://test)] Default Loggers started
[INFO] [06/30/2025 09:09:03.596] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.168:17355] with UID [-155829177672523015]
09:09:03,596 AM [test-pekko.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.168:17355] with UID [-155829177672523015]
[INFO] [06/30/2025 09:09:03.596] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Starting up, Pekko version [1.0.3] ...
09:09:03,596 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Starting up, Pekko version [1.0.3] ...
[INFO] [06/30/2025 09:09:03.598] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Registered cluster JMX MBean [pekko:type=Cluster]
[INFO] [06/30/2025 09:09:03.599] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Started up successfully
09:09:03,599 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Registered cluster JMX MBean [pekko:type=Cluster]
09:09:03,599 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Started up successfully
[INFO] [06/30/2025 09:09:03.600] [test-pekko.actor.internal-dispatcher-10] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing
[INFO] [06/30/2025 09:09:03.601] [test-pekko.actor.internal-dispatcher-10] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining
09:09:03,601 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing
09:09:03,601 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining
09:09:03,611 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferAborted starting
09:09:03,611 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [06/30/2025 09:09:03.615] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower279]: org.opendaylight.controller.cluster.common.actor.Monitor@2f55b2b1
[INFO] [pekkoDeadLetter][06/30/2025 09:09:03.616] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower279] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:03,617 AM [test-pekko.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower279] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:03,618 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower279: Starting recovery with journal batch size 1000
09:09:03,619 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower279: started executor
09:09:03,619 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower279: started executor
09:09:03,619 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower279: metadata journal open: replayFrom=1 applyTo=0
09:09:03,620 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower279: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:03,620 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower279: journal open: applyTo=0
09:09:03,620 AM [follower279-writer-132] [DEBUG] JournalWriteTask - follower279: journal writer started
09:09:03,620 AM [follower279-writer-132] [DEBUG] JournalWriteTask - follower279: waiting to receive commands
[WARN] [06/30/2025 09:09:03.621] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower280]: org.opendaylight.controller.cluster.common.actor.Monitor@be902e2
[INFO] [pekkoDeadLetter][06/30/2025 09:09:03.622] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower280] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:03,622 AM [test-pekko.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower280] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:03,622 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower280: Starting recovery with journal batch size 1000
09:09:03,622 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: started executor
09:09:03,622 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: started executor
09:09:03,623 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower280: metadata journal open: replayFrom=1 applyTo=0
09:09:03,623 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower280: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:03,623 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower280: journal open: applyTo=0
09:09:03,623 AM [follower280-writer-133] [DEBUG] JournalWriteTask - follower280: journal writer started
09:09:03,623 AM [follower280-writer-133] [DEBUG] JournalWriteTask - follower280: waiting to receive commands
[WARN] [06/30/2025 09:09:03.625] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower281]: org.opendaylight.controller.cluster.common.actor.Monitor@51905b63
[INFO] [pekkoDeadLetter][06/30/2025 09:09:03.625] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower281] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:03,625 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower281] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:03,626 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - follower281: Starting recovery with journal batch size 1000
09:09:03,627 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower281: started executor
09:09:03,627 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower281: started executor
09:09:03,628 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower281: metadata journal open: replayFrom=1 applyTo=0
09:09:03,628 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower281: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:03,628 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower281: journal open: applyTo=0
09:09:03,629 AM [follower281-writer-134] [DEBUG] JournalWriteTask - follower281: journal writer started
09:09:03,629 AM [follower281-writer-134] [DEBUG] JournalWriteTask - follower281: waiting to receive commands
09:09:03,630 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower281/TermInfo.properties does not exist
09:09:03,630 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower281: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower281/journal-v1-1.log
09:09:03,630 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower281: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower281/metadata-v1-1.log
09:09:03,630 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower281: no eligible files found
09:09:03,630 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower281: SnapshotOffer called.
09:09:03,630 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower281: initializing from snapshot taken at 2025-06-30T09:09:03.612Z
09:09:03,630 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower281: Set currentTerm=1, votedFor=null
09:09:03,630 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PeerInfos - follower281: Updated server config: isVoting: false, peers: [PeerInfo [id=leader278, address=pekko://test/user/leader278, votingState=VOTING], PeerInfo [id=follower280, address=pekko://test/user/follower280, votingState=VOTING], PeerInfo [id=follower279, address=pekko://test/user/follower279, votingState=VOTING]]
09:09:03,630 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower280/TermInfo.properties does not exist
09:09:03,630 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower280/journal-v1-1.log
09:09:03,630 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower280/metadata-v1-1.log
09:09:03,630 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: no eligible files found
09:09:03,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower280: SnapshotOffer called.
09:09:03,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower280: initializing from snapshot taken at 2025-06-30T09:09:03.612Z
09:09:03,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower280: Set currentTerm=1, votedFor=null
09:09:03,631 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - Recovery snapshot applied for follower281 in 234.7 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:03,631 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower281: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:03.612Z
09:09:03,631 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower281: support() called
09:09:03,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PeerInfos - follower280: Updated server config: isVoting: true, peers: [PeerInfo [id=leader278, address=pekko://test/user/leader278, votingState=VOTING], PeerInfo [id=follower281, address=pekko://test/user/follower281, votingState=NON_VOTING], PeerInfo [id=follower279, address=pekko://test/user/follower279, votingState=VOTING]]
09:09:03,631 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - Recovery snapshot applied for follower280 in 151.2 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:03,631 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower280: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:03.612Z
09:09:03,631 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower280: support() called
09:09:03,631 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower281: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower281/snapshot-000000006862542F-247A6100.tmp
09:09:03,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower280/snapshot-000000006862542F-247A6100.tmp
09:09:03,632 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower279/TermInfo.properties does not exist
09:09:03,632 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower279: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower279/journal-v1-1.log
09:09:03,632 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower279: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower279/metadata-v1-1.log
09:09:03,632 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower279: no eligible files found
09:09:03,632 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower279: SnapshotOffer called.
09:09:03,632 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower279: initializing from snapshot taken at 2025-06-30T09:09:03.612Z
09:09:03,632 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower279: Set currentTerm=1, votedFor=null
09:09:03,632 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - follower279: Updated server config: isVoting: true, peers: [PeerInfo [id=leader278, address=pekko://test/user/leader278, votingState=VOTING], PeerInfo [id=follower281, address=pekko://test/user/follower281, votingState=NON_VOTING], PeerInfo [id=follower280, address=pekko://test/user/follower280, votingState=VOTING]]
09:09:03,632 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - Recovery snapshot applied for follower279 in 55.38 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:03,632 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower279: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:03.612Z
09:09:03,632 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower279: support() called
09:09:03,632 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower279: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower279/snapshot-000000006862542F-247A6100.tmp
[WARN] [06/30/2025 09:09:03.633] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader278]: org.opendaylight.controller.cluster.common.actor.Monitor@6b2bc278
[INFO] [pekkoDeadLetter][06/30/2025 09:09:03.633] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader278] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:03,633 AM [test-pekko.actor.default-dispatcher-15] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader278] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:03,633 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - leader278: Starting recovery with journal batch size 1000
09:09:03,633 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader278: started executor
09:09:03,634 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader278: started executor
09:09:03,634 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader278: metadata journal open: replayFrom=1 applyTo=0
09:09:03,635 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower281: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower281/snapshot-000000006862542F-247A6100.v1
09:09:03,635 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower281: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower281/snapshot-000000006862542F-247A6100.v1
09:09:03,635 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower281: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower281/journal-v1-1.log
09:09:03,635 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower281: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower281/metadata-v1-1.log
09:09:03,635 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower281: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:03.612Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower281/snapshot-000000006862542F-247A6100.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:03,635 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower281: local snapshot saved in 4.238 ms, deleting Pekko-persisted snapshots
09:09:03,636 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader278: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:03,636 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - leader278: journal open: applyTo=0
09:09:03,636 AM [leader278-writer-135] [DEBUG] JournalWriteTask - leader278: journal writer started
09:09:03,636 AM [leader278-writer-135] [DEBUG] JournalWriteTask - leader278: waiting to receive commands
09:09:03,636 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower281: Recovery completed in 5.692 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:03,636 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/leader278/TermInfo.properties does not exist
09:09:03,636 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader278: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/leader278/journal-v1-1.log
09:09:03,636 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader278: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/leader278/metadata-v1-1.log
09:09:03,636 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader278: no eligible files found
09:09:03,636 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - leader278: SnapshotOffer called.
09:09:03,636 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - leader278: initializing from snapshot taken at 2025-06-30T09:09:03.612Z
09:09:03,636 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader278: Set currentTerm=1, votedFor=null
09:09:03,636 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - leader278: Updated server config: isVoting: true, peers: [PeerInfo [id=follower281, address=pekko://test/user/follower281, votingState=NON_VOTING], PeerInfo [id=follower280, address=pekko://test/user/follower280, votingState=VOTING], PeerInfo [id=follower279, address=pekko://test/user/follower279, votingState=VOTING]]
09:09:03,637 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for leader278 in 75.70 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:03,637 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader278: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:03.612Z
09:09:03,637 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader278: support() called
09:09:03,637 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader278: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/leader278/snapshot-000000006862542F-247A6100.tmp
09:09:03,638 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower279: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower279/snapshot-000000006862542F-247A6100.v1
09:09:03,638 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower280/snapshot-000000006862542F-247A6100.v1
09:09:03,638 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower279: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower279/snapshot-000000006862542F-247A6100.v1
09:09:03,638 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower280/snapshot-000000006862542F-247A6100.v1
09:09:03,638 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower279: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower279/journal-v1-1.log
09:09:03,638 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower279: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower279/metadata-v1-1.log
09:09:03,638 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower280/journal-v1-1.log
09:09:03,638 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower279: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:03.612Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower279/snapshot-000000006862542F-247A6100.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:03,638 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower280/metadata-v1-1.log
09:09:03,638 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower279: local snapshot saved in 6.022 ms, deleting Pekko-persisted snapshots
09:09:03,638 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:03.612Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/follower280/snapshot-000000006862542F-247A6100.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:03,638 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower280: local snapshot saved in 7.214 ms, deleting Pekko-persisted snapshots
09:09:03,639 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower279: Recovery completed in 6.791 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:03,639 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower280: Recovery completed in 8.304 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:03,639 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader278: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/leader278/snapshot-000000006862542F-247A6100.v1
09:09:03,639 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader278: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/leader278/snapshot-000000006862542F-247A6100.v1
09:09:03,639 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower281: Set currentTerm=1, votedFor=null
09:09:03,639 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader278: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/leader278/journal-v1-1.log
09:09:03,639 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower281: Local TermInfo store seeded with TermInfo{term=1}
09:09:03,639 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader278: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/leader278/metadata-v1-1.log
09:09:03,639 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower281: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@7ca34ff
09:09:03,639 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader278: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:03.612Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8506429610851595737/leader278/snapshot-000000006862542F-247A6100.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:03,639 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower281: Moving last applied index from -1 to -1
09:09:03,639 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader278: local snapshot saved in 2.592 ms, deleting Pekko-persisted snapshots
09:09:03,640 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower281: journal recovery completedin 400.3 μs with journalIndex=1
09:09:03,640 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower281: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:03,641 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader278: Recovery completed in 4.463 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:03,641 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower280: Set currentTerm=1, votedFor=null
09:09:03,641 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower280: Local TermInfo store seeded with TermInfo{term=1}
09:09:03,641 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower280: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@384bacd
09:09:03,641 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower280: Moving last applied index from -1 to -1
09:09:03,641 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower279: Set currentTerm=1, votedFor=null
09:09:03,641 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower279: Local TermInfo store seeded with TermInfo{term=1}
09:09:03,641 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower279: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@455b3009
09:09:03,641 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower279: Moving last applied index from -1 to -1
09:09:03,642 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower279: journal recovery completedin 256.2 μs with journalIndex=1
09:09:03,642 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower280: journal recovery completedin 474.1 μs with journalIndex=1
09:09:03,642 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower279: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:03,642 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower280: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:03,647 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader278: Set currentTerm=1, votedFor=null
09:09:03,647 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader278: Local TermInfo store seeded with TermInfo{term=1}
09:09:03,647 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader278: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@663c04a3
09:09:03,647 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader278: Moving last applied index from -1 to -1
09:09:03,648 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader278: journal recovery completedin 277.9 μs with journalIndex=1
09:09:03,648 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader278: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:03,981 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:09:03,981 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader278 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed)
09:09:03,981 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader278 (Follower): Received ElectionTimeout - switching to Candidate
09:09:03,981 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader278 (Candidate): Election: Candidate has following voting peers: [follower280, follower279]
09:09:03,984 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader278: Set currentTerm=2, votedFor=leader278
09:09:03,984 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader278 (Candidate): Starting new election term 2
09:09:03,985 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader278 (Candidate): Sending RequestVote{term=2, candidateId=leader278, lastLogIndex=-1, lastLogTerm=-1} to peer follower280
09:09:03,985 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader278 (Candidate): Sending RequestVote{term=2, candidateId=leader278, lastLogIndex=-1, lastLogTerm=-1} to peer follower279
09:09:03,985 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader278 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:09:03,985 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower280 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:09:03,985 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower280 (Follower): Cluster state: []
09:09:03,985 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower280 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader278, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:09:03,985 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower280 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader278, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:09:03,985 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower279 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:09:03,985 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower279 (Follower): Cluster state: []
09:09:03,985 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower279 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader278, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:09:03,985 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower279 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader278, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:09:03,988 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower280: Set currentTerm=2, votedFor=null
09:09:03,988 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower280 (Follower): In requestVote: RequestVote{term=2, candidateId=leader278, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:09:03,989 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower279: Set currentTerm=2, votedFor=null
09:09:03,989 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower279 (Follower): In requestVote: RequestVote{term=2, candidateId=leader278, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:09:03,990 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower280: Set currentTerm=2, votedFor=leader278
09:09:03,990 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower280 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:09:03,991 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader278 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
09:09:03,991 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader278 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
09:09:03,991 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader278 (Leader): Election: Leader has following peers: [follower281, follower280, follower279]
09:09:03,991 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower281: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:03,991 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower280: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:03,991 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower279: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:03,991 AM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower281 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader278, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
09:09:03,991 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader278 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
09:09:03,991 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower280: Last sync leader does not match current leader leader278, need to catch up to -1
09:09:03,991 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader278 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower280 updated: matchIndex: -1, nextIndex: 0
09:09:03,991 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower280: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:03,991 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower279: Set currentTerm=2, votedFor=leader278
[WARN] [06/30/2025 09:09:03.991] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower280] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower280, initialSyncDone=false]
09:09:03,991 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower279 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
[INFO] [pekkoDeadLetter][06/30/2025 09:09:03.991] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower280] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower280] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:03,992 AM [test-pekko.actor.default-dispatcher-11] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower280] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:03,992 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower279: Last sync leader does not match current leader leader278, need to catch up to -1
09:09:03,992 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader278 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower279 updated: matchIndex: -1, nextIndex: 0
09:09:03,992 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower279: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/30/2025 09:09:03.992] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower279] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower279, initialSyncDone=false]
09:09:03,992 AM [test-pekko.actor.default-dispatcher-15] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower279] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[INFO] [pekkoDeadLetter][06/30/2025 09:09:03.992] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower279] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower279] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:03,993 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower281: Set currentTerm=2, votedFor=null
09:09:03,993 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower281: Last sync leader does not match current leader leader278, need to catch up to -1
09:09:03,993 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader278 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower281 updated: matchIndex: -1, nextIndex: 0
09:09:03,994 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower281: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/30/2025 09:09:03.994] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower281] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower281, initialSyncDone=false]
[INFO] [pekkoDeadLetter][06/30/2025 09:09:03.994] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower281] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower281] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:03,994 AM [test-pekko.actor.default-dispatcher-12] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower281] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:04,35 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
09:09:04,35 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader278 starting
09:09:04,38 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader278: onShutDown
09:09:04,38 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader278: Initiating leader transfer
09:09:04,39 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower281: onLeaderTransitioning: LeaderTransitioning [leaderId=leader278]
09:09:04,39 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower279: onLeaderTransitioning: LeaderTransitioning [leaderId=leader278]
09:09:04,39 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower280: onLeaderTransitioning: LeaderTransitioning [leaderId=leader278]
09:09:04,39 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorLeadershipTransferCohort - leader278: pauseLeader successfully completed - doing transfer
09:09:04,39 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Leader - leader278 (Leader): Attempting to transfer leadership
09:09:04,39 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower281: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:04,39 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower280: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:04,39 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower281: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
09:09:04,39 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower280: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
[WARN] [06/30/2025 09:09:04.040] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower281] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower281, initialSyncDone=true]
[WARN] [06/30/2025 09:09:04.040] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower280] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower280, initialSyncDone=true]
[INFO] [pekkoDeadLetter][06/30/2025 09:09:04.040] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower281] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower281] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:04,40 AM [test-pekko.actor.default-dispatcher-17] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower281] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[INFO] [pekkoDeadLetter][06/30/2025 09:09:04.040] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower280] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower280] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:04,40 AM [test-pekko.actor.default-dispatcher-17] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower280] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:04,40 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower279: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:04,40 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower279: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
[WARN] [06/30/2025 09:09:04.041] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower279] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower279, initialSyncDone=true]
[INFO] [pekkoDeadLetter][06/30/2025 09:09:04.041] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower279] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower279] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:04,41 AM [test-pekko.actor.default-dispatcher-12] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower279] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:09:04,101 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower281: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
09:09:04,101 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower280: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
09:09:04,101 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower279: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
09:09:04,221 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower280: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
09:09:04,222 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower279: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
09:09:04,222 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower281: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
09:09:04,341 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorLeadershipTransferCohort - leader278: leader transfer aborted
09:09:04,341 AM [test-pekko.actor.default-dispatcher-12] [WARN] RaftActorLeadershipTransferCohort - leader278: Failed to transfer leadership in 302.3 ms
09:09:04,341 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader278: leader transfer failed - sending PoisonPill
09:09:04,341 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Leader - leader278 (Leader): Leadership transfer expired
09:09:04,341 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower279: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
09:09:04,341 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower280: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
09:09:04,342 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower281: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
09:09:04,342 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRaftStorage - leader278: terminating thread VirtualThread[#708,leader278-writer-135]/waiting
09:09:04,342 AM [leader278-writer-135] [DEBUG] JournalWriteTask - leader278: received 1 commands after 706.0 ms
09:09:04,342 AM [leader278-writer-135] [DEBUG] JournalWriteTask - leader278: completed 1 commands in 47.36 μs
09:09:04,342 AM [leader278-writer-135] [DEBUG] JournalWriteTask - leader278: journal writer stopped
09:09:04,342 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader278: journal closed
09:09:04,342 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - leader278: journal closed
09:09:04,342 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader278: stopped executor with 0 remaining tasks
09:09:04,342 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader278: stopped executor with 0 remaining tasks
[WARN] [06/30/2025 09:09:04.343] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/leader278] received dead letter from TestActor[pekko://test/user/follower279]: AppendEntriesReply{term=2, success=true, followerId=follower279, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
[WARN] [06/30/2025 09:09:04.343] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/leader278] received dead letter from TestActor[pekko://test/user/follower280]: AppendEntriesReply{term=2, success=true, followerId=follower280, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
[WARN] [06/30/2025 09:09:04.343] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/leader278] received dead letter from TestActor[pekko://test/user/follower281]: AppendEntriesReply{term=2, success=true, followerId=follower281, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:09:04,345 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader278 ending
09:09:04,346 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending
09:09:04,346 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower279-notifier282#198957184]
09:09:04,358 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower279-collector283#-134191038]
09:09:04,358 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower279]
09:09:04,358 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRaftStorage - follower279: terminating thread VirtualThread[#703,follower279-writer-132]/waiting
09:09:04,359 AM [follower279-writer-132] [DEBUG] JournalWriteTask - follower279: received 1 commands after 739.3 ms
09:09:04,359 AM [follower279-writer-132] [DEBUG] JournalWriteTask - follower279: completed 1 commands in 10.78 μs
09:09:04,359 AM [follower279-writer-132] [DEBUG] JournalWriteTask - follower279: journal writer stopped
09:09:04,359 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower279: journal closed
09:09:04,359 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower279: journal closed
09:09:04,360 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower279: stopped executor with 0 remaining tasks
09:09:04,360 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower279: stopped executor with 0 remaining tasks
09:09:04,360 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower280-notifier284#38803658]
09:09:04,361 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower280-collector285#-644623326]
09:09:04,361 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower280]
09:09:04,361 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRaftStorage - follower280: terminating thread VirtualThread[#704,follower280-writer-133]/waiting
09:09:04,361 AM [follower280-writer-133] [DEBUG] JournalWriteTask - follower280: received 1 commands after 738.1 ms
09:09:04,361 AM [follower280-writer-133] [DEBUG] JournalWriteTask - follower280: completed 1 commands in 10.24 μs
09:09:04,361 AM [follower280-writer-133] [DEBUG] JournalWriteTask - follower280: journal writer stopped
09:09:04,361 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower280: journal closed
09:09:04,361 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower280: journal closed
09:09:04,361 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower280: stopped executor with 0 remaining tasks
09:09:04,361 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower280: stopped executor with 0 remaining tasks
09:09:04,361 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower281-notifier286#-1416753027]
09:09:04,362 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower281-collector287#2126314797]
09:09:04,362 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower281]
09:09:04,362 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRaftStorage - follower281: terminating thread VirtualThread[#705,follower281-writer-134]/waiting
09:09:04,362 AM [follower281-writer-134] [DEBUG] JournalWriteTask - follower281: received 1 commands after 733.4 ms
09:09:04,362 AM [follower281-writer-134] [DEBUG] JournalWriteTask - follower281: completed 1 commands in 8.930 μs
09:09:04,362 AM [follower281-writer-134] [DEBUG] JournalWriteTask - follower281: journal writer stopped
09:09:04,362 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower281: journal closed
09:09:04,362 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower281: journal closed
09:09:04,362 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower281: stopped executor with 0 remaining tasks
09:09:04,362 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower281: stopped executor with 0 remaining tasks
09:09:04,362 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader278-notifier288#614582879]
09:09:04,363 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader278-collector289#-1967048486]
09:09:04,363 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader278]
09:09:04,366 AM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 starting
09:09:04,366 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [06/30/2025 09:09:04.368] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower291]: org.opendaylight.controller.cluster.common.actor.Monitor@bfe533d
09:09:04,369 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - follower291: Starting recovery with journal batch size 1000
09:09:04,369 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower291: started executor
09:09:04,369 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower291: started executor
09:09:04,369 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower291: metadata journal open: replayFrom=1 applyTo=0
09:09:04,370 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower291: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:04,370 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower291: journal open: applyTo=0
09:09:04,370 AM [follower291-writer-136] [DEBUG] JournalWriteTask - follower291: journal writer started
09:09:04,370 AM [follower291-writer-136] [DEBUG] JournalWriteTask - follower291: waiting to receive commands
09:09:04,371 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower291/TermInfo.properties does not exist
09:09:04,371 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower291: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower291/journal-v1-1.log
09:09:04,371 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower291: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower291/metadata-v1-1.log
09:09:04,371 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower291: no eligible files found
09:09:04,371 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower291: SnapshotOffer called.
09:09:04,371 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower291: initializing from snapshot taken at 2025-06-30T09:09:04.366Z
09:09:04,371 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower291: Set currentTerm=1, votedFor=null
09:09:04,371 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - follower291: Updated server config: isVoting: true, peers: [PeerInfo [id=follower292, address=pekko://test/user/follower292, votingState=VOTING], PeerInfo [id=follower293, address=pekko://test/user/follower293, votingState=NON_VOTING], PeerInfo [id=leader290, address=pekko://test/user/leader290, votingState=VOTING]]
09:09:04,371 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - Recovery snapshot applied for follower291 in 80.79 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:04,371 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower291: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:04.366Z
09:09:04,371 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower291: support() called
09:09:04,371 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower291: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower291/snapshot-0000000068625430-15D0B780.tmp
[WARN] [06/30/2025 09:09:04.372] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower292]: org.opendaylight.controller.cluster.common.actor.Monitor@416a8518
09:09:04,373 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower292: Starting recovery with journal batch size 1000
09:09:04,373 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower292: started executor
09:09:04,373 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower292: started executor
09:09:04,373 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower292: metadata journal open: replayFrom=1 applyTo=0
09:09:04,374 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower292: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:04,374 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower292: journal open: applyTo=0
09:09:04,374 AM [follower292-writer-137] [DEBUG] JournalWriteTask - follower292: journal writer started
09:09:04,374 AM [follower292-writer-137] [DEBUG] JournalWriteTask - follower292: waiting to receive commands
09:09:04,374 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower291: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower291/snapshot-0000000068625430-15D0B780.v1
09:09:04,374 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower291: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower291/journal-v1-1.log
09:09:04,375 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower291: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower291/metadata-v1-1.log
09:09:04,375 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower291: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower291/snapshot-0000000068625430-15D0B780.v1
09:09:04,375 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower291: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:04.366Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower291/snapshot-0000000068625430-15D0B780.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:04,375 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower291: local snapshot saved in 3.405 ms, deleting Pekko-persisted snapshots
09:09:04,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower292/TermInfo.properties does not exist
09:09:04,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower292: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower292/journal-v1-1.log
09:09:04,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower292: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower292/metadata-v1-1.log
09:09:04,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower292: no eligible files found
09:09:04,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower292: SnapshotOffer called.
09:09:04,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower292: initializing from snapshot taken at 2025-06-30T09:09:04.366Z
09:09:04,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower292: Set currentTerm=1, votedFor=null
09:09:04,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - follower292: Updated server config: isVoting: true, peers: [PeerInfo [id=follower291, address=pekko://test/user/follower291, votingState=VOTING], PeerInfo [id=follower293, address=pekko://test/user/follower293, votingState=NON_VOTING], PeerInfo [id=leader290, address=pekko://test/user/leader290, votingState=VOTING]]
09:09:04,375 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for follower292 in 51.99 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:04,375 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower292: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:04.366Z
09:09:04,375 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower292: support() called
09:09:04,376 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower292: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower292/snapshot-0000000068625430-15D0B780.tmp
09:09:04,376 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower291: Recovery completed in 5.057 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [06/30/2025 09:09:04.376] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower293]: org.opendaylight.controller.cluster.common.actor.Monitor@1e1b6cf2
09:09:04,377 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower293: Starting recovery with journal batch size 1000
09:09:04,377 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower293: started executor
09:09:04,377 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower293: started executor
09:09:04,378 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower293: metadata journal open: replayFrom=1 applyTo=0
09:09:04,378 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower293: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:04,378 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower293: journal open: applyTo=0
09:09:04,378 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower292: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower292/snapshot-0000000068625430-15D0B780.v1
09:09:04,378 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower292: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower292/journal-v1-1.log
09:09:04,378 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower292: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower292/metadata-v1-1.log
09:09:04,378 AM [follower293-writer-138] [DEBUG] JournalWriteTask - follower293: journal writer started
09:09:04,378 AM [follower293-writer-138] [DEBUG] JournalWriteTask - follower293: waiting to receive commands
09:09:04,378 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower292: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower292/snapshot-0000000068625430-15D0B780.v1
09:09:04,378 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower292: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:04.366Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower292/snapshot-0000000068625430-15D0B780.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:04,378 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower292: local snapshot saved in 3.138 ms, deleting Pekko-persisted snapshots
09:09:04,379 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower293/TermInfo.properties does not exist
09:09:04,379 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower293: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower293/journal-v1-1.log
09:09:04,379 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower293: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower293/metadata-v1-1.log
09:09:04,379 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower293: no eligible files found
09:09:04,379 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower293: SnapshotOffer called.
09:09:04,379 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower293: initializing from snapshot taken at 2025-06-30T09:09:04.366Z
09:09:04,379 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower293: Set currentTerm=1, votedFor=null
09:09:04,379 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower291: Set currentTerm=1, votedFor=null
09:09:04,379 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower291: Local TermInfo store seeded with TermInfo{term=1}
09:09:04,379 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower291: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@ae58404
09:09:04,379 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower291: Moving last applied index from -1 to -1
09:09:04,380 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower292: Recovery completed in 4.290 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:04,380 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PeerInfos - follower293: Updated server config: isVoting: false, peers: [PeerInfo [id=follower292, address=pekko://test/user/follower292, votingState=VOTING], PeerInfo [id=follower291, address=pekko://test/user/follower291, votingState=VOTING], PeerInfo [id=leader290, address=pekko://test/user/leader290, votingState=VOTING]]
09:09:04,380 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower291: journal recovery completedin 208.7 μs with journalIndex=1
09:09:04,380 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - Recovery snapshot applied for follower293 in 85.66 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:04,380 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower293: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:04.366Z
09:09:04,380 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower293: support() called
09:09:04,380 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower291: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:04,380 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower293: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower293/snapshot-0000000068625430-15D0B780.tmp
09:09:04,381 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader290: Starting recovery with journal batch size 1000
09:09:04,381 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader290: started executor
09:09:04,381 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader290: started executor
09:09:04,382 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader290: metadata journal open: replayFrom=1 applyTo=0
09:09:04,382 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader290: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:04,382 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader290: journal open: applyTo=0
[WARN] [06/30/2025 09:09:04.382] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader290]: org.opendaylight.controller.cluster.common.actor.Monitor@64c6572c
09:09:04,382 AM [leader290-writer-139] [DEBUG] JournalWriteTask - leader290: journal writer started
09:09:04,382 AM [leader290-writer-139] [DEBUG] JournalWriteTask - leader290: waiting to receive commands
09:09:04,382 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/leader290/TermInfo.properties does not exist
09:09:04,382 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader290: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/leader290/journal-v1-1.log
09:09:04,382 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader290: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/leader290/metadata-v1-1.log
09:09:04,382 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader290: no eligible files found
09:09:04,382 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader290: SnapshotOffer called.
09:09:04,382 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader290: initializing from snapshot taken at 2025-06-30T09:09:04.366Z
09:09:04,382 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader290: Set currentTerm=1, votedFor=null
09:09:04,382 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - leader290: Updated server config: isVoting: true, peers: [PeerInfo [id=follower292, address=pekko://test/user/follower292, votingState=VOTING], PeerInfo [id=follower291, address=pekko://test/user/follower291, votingState=VOTING], PeerInfo [id=follower293, address=pekko://test/user/follower293, votingState=NON_VOTING]]
09:09:04,383 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for leader290 in 40.82 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:04,383 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader290: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:04.366Z
09:09:04,383 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader290: support() called
09:09:04,383 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader290: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/leader290/snapshot-0000000068625430-15D0B780.tmp
09:09:04,398 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower292: Set currentTerm=1, votedFor=null
09:09:04,398 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower292: Local TermInfo store seeded with TermInfo{term=1}
09:09:04,398 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower292: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@73ded43b
09:09:04,398 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower292: Moving last applied index from -1 to -1
09:09:04,398 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower292: journal recovery completedin 338.8 μs with journalIndex=1
09:09:04,399 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower293: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower293/snapshot-0000000068625430-15D0B780.v1
09:09:04,399 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader290: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/leader290/snapshot-0000000068625430-15D0B780.v1
09:09:04,399 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower293: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower293/journal-v1-1.log
09:09:04,399 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower292: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:04,399 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower293: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower293/metadata-v1-1.log
09:09:04,399 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower293: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower293/snapshot-0000000068625430-15D0B780.v1
09:09:04,399 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader290: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/leader290/journal-v1-1.log
09:09:04,399 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader290: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/leader290/metadata-v1-1.log
09:09:04,399 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader290: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/leader290/snapshot-0000000068625430-15D0B780.v1
09:09:04,399 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower293: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:04.366Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/follower293/snapshot-0000000068625430-15D0B780.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:04,399 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower293: local snapshot saved in 19.22 ms, deleting Pekko-persisted snapshots
09:09:04,399 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader290: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:04.366Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8408411157740182103/leader290/snapshot-0000000068625430-15D0B780.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:04,399 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader290: local snapshot saved in 16.55 ms, deleting Pekko-persisted snapshots
09:09:04,400 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower293: Recovery completed in 21.16 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:04,401 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader290: Recovery completed in 18.54 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:04,404 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower293: Set currentTerm=1, votedFor=null
09:09:04,404 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower293: Local TermInfo store seeded with TermInfo{term=1}
09:09:04,404 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower293: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@7178c144
09:09:04,404 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower293: Moving last applied index from -1 to -1
09:09:04,404 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower293: journal recovery completedin 282.2 μs with journalIndex=1
09:09:04,404 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader290: Set currentTerm=1, votedFor=null
09:09:04,404 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader290: Local TermInfo store seeded with TermInfo{term=1}
09:09:04,404 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower293: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:04,404 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader290: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@7f9786c2
09:09:04,404 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader290: Moving last applied index from -1 to -1
09:09:04,405 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader290: journal recovery completedin 282.9 μs with journalIndex=1
09:09:04,406 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader290: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:04,811 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:09:04,811 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader290 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed)
09:09:04,811 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader290 (Follower): Received ElectionTimeout - switching to Candidate
09:09:04,811 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader290 (Candidate): Election: Candidate has following voting peers: [follower292, follower291]
09:09:04,816 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader290: Set currentTerm=2, votedFor=leader290
09:09:04,816 AM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader290 (Candidate): Starting new election term 2
09:09:04,816 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader290 (Candidate): Sending RequestVote{term=2, candidateId=leader290, lastLogIndex=-1, lastLogTerm=-1} to peer follower292
09:09:04,816 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader290 (Candidate): Sending RequestVote{term=2, candidateId=leader290, lastLogIndex=-1, lastLogTerm=-1} to peer follower291
09:09:04,816 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader290 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:09:04,816 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower292 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:09:04,816 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower291 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:09:04,816 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower292 (Follower): Cluster state: []
09:09:04,816 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower291 (Follower): Cluster state: []
09:09:04,816 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower292 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader290, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:09:04,816 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower291 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader290, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:09:04,816 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower292 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader290, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:09:04,816 AM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower291 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader290, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:09:04,820 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower291: Set currentTerm=2, votedFor=null
09:09:04,820 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower291 (Follower): In requestVote: RequestVote{term=2, candidateId=leader290, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:09:04,820 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower292: Set currentTerm=2, votedFor=null
09:09:04,821 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower292 (Follower): In requestVote: RequestVote{term=2, candidateId=leader290, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:09:04,823 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower291: Set currentTerm=2, votedFor=leader290
09:09:04,823 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower291 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:09:04,823 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader290 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
09:09:04,824 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader290 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
09:09:04,824 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader290 (Leader): Election: Leader has following peers: [follower292, follower291, follower293]
09:09:04,824 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower292: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:04,824 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower291: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:04,824 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower293: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:04,824 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower291: Last sync leader does not match current leader leader290, need to catch up to -1
09:09:04,824 AM [test-pekko.actor.default-dispatcher-11] [INFO] Follower - follower293 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader290, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
09:09:04,824 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower292: Set currentTerm=2, votedFor=leader290
09:09:04,824 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower292 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
[WARN] [06/30/2025 09:09:04.824] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower291] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower291, initialSyncDone=false]
09:09:04,825 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader290 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
09:09:04,825 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower292: Last sync leader does not match current leader leader290, need to catch up to -1
09:09:04,825 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader290 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower291 updated: matchIndex: -1, nextIndex: 0
09:09:04,825 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower291: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:04,825 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader290 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower292 updated: matchIndex: -1, nextIndex: 0
09:09:04,825 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower292: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/30/2025 09:09:04.825] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower292] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower292, initialSyncDone=false]
09:09:04,827 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower293: Set currentTerm=2, votedFor=null
09:09:04,827 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower293: Last sync leader does not match current leader leader290, need to catch up to -1
09:09:04,827 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader290 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower293 updated: matchIndex: -1, nextIndex: 0
09:09:04,827 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower293: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/30/2025 09:09:04.827] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower293] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower293, initialSyncDone=false]
09:09:04,858 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
09:09:04,859 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
09:09:04,859 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
09:09:04,859 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
09:09:04,860 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
09:09:04,860 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader290: onRequestLeadership RequestLeadership [requestedFollowerId=follower292, replyTo=Actor[pekko://test/user/$a#784182091]]
09:09:04,862 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader290: Initiating leader transfer
09:09:04,862 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader290: pauseLeader successfully completed - doing transfer
09:09:04,862 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower292: onLeaderTransitioning: LeaderTransitioning [leaderId=leader290]
09:09:04,862 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader290 (Leader): Attempting to transfer leadership
09:09:04,862 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower291: onLeaderTransitioning: LeaderTransitioning [leaderId=leader290]
09:09:04,862 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower293: onLeaderTransitioning: LeaderTransitioning [leaderId=leader290]
09:09:04,862 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower292: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:04,863 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower291: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:04,863 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower293: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:04,863 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower292: Lagging 0 entries behind leader leader290 and reached -1 (of expected -1)
09:09:04,863 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower291: Lagging 0 entries behind leader leader290 and reached -1 (of expected -1)
09:09:04,863 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower293: Lagging 0 entries behind leader leader290 and reached -1 (of expected -1)
[WARN] [06/30/2025 09:09:04.863] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower292] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower292, initialSyncDone=true]
[WARN] [06/30/2025 09:09:04.863] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower291] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower291, initialSyncDone=true]
[WARN] [06/30/2025 09:09:04.863] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower293] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower293, initialSyncDone=true]
09:09:04,863 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader290 (Leader): tryToCompleteLeadershipTransfer: followerId: follower292, matchIndex: -1, lastIndex: -1, isVoting: true
09:09:04,863 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader290 (Leader): Follower's log matches - sending ElectionTimeout
09:09:04,863 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower292: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:04,863 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower291: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:04,863 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower293: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:04,863 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower292: Lagging 0 entries behind leader leader290 and reached -1 (of expected -1)
09:09:04,863 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower291: Lagging 0 entries behind leader leader290 and reached -1 (of expected -1)
09:09:04,863 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader290 (Leader): Leader transfer complete
09:09:04,863 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader290: leader transfer complete - waiting for new leader
09:09:04,863 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower293: Lagging 0 entries behind leader leader290 and reached -1 (of expected -1)
09:09:04,863 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:09:04,863 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower292 (Follower): Received TimeoutNow - switching to Candidate
09:09:04,864 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - follower292 (Candidate): Election: Candidate has following voting peers: [follower291, leader290]
09:09:04,867 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower292: Set currentTerm=3, votedFor=follower292
09:09:04,867 AM [test-pekko.actor.default-dispatcher-12] [INFO] Candidate - follower292 (Candidate): Starting new election term 3
09:09:04,867 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - follower292 (Candidate): Sending RequestVote{term=3, candidateId=follower292, lastLogIndex=-1, lastLogTerm=-1} to peer follower291
09:09:04,867 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - follower292 (Candidate): Sending RequestVote{term=3, candidateId=follower292, lastLogIndex=-1, lastLogTerm=-1} to peer leader290
09:09:04,867 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower291 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:09:04,867 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActorBehavior - follower292 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
09:09:04,867 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader290 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:09:04,867 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader290 (Leader): Cluster state: []
09:09:04,867 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader290 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower292, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:09:04,867 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractLeader - leader290 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower292, lastLogIndex=-1, lastLogTerm=-1}" message is greater than leader's term 2 - switching to Follower
09:09:04,867 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower291 (Follower): Cluster state: []
09:09:04,867 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower291 (Follower): Candidate in requestVote:RequestVote{term=3, candidateId=follower292, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:09:04,867 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower291 (Follower): Term 3 in "RequestVote{term=3, candidateId=follower292, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 2 - updating term
09:09:04,869 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader290: Set currentTerm=3, votedFor=null
09:09:04,869 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader290 (Leader): Leadership transfer in progress - processing RequestVote
09:09:04,869 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader290 (Leader): In requestVote: RequestVote{term=3, candidateId=follower292, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
09:09:04,870 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower291: Set currentTerm=3, votedFor=null
09:09:04,870 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower291 (Follower): In requestVote: RequestVote{term=3, candidateId=follower292, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
09:09:04,872 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader290: Set currentTerm=3, votedFor=follower292
09:09:04,872 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader290 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
09:09:04,872 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader290 (Leader) :- Switching from behavior Leader to Follower, election term: 3
09:09:04,872 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - follower292 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3
09:09:04,872 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - follower292 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1
09:09:04,872 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower292 (Leader): Election: Leader has following peers: [follower291, follower293, leader290]
09:09:04,872 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower292 (Leader): Checking sendAppendEntries for follower follower291: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:04,872 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower291: Set currentTerm=3, votedFor=follower292
09:09:04,872 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower292 (Leader): Checking sendAppendEntries for follower follower293: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:04,872 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower291 (Follower): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
09:09:04,872 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower292 (Leader): Checking sendAppendEntries for follower leader290: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:04,872 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - follower292 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
09:09:04,872 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower291: Last sync leader does not match current leader follower292, need to catch up to -1
09:09:04,873 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - leader290: Last sync leader does not match current leader follower292, need to catch up to -1
09:09:04,873 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorLeadershipTransferCohort - leader290: leader changed to follower292
09:09:04,873 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower292 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower291 updated: matchIndex: -1, nextIndex: 0
09:09:04,873 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorLeadershipTransferCohort - leader290: Successfully transferred leadership to follower292 in 10.53 ms
09:09:04,873 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower292 (Leader): Checking sendAppendEntries for follower follower291: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:04,873 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader290: Leadership transferred successfully to follower292
09:09:04,873 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower292 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader290 updated: matchIndex: -1, nextIndex: 0
09:09:04,873 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower292 (Leader): Checking sendAppendEntries for follower leader290: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/30/2025 09:09:04.873] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower291] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower291, initialSyncDone=false]
[WARN] [06/30/2025 09:09:04.873] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/leader290] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=leader290, initialSyncDone=false]
09:09:04,873 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower293 (Follower): Term 3 in "AppendEntries{term=3, leaderId=follower292, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 2 - updating term
09:09:04,875 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower293: Set currentTerm=3, votedFor=null
09:09:04,875 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower293: Last sync leader does not match current leader follower292, need to catch up to -1
09:09:04,875 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower292 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower293 updated: matchIndex: -1, nextIndex: 0
09:09:04,876 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower292 (Leader): Checking sendAppendEntries for follower follower293: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/30/2025 09:09:04.876] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower293] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower293, initialSyncDone=false]
09:09:04,913 AM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 ending
09:09:04,913 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower291-notifier294#-1809493775]
09:09:04,924 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower291-collector295#1515363529]
09:09:04,924 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower291]
09:09:04,924 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - follower291: terminating thread VirtualThread[#710,follower291-writer-136]/waiting
09:09:04,924 AM [follower291-writer-136] [DEBUG] JournalWriteTask - follower291: received 1 commands after 554.4 ms
09:09:04,925 AM [follower291-writer-136] [DEBUG] JournalWriteTask - follower291: completed 1 commands in 18.93 μs
09:09:04,925 AM [follower291-writer-136] [DEBUG] JournalWriteTask - follower291: journal writer stopped
09:09:04,925 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower291: journal closed
09:09:04,925 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower291: journal closed
09:09:04,925 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower291: stopped executor with 0 remaining tasks
09:09:04,925 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower291: stopped executor with 0 remaining tasks
09:09:04,925 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower292-notifier296#2126269327]
09:09:04,925 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower292-collector297#1135926991]
09:09:04,925 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower292]
09:09:04,926 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - follower292: terminating thread VirtualThread[#711,follower292-writer-137]/waiting
09:09:04,926 AM [follower292-writer-137] [DEBUG] JournalWriteTask - follower292: received 1 commands after 551.5 ms
09:09:04,926 AM [follower292-writer-137] [DEBUG] JournalWriteTask - follower292: completed 1 commands in 9.210 μs
09:09:04,926 AM [follower292-writer-137] [DEBUG] JournalWriteTask - follower292: journal writer stopped
09:09:04,926 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower292: journal closed
09:09:04,926 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower292: journal closed
09:09:04,926 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower292: stopped executor with 0 remaining tasks
09:09:04,926 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower292: stopped executor with 0 remaining tasks
09:09:04,926 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower293-notifier298#694814379]
09:09:04,926 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower293-collector299#-1425078600]
09:09:04,926 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower293]
09:09:04,926 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - follower293: terminating thread VirtualThread[#712,follower293-writer-138]/waiting
09:09:04,927 AM [follower293-writer-138] [DEBUG] JournalWriteTask - follower293: received 1 commands after 548.2 ms
09:09:04,927 AM [follower293-writer-138] [DEBUG] JournalWriteTask - follower293: completed 1 commands in 8.660 μs
09:09:04,927 AM [follower293-writer-138] [DEBUG] JournalWriteTask - follower293: journal writer stopped
09:09:04,927 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower293: journal closed
09:09:04,927 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower293: journal closed
09:09:04,927 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower293: stopped executor with 0 remaining tasks
09:09:04,927 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower293: stopped executor with 0 remaining tasks
09:09:04,927 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader290-notifier300#1632435582]
09:09:04,927 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader290-collector301#-1782083670]
09:09:04,927 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader290]
09:09:04,927 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - leader290: terminating thread VirtualThread[#713,leader290-writer-139]/waiting
09:09:04,927 AM [leader290-writer-139] [DEBUG] JournalWriteTask - leader290: received 1 commands after 545.3 ms
09:09:04,927 AM [leader290-writer-139] [DEBUG] JournalWriteTask - leader290: completed 1 commands in 9.060 μs
09:09:04,927 AM [leader290-writer-139] [DEBUG] JournalWriteTask - leader290: journal writer stopped
09:09:04,927 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader290: journal closed
09:09:04,927 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - leader290: journal closed
09:09:04,927 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader290: stopped executor with 0 remaining tasks
09:09:04,927 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader290: stopped executor with 0 remaining tasks
09:09:04,928 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$a#784182091]
09:09:04,930 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown starting
09:09:04,930 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
09:09:04,933 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower303: Starting recovery with journal batch size 1000
[WARN] [06/30/2025 09:09:04.933] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower303]: org.opendaylight.controller.cluster.common.actor.Monitor@d782abd
09:09:04,933 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower303: started executor
09:09:04,933 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower303: started executor
09:09:04,934 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower303: metadata journal open: replayFrom=1 applyTo=0
09:09:04,935 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower303: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:04,935 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower303: journal open: applyTo=0
09:09:04,935 AM [follower303-writer-140] [DEBUG] JournalWriteTask - follower303: journal writer started
09:09:04,935 AM [follower303-writer-140] [DEBUG] JournalWriteTask - follower303: waiting to receive commands
09:09:04,935 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower303/TermInfo.properties does not exist
09:09:04,935 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower303: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower303/journal-v1-1.log
09:09:04,935 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower303: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower303/metadata-v1-1.log
09:09:04,936 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower303: no eligible files found
09:09:04,936 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower303: SnapshotOffer called.
09:09:04,936 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower303: initializing from snapshot taken at 2025-06-30T09:09:04.930Z
09:09:04,936 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower303: Set currentTerm=1, votedFor=null
09:09:04,936 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PeerInfos - follower303: Updated server config: isVoting: true, peers: [PeerInfo [id=follower304, address=pekko://test/user/follower304, votingState=VOTING], PeerInfo [id=leader302, address=pekko://test/user/leader302, votingState=VOTING], PeerInfo [id=follower305, address=pekko://test/user/follower305, votingState=NON_VOTING]]
09:09:04,936 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - Recovery snapshot applied for follower303 in 300.1 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:04,936 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower303: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:04.930Z
09:09:04,936 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower303: support() called
09:09:04,936 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower303: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower303/snapshot-0000000068625430-376EAC80.tmp
[WARN] [06/30/2025 09:09:04.937] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower304]: org.opendaylight.controller.cluster.common.actor.Monitor@2cb68031
09:09:04,939 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower304: Starting recovery with journal batch size 1000
09:09:04,939 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: started executor
09:09:04,940 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: started executor
09:09:04,940 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower303: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower303/snapshot-0000000068625430-376EAC80.v1
09:09:04,940 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower303: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower303/snapshot-0000000068625430-376EAC80.v1
09:09:04,940 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower303: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower303/journal-v1-1.log
09:09:04,940 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower303: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower303/metadata-v1-1.log
09:09:04,940 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower303: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:04.930Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower303/snapshot-0000000068625430-376EAC80.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:04,940 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower303: local snapshot saved in 4.007 ms, deleting Pekko-persisted snapshots
09:09:04,940 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower304: metadata journal open: replayFrom=1 applyTo=0
09:09:04,941 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower303: Recovery completed in 5.728 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:04,942 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower304: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:04,942 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower304: journal open: applyTo=0
09:09:04,942 AM [follower304-writer-141] [DEBUG] JournalWriteTask - follower304: journal writer started
09:09:04,942 AM [follower304-writer-141] [DEBUG] JournalWriteTask - follower304: waiting to receive commands
09:09:04,943 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower304/TermInfo.properties does not exist
09:09:04,943 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower304: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower304/journal-v1-1.log
09:09:04,943 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower304: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower304/metadata-v1-1.log
09:09:04,943 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower304: no eligible files found
09:09:04,943 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower304: SnapshotOffer called.
09:09:04,943 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower304: initializing from snapshot taken at 2025-06-30T09:09:04.930Z
09:09:04,943 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower304: Set currentTerm=1, votedFor=null
09:09:04,943 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PeerInfos - follower304: Updated server config: isVoting: true, peers: [PeerInfo [id=follower303, address=pekko://test/user/follower303, votingState=VOTING], PeerInfo [id=leader302, address=pekko://test/user/leader302, votingState=VOTING], PeerInfo [id=follower305, address=pekko://test/user/follower305, votingState=NON_VOTING]]
09:09:04,944 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - Recovery snapshot applied for follower304 in 311.4 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:04,944 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower304: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:04.930Z
09:09:04,944 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower304: support() called
09:09:04,944 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower303: Set currentTerm=1, votedFor=null
09:09:04,944 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower303: Local TermInfo store seeded with TermInfo{term=1}
09:09:04,944 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower303: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@6e3457bb
09:09:04,944 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower303: Moving last applied index from -1 to -1
09:09:04,945 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower303: journal recovery completedin 403.1 μs with journalIndex=1
09:09:04,945 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower305: Starting recovery with journal batch size 1000
09:09:04,945 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower305: started executor
09:09:04,945 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower305: started executor
09:09:04,945 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower305: metadata journal open: replayFrom=1 applyTo=0
09:09:04,945 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower303: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
[WARN] [06/30/2025 09:09:04.945] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower305]: org.opendaylight.controller.cluster.common.actor.Monitor@13ff7f9b
09:09:04,946 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower305: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:04,946 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower305: journal open: applyTo=0
09:09:04,946 AM [follower305-writer-142] [DEBUG] JournalWriteTask - follower305: journal writer started
09:09:04,946 AM [follower305-writer-142] [DEBUG] JournalWriteTask - follower305: waiting to receive commands
09:09:04,946 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower304: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower304/snapshot-0000000068625430-376EAC80.tmp
09:09:04,946 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower305/TermInfo.properties does not exist
09:09:04,946 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower305: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower305/journal-v1-1.log
09:09:04,946 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower305: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower305/metadata-v1-1.log
09:09:04,946 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower305: no eligible files found
09:09:04,946 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower305: SnapshotOffer called.
09:09:04,946 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower305: initializing from snapshot taken at 2025-06-30T09:09:04.930Z
09:09:04,946 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower305: Set currentTerm=1, votedFor=null
09:09:04,947 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PeerInfos - follower305: Updated server config: isVoting: false, peers: [PeerInfo [id=follower304, address=pekko://test/user/follower304, votingState=VOTING], PeerInfo [id=follower303, address=pekko://test/user/follower303, votingState=VOTING], PeerInfo [id=leader302, address=pekko://test/user/leader302, votingState=VOTING]]
09:09:04,947 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - Recovery snapshot applied for follower305 in 104.7 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:04,947 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower305: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:04.930Z
09:09:04,947 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower305: support() called
09:09:04,947 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower305: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower305/snapshot-0000000068625430-376EAC80.tmp
[WARN] [06/30/2025 09:09:04.947] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader302]: org.opendaylight.controller.cluster.common.actor.Monitor@78f0fce9
09:09:04,948 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - leader302: Starting recovery with journal batch size 1000
09:09:04,949 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower304: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower304/snapshot-0000000068625430-376EAC80.v1
09:09:04,949 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower304: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower304/snapshot-0000000068625430-376EAC80.v1
09:09:04,949 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader302: started executor
09:09:04,949 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader302: started executor
09:09:04,949 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower304: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower304/journal-v1-1.log
09:09:04,949 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower304: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower304/metadata-v1-1.log
09:09:04,949 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower304: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:04.930Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower304/snapshot-0000000068625430-376EAC80.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:04,949 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower304: local snapshot saved in 5.194 ms, deleting Pekko-persisted snapshots
09:09:04,949 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader302: metadata journal open: replayFrom=1 applyTo=0
09:09:04,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower305: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower305/snapshot-0000000068625430-376EAC80.v1
09:09:04,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower305: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower305/snapshot-0000000068625430-376EAC80.v1
09:09:04,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower305: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower305/journal-v1-1.log
09:09:04,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower305: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower305/metadata-v1-1.log
09:09:04,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower305: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:04.930Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/follower305/snapshot-0000000068625430-376EAC80.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:04,950 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower305: local snapshot saved in 2.957 ms, deleting Pekko-persisted snapshots
09:09:04,950 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader302: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:04,950 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader302: journal open: applyTo=0
09:09:04,950 AM [leader302-writer-143] [DEBUG] JournalWriteTask - leader302: journal writer started
09:09:04,950 AM [leader302-writer-143] [DEBUG] JournalWriteTask - leader302: waiting to receive commands
09:09:04,950 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower305: Recovery completed in 3.855 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:04,950 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/leader302/TermInfo.properties does not exist
09:09:04,950 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower304: Recovery completed in 7.188 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:04,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader302: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/leader302/journal-v1-1.log
09:09:04,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader302: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/leader302/metadata-v1-1.log
09:09:04,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader302: no eligible files found
09:09:04,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader302: SnapshotOffer called.
09:09:04,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader302: initializing from snapshot taken at 2025-06-30T09:09:04.930Z
09:09:04,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader302: Set currentTerm=1, votedFor=null
09:09:04,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - leader302: Updated server config: isVoting: true, peers: [PeerInfo [id=follower304, address=pekko://test/user/follower304, votingState=VOTING], PeerInfo [id=follower303, address=pekko://test/user/follower303, votingState=VOTING], PeerInfo [id=follower305, address=pekko://test/user/follower305, votingState=NON_VOTING]]
09:09:04,951 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for leader302 in 92.29 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:04,951 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader302: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:04.930Z
09:09:04,951 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader302: support() called
09:09:04,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader302: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/leader302/snapshot-0000000068625430-376EAC80.tmp
09:09:04,954 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower305: Set currentTerm=1, votedFor=null
09:09:04,954 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower305: Local TermInfo store seeded with TermInfo{term=1}
09:09:04,954 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower305: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@3d478b79
09:09:04,954 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower305: Moving last applied index from -1 to -1
09:09:04,955 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower305: journal recovery completedin 320.5 μs with journalIndex=1
09:09:04,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader302: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/leader302/snapshot-0000000068625430-376EAC80.v1
09:09:04,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader302: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/leader302/snapshot-0000000068625430-376EAC80.v1
09:09:04,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader302: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/leader302/journal-v1-1.log
09:09:04,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader302: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/leader302/metadata-v1-1.log
09:09:04,955 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower304: Set currentTerm=1, votedFor=null
09:09:04,955 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower304: Local TermInfo store seeded with TermInfo{term=1}
09:09:04,955 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower304: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@17485c7
09:09:04,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader302: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:04.930Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest6904171468073777590/leader302/snapshot-0000000068625430-376EAC80.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:04,955 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower304: Moving last applied index from -1 to -1
09:09:04,955 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader302: local snapshot saved in 4.530 ms, deleting Pekko-persisted snapshots
09:09:04,956 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower305: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:04,956 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader302: Recovery completed in 5.367 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:04,956 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower304: journal recovery completedin 612.4 μs with journalIndex=1
09:09:04,957 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower304: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:04,958 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader302: Set currentTerm=1, votedFor=null
09:09:04,958 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader302: Local TermInfo store seeded with TermInfo{term=1}
09:09:04,958 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader302: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@54730c1c
09:09:04,958 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader302: Moving last applied index from -1 to -1
09:09:04,958 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader302: journal recovery completedin 194.6 μs with journalIndex=1
09:09:04,959 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader302: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:05,372 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:09:05,372 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader302 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed)
09:09:05,372 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader302 (Follower): Received ElectionTimeout - switching to Candidate
09:09:05,372 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader302 (Candidate): Election: Candidate has following voting peers: [follower304, follower303]
09:09:05,376 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader302: Set currentTerm=2, votedFor=leader302
09:09:05,376 AM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader302 (Candidate): Starting new election term 2
09:09:05,376 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader302 (Candidate): Sending RequestVote{term=2, candidateId=leader302, lastLogIndex=-1, lastLogTerm=-1} to peer follower304
09:09:05,376 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader302 (Candidate): Sending RequestVote{term=2, candidateId=leader302, lastLogIndex=-1, lastLogTerm=-1} to peer follower303
09:09:05,376 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader302 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:09:05,376 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower304 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:09:05,376 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower304 (Follower): Cluster state: []
09:09:05,376 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower304 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader302, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:09:05,376 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower304 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader302, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:09:05,377 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower303 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:09:05,377 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower303 (Follower): Cluster state: []
09:09:05,377 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower303 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader302, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:09:05,377 AM [test-pekko.actor.default-dispatcher-11] [INFO] Follower - follower303 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader302, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:09:05,380 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower304: Set currentTerm=2, votedFor=null
09:09:05,380 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower304 (Follower): In requestVote: RequestVote{term=2, candidateId=leader302, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:09:05,381 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower303: Set currentTerm=2, votedFor=null
09:09:05,381 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower303 (Follower): In requestVote: RequestVote{term=2, candidateId=leader302, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:09:05,384 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower304: Set currentTerm=2, votedFor=leader302
09:09:05,384 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower304 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:09:05,384 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader302 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
09:09:05,384 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader302 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
09:09:05,384 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader302 (Leader): Election: Leader has following peers: [follower304, follower303, follower305]
09:09:05,384 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower304: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:05,384 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower303: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:05,384 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower305: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:05,384 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader302 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
09:09:05,384 AM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - follower305 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader302, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
09:09:05,384 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower304: Last sync leader does not match current leader leader302, need to catch up to -1
[WARN] [06/30/2025 09:09:05.385] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower304] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower304, initialSyncDone=false]
09:09:05,385 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader302 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower304 updated: matchIndex: -1, nextIndex: 0
09:09:05,385 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower304: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:05,385 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower303: Set currentTerm=2, votedFor=leader302
09:09:05,385 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower303 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:09:05,385 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower303: Last sync leader does not match current leader leader302, need to catch up to -1
09:09:05,385 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader302 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower303 updated: matchIndex: -1, nextIndex: 0
09:09:05,385 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower303: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/30/2025 09:09:05.385] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower303] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower303, initialSyncDone=false]
09:09:05,387 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower305: Set currentTerm=2, votedFor=null
09:09:05,387 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower305: Last sync leader does not match current leader leader302, need to catch up to -1
09:09:05,387 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader302 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower305 updated: matchIndex: -1, nextIndex: 0
09:09:05,387 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower305: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/30/2025 09:09:05.387] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower305] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower305, initialSyncDone=false]
09:09:05,412 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
09:09:05,413 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
09:09:05,413 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
09:09:05,413 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower304 starting
09:09:05,413 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower304: onShutDown
09:09:05,414 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - follower304: terminating thread VirtualThread[#716,follower304-writer-141]/waiting
09:09:05,414 AM [follower304-writer-141] [DEBUG] JournalWriteTask - follower304: received 1 commands after 471.7 ms
09:09:05,414 AM [follower304-writer-141] [DEBUG] JournalWriteTask - follower304: completed 1 commands in 17.79 μs
09:09:05,414 AM [follower304-writer-141] [DEBUG] JournalWriteTask - follower304: journal writer stopped
09:09:05,414 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower304: journal closed
09:09:05,414 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower304: journal closed
09:09:05,414 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower304: stopped executor with 0 remaining tasks
09:09:05,414 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower304: stopped executor with 0 remaining tasks
09:09:05,414 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower304 ending
09:09:05,414 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
09:09:05,415 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
09:09:05,415 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader302: onRequestLeadership RequestLeadership [requestedFollowerId=follower304, replyTo=Actor[pekko://test/user/$b#-431826420]]
09:09:05,415 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader302: Initiating leader transfer
[WARN] [06/30/2025 09:09:05.415] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower304] received dead letter from TestActor[pekko://test/user/leader302]: LeaderTransitioning [leaderId=leader302]
09:09:05,415 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower303: onLeaderTransitioning: LeaderTransitioning [leaderId=leader302]
09:09:05,416 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorLeadershipTransferCohort - leader302: pauseLeader successfully completed - doing transfer
09:09:05,416 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Leader - leader302 (Leader): Attempting to transfer leadership
09:09:05,416 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower305: onLeaderTransitioning: LeaderTransitioning [leaderId=leader302]
09:09:05,416 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower304: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/30/2025 09:09:05.416] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower304] received dead letter from TestActor[pekko://test/user/leader302]: AppendEntries{term=2, leaderId=leader302, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
09:09:05,416 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower303: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:05,416 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower303: Lagging 0 entries behind leader leader302 and reached -1 (of expected -1)
[WARN] [06/30/2025 09:09:05.416] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower303] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower303, initialSyncDone=true]
09:09:05,416 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower305: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:05,416 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower305: Lagging 0 entries behind leader leader302 and reached -1 (of expected -1)
[WARN] [06/30/2025 09:09:05.416] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower305] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower305, initialSyncDone=true]
[WARN] [06/30/2025 09:09:05.502] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower304] received dead letter from TestActor[pekko://test/user/leader302]: AppendEntries{term=2, leaderId=leader302, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
09:09:05,621 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower303: Lagging 0 entries behind leader leader302 and reached -1 (of expected -1)
09:09:05,621 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower305: Lagging 0 entries behind leader leader302 and reached -1 (of expected -1)
[WARN] [06/30/2025 09:09:05.621] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower304] received dead letter from TestActor[pekko://test/user/leader302]: AppendEntries{term=2, leaderId=leader302, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
09:09:05,741 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorLeadershipTransferCohort - leader302: leader transfer aborted
09:09:05,741 AM [test-pekko.actor.default-dispatcher-11] [WARN] RaftActorLeadershipTransferCohort - leader302: Failed to transfer leadership in 326.3 ms
09:09:05,741 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader302: LeadershipTransfer request from follower304 failed
09:09:05,742 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Leader - leader302 (Leader): Leadership transfer expired
09:09:05,742 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower303: Lagging 0 entries behind leader leader302 and reached -1 (of expected -1)
09:09:05,742 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower305: Lagging 0 entries behind leader leader302 and reached -1 (of expected -1)
[WARN] [06/30/2025 09:09:05.742] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower304] received dead letter from TestActor[pekko://test/user/leader302]: AppendEntries{term=2, leaderId=leader302, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
09:09:05,767 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown ending
09:09:05,767 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower303-notifier306#-1860846089]
09:09:05,778 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower303-collector307#1669892614]
09:09:05,778 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower303]
09:09:05,778 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - follower303: terminating thread VirtualThread[#715,follower303-writer-140]/waiting
09:09:05,779 AM [follower303-writer-140] [DEBUG] JournalWriteTask - follower303: received 1 commands after 843.8 ms
09:09:05,779 AM [follower303-writer-140] [DEBUG] JournalWriteTask - follower303: completed 1 commands in 10.22 μs
09:09:05,779 AM [follower303-writer-140] [DEBUG] JournalWriteTask - follower303: journal writer stopped
09:09:05,779 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower303: journal closed
09:09:05,779 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower303: journal closed
09:09:05,779 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower303: stopped executor with 0 remaining tasks
09:09:05,779 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower303: stopped executor with 0 remaining tasks
09:09:05,779 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower304-notifier308#-387444493]
09:09:05,779 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower304-collector309#-698718253]
09:09:05,780 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower304]
09:09:05,780 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower305-notifier310#-54146854]
09:09:05,780 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower305-collector311#-801730971]
09:09:05,780 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower305]
09:09:05,781 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - follower305: terminating thread VirtualThread[#717,follower305-writer-142]/waiting
09:09:05,781 AM [follower305-writer-142] [DEBUG] JournalWriteTask - follower305: received 1 commands after 835.0 ms
09:09:05,781 AM [follower305-writer-142] [DEBUG] JournalWriteTask - follower305: completed 1 commands in 11.15 μs
09:09:05,781 AM [follower305-writer-142] [DEBUG] JournalWriteTask - follower305: journal writer stopped
09:09:05,781 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower305: journal closed
09:09:05,781 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower305: journal closed
09:09:05,781 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower305: stopped executor with 0 remaining tasks
09:09:05,781 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower305: stopped executor with 0 remaining tasks
09:09:05,781 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader302-notifier312#1911646641]
09:09:05,781 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader302-collector313#1570234487]
09:09:05,782 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader302]
09:09:05,782 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - leader302: terminating thread VirtualThread[#718,leader302-writer-143]/waiting
09:09:05,782 AM [leader302-writer-143] [DEBUG] JournalWriteTask - leader302: received 1 commands after 832.1 ms
09:09:05,782 AM [leader302-writer-143] [DEBUG] JournalWriteTask - leader302: completed 1 commands in 11.24 μs
09:09:05,782 AM [leader302-writer-143] [DEBUG] JournalWriteTask - leader302: journal writer stopped
09:09:05,782 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader302: journal closed
09:09:05,782 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - leader302: journal closed
09:09:05,782 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader302: stopped executor with 0 remaining tasks
09:09:05,782 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader302: stopped executor with 0 remaining tasks
09:09:05,783 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$b#-431826420]
09:09:05,786 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown starting
09:09:05,786 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [06/30/2025 09:09:05.788] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower315]: org.opendaylight.controller.cluster.common.actor.Monitor@45daf493
09:09:05,788 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower315: Starting recovery with journal batch size 1000
09:09:05,789 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower315: started executor
09:09:05,789 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower315: started executor
09:09:05,789 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower315: metadata journal open: replayFrom=1 applyTo=0
09:09:05,789 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower315: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:05,789 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower315: journal open: applyTo=0
09:09:05,790 AM [follower315-writer-144] [DEBUG] JournalWriteTask - follower315: journal writer started
09:09:05,790 AM [follower315-writer-144] [DEBUG] JournalWriteTask - follower315: waiting to receive commands
09:09:05,790 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower315/TermInfo.properties does not exist
09:09:05,790 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower315: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower315/journal-v1-1.log
09:09:05,790 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower315: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower315/metadata-v1-1.log
09:09:05,790 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower315: no eligible files found
09:09:05,790 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower315: SnapshotOffer called.
09:09:05,790 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower315: initializing from snapshot taken at 2025-06-30T09:09:05.786Z
09:09:05,790 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower315: Set currentTerm=1, votedFor=null
09:09:05,790 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PeerInfos - follower315: Updated server config: isVoting: true, peers: [PeerInfo [id=follower317, address=pekko://test/user/follower317, votingState=NON_VOTING], PeerInfo [id=follower316, address=pekko://test/user/follower316, votingState=VOTING], PeerInfo [id=leader314, address=pekko://test/user/leader314, votingState=VOTING]]
09:09:05,790 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - Recovery snapshot applied for follower315 in 74.19 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:05,790 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower315: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:05.786Z
09:09:05,791 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower315: support() called
09:09:05,791 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower315: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower315/snapshot-0000000068625431-2ED96880.tmp
[WARN] [06/30/2025 09:09:05.792] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower316]: org.opendaylight.controller.cluster.common.actor.Monitor@79ec2a81
09:09:05,793 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower316: Starting recovery with journal batch size 1000
09:09:05,793 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower316: started executor
09:09:05,793 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower316: started executor
09:09:05,793 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower316: metadata journal open: replayFrom=1 applyTo=0
09:09:05,794 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower315: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower315/snapshot-0000000068625431-2ED96880.v1
09:09:05,794 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower315: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower315/snapshot-0000000068625431-2ED96880.v1
09:09:05,794 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower315: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower315/journal-v1-1.log
09:09:05,794 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower315: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower315/metadata-v1-1.log
09:09:05,794 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower315: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:05.786Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower315/snapshot-0000000068625431-2ED96880.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:05,794 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower315: local snapshot saved in 3.339 ms, deleting Pekko-persisted snapshots
09:09:05,794 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower316: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:05,794 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower316: journal open: applyTo=0
09:09:05,795 AM [follower316-writer-145] [DEBUG] JournalWriteTask - follower316: journal writer started
09:09:05,795 AM [follower316-writer-145] [DEBUG] JournalWriteTask - follower316: waiting to receive commands
09:09:05,795 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower315: Recovery completed in 4.746 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:05,795 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower316/TermInfo.properties does not exist
09:09:05,795 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower316: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower316/journal-v1-1.log
09:09:05,795 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower316: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower316/metadata-v1-1.log
09:09:05,795 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower316: no eligible files found
09:09:05,795 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower316: SnapshotOffer called.
09:09:05,795 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower316: initializing from snapshot taken at 2025-06-30T09:09:05.786Z
09:09:05,795 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower316: Set currentTerm=1, votedFor=null
09:09:05,796 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PeerInfos - follower316: Updated server config: isVoting: true, peers: [PeerInfo [id=follower315, address=pekko://test/user/follower315, votingState=VOTING], PeerInfo [id=follower317, address=pekko://test/user/follower317, votingState=NON_VOTING], PeerInfo [id=leader314, address=pekko://test/user/leader314, votingState=VOTING]]
09:09:05,796 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - Recovery snapshot applied for follower316 in 101.5 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:05,796 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower316: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:05.786Z
09:09:05,796 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower316: support() called
09:09:05,796 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower316: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower316/snapshot-0000000068625431-2ED96880.tmp
[WARN] [06/30/2025 09:09:05.798] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower317]: org.opendaylight.controller.cluster.common.actor.Monitor@14320746
09:09:05,798 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower317: Starting recovery with journal batch size 1000
09:09:05,798 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: started executor
09:09:05,798 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: started executor
09:09:05,799 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower317: metadata journal open: replayFrom=1 applyTo=0
09:09:05,799 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower317: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:05,799 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower317: journal open: applyTo=0
09:09:05,800 AM [follower317-writer-146] [DEBUG] JournalWriteTask - follower317: journal writer started
09:09:05,800 AM [follower317-writer-146] [DEBUG] JournalWriteTask - follower317: waiting to receive commands
09:09:05,800 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower315: Set currentTerm=1, votedFor=null
09:09:05,800 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower315: Local TermInfo store seeded with TermInfo{term=1}
09:09:05,800 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower315: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@7087888c
09:09:05,800 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower315: Moving last applied index from -1 to -1
09:09:05,800 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower317/TermInfo.properties does not exist
09:09:05,800 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower317/journal-v1-1.log
09:09:05,800 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower317/metadata-v1-1.log
09:09:05,800 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: no eligible files found
09:09:05,800 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower317: SnapshotOffer called.
09:09:05,800 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower317: initializing from snapshot taken at 2025-06-30T09:09:05.786Z
09:09:05,800 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower317: Set currentTerm=1, votedFor=null
09:09:05,800 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PeerInfos - follower317: Updated server config: isVoting: false, peers: [PeerInfo [id=follower315, address=pekko://test/user/follower315, votingState=VOTING], PeerInfo [id=follower316, address=pekko://test/user/follower316, votingState=VOTING], PeerInfo [id=leader314, address=pekko://test/user/leader314, votingState=VOTING]]
09:09:05,800 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower315: journal recovery completedin 290.7 μs with journalIndex=1
09:09:05,800 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - Recovery snapshot applied for follower317 in 68.62 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:05,800 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower317: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:05.786Z
09:09:05,800 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower317: support() called
09:09:05,801 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower317/snapshot-0000000068625431-2ED96880.tmp
09:09:05,801 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower315: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:05,801 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower316: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower316/snapshot-0000000068625431-2ED96880.v1
09:09:05,801 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower316: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower316/snapshot-0000000068625431-2ED96880.v1
09:09:05,801 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower316: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower316/journal-v1-1.log
09:09:05,801 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower316: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower316/metadata-v1-1.log
09:09:05,801 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower316: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:05.786Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower316/snapshot-0000000068625431-2ED96880.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:05,801 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower316: local snapshot saved in 5.361 ms, deleting Pekko-persisted snapshots
[WARN] [06/30/2025 09:09:05.802] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader314]: org.opendaylight.controller.cluster.common.actor.Monitor@33bbe02e
09:09:05,802 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower316: Recovery completed in 6.725 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:05,802 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader314: Starting recovery with journal batch size 1000
09:09:05,802 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader314: started executor
09:09:05,802 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader314: started executor
09:09:05,803 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader314: metadata journal open: replayFrom=1 applyTo=0
09:09:05,803 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower317/snapshot-0000000068625431-2ED96880.v1
09:09:05,803 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower317/snapshot-0000000068625431-2ED96880.v1
09:09:05,803 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower317/journal-v1-1.log
09:09:05,803 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower317/metadata-v1-1.log
09:09:05,803 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:05.786Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/follower317/snapshot-0000000068625431-2ED96880.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:05,803 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower317: local snapshot saved in 2.712 ms, deleting Pekko-persisted snapshots
09:09:05,804 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower317: Recovery completed in 3.560 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:05,804 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader314: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:05,804 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader314: journal open: applyTo=0
09:09:05,804 AM [leader314-writer-147] [DEBUG] JournalWriteTask - leader314: journal writer started
09:09:05,804 AM [leader314-writer-147] [DEBUG] JournalWriteTask - leader314: waiting to receive commands
09:09:05,804 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/leader314/TermInfo.properties does not exist
09:09:05,805 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader314: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/leader314/journal-v1-1.log
09:09:05,805 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower316: Set currentTerm=1, votedFor=null
09:09:05,805 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader314: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/leader314/metadata-v1-1.log
09:09:05,805 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower316: Local TermInfo store seeded with TermInfo{term=1}
09:09:05,805 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower316: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@39e4c92e
09:09:05,805 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader314: no eligible files found
09:09:05,805 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - leader314: SnapshotOffer called.
09:09:05,805 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower316: Moving last applied index from -1 to -1
09:09:05,805 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - leader314: initializing from snapshot taken at 2025-06-30T09:09:05.786Z
09:09:05,805 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader314: Set currentTerm=1, votedFor=null
09:09:05,805 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - leader314: Updated server config: isVoting: true, peers: [PeerInfo [id=follower315, address=pekko://test/user/follower315, votingState=VOTING], PeerInfo [id=follower317, address=pekko://test/user/follower317, votingState=NON_VOTING], PeerInfo [id=follower316, address=pekko://test/user/follower316, votingState=VOTING]]
09:09:05,805 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - Recovery snapshot applied for leader314 in 62.88 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:05,805 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - follower316: journal recovery completedin 223.9 μs with journalIndex=1
09:09:05,805 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader314: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:05.786Z
09:09:05,805 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader314: support() called
09:09:05,805 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader314: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/leader314/snapshot-0000000068625431-2ED96880.tmp
09:09:05,806 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower316: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:05,806 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower317: Set currentTerm=1, votedFor=null
09:09:05,806 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower317: Local TermInfo store seeded with TermInfo{term=1}
09:09:05,806 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower317: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@47a8bcfa
09:09:05,806 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower317: Moving last applied index from -1 to -1
09:09:05,806 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower317: journal recovery completedin 531.7 μs with journalIndex=1
09:09:05,807 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower317: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:05,807 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader314: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/leader314/snapshot-0000000068625431-2ED96880.v1
09:09:05,808 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader314: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/leader314/snapshot-0000000068625431-2ED96880.v1
09:09:05,808 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader314: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/leader314/journal-v1-1.log
09:09:05,808 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader314: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/leader314/metadata-v1-1.log
09:09:05,808 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader314: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:05.786Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest820190123085166501/leader314/snapshot-0000000068625431-2ED96880.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:05,808 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader314: local snapshot saved in 2.501 ms, deleting Pekko-persisted snapshots
09:09:05,808 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader314: Recovery completed in 3.248 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:05,812 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader314: Set currentTerm=1, votedFor=null
09:09:05,812 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader314: Local TermInfo store seeded with TermInfo{term=1}
09:09:05,812 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader314: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@72f19693
09:09:05,812 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader314: Moving last applied index from -1 to -1
09:09:05,812 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader314: journal recovery completedin 160.8 μs with journalIndex=1
09:09:05,813 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader314: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:06,151 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:09:06,151 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader314 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed)
09:09:06,151 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader314 (Follower): Received ElectionTimeout - switching to Candidate
09:09:06,151 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader314 (Candidate): Election: Candidate has following voting peers: [follower315, follower316]
09:09:06,156 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader314: Set currentTerm=2, votedFor=leader314
09:09:06,156 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader314 (Candidate): Starting new election term 2
09:09:06,156 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader314 (Candidate): Sending RequestVote{term=2, candidateId=leader314, lastLogIndex=-1, lastLogTerm=-1} to peer follower315
09:09:06,156 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader314 (Candidate): Sending RequestVote{term=2, candidateId=leader314, lastLogIndex=-1, lastLogTerm=-1} to peer follower316
09:09:06,156 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader314 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:09:06,156 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower316 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:09:06,156 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower316 (Follower): Cluster state: []
09:09:06,156 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower316 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader314, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:09:06,156 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower316 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader314, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:09:06,157 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower315 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:09:06,157 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower315 (Follower): Cluster state: []
09:09:06,157 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower315 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader314, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:09:06,157 AM [test-pekko.actor.default-dispatcher-11] [INFO] Follower - follower315 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader314, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:09:06,159 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower316: Set currentTerm=2, votedFor=null
09:09:06,159 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower316 (Follower): In requestVote: RequestVote{term=2, candidateId=leader314, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:09:06,161 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower315: Set currentTerm=2, votedFor=null
09:09:06,161 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower315 (Follower): In requestVote: RequestVote{term=2, candidateId=leader314, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:09:06,162 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower316: Set currentTerm=2, votedFor=leader314
09:09:06,162 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower316 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:09:06,162 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader314 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
09:09:06,162 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader314 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
09:09:06,162 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): Election: Leader has following peers: [follower315, follower317, follower316]
09:09:06,162 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower315: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:06,162 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower317: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:06,162 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower316: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:06,162 AM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower317 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader314, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
09:09:06,162 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader314 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
09:09:06,163 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower316: Last sync leader does not match current leader leader314, need to catch up to -1
[WARN] [06/30/2025 09:09:06.163] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower316] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower316, initialSyncDone=false]
09:09:06,163 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower316 updated: matchIndex: -1, nextIndex: 0
09:09:06,163 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower316: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:06,165 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
09:09:06,165 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting
09:09:06,165 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader314: Persist data index=0 term=2 command=zero
09:09:06,165 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader314: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
09:09:06,165 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
09:09:06,165 AM [leader314-writer-147] [DEBUG] JournalWriteTask - leader314: received 1 commands after 361.4 ms
09:09:06,166 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower315: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,166 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower317: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,166 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower316: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,166 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): sendAppendEntries: 0 is present for follower follower316
09:09:06,166 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): Sending AppendEntries to follower follower316: AppendEntries{term=2, leaderId=leader314, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:09:06,166 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower315: Set currentTerm=2, votedFor=leader314
09:09:06,166 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower315 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:09:06,166 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower315: Last sync leader does not match current leader leader314, need to catch up to -1
09:09:06,166 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower315: Lagging 0 entries behind leader leader314 and reached -1 (of expected -1)
09:09:06,166 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower315 updated: matchIndex: -1, nextIndex: 0
[WARN] [06/30/2025 09:09:06.166] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower315] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower315, initialSyncDone=false]
[WARN] [06/30/2025 09:09:06.166] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower315] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower315, initialSyncDone=true]
09:09:06,167 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower315: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,167 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): sendAppendEntries: 0 is present for follower follower315
09:09:06,167 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): Sending AppendEntries to follower follower315: AppendEntries{term=2, leaderId=leader314, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:09:06,167 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower315 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader314, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:09:06,167 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower315 (Follower): Number of entries to be appended = 1
09:09:06,167 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower315 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:09:06,167 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower315 (Follower): Append entry to log zero
09:09:06,167 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower315: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
09:09:06,167 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower315 (Follower): Log size is now 1
09:09:06,167 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower315 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower315, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:09:06,167 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower315: Lagging 0 entries behind leader leader314 and reached -1 (of expected -1)
09:09:06,167 AM [follower315-writer-144] [DEBUG] JournalWriteTask - follower315: received 1 commands after 377.3 ms
09:09:06,167 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower315: awaiting more completions to resolve 1 deferred callback(s)
09:09:06,167 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): sendAppendEntries: 0 is present for follower follower315
09:09:06,167 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower315 updated: matchIndex: 0, nextIndex: 1
09:09:06,167 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower315: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,169 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower317: Set currentTerm=2, votedFor=null
09:09:06,169 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower317: Last sync leader does not match current leader leader314, need to catch up to -1
09:09:06,169 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower317: Lagging 0 entries behind leader leader314 and reached -1 (of expected -1)
09:09:06,169 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader314 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower317 updated: matchIndex: -1, nextIndex: 0
09:09:06,169 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower317: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,169 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader314 (Leader): sendAppendEntries: 0 is present for follower follower317
09:09:06,169 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader314 (Leader): Sending AppendEntries to follower follower317: AppendEntries{term=2, leaderId=leader314, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:09:06,169 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader314 (Leader): sendAppendEntries: 0 is present for follower follower317
[WARN] [06/30/2025 09:09:06.169] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower317] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower317, initialSyncDone=false]
[WARN] [06/30/2025 09:09:06.169] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower317] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower317, initialSyncDone=true]
09:09:06,169 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower317 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader314, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:09:06,169 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower317 (Follower): Number of entries to be appended = 1
09:09:06,169 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower317 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:09:06,169 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower317 (Follower): Append entry to log zero
09:09:06,169 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower317: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
09:09:06,170 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower317 (Follower): Log size is now 1
09:09:06,170 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower317 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower317, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:09:06,170 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower317: Lagging 0 entries behind leader leader314 and reached -1 (of expected -1)
09:09:06,170 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower317: awaiting more completions to resolve 1 deferred callback(s)
09:09:06,170 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower317 updated: matchIndex: 0, nextIndex: 1
09:09:06,170 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower317: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,170 AM [follower317-writer-146] [DEBUG] JournalWriteTask - follower317: received 1 commands after 370.1 ms
09:09:06,172 AM [leader314-writer-147] [DEBUG] EntryStoreCompleter - leader314: 1 completion(s) pending
09:09:06,172 AM [leader314-writer-147] [DEBUG] JournalWriteTask - leader314: completed 1 commands in 6.185 ms
09:09:06,172 AM [leader314-writer-147] [DEBUG] JournalWriteTask - leader314: waiting to receive commands
09:09:06,172 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - leader314: running 1 completion(s)
09:09:06,172 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader314: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=true}
09:09:06,172 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader314 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
09:09:06,172 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader314 (Leader): Setting last applied to 0
09:09:06,172 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader314: Moving last applied index from -1 to 0
09:09:06,172 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader314: Applying state for log index 0 data zero
09:09:06,172 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - leader314: applyState called: zero
09:09:06,172 AM [leader314-writer-147] [DEBUG] JournalWriteTask - leader314: received 1 commands after 722.8 μs
09:09:06,173 AM [leader314-writer-147] [DEBUG] JournalWriteTask - leader314: completed 1 commands in 89.74 μs
09:09:06,173 AM [leader314-writer-147] [DEBUG] JournalWriteTask - leader314: waiting to receive commands
09:09:06,173 AM [follower315-writer-144] [DEBUG] EntryStoreCompleter - follower315: 1 completion(s) pending
09:09:06,173 AM [follower317-writer-146] [DEBUG] EntryStoreCompleter - follower317: 1 completion(s) pending
09:09:06,173 AM [follower315-writer-144] [DEBUG] JournalWriteTask - follower315: completed 1 commands in 6.470 ms
09:09:06,174 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower315: running 1 completion(s)
09:09:06,174 AM [follower315-writer-144] [DEBUG] JournalWriteTask - follower315: waiting to receive commands
09:09:06,174 AM [follower317-writer-146] [DEBUG] JournalWriteTask - follower317: completed 1 commands in 3.735 ms
09:09:06,174 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower315: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
09:09:06,174 AM [follower317-writer-146] [DEBUG] JournalWriteTask - follower317: waiting to receive commands
09:09:06,174 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower317: running 1 completion(s)
09:09:06,174 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower315: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@1944d1
09:09:06,174 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower317: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
09:09:06,174 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower317: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@6b8f3d97
09:09:06,282 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader314 (Leader): sendAppendEntries: 0 is present for follower follower316
09:09:06,282 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower315 (Follower): Commit index set to 0
09:09:06,282 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader314 (Leader): Sending AppendEntries to follower follower316: AppendEntries{term=2, leaderId=leader314, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
09:09:06,282 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower315: Lagging 0 entries behind leader leader314 and reached 0 (of expected -1)
09:09:06,282 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower315 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:09:06,282 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower315 (Follower): Setting last applied to 0
09:09:06,282 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower315: Moving last applied index from -1 to 0
09:09:06,282 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower315: Applying state for log index 0 data zero
09:09:06,282 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower315: applyState called: zero
09:09:06,282 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower317 (Follower): Commit index set to 0
09:09:06,282 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower317: Lagging 0 entries behind leader leader314 and reached 0 (of expected -1)
09:09:06,282 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower317 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:09:06,282 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower317 (Follower): Setting last applied to 0
09:09:06,282 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower317: Moving last applied index from -1 to 0
09:09:06,282 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower317: Applying state for log index 0 data zero
09:09:06,282 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower317: applyState called: zero
09:09:06,282 AM [follower315-writer-144] [DEBUG] JournalWriteTask - follower315: received 1 commands after 108.9 ms
09:09:06,283 AM [follower317-writer-146] [DEBUG] JournalWriteTask - follower317: received 1 commands after 109.0 ms
09:09:06,283 AM [follower315-writer-144] [DEBUG] JournalWriteTask - follower315: completed 1 commands in 188.5 μs
09:09:06,283 AM [follower315-writer-144] [DEBUG] JournalWriteTask - follower315: waiting to receive commands
09:09:06,283 AM [follower317-writer-146] [DEBUG] JournalWriteTask - follower317: completed 1 commands in 178.8 μs
09:09:06,283 AM [follower317-writer-146] [DEBUG] JournalWriteTask - follower317: waiting to receive commands
09:09:06,316 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending
09:09:06,317 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 starting
09:09:06,317 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader314: onShutDown
09:09:06,317 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader314: Initiating leader transfer
09:09:06,317 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorLeadershipTransferCohort - leader314: pauseLeader successfully completed - doing transfer
09:09:06,317 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Leader - leader314 (Leader): Attempting to transfer leadership
09:09:06,317 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower315: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,317 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower317: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,317 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower315: onLeaderTransitioning: LeaderTransitioning [leaderId=leader314]
09:09:06,317 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower316: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,317 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader314 (Leader): sendAppendEntries: 0 is present for follower follower316
09:09:06,317 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower315: Lagging 0 entries behind leader leader314 and reached 0 (of expected -1)
09:09:06,317 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower317: Lagging 0 entries behind leader leader314 and reached 0 (of expected -1)
09:09:06,317 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower317: onLeaderTransitioning: LeaderTransitioning [leaderId=leader314]
09:09:06,317 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Leader - leader314 (Leader): tryToCompleteLeadershipTransfer: followerId: follower315, matchIndex: 0, lastIndex: 0, isVoting: true
09:09:06,317 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Leader - leader314 (Leader): Follower's log matches - sending ElectionTimeout
09:09:06,317 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower315: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,318 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower317: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,318 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower316: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,318 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower315: Lagging 0 entries behind leader leader314 and reached 0 (of expected -1)
09:09:06,318 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): sendAppendEntries: 0 is present for follower follower316
09:09:06,318 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Leader - leader314 (Leader): Leader transfer complete
09:09:06,318 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower317: Lagging 0 entries behind leader leader314 and reached 0 (of expected -1)
09:09:06,318 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader314: leader transfer complete - waiting for new leader
09:09:06,318 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:09:06,318 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower315 (Follower): Received TimeoutNow - switching to Candidate
09:09:06,318 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - follower315 (Candidate): Election: Candidate has following voting peers: [follower316, leader314]
09:09:06,321 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower315: Set currentTerm=3, votedFor=follower315
09:09:06,321 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - follower315 (Candidate): Starting new election term 3
09:09:06,321 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - follower315 (Candidate): Sending RequestVote{term=3, candidateId=follower315, lastLogIndex=0, lastLogTerm=2} to peer follower316
09:09:06,321 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - follower315 (Candidate): Sending RequestVote{term=3, candidateId=follower315, lastLogIndex=0, lastLogTerm=2} to peer leader314
09:09:06,321 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower316 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:09:06,321 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - follower315 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
09:09:06,321 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower316 (Follower): Cluster state: []
09:09:06,322 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower316 (Follower): Candidate in requestVote:RequestVote{term=3, candidateId=follower315, lastLogIndex=0, lastLogTerm=2} with higher term appears reachable, updating term.
09:09:06,322 AM [test-pekko.actor.default-dispatcher-11] [INFO] Follower - follower316 (Follower): Term 3 in "RequestVote{term=3, candidateId=follower315, lastLogIndex=0, lastLogTerm=2}" message is greater than follower's term 2 - updating term
09:09:06,322 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader314 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:09:06,322 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader314 (Leader): Cluster state: []
09:09:06,322 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader314 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower315, lastLogIndex=0, lastLogTerm=2} with higher term appears reachable, updating term.
09:09:06,322 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractLeader - leader314 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower315, lastLogIndex=0, lastLogTerm=2}" message is greater than leader's term 2 - switching to Follower
09:09:06,326 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader314: Set currentTerm=3, votedFor=null
09:09:06,326 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader314 (Leader): Leadership transfer in progress - processing RequestVote
09:09:06,326 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader314 (Leader): In requestVote: RequestVote{term=3, candidateId=follower315, lastLogIndex=0, lastLogTerm=2} - currentTerm: 3, votedFor: null, lastIndex: 0, lastTerm: 2
09:09:06,329 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower316: Set currentTerm=3, votedFor=null
09:09:06,329 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower316 (Follower): In requestVote: RequestVote{term=3, candidateId=follower315, lastLogIndex=0, lastLogTerm=2} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
09:09:06,330 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader314: Set currentTerm=3, votedFor=follower315
09:09:06,330 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader314 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
09:09:06,330 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower315 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3
09:09:06,330 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower315 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1
09:09:06,330 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader314 (Leader) :- Switching from behavior Leader to Follower, election term: 3
09:09:06,330 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower315 (Leader): Election: Leader has following peers: [follower317, follower316, leader314]
09:09:06,330 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower315 (Leader): Checking sendAppendEntries for follower follower317: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,330 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower315 (Leader): Checking sendAppendEntries for follower follower316: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,330 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower315 (Leader): Checking sendAppendEntries for follower leader314: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,330 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower317 (Follower): Term 3 in "AppendEntries{term=3, leaderId=follower315, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 2 - updating term
09:09:06,331 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - leader314: Last sync leader does not match current leader follower315, need to catch up to -1
09:09:06,331 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader314: leader changed to follower315
09:09:06,331 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorLeadershipTransferCohort - leader314: Successfully transferred leadership to follower315 in 13.73 ms
09:09:06,331 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader314: leader transfer succeeded - sending PoisonPill
[WARN] [06/30/2025 09:09:06.331] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/leader314] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=leader314, initialSyncDone=false]
09:09:06,331 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - leader314: terminating thread VirtualThread[#722,leader314-writer-147]/waiting
09:09:06,331 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower316: Set currentTerm=3, votedFor=follower315
09:09:06,331 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower316 (Follower): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
09:09:06,331 AM [leader314-writer-147] [DEBUG] JournalWriteTask - leader314: received 1 commands after 158.6 ms
09:09:06,331 AM [leader314-writer-147] [DEBUG] JournalWriteTask - leader314: completed 1 commands in 11.94 μs
09:09:06,331 AM [leader314-writer-147] [DEBUG] JournalWriteTask - leader314: journal writer stopped
09:09:06,331 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader314: journal closed
09:09:06,331 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader314: journal closed
09:09:06,331 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader314: stopped executor with 0 remaining tasks
09:09:06,331 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader314: stopped executor with 0 remaining tasks
09:09:06,332 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - follower315 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
09:09:06,332 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower315 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader314 updated: matchIndex: 0, nextIndex: 1
09:09:06,332 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower315 (Leader): Checking sendAppendEntries for follower leader314: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,333 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower317: Set currentTerm=3, votedFor=null
09:09:06,333 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower317: Last sync leader does not match current leader follower315, need to catch up to -1
09:09:06,333 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - follower315 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower317 updated: matchIndex: 0, nextIndex: 1
[WARN] [06/30/2025 09:09:06.333] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/leader314] received dead letter from TestActor[pekko://test/user/follower315]: AppendEntries{term=3, leaderId=follower315, prevLogIndex=0, prevLogTerm=2, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
09:09:06,333 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - follower315 (Leader): Checking sendAppendEntries for follower follower317: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
[WARN] [06/30/2025 09:09:06.333] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower317] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower317, initialSyncDone=false]
09:09:06,333 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower317: Lagging 0 entries behind leader follower315 and reached 0 (of expected -1)
[WARN] [06/30/2025 09:09:06.333] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower317] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower317, initialSyncDone=true]
09:09:06,852 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower317: Lagging 0 entries behind leader follower315 and reached 0 (of expected -1)
09:09:06,852 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower316: Last sync leader does not match current leader follower315, need to catch up to -1
[WARN] [06/30/2025 09:09:06.852] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/leader314] received dead letter from TestActor[pekko://test/user/follower315]: AppendEntries{term=3, leaderId=follower315, prevLogIndex=0, prevLogTerm=2, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
09:09:06,852 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower315 (Leader): sendAppendEntries: 0 is present for follower follower316
09:09:06,852 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower315 (Leader): Sending AppendEntries to follower follower316: AppendEntries{term=3, leaderId=follower315, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
09:09:06,852 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower316 (Follower): handleAppendEntries: AppendEntries{term=3, leaderId=follower315, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
[WARN] [06/30/2025 09:09:06.852] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower316] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower316, initialSyncDone=false]
09:09:06,852 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower316 (Follower): Number of entries to be appended = 1
09:09:06,852 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower316 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:09:06,852 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower316 (Follower): Append entry to log zero
09:09:06,852 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower316: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=false} 
09:09:06,852 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower316 (Follower): Log size is now 1
09:09:06,852 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower316 (Follower): Commit index set to 0
09:09:06,852 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower316 (Follower): handleAppendEntries returning : AppendEntriesReply{term=3, success=true, followerId=follower316, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:09:06,852 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower316: Lagging 0 entries behind leader follower315 and reached 0 (of expected -1)
09:09:06,852 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower316 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:09:06,852 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower316 (Follower): Setting last applied to 0
09:09:06,852 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower316: Moving last applied index from -1 to 0
09:09:06,852 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower316: Applying state for log index 0 data zero
09:09:06,852 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower316: applyState called: zero
09:09:06,852 AM [follower316-writer-145] [DEBUG] JournalWriteTask - follower316: received 1 commands after 1.058 s
09:09:06,853 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - follower315 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower316 updated: matchIndex: 0, nextIndex: 1
09:09:06,853 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower316: awaiting more completions to resolve 1 deferred callback(s)
09:09:06,853 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - follower315 (Leader): Checking sendAppendEntries for follower follower316: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:06,857 AM [follower316-writer-145] [DEBUG] EntryStoreCompleter - follower316: 1 completion(s) pending
09:09:06,857 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower316: running 1 completion(s)
09:09:06,857 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower316: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
09:09:06,857 AM [follower316-writer-145] [DEBUG] JournalWriteTask - follower316: completed 1 commands in 4.791 ms
09:09:06,857 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower316: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@784b223a
09:09:06,857 AM [follower316-writer-145] [DEBUG] JournalWriteTask - follower316: received 1 commands after 5.400 μs
09:09:06,858 AM [follower316-writer-145] [DEBUG] JournalWriteTask - follower316: completed 1 commands in 116.8 μs
09:09:06,858 AM [follower316-writer-145] [DEBUG] JournalWriteTask - follower316: waiting to receive commands
[WARN] [06/30/2025 09:09:06.858] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower316] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower316, initialSyncDone=true]
09:09:06,871 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower316: onLeaderTransitioning: LeaderTransitioning [leaderId=leader314]
09:09:06,872 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 ending
09:09:06,872 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower316 starting
09:09:06,872 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower316: onShutDown
09:09:06,872 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - follower316: terminating thread VirtualThread[#720,follower316-writer-145]/waiting
09:09:06,872 AM [follower316-writer-145] [DEBUG] JournalWriteTask - follower316: received 1 commands after 14.89 ms
09:09:06,872 AM [follower316-writer-145] [DEBUG] JournalWriteTask - follower316: completed 1 commands in 10.68 μs
09:09:06,873 AM [follower316-writer-145] [DEBUG] JournalWriteTask - follower316: journal writer stopped
09:09:06,873 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower316: journal closed
09:09:06,873 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower316: journal closed
09:09:06,873 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower316: stopped executor with 0 remaining tasks
09:09:06,873 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower316: stopped executor with 0 remaining tasks
09:09:06,873 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower316 ending
09:09:06,873 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending
09:09:06,873 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower315-notifier318#-1532941829]
09:09:06,884 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower315-collector319#-1706423029]
09:09:06,884 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower315]
09:09:06,885 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - follower315: terminating thread VirtualThread[#719,follower315-writer-144]/waiting
09:09:06,885 AM [follower315-writer-144] [DEBUG] JournalWriteTask - follower315: received 1 commands after 602.1 ms
09:09:06,885 AM [follower315-writer-144] [DEBUG] JournalWriteTask - follower315: completed 1 commands in 10.21 μs
09:09:06,885 AM [follower315-writer-144] [DEBUG] JournalWriteTask - follower315: journal writer stopped
09:09:06,885 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower315: journal closed
09:09:06,885 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower315: journal closed
09:09:06,885 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower315: stopped executor with 0 remaining tasks
09:09:06,885 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower315: stopped executor with 0 remaining tasks
09:09:06,885 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower316-notifier320#2109726378]
09:09:06,886 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower316-collector321#-416375852]
09:09:06,886 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower316]
09:09:06,886 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower317-notifier322#-1228702271]
09:09:06,886 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower317-collector323#-1590488293]
09:09:06,886 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower317]
09:09:06,886 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - follower317: terminating thread VirtualThread[#721,follower317-writer-146]/waiting
09:09:06,886 AM [follower317-writer-146] [DEBUG] JournalWriteTask - follower317: received 1 commands after 603.5 ms
09:09:06,886 AM [follower317-writer-146] [DEBUG] JournalWriteTask - follower317: completed 1 commands in 11.15 μs
09:09:06,886 AM [follower317-writer-146] [DEBUG] JournalWriteTask - follower317: journal writer stopped
09:09:06,887 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower317: journal closed
09:09:06,887 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower317: journal closed
09:09:06,887 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower317: stopped executor with 0 remaining tasks
09:09:06,887 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower317: stopped executor with 0 remaining tasks
09:09:06,887 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader314-notifier324#-1743438119]
09:09:06,887 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader314-collector325#-1452894418]
09:09:06,887 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader314]
09:09:06,890 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers starting
[WARN] [06/30/2025 09:09:06.891] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader326]: org.opendaylight.controller.cluster.common.actor.Monitor@26a3fae1
09:09:06,892 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - leader326: Starting recovery with journal batch size 1000
09:09:06,893 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader326: started executor
09:09:06,893 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader326: started executor
09:09:06,893 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader326: metadata journal open: replayFrom=1 applyTo=0
09:09:06,894 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader326: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:06,894 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - leader326: journal open: applyTo=0
09:09:06,894 AM [leader326-writer-148] [DEBUG] JournalWriteTask - leader326: journal writer started
09:09:06,894 AM [leader326-writer-148] [DEBUG] JournalWriteTask - leader326: waiting to receive commands
09:09:06,896 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1619853412832933488/leader326/TermInfo.properties does not exist
09:09:06,896 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader326: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1619853412832933488/leader326/journal-v1-1.log
09:09:06,896 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader326: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1619853412832933488/leader326/metadata-v1-1.log
09:09:06,896 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader326: no eligible files found
09:09:06,896 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader326: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:06,900 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader326: Set currentTerm=0, votedFor=null
09:09:06,900 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader326: Local TermInfo store seeded with TermInfo{term=0}
09:09:06,900 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader326: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@52c65748
09:09:06,900 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader326: Moving last applied index from -1 to -1
09:09:06,900 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader326: journal recovery completedin 351.8 μs with journalIndex=1
09:09:06,901 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:09:06,901 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader326 (Follower): Received TimeoutNow - switching to Candidate
09:09:06,901 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader326 (Candidate): Election: Candidate has following voting peers: []
09:09:06,905 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader326: Set currentTerm=1, votedFor=leader326
09:09:06,905 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader326 (Candidate): Starting new election term 1
09:09:06,905 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader326 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
09:09:06,905 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader326 (Candidate): Received ElectionTimeout
09:09:06,905 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader326 (Leader): Election: Leader has following peers: []
09:09:06,905 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader326 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
09:09:06,906 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader326 starting
09:09:06,906 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader326: onShutDown
09:09:06,906 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - leader326: terminating thread VirtualThread[#723,leader326-writer-148]/waiting
09:09:06,906 AM [leader326-writer-148] [DEBUG] JournalWriteTask - leader326: received 1 commands after 12.36 ms
09:09:06,906 AM [leader326-writer-148] [DEBUG] JournalWriteTask - leader326: completed 1 commands in 13.99 μs
09:09:06,906 AM [leader326-writer-148] [DEBUG] JournalWriteTask - leader326: journal writer stopped
09:09:06,907 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader326: journal closed
09:09:06,907 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - leader326: journal closed
09:09:06,907 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader326: stopped executor with 0 remaining tasks
09:09:06,907 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader326: stopped executor with 0 remaining tasks
09:09:06,907 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader326 ending
09:09:06,907 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers ending
09:09:06,907 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader326-collector330#-468573214]
09:09:06,918 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader326]
09:09:06,920 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging starting
09:09:06,920 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
09:09:06,922 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower332: Starting recovery with journal batch size 1000
09:09:06,923 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower332: started executor
09:09:06,923 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower332: started executor
09:09:06,923 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower332: metadata journal open: replayFrom=1 applyTo=0
[WARN] [06/30/2025 09:09:06.924] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower332]: org.opendaylight.controller.cluster.common.actor.Monitor@3703823b
09:09:06,924 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower332: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:06,924 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower332: journal open: applyTo=0
09:09:06,924 AM [follower332-writer-149] [DEBUG] JournalWriteTask - follower332: journal writer started
09:09:06,924 AM [follower332-writer-149] [DEBUG] JournalWriteTask - follower332: waiting to receive commands
09:09:06,925 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower332/TermInfo.properties does not exist
09:09:06,925 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower332: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower332/journal-v1-1.log
09:09:06,925 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower332: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower332/metadata-v1-1.log
09:09:06,925 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower332: no eligible files found
09:09:06,925 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower332: SnapshotOffer called.
09:09:06,925 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower332: initializing from snapshot taken at 2025-06-30T09:09:06.920Z
09:09:06,925 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower332: Set currentTerm=1, votedFor=null
09:09:06,925 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PeerInfos - follower332: Updated server config: isVoting: true, peers: [PeerInfo [id=leader331, address=pekko://test/user/leader331, votingState=VOTING], PeerInfo [id=follower333, address=pekko://test/user/follower333, votingState=VOTING], PeerInfo [id=follower334, address=pekko://test/user/follower334, votingState=NON_VOTING]]
09:09:06,925 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - Recovery snapshot applied for follower332 in 110.9 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:06,925 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower332: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:06.920Z
09:09:06,925 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower332: support() called
09:09:06,926 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower332: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower332/snapshot-0000000068625432-36D61600.tmp
[WARN] [06/30/2025 09:09:06.927] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower333]: org.opendaylight.controller.cluster.common.actor.Monitor@36f223ec
09:09:06,928 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower332: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower332/snapshot-0000000068625432-36D61600.v1
09:09:06,928 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower332: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower332/snapshot-0000000068625432-36D61600.v1
09:09:06,929 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower332: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower332/journal-v1-1.log
09:09:06,929 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower332: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower332/metadata-v1-1.log
09:09:06,929 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower332: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:06.920Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower332/snapshot-0000000068625432-36D61600.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:06,929 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower332: local snapshot saved in 3.326 ms, deleting Pekko-persisted snapshots
09:09:06,929 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower333: Starting recovery with journal batch size 1000
09:09:06,929 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower333: started executor
09:09:06,929 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower333: started executor
09:09:06,929 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower332: Recovery completed in 4.379 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:06,930 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower333: metadata journal open: replayFrom=1 applyTo=0
09:09:06,931 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower333: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:06,931 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower333: journal open: applyTo=0
09:09:06,931 AM [follower333-writer-150] [DEBUG] JournalWriteTask - follower333: journal writer started
09:09:06,931 AM [follower333-writer-150] [DEBUG] JournalWriteTask - follower333: waiting to receive commands
09:09:06,932 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower333/TermInfo.properties does not exist
09:09:06,932 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower333: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower333/journal-v1-1.log
09:09:06,932 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower333: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower333/metadata-v1-1.log
09:09:06,932 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower332: Set currentTerm=1, votedFor=null
09:09:06,932 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower332: Local TermInfo store seeded with TermInfo{term=1}
09:09:06,932 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower332: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@5a200201
09:09:06,932 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower333: no eligible files found
09:09:06,932 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower332: Moving last applied index from -1 to -1
09:09:06,932 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower333: SnapshotOffer called.
09:09:06,932 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower333: initializing from snapshot taken at 2025-06-30T09:09:06.920Z
09:09:06,932 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower333: Set currentTerm=1, votedFor=null
09:09:06,932 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - follower333: Updated server config: isVoting: true, peers: [PeerInfo [id=leader331, address=pekko://test/user/leader331, votingState=VOTING], PeerInfo [id=follower332, address=pekko://test/user/follower332, votingState=VOTING], PeerInfo [id=follower334, address=pekko://test/user/follower334, votingState=NON_VOTING]]
09:09:06,932 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower332: journal recovery completedin 251.2 μs with journalIndex=1
09:09:06,932 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for follower333 in 133.3 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:06,933 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower333: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:06.920Z
09:09:06,933 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower333: support() called
09:09:06,933 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower332: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:06,933 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower333: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower333/snapshot-0000000068625432-36D61600.tmp
[WARN] [06/30/2025 09:09:06.933] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower334]: org.opendaylight.controller.cluster.common.actor.Monitor@4da446c3
09:09:06,934 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower334: Starting recovery with journal batch size 1000
09:09:06,934 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower334: started executor
09:09:06,934 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower334: started executor
09:09:06,935 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower334: metadata journal open: replayFrom=1 applyTo=0
09:09:06,935 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower334: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:06,935 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower334: journal open: applyTo=0
09:09:06,935 AM [follower334-writer-151] [DEBUG] JournalWriteTask - follower334: journal writer started
09:09:06,935 AM [follower334-writer-151] [DEBUG] JournalWriteTask - follower334: waiting to receive commands
09:09:06,936 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower333: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower333/snapshot-0000000068625432-36D61600.v1
09:09:06,936 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower333: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower333/snapshot-0000000068625432-36D61600.v1
09:09:06,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower334/TermInfo.properties does not exist
09:09:06,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower334: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower334/journal-v1-1.log
09:09:06,936 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower333: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower333/journal-v1-1.log
09:09:06,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower334: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower334/metadata-v1-1.log
09:09:06,936 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower333: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower333/metadata-v1-1.log
09:09:06,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower334: no eligible files found
09:09:06,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - follower334: SnapshotOffer called.
09:09:06,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - follower334: initializing from snapshot taken at 2025-06-30T09:09:06.920Z
09:09:06,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower334: Set currentTerm=1, votedFor=null
09:09:06,936 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower333: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:06.920Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower333/snapshot-0000000068625432-36D61600.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:06,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - follower334: Updated server config: isVoting: false, peers: [PeerInfo [id=leader331, address=pekko://test/user/leader331, votingState=VOTING], PeerInfo [id=follower333, address=pekko://test/user/follower333, votingState=VOTING], PeerInfo [id=follower332, address=pekko://test/user/follower332, votingState=VOTING]]
09:09:06,936 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower333: local snapshot saved in 3.416 ms, deleting Pekko-persisted snapshots
09:09:06,936 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - Recovery snapshot applied for follower334 in 66.47 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:06,936 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower334: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:06.920Z
09:09:06,936 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower334: support() called
09:09:06,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower334: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower334/snapshot-0000000068625432-36D61600.tmp
09:09:06,937 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower333: Recovery completed in 5.106 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:06,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower334: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower334/snapshot-0000000068625432-36D61600.v1
09:09:06,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower334: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower334/snapshot-0000000068625432-36D61600.v1
09:09:06,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower334: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower334/journal-v1-1.log
09:09:06,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower334: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower334/metadata-v1-1.log
09:09:06,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower334: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:06.920Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/follower334/snapshot-0000000068625432-36D61600.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:06,940 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower334: local snapshot saved in 3.333 ms, deleting Pekko-persisted snapshots
09:09:06,940 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower333: Set currentTerm=1, votedFor=null
09:09:06,940 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower333: Local TermInfo store seeded with TermInfo{term=1}
09:09:06,940 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower333: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@3ce0a93a
09:09:06,940 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower333: Moving last applied index from -1 to -1
09:09:06,940 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower334: Recovery completed in 4.268 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:06,940 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower333: journal recovery completedin 197.6 μs with journalIndex=1
09:09:06,941 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower333: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
[WARN] [06/30/2025 09:09:06.941] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader331]: org.opendaylight.controller.cluster.common.actor.Monitor@434323fe
09:09:06,942 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader331: Starting recovery with journal batch size 1000
09:09:06,942 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader331: started executor
09:09:06,943 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader331: started executor
09:09:06,943 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower334: Set currentTerm=1, votedFor=null
09:09:06,943 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower334: Local TermInfo store seeded with TermInfo{term=1}
09:09:06,943 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower334: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@c815449
09:09:06,943 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower334: Moving last applied index from -1 to -1
09:09:06,943 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower334: journal recovery completedin 310.4 μs with journalIndex=1
09:09:06,944 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower334: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:06,944 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader331: metadata journal open: replayFrom=1 applyTo=0
09:09:06,945 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader331: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:06,945 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader331: journal open: applyTo=0
09:09:06,945 AM [leader331-writer-152] [DEBUG] JournalWriteTask - leader331: journal writer started
09:09:06,945 AM [leader331-writer-152] [DEBUG] JournalWriteTask - leader331: waiting to receive commands
09:09:06,945 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/leader331/TermInfo.properties does not exist
09:09:06,945 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader331: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/leader331/journal-v1-1.log
09:09:06,945 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader331: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/leader331/metadata-v1-1.log
09:09:06,945 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader331: no eligible files found
09:09:06,945 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader331: SnapshotOffer called.
09:09:06,945 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader331: initializing from snapshot taken at 2025-06-30T09:09:06.920Z
09:09:06,945 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader331: Set currentTerm=1, votedFor=null
09:09:06,945 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - leader331: Updated server config: isVoting: true, peers: [PeerInfo [id=follower333, address=pekko://test/user/follower333, votingState=VOTING], PeerInfo [id=follower332, address=pekko://test/user/follower332, votingState=VOTING], PeerInfo [id=follower334, address=pekko://test/user/follower334, votingState=NON_VOTING]]
09:09:06,945 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for leader331 in 64.47 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:06,945 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader331: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:06.920Z
09:09:06,946 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader331: support() called
09:09:06,946 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader331: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/leader331/snapshot-0000000068625432-36D61600.tmp
09:09:06,948 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader331: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/leader331/snapshot-0000000068625432-36D61600.v1
09:09:06,948 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader331: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/leader331/snapshot-0000000068625432-36D61600.v1
09:09:06,948 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader331: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/leader331/journal-v1-1.log
09:09:06,948 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader331: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/leader331/metadata-v1-1.log
09:09:06,948 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader331: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:06.920Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8470539955504377763/leader331/snapshot-0000000068625432-36D61600.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:06,948 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader331: local snapshot saved in 2.888 ms, deleting Pekko-persisted snapshots
09:09:06,950 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader331: Recovery completed in 4.265 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:06,952 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader331: Set currentTerm=1, votedFor=null
09:09:06,952 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader331: Local TermInfo store seeded with TermInfo{term=1}
09:09:06,952 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader331: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@cbcc34b
09:09:06,952 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader331: Moving last applied index from -1 to -1
09:09:06,953 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader331: journal recovery completedin 246.0 μs with journalIndex=1
09:09:06,953 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader331: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:07,372 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:09:07,372 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader331 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed)
09:09:07,372 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader331 (Follower): Received ElectionTimeout - switching to Candidate
09:09:07,372 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader331 (Candidate): Election: Candidate has following voting peers: [follower333, follower332]
09:09:07,376 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader331: Set currentTerm=2, votedFor=leader331
09:09:07,376 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader331 (Candidate): Starting new election term 2
09:09:07,376 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader331 (Candidate): Sending RequestVote{term=2, candidateId=leader331, lastLogIndex=-1, lastLogTerm=-1} to peer follower333
09:09:07,376 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader331 (Candidate): Sending RequestVote{term=2, candidateId=leader331, lastLogIndex=-1, lastLogTerm=-1} to peer follower332
09:09:07,376 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader331 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:09:07,376 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower332 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:09:07,376 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower332 (Follower): Cluster state: []
09:09:07,376 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower332 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader331, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:09:07,376 AM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower332 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader331, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:09:07,377 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower333 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:09:07,377 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower333 (Follower): Cluster state: []
09:09:07,377 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower333 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader331, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:09:07,377 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower333 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader331, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:09:07,379 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower332: Set currentTerm=2, votedFor=null
09:09:07,379 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower332 (Follower): In requestVote: RequestVote{term=2, candidateId=leader331, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:09:07,381 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower333: Set currentTerm=2, votedFor=null
09:09:07,381 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower333 (Follower): In requestVote: RequestVote{term=2, candidateId=leader331, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:09:07,382 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower332: Set currentTerm=2, votedFor=leader331
09:09:07,382 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower332 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:09:07,382 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader331 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
09:09:07,382 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader331 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
09:09:07,383 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader331 (Leader): Election: Leader has following peers: [follower333, follower332, follower334]
09:09:07,383 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower333: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:07,383 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower332: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:07,383 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower334: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:07,383 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActorBehavior - leader331 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
09:09:07,383 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower332: Last sync leader does not match current leader leader331, need to catch up to -1
09:09:07,383 AM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower334 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader331, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
09:09:07,383 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader331 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower332 updated: matchIndex: -1, nextIndex: 0
09:09:07,383 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower332: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:07,383 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower333: Set currentTerm=2, votedFor=leader331
09:09:07,383 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower333 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
[WARN] [06/30/2025 09:09:07.383] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower332] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower332, initialSyncDone=false]
09:09:07,384 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower333: Last sync leader does not match current leader leader331, need to catch up to -1
09:09:07,384 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower333 updated: matchIndex: -1, nextIndex: 0
09:09:07,384 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower333: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/30/2025 09:09:07.384] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower333] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower333, initialSyncDone=false]
09:09:07,386 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower334: Set currentTerm=2, votedFor=null
09:09:07,386 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower334: Last sync leader does not match current leader leader331, need to catch up to -1
09:09:07,386 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower334 updated: matchIndex: -1, nextIndex: 0
09:09:07,386 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower334: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/30/2025 09:09:07.386] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower334] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower334, initialSyncDone=false]
09:09:07,407 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
09:09:07,407 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
09:09:07,407 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
09:09:07,408 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting
09:09:07,408 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader331: Persist data index=0 term=2 command=zero
09:09:07,408 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader331: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
09:09:07,408 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader331 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
09:09:07,408 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower333: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:07,408 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader331 (Leader): sendAppendEntries: 0 is present for follower follower333
09:09:07,408 AM [leader331-writer-152] [DEBUG] JournalWriteTask - leader331: received 1 commands after 463.2 ms
09:09:07,408 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader331 (Leader): Sending AppendEntries to follower follower333: AppendEntries{term=2, leaderId=leader331, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:09:07,408 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower332: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:07,408 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader331 (Leader): sendAppendEntries: 0 is present for follower follower332
09:09:07,408 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader331 (Leader): Sending AppendEntries to follower follower332: AppendEntries{term=2, leaderId=leader331, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:09:07,408 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower334: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:07,408 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader331 (Leader): sendAppendEntries: 0 is present for follower follower334
09:09:07,408 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader331 (Leader): Sending AppendEntries to follower follower334: AppendEntries{term=2, leaderId=leader331, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:09:07,408 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower334 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader331, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:09:07,408 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower334 (Follower): Number of entries to be appended = 1
09:09:07,408 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower334 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:09:07,408 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower334 (Follower): Append entry to log zero
09:09:07,408 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower334: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
09:09:07,409 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower332 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader331, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:09:07,409 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower332 (Follower): Number of entries to be appended = 1
09:09:07,409 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower332 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:09:07,409 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower332 (Follower): Append entry to log zero
09:09:07,409 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower332: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
09:09:07,409 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower334 (Follower): Log size is now 1
09:09:07,409 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower332 (Follower): Log size is now 1
09:09:07,409 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower332 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower332, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:09:07,409 AM [follower334-writer-151] [DEBUG] JournalWriteTask - follower334: received 1 commands after 473.9 ms
09:09:07,409 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower334 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower334, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:09:07,409 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower334: Lagging 0 entries behind leader leader331 and reached -1 (of expected -1)
09:09:07,409 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower332: Lagging 0 entries behind leader leader331 and reached -1 (of expected -1)
09:09:07,409 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower332: awaiting more completions to resolve 1 deferred callback(s)
09:09:07,409 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower334: awaiting more completions to resolve 1 deferred callback(s)
09:09:07,409 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower332 updated: matchIndex: 0, nextIndex: 1
09:09:07,409 AM [follower332-writer-149] [DEBUG] JournalWriteTask - follower332: received 1 commands after 485.4 ms
09:09:07,409 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower332: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:07,410 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower334 updated: matchIndex: 0, nextIndex: 1
09:09:07,410 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower334: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:07,413 AM [leader331-writer-152] [DEBUG] EntryStoreCompleter - leader331: 1 completion(s) pending
09:09:07,413 AM [leader331-writer-152] [DEBUG] JournalWriteTask - leader331: completed 1 commands in 5.402 ms
09:09:07,413 AM [leader331-writer-152] [DEBUG] JournalWriteTask - leader331: waiting to receive commands
09:09:07,413 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - leader331: running 1 completion(s)
09:09:07,413 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader331: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=true}
09:09:07,414 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader331 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
09:09:07,414 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader331 (Leader): Setting last applied to 0
09:09:07,414 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader331: Moving last applied index from -1 to 0
09:09:07,414 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader331: Applying state for log index 0 data zero
09:09:07,414 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader331: applyState called: zero
09:09:07,414 AM [leader331-writer-152] [DEBUG] JournalWriteTask - leader331: received 1 commands after 537.0 μs
09:09:07,414 AM [leader331-writer-152] [DEBUG] JournalWriteTask - leader331: completed 1 commands in 85.85 μs
09:09:07,414 AM [leader331-writer-152] [DEBUG] JournalWriteTask - leader331: waiting to receive commands
09:09:07,414 AM [follower332-writer-149] [DEBUG] EntryStoreCompleter - follower332: 1 completion(s) pending
09:09:07,414 AM [follower332-writer-149] [DEBUG] JournalWriteTask - follower332: completed 1 commands in 5.017 ms
09:09:07,414 AM [follower332-writer-149] [DEBUG] JournalWriteTask - follower332: waiting to receive commands
09:09:07,414 AM [follower334-writer-151] [DEBUG] EntryStoreCompleter - follower334: 1 completion(s) pending
09:09:07,415 AM [follower334-writer-151] [DEBUG] JournalWriteTask - follower334: completed 1 commands in 5.266 ms
09:09:07,415 AM [follower334-writer-151] [DEBUG] JournalWriteTask - follower334: waiting to receive commands
09:09:07,415 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower332: running 1 completion(s)
09:09:07,415 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower334: running 1 completion(s)
09:09:07,415 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower334: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
09:09:07,415 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower334: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@54a2deb
09:09:07,415 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower332: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
09:09:07,415 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower332: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@bf8c61b
[WARN] [06/30/2025 09:09:07.415] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower334] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower334, initialSyncDone=true]
[WARN] [06/30/2025 09:09:07.415] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower332] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower332, initialSyncDone=true]
09:09:07,501 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader331 (Leader): sendAppendEntries: 0 is present for follower follower333
09:09:07,501 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader331 (Leader): Sending AppendEntries to follower follower333: AppendEntries{term=2, leaderId=leader331, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
09:09:07,621 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader331 (Leader): sendAppendEntries: 0 is present for follower follower333
09:09:07,621 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader331 (Leader): Sending AppendEntries to follower follower333: AppendEntries{term=2, leaderId=leader331, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
09:09:07,621 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower332 (Follower): Commit index set to 0
09:09:07,621 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower334 (Follower): Commit index set to 0
09:09:07,622 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower334: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
09:09:07,622 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower332: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
09:09:07,622 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower334 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:09:07,622 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower332 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:09:07,622 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower334 (Follower): Setting last applied to 0
09:09:07,622 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower332 (Follower): Setting last applied to 0
09:09:07,622 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower334: Moving last applied index from -1 to 0
09:09:07,622 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower332: Moving last applied index from -1 to 0
09:09:07,622 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower334: Applying state for log index 0 data zero
09:09:07,622 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower332: Applying state for log index 0 data zero
09:09:07,622 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower334: applyState called: zero
09:09:07,622 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower332: applyState called: zero
09:09:07,622 AM [follower334-writer-151] [DEBUG] JournalWriteTask - follower334: received 1 commands after 207.4 ms
09:09:07,622 AM [follower332-writer-149] [DEBUG] JournalWriteTask - follower332: received 1 commands after 207.4 ms
09:09:07,622 AM [follower334-writer-151] [DEBUG] JournalWriteTask - follower334: completed 1 commands in 187.3 μs
09:09:07,622 AM [follower332-writer-149] [DEBUG] JournalWriteTask - follower332: completed 1 commands in 182.4 μs
09:09:07,622 AM [follower334-writer-151] [DEBUG] JournalWriteTask - follower334: waiting to receive commands
09:09:07,622 AM [follower332-writer-149] [DEBUG] JournalWriteTask - follower332: waiting to receive commands
09:09:07,659 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending
09:09:07,659 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
09:09:07,660 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
09:09:07,660 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader331: onRequestLeadership RequestLeadership [requestedFollowerId=follower333, replyTo=Actor[pekko://test/user/$c#1571960161]]
09:09:07,660 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader331: Initiating leader transfer
09:09:07,660 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorLeadershipTransferCohort - leader331: pauseLeader successfully completed - doing transfer
09:09:07,660 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Leader - leader331 (Leader): Attempting to transfer leadership
09:09:07,660 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower333: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:07,660 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower332: onLeaderTransitioning: LeaderTransitioning [leaderId=leader331]
09:09:07,660 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader331 (Leader): sendAppendEntries: 0 is present for follower follower333
09:09:07,660 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower332: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:07,661 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower334: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:09:07,661 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower334: onLeaderTransitioning: LeaderTransitioning [leaderId=leader331]
09:09:07,661 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower332: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
09:09:07,661 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower334: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
09:09:07,661 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower333: onLeaderTransitioning: LeaderTransitioning [leaderId=leader331]
09:09:07,861 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower332: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
09:09:07,861 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower334: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
09:09:07,981 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorLeadershipTransferCohort - leader331: leader transfer aborted
09:09:07,981 AM [test-pekko.actor.default-dispatcher-15] [WARN] RaftActorLeadershipTransferCohort - leader331: Failed to transfer leadership in 321.2 ms
09:09:07,981 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader331: LeadershipTransfer request from follower333 failed
09:09:07,981 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Leader - leader331 (Leader): Leadership transfer expired
09:09:07,982 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower332: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
09:09:07,982 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower334: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
09:09:08,13 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging ending
09:09:08,13 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower332-notifier335#-1352187278]
09:09:08,25 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower332-collector336#432595135]
09:09:08,25 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower332]
09:09:08,25 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - follower332: terminating thread VirtualThread[#724,follower332-writer-149]/waiting
09:09:08,25 AM [follower332-writer-149] [DEBUG] JournalWriteTask - follower332: received 1 commands after 403.2 ms
09:09:08,26 AM [follower332-writer-149] [DEBUG] JournalWriteTask - follower332: completed 1 commands in 17.12 μs
09:09:08,26 AM [follower332-writer-149] [DEBUG] JournalWriteTask - follower332: journal writer stopped
09:09:08,26 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower332: journal closed
09:09:08,26 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower332: journal closed
09:09:08,26 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower332: stopped executor with 0 remaining tasks
09:09:08,26 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower332: stopped executor with 0 remaining tasks
09:09:08,26 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower333-notifier337#-2070196268]
09:09:08,27 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower333-collector338#102024899]
09:09:08,27 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower333]
09:09:08,27 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - follower333: terminating thread VirtualThread[#725,follower333-writer-150]/waiting
09:09:08,27 AM [follower333-writer-150] [DEBUG] JournalWriteTask - follower333: received 1 commands after 1.096 s
09:09:08,27 AM [follower333-writer-150] [DEBUG] JournalWriteTask - follower333: completed 1 commands in 9.960 μs
09:09:08,27 AM [follower333-writer-150] [DEBUG] JournalWriteTask - follower333: journal writer stopped
09:09:08,27 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower333: journal closed
09:09:08,27 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower333: journal closed
09:09:08,27 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower333: stopped executor with 0 remaining tasks
09:09:08,27 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower333: stopped executor with 0 remaining tasks
09:09:08,28 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower334-notifier339#975909449]
09:09:08,31 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower334-collector340#-1076978208]
09:09:08,32 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower334]
09:09:08,32 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - follower334: terminating thread VirtualThread[#726,follower334-writer-151]/waiting
09:09:08,32 AM [follower334-writer-151] [DEBUG] JournalWriteTask - follower334: received 1 commands after 409.8 ms
09:09:08,32 AM [follower334-writer-151] [DEBUG] JournalWriteTask - follower334: completed 1 commands in 9.080 μs
09:09:08,32 AM [follower334-writer-151] [DEBUG] JournalWriteTask - follower334: journal writer stopped
09:09:08,32 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower334: journal closed
09:09:08,32 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower334: journal closed
09:09:08,32 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower334: stopped executor with 0 remaining tasks
09:09:08,32 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower334: stopped executor with 0 remaining tasks
09:09:08,33 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader331-notifier341#-1946731231]
09:09:08,33 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader331-collector342#1426810958]
09:09:08,33 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader331]
09:09:08,33 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader331: terminating thread VirtualThread[#727,leader331-writer-152]/waiting
09:09:08,33 AM [leader331-writer-152] [DEBUG] JournalWriteTask - leader331: received 1 commands after 619.4 ms
09:09:08,33 AM [leader331-writer-152] [DEBUG] JournalWriteTask - leader331: completed 1 commands in 8.440 μs
09:09:08,33 AM [leader331-writer-152] [DEBUG] JournalWriteTask - leader331: journal writer stopped
09:09:08,34 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader331: journal closed
09:09:08,34 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader331: journal closed
09:09:08,34 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader331: stopped executor with 0 remaining tasks
09:09:08,34 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader331: stopped executor with 0 remaining tasks
09:09:08,34 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$c#1571960161]
09:09:08,37 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown starting
09:09:08,37 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [06/30/2025 09:09:08.041] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower344]: org.opendaylight.controller.cluster.common.actor.Monitor@2a2acf08
09:09:08,41 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower344: Starting recovery with journal batch size 1000
09:09:08,42 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower344: started executor
09:09:08,42 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower344: started executor
09:09:08,42 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower344: metadata journal open: replayFrom=1 applyTo=0
09:09:08,42 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower344: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:08,42 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower344: journal open: applyTo=0
09:09:08,43 AM [follower344-writer-153] [DEBUG] JournalWriteTask - follower344: journal writer started
09:09:08,43 AM [follower344-writer-153] [DEBUG] JournalWriteTask - follower344: waiting to receive commands
09:09:08,43 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower344/TermInfo.properties does not exist
09:09:08,43 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower344: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower344/journal-v1-1.log
09:09:08,43 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower344: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower344/metadata-v1-1.log
09:09:08,43 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower344: no eligible files found
09:09:08,43 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - follower344: SnapshotOffer called.
09:09:08,43 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - follower344: initializing from snapshot taken at 2025-06-30T09:09:08.037Z
09:09:08,43 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower344: Set currentTerm=1, votedFor=null
09:09:08,44 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - follower344: Updated server config: isVoting: true, peers: [PeerInfo [id=leader343, address=pekko://test/user/leader343, votingState=VOTING], PeerInfo [id=follower346, address=pekko://test/user/follower346, votingState=NON_VOTING], PeerInfo [id=follower345, address=pekko://test/user/follower345, votingState=VOTING]]
09:09:08,44 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - Recovery snapshot applied for follower344 in 111.5 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:08,44 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower344: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:08.037Z
09:09:08,44 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower344: support() called
[WARN] [06/30/2025 09:09:08.044] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower345]: org.opendaylight.controller.cluster.common.actor.Monitor@4cdf5d0b
09:09:08,44 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower344: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower344/snapshot-0000000068625434-02349340.tmp
09:09:08,45 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - follower345: Starting recovery with journal batch size 1000
09:09:08,45 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower345: started executor
09:09:08,45 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower345: started executor
09:09:08,45 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower345: metadata journal open: replayFrom=1 applyTo=0
09:09:08,45 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower345: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:08,46 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower345: journal open: applyTo=0
09:09:08,46 AM [follower345-writer-154] [DEBUG] JournalWriteTask - follower345: journal writer started
09:09:08,46 AM [follower345-writer-154] [DEBUG] JournalWriteTask - follower345: waiting to receive commands
09:09:08,46 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower345/TermInfo.properties does not exist
09:09:08,46 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower345: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower345/journal-v1-1.log
09:09:08,46 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower345: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower345/metadata-v1-1.log
09:09:08,46 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower345: no eligible files found
09:09:08,46 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - follower345: SnapshotOffer called.
09:09:08,46 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - follower345: initializing from snapshot taken at 2025-06-30T09:09:08.037Z
09:09:08,46 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower345: Set currentTerm=1, votedFor=null
09:09:08,46 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PeerInfos - follower345: Updated server config: isVoting: true, peers: [PeerInfo [id=leader343, address=pekko://test/user/leader343, votingState=VOTING], PeerInfo [id=follower344, address=pekko://test/user/follower344, votingState=VOTING], PeerInfo [id=follower346, address=pekko://test/user/follower346, votingState=NON_VOTING]]
09:09:08,46 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - Recovery snapshot applied for follower345 in 59.60 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:08,47 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower345: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:08.037Z
09:09:08,47 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower345: support() called
09:09:08,47 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower345: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower345/snapshot-0000000068625434-02349340.tmp
[WARN] [06/30/2025 09:09:08.047] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower346]: org.opendaylight.controller.cluster.common.actor.Monitor@471d1c78
09:09:08,48 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower344: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower344/snapshot-0000000068625434-02349340.v1
09:09:08,48 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower344: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower344/journal-v1-1.log
09:09:08,48 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower344: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower344/metadata-v1-1.log
09:09:08,48 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower344: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower344/snapshot-0000000068625434-02349340.v1
09:09:08,48 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower346: Starting recovery with journal batch size 1000
09:09:08,48 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower346: started executor
09:09:08,48 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower346: started executor
09:09:08,48 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower344: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:08.037Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower344/snapshot-0000000068625434-02349340.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:08,48 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower344: local snapshot saved in 4.467 ms, deleting Pekko-persisted snapshots
09:09:08,49 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower346: metadata journal open: replayFrom=1 applyTo=0
09:09:08,49 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower344: Recovery completed in 5.696 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:08,50 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower346: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:08,50 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower346: journal open: applyTo=0
09:09:08,50 AM [follower346-writer-155] [DEBUG] JournalWriteTask - follower346: journal writer started
09:09:08,50 AM [follower346-writer-155] [DEBUG] JournalWriteTask - follower346: waiting to receive commands
09:09:08,51 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower346/TermInfo.properties does not exist
09:09:08,51 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower346: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower346/journal-v1-1.log
09:09:08,51 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower346: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower346/metadata-v1-1.log
09:09:08,51 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower346: no eligible files found
09:09:08,51 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower346: SnapshotOffer called.
09:09:08,51 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower346: initializing from snapshot taken at 2025-06-30T09:09:08.037Z
09:09:08,51 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower346: Set currentTerm=1, votedFor=null
09:09:08,51 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PeerInfos - follower346: Updated server config: isVoting: false, peers: [PeerInfo [id=leader343, address=pekko://test/user/leader343, votingState=VOTING], PeerInfo [id=follower344, address=pekko://test/user/follower344, votingState=VOTING], PeerInfo [id=follower345, address=pekko://test/user/follower345, votingState=VOTING]]
09:09:08,51 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - Recovery snapshot applied for follower346 in 102.5 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:08,51 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower346: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:08.037Z
09:09:08,51 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower346: support() called
09:09:08,51 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower345: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower345/snapshot-0000000068625434-02349340.v1
09:09:08,51 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower345: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower345/journal-v1-1.log
09:09:08,52 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower345: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower345/metadata-v1-1.log
09:09:08,52 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower345: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower345/snapshot-0000000068625434-02349340.v1
09:09:08,52 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower346: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower346/snapshot-0000000068625434-02349340.tmp
09:09:08,52 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower345: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:08.037Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower345/snapshot-0000000068625434-02349340.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:08,52 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower345: local snapshot saved in 5.209 ms, deleting Pekko-persisted snapshots
09:09:08,52 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower345: Recovery completed in 5.997 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:08,52 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower344: Set currentTerm=1, votedFor=null
09:09:08,52 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower344: Local TermInfo store seeded with TermInfo{term=1}
09:09:08,52 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower344: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@1e294c1e
09:09:08,53 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower344: Moving last applied index from -1 to -1
09:09:08,53 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - follower344: journal recovery completedin 268.7 μs with journalIndex=1
[WARN] [06/30/2025 09:09:08.053] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader343]: org.opendaylight.controller.cluster.common.actor.Monitor@485f16df
09:09:08,53 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower344: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:08,54 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - leader343: Starting recovery with journal batch size 1000
09:09:08,54 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader343: started executor
09:09:08,54 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader343: started executor
09:09:08,55 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower345: Set currentTerm=1, votedFor=null
09:09:08,55 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower345: Local TermInfo store seeded with TermInfo{term=1}
09:09:08,55 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower345: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@1c572a49
09:09:08,55 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower345: Moving last applied index from -1 to -1
09:09:08,55 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader343: metadata journal open: replayFrom=1 applyTo=0
09:09:08,55 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower345: journal recovery completedin 184.3 μs with journalIndex=1
09:09:08,56 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader343: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:09:08,56 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - leader343: journal open: applyTo=0
09:09:08,56 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower345: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:08,56 AM [leader343-writer-156] [DEBUG] JournalWriteTask - leader343: journal writer started
09:09:08,56 AM [leader343-writer-156] [DEBUG] JournalWriteTask - leader343: waiting to receive commands
09:09:08,56 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/leader343/TermInfo.properties does not exist
09:09:08,56 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader343: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/leader343/journal-v1-1.log
09:09:08,56 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader343: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/leader343/metadata-v1-1.log
09:09:08,56 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader343: no eligible files found
09:09:08,56 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - leader343: SnapshotOffer called.
09:09:08,56 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - leader343: initializing from snapshot taken at 2025-06-30T09:09:08.037Z
09:09:08,56 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader343: Set currentTerm=1, votedFor=null
09:09:08,56 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PeerInfos - leader343: Updated server config: isVoting: true, peers: [PeerInfo [id=follower344, address=pekko://test/user/follower344, votingState=VOTING], PeerInfo [id=follower346, address=pekko://test/user/follower346, votingState=NON_VOTING], PeerInfo [id=follower345, address=pekko://test/user/follower345, votingState=VOTING]]
09:09:08,56 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - Recovery snapshot applied for leader343 in 57.36 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:09:08,56 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader343: migrating from Pekko persistent-snapshot taken at 2025-06-30T09:09:08.037Z
09:09:08,56 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - leader343: support() called
09:09:08,57 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader343: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/leader343/snapshot-0000000068625434-02349340.tmp
09:09:08,58 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower346: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower346/snapshot-0000000068625434-02349340.v1
09:09:08,59 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower346: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower346/journal-v1-1.log
09:09:08,59 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower346: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower346/metadata-v1-1.log
09:09:08,59 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower346: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower346/snapshot-0000000068625434-02349340.v1
09:09:08,59 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower346: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:08.037Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/follower346/snapshot-0000000068625434-02349340.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:08,59 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower346: local snapshot saved in 7.604 ms, deleting Pekko-persisted snapshots
09:09:08,59 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader343: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/leader343/snapshot-0000000068625434-02349340.v1
09:09:08,59 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader343: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/leader343/journal-v1-1.log
09:09:08,59 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader343: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/leader343/metadata-v1-1.log
09:09:08,59 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader343: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/leader343/snapshot-0000000068625434-02349340.v1
09:09:08,59 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader343: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-06-30T09:09:08.037Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5758198182130121336/leader343/snapshot-0000000068625434-02349340.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:09:08,59 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader343: local snapshot saved in 2.914 ms, deleting Pekko-persisted snapshots
09:09:08,60 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader343: Recovery completed in 3.796 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:08,60 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower346: Recovery completed in 9.123 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:09:08,62 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader343: Set currentTerm=1, votedFor=null
09:09:08,62 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader343: Local TermInfo store seeded with TermInfo{term=1}
09:09:08,62 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader343: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@46e01cfc
09:09:08,62 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader343: Moving last applied index from -1 to -1
09:09:08,63 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - leader343: journal recovery completedin 387.2 μs with journalIndex=1
09:09:08,63 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader343: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:08,64 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower346: Set currentTerm=1, votedFor=null
09:09:08,64 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower346: Local TermInfo store seeded with TermInfo{term=1}
09:09:08,64 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower346: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@f519bf7
09:09:08,64 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower346: Moving last applied index from -1 to -1
09:09:08,64 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - follower346: journal recovery completedin 220.0 μs with journalIndex=1
09:09:08,64 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower346: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:09:08,441 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:09:08,442 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader343 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed)
09:09:08,442 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader343 (Follower): Received ElectionTimeout - switching to Candidate
09:09:08,442 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader343 (Candidate): Election: Candidate has following voting peers: [follower344, follower345]
09:09:08,445 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader343: Set currentTerm=2, votedFor=leader343
09:09:08,445 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - leader343 (Candidate): Starting new election term 2
09:09:08,445 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader343 (Candidate): Sending RequestVote{term=2, candidateId=leader343, lastLogIndex=-1, lastLogTerm=-1} to peer follower344
09:09:08,445 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader343 (Candidate): Sending RequestVote{term=2, candidateId=leader343, lastLogIndex=-1, lastLogTerm=-1} to peer follower345
09:09:08,446 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader343 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:09:08,446 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower344 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:09:08,446 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower344 (Follower): Cluster state: []
09:09:08,446 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower344 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader343, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:09:08,446 AM [test-pekko.actor.default-dispatcher-18] [INFO] Follower - follower344 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader343, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:09:08,446 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower345 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:09:08,446 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower345 (Follower): Cluster state: []
09:09:08,446 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower345 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader343, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:09:08,446 AM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - follower345 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader343, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:09:08,449 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower345: Set currentTerm=2, votedFor=null
09:09:08,449 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower344: Set currentTerm=2, votedFor=null
09:09:08,449 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower345 (Follower): In requestVote: RequestVote{term=2, candidateId=leader343, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:09:08,449 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower344 (Follower): In requestVote: RequestVote{term=2, candidateId=leader343, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:09:08,452 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower345: Set currentTerm=2, votedFor=leader343
09:09:08,452 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower345 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:09:08,452 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader343 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
09:09:08,452 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower344: Set currentTerm=2, votedFor=leader343
09:09:08,452 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader343 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
09:09:08,452 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower344 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:09:08,452 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader343 (Leader): Election: Leader has following peers: [follower344, follower346, follower345]
09:09:08,452 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower344: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:08,452 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower346: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:08,452 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower345: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:08,452 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader343 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
09:09:08,452 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower344: Last sync leader does not match current leader leader343, need to catch up to -1
09:09:08,452 AM [test-pekko.actor.default-dispatcher-11] [INFO] Follower - follower346 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader343, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
09:09:08,453 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader343 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower344 updated: matchIndex: -1, nextIndex: 0
09:09:08,453 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower344: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:08,453 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower345: Last sync leader does not match current leader leader343, need to catch up to -1
09:09:08,453 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader343 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower345 updated: matchIndex: -1, nextIndex: 0
[WARN] [06/30/2025 09:09:08.453] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower344] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower344, initialSyncDone=false]
[WARN] [06/30/2025 09:09:08.453] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower345] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower345, initialSyncDone=false]
09:09:08,453 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower345: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:08,466 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
09:09:08,466 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
09:09:08,467 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower346: Set currentTerm=2, votedFor=null
09:09:08,467 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower346: Last sync leader does not match current leader leader343, need to catch up to -1
09:09:08,467 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader343 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower346 updated: matchIndex: -1, nextIndex: 0
09:09:08,467 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower346: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/30/2025 09:09:08.468] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower346] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower346, initialSyncDone=false]
09:09:08,468 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
09:09:08,468 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower344]
09:09:08,478 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - follower344: terminating thread VirtualThread[#728,follower344-writer-153]/waiting
09:09:08,479 AM [follower344-writer-153] [DEBUG] JournalWriteTask - follower344: received 1 commands after 436.1 ms
09:09:08,479 AM [follower344-writer-153] [DEBUG] JournalWriteTask - follower344: completed 1 commands in 15.75 μs
09:09:08,479 AM [follower344-writer-153] [DEBUG] JournalWriteTask - follower344: journal writer stopped
09:09:08,479 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower344: journal closed
09:09:08,479 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower344: journal closed
09:09:08,479 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower344: stopped executor with 0 remaining tasks
09:09:08,479 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower344: stopped executor with 0 remaining tasks
09:09:08,479 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower346]
09:09:08,490 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - follower346: terminating thread VirtualThread[#730,follower346-writer-155]/waiting
09:09:08,490 AM [follower346-writer-155] [DEBUG] JournalWriteTask - follower346: received 1 commands after 439.8 ms
09:09:08,490 AM [follower346-writer-155] [DEBUG] JournalWriteTask - follower346: completed 1 commands in 9.710 μs
09:09:08,490 AM [follower346-writer-155] [DEBUG] JournalWriteTask - follower346: journal writer stopped
09:09:08,490 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower346: journal closed
09:09:08,490 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower346: journal closed
09:09:08,490 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower346: stopped executor with 0 remaining tasks
09:09:08,490 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower346: stopped executor with 0 remaining tasks
09:09:08,491 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
09:09:08,491 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
09:09:08,491 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader343: onRequestLeadership RequestLeadership [requestedFollowerId=follower345, replyTo=Actor[pekko://test/user/$d#916087484]]
09:09:08,491 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader343: Initiating leader transfer
[WARN] [06/30/2025 09:09:08.491] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower344] received dead letter from TestActor[pekko://test/user/leader343]: LeaderTransitioning [leaderId=leader343]
09:09:08,491 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorLeadershipTransferCohort - leader343: pauseLeader successfully completed - doing transfer
09:09:08,491 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Leader - leader343 (Leader): Attempting to transfer leadership
[WARN] [06/30/2025 09:09:08.491] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower346] received dead letter from TestActor[pekko://test/user/leader343]: LeaderTransitioning [leaderId=leader343]
09:09:08,491 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower344: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:08,491 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower345: onLeaderTransitioning: LeaderTransitioning [leaderId=leader343]
09:09:08,491 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower346: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:08,491 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower345: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/30/2025 09:09:08.491] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower344] received dead letter from TestActor[pekko://test/user/leader343]: AppendEntries{term=2, leaderId=leader343, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
[WARN] [06/30/2025 09:09:08.491] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower346] received dead letter from TestActor[pekko://test/user/leader343]: AppendEntries{term=2, leaderId=leader343, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
09:09:08,491 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower345: Lagging 0 entries behind leader leader343 and reached -1 (of expected -1)
09:09:08,492 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader343 (Leader): tryToCompleteLeadershipTransfer: followerId: follower345, matchIndex: -1, lastIndex: -1, isVoting: true
09:09:08,492 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader343 (Leader): Follower's log matches - sending ElectionTimeout
09:09:08,492 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower344: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/30/2025 09:09:08.492] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower345] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower345, initialSyncDone=true]
09:09:08,492 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower346: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [06/30/2025 09:09:08.492] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower344] received dead letter from TestActor[pekko://test/user/leader343]: AppendEntries{term=2, leaderId=leader343, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
[WARN] [06/30/2025 09:09:08.492] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower346] received dead letter from TestActor[pekko://test/user/leader343]: AppendEntries{term=2, leaderId=leader343, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
09:09:08,492 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower345: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:08,492 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader343 (Leader): Leader transfer complete
09:09:08,492 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader343: leader transfer complete - waiting for new leader
09:09:08,492 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower345: Lagging 0 entries behind leader leader343 and reached -1 (of expected -1)
09:09:08,492 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:09:08,492 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower345 (Follower): Received TimeoutNow - switching to Candidate
09:09:08,492 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower345 (Candidate): Election: Candidate has following voting peers: [leader343, follower344]
09:09:08,495 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower345: Set currentTerm=3, votedFor=follower345
09:09:08,495 AM [test-pekko.actor.default-dispatcher-18] [INFO] Candidate - follower345 (Candidate): Starting new election term 3
09:09:08,495 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower345 (Candidate): Sending RequestVote{term=3, candidateId=follower345, lastLogIndex=-1, lastLogTerm=-1} to peer leader343
09:09:08,495 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower345 (Candidate): Sending RequestVote{term=3, candidateId=follower345, lastLogIndex=-1, lastLogTerm=-1} to peer follower344
09:09:08,495 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader343 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:09:08,495 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - follower345 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
09:09:08,495 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader343 (Leader): Cluster state: []
09:09:08,495 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader343 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower345, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:09:08,495 AM [test-pekko.actor.default-dispatcher-17] [INFO] AbstractLeader - leader343 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower345, lastLogIndex=-1, lastLogTerm=-1}" message is greater than leader's term 2 - switching to Follower
[WARN] [06/30/2025 09:09:08.495] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower344] received dead letter from TestActor[pekko://test/user/follower345]: RequestVote{term=3, candidateId=follower345, lastLogIndex=-1, lastLogTerm=-1}
09:09:08,498 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader343: Set currentTerm=3, votedFor=null
09:09:08,498 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader343 (Leader): Leadership transfer in progress - processing RequestVote
09:09:08,498 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader343 (Leader): In requestVote: RequestVote{term=3, candidateId=follower345, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
09:09:08,500 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader343: Set currentTerm=3, votedFor=follower345
09:09:08,500 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader343 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
09:09:08,500 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - follower345 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3
09:09:08,500 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - follower345 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1
09:09:08,500 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader343 (Leader) :- Switching from behavior Leader to Follower, election term: 3
09:09:08,500 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower345 (Leader): Election: Leader has following peers: [leader343, follower344, follower346]
09:09:08,500 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower345 (Leader): Checking sendAppendEntries for follower leader343: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:08,500 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower345 (Leader): Checking sendAppendEntries for follower follower344: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:08,501 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - leader343: Last sync leader does not match current leader follower345, need to catch up to -1
09:09:08,501 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader343: leader changed to follower345
09:09:08,501 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorLeadershipTransferCohort - leader343: Successfully transferred leadership to follower345 in 9.894 ms
09:09:08,501 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader343: Leadership transferred successfully to follower345
09:09:08,501 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower345 (Leader): Checking sendAppendEntries for follower follower346: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:08,501 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - follower345 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
[WARN] [06/30/2025 09:09:08.501] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower344] received dead letter from TestActor[pekko://test/user/follower345]: AppendEntries{term=3, leaderId=follower345, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
[WARN] [06/30/2025 09:09:08.501] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower346] received dead letter from TestActor[pekko://test/user/follower345]: AppendEntries{term=3, leaderId=follower345, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
[WARN] [06/30/2025 09:09:08.501] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/leader343] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=leader343, initialSyncDone=false]
09:09:08,501 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower345 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader343 updated: matchIndex: -1, nextIndex: 0
09:09:08,501 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower345 (Leader): Checking sendAppendEntries for follower leader343: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:09:08,542 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown ending
09:09:08,542 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower344-notifier347#-1727748696]
09:09:08,553 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower344-collector348#-1641146789]
09:09:08,553 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower345-notifier349#-1627748371]
09:09:08,553 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower345-collector350#-642112326]
09:09:08,553 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower345]
09:09:08,554 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - follower345: terminating thread VirtualThread[#729,follower345-writer-154]/waiting
09:09:08,554 AM [follower345-writer-154] [DEBUG] JournalWriteTask - follower345: received 1 commands after 508.2 ms
09:09:08,554 AM [follower345-writer-154] [DEBUG] JournalWriteTask - follower345: completed 1 commands in 25.89 μs
09:09:08,554 AM [follower345-writer-154] [DEBUG] JournalWriteTask - follower345: journal writer stopped
09:09:08,554 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower345: journal closed
09:09:08,554 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower345: journal closed
09:09:08,554 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower345: stopped executor with 0 remaining tasks
09:09:08,554 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower345: stopped executor with 0 remaining tasks
09:09:08,554 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower346-notifier351#1299886781]
09:09:08,554 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower346-collector352#-220228508]
09:09:08,555 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader343-notifier353#1942641679]
09:09:08,555 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader343-collector354#1986420982]
09:09:08,555 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader343]
09:09:08,555 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - leader343: terminating thread VirtualThread[#731,leader343-writer-156]/waiting
09:09:08,555 AM [leader343-writer-156] [DEBUG] JournalWriteTask - leader343: received 1 commands after 499.2 ms
09:09:08,555 AM [leader343-writer-156] [DEBUG] JournalWriteTask - leader343: completed 1 commands in 7.360 μs
09:09:08,555 AM [leader343-writer-156] [DEBUG] JournalWriteTask - leader343: journal writer stopped
09:09:08,555 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader343: journal closed
09:09:08,555 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - leader343: journal closed
09:09:08,555 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader343: stopped executor with 0 remaining tasks
09:09:08,555 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader343: stopped executor with 0 remaining tasks
09:09:08,555 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$d#916087484]
09:09:08,558 AM [test-pekko.actor.default-dispatcher-5] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
[INFO] [06/30/2025 09:09:08.557] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
[WARN] [06/30/2025 09:09:08.559] [test-pekko.actor.default-dispatcher-18] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.170.168:17355)
09:09:08,560 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Exiting completed
09:09:08,560 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Shutting down...
09:09:08,560 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Successfully shut down
[INFO] [06/30/2025 09:09:08.560] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Exiting completed
[INFO] [06/30/2025 09:09:08.560] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Shutting down...
[INFO] [06/30/2025 09:09:08.560] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Successfully shut down
[INFO] [06/30/2025 09:09:08.561] [test-pekko.remote.default-remote-dispatcher-9] [pekko://test@10.30.170.168:17355/system/remoting-terminator] Shutting down remote daemon.
09:09:08,561 AM [test-pekko.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
09:09:08,562 AM [test-pekko.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
[INFO] [06/30/2025 09:09:08.561] [test-pekko.remote.default-remote-dispatcher-9] [pekko://test@10.30.170.168:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports.
[INFO] [06/30/2025 09:09:08.564] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.170.168:17355/system/remoting-terminator] Remoting shut down.
09:09:08,564 AM [test-pekko.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[DEBUG] [06/30/2025 09:09:08.564] [test-pekko.actor.internal-dispatcher-4] [EventStream] shutting down: StandardOutLogger