[DEBUG] [07/02/2025 09:30:39.669] [main] [EventStream(pekko://test)] logger log1-TestEventListener started
09:30:39,670 AM [test-pekko.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started
[DEBUG] [07/02/2025 09:30:39.670] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started
[DEBUG] [07/02/2025 09:30:39.670] [main] [EventStream(pekko://test)] Default Loggers started
[INFO] [07/02/2025 09:30:39.681] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.171.82:17355] with UID [7151622629435944461]
09:30:39,682 AM [test-pekko.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.171.82:17355] with UID [7151622629435944461]
[INFO] [07/02/2025 09:30:39.682] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.82:17355] - Starting up, Pekko version [1.0.3] ...
09:30:39,682 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.82:17355] - Starting up, Pekko version [1.0.3] ...
[INFO] [07/02/2025 09:30:39.685] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.82:17355] - Registered cluster JMX MBean [pekko:type=Cluster]
09:30:39,685 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.82:17355] - Registered cluster JMX MBean [pekko:type=Cluster]
[INFO] [07/02/2025 09:30:39.685] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.82:17355] - Started up successfully
09:30:39,685 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.82:17355] - Started up successfully
[INFO] [07/02/2025 09:30:39.686] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.82:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing
09:30:39,686 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.82:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing
[INFO] [07/02/2025 09:30:39.686] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.82:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining
09:30:39,686 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.82:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining
09:30:39,701 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferAborted starting
09:30:39,701 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [07/02/2025 09:30:39.704] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower280]: org.opendaylight.controller.cluster.common.actor.Monitor@49bc3851
[INFO] [pekkoDeadLetter][07/02/2025 09:30:39.704] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower280] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:30:39,705 AM [test-pekko.actor.default-dispatcher-7] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower280] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:30:39,707 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower280: Starting recovery with journal batch size 1000
09:30:39,707 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower280: started executor
09:30:39,707 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower280: started executor
09:30:39,708 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower280: metadata journal open: replayFrom=1 applyTo=0
09:30:39,709 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower280: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:39,709 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower280: journal open: applyTo=0
09:30:39,709 AM [follower280-writer-130] [DEBUG] JournalWriteTask - follower280: journal writer started
09:30:39,709 AM [follower280-writer-130] [DEBUG] JournalWriteTask - follower280: waiting to receive commands
09:30:39,709 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower280/TermInfo.properties does not exist
09:30:39,709 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower280: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower280/journal-v1-1.log
09:30:39,709 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower280: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower280/metadata-v1-1.log
09:30:39,710 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower280: no eligible files found
09:30:39,710 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower280: SnapshotOffer called.
09:30:39,710 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower280: initializing from snapshot taken at 2025-07-02T09:30:39.702Z
09:30:39,710 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower280: Set currentTerm=1, votedFor=null
09:30:39,710 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - follower280: Updated server config: isVoting: true, peers: [PeerInfo [id=follower281, address=pekko://test/user/follower281, votingState=VOTING], PeerInfo [id=leader279, address=pekko://test/user/leader279, votingState=VOTING], PeerInfo [id=follower282, address=pekko://test/user/follower282, votingState=NON_VOTING]]
09:30:39,710 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for follower280 in 89.81 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:39,710 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower280: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:39.702Z
09:30:39,710 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower280: support() called
09:30:39,710 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower280: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower280/snapshot-000000006864FC3F-29D7AB80.tmp
09:30:39,714 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower280: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower280/snapshot-000000006864FC3F-29D7AB80.v1
09:30:39,714 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower280: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower280/snapshot-000000006864FC3F-29D7AB80.v1
09:30:39,714 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower280: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower280/journal-v1-1.log
09:30:39,714 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower280: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower280/metadata-v1-1.log
09:30:39,714 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower280: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:39.702Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower280/snapshot-000000006864FC3F-29D7AB80.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:39,714 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower280: local snapshot saved in 4.141 ms, deleting Pekko-persisted snapshots
09:30:39,715 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower280: Recovery completed in 4.861 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:39,718 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower280: Set currentTerm=1, votedFor=null
09:30:39,718 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower280: Local TermInfo store seeded with TermInfo{term=1}
09:30:39,718 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower280: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@5b5056b3
09:30:39,718 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower280: Moving last applied index from -1 to -1
09:30:39,718 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower280: empty journal: appending 0 entries
09:30:39,718 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower280: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:39,718 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower280: journal recovery completedin 188.8 μs with journalIndex=1
09:30:39,719 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower280: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
[WARN] [07/02/2025 09:30:39.805] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower281]: org.opendaylight.controller.cluster.common.actor.Monitor@41f70f77
09:30:39,805 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower281] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[INFO] [pekkoDeadLetter][07/02/2025 09:30:39.805] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower281] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:30:39,806 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower281: Starting recovery with journal batch size 1000
09:30:39,806 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower281: started executor
09:30:39,806 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower281: started executor
09:30:39,807 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower281: metadata journal open: replayFrom=1 applyTo=0
09:30:39,807 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower281: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:39,807 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower281: journal open: applyTo=0
09:30:39,807 AM [follower281-writer-131] [DEBUG] JournalWriteTask - follower281: journal writer started
09:30:39,807 AM [follower281-writer-131] [DEBUG] JournalWriteTask - follower281: waiting to receive commands
09:30:39,808 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower281/TermInfo.properties does not exist
09:30:39,808 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower281: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower281/journal-v1-1.log
09:30:39,808 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower281: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower281/metadata-v1-1.log
09:30:39,808 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower281: no eligible files found
09:30:39,808 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower281: SnapshotOffer called.
09:30:39,808 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower281: initializing from snapshot taken at 2025-07-02T09:30:39.702Z
09:30:39,808 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower281: Set currentTerm=1, votedFor=null
09:30:39,808 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - follower281: Updated server config: isVoting: true, peers: [PeerInfo [id=leader279, address=pekko://test/user/leader279, votingState=VOTING], PeerInfo [id=follower280, address=pekko://test/user/follower280, votingState=VOTING], PeerInfo [id=follower282, address=pekko://test/user/follower282, votingState=NON_VOTING]]
09:30:39,809 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for follower281 in 95.97 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:39,809 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower281: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:39.702Z
09:30:39,809 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower281: support() called
09:30:39,809 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower281: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower281/snapshot-000000006864FC3F-29D7AB80.tmp
[WARN] [07/02/2025 09:30:39.809] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower282]: org.opendaylight.controller.cluster.common.actor.Monitor@cbebf02
[INFO] [pekkoDeadLetter][07/02/2025 09:30:39.810] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower282] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:30:39,810 AM [test-pekko.actor.default-dispatcher-7] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower282] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:30:39,811 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - follower282: Starting recovery with journal batch size 1000
09:30:39,811 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower282: started executor
09:30:39,811 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower282: started executor
09:30:39,812 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower282: metadata journal open: replayFrom=1 applyTo=0
09:30:39,813 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower282: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:39,813 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower282: journal open: applyTo=0
09:30:39,813 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower281: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower281/snapshot-000000006864FC3F-29D7AB80.v1
09:30:39,813 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower281: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower281/snapshot-000000006864FC3F-29D7AB80.v1
09:30:39,813 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower281: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower281/journal-v1-1.log
09:30:39,813 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower281: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower281/metadata-v1-1.log
09:30:39,813 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower281: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:39.702Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower281/snapshot-000000006864FC3F-29D7AB80.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:39,813 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower281: local snapshot saved in 4.801 ms, deleting Pekko-persisted snapshots
09:30:39,814 AM [follower282-writer-132] [DEBUG] JournalWriteTask - follower282: journal writer started
09:30:39,814 AM [follower282-writer-132] [DEBUG] JournalWriteTask - follower282: waiting to receive commands
09:30:39,814 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower281: Recovery completed in 5.710 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:39,814 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower282/TermInfo.properties does not exist
09:30:39,814 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower282: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower282/journal-v1-1.log
09:30:39,814 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower282: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower282/metadata-v1-1.log
09:30:39,814 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower282: no eligible files found
09:30:39,814 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower282: SnapshotOffer called.
09:30:39,814 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower282: initializing from snapshot taken at 2025-07-02T09:30:39.702Z
09:30:39,814 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower282: Set currentTerm=1, votedFor=null
09:30:39,814 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - follower282: Updated server config: isVoting: false, peers: [PeerInfo [id=follower281, address=pekko://test/user/follower281, votingState=VOTING], PeerInfo [id=leader279, address=pekko://test/user/leader279, votingState=VOTING], PeerInfo [id=follower280, address=pekko://test/user/follower280, votingState=VOTING]]
09:30:39,814 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for follower282 in 61.59 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:39,814 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower282: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:39.702Z
09:30:39,814 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower282: support() called
09:30:39,815 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower282: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower282/snapshot-000000006864FC3F-29D7AB80.tmp
09:30:39,816 AM [test-pekko.actor.default-dispatcher-7] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader279] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[WARN] [07/02/2025 09:30:39.816] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader279]: org.opendaylight.controller.cluster.common.actor.Monitor@1c10508c
[INFO] [pekkoDeadLetter][07/02/2025 09:30:39.815] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader279] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:30:39,816 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader279: Starting recovery with journal batch size 1000
09:30:39,816 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader279: started executor
09:30:39,816 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader279: started executor
09:30:39,817 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader279: metadata journal open: replayFrom=1 applyTo=0
09:30:39,817 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower281: Set currentTerm=1, votedFor=null
09:30:39,817 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower281: Local TermInfo store seeded with TermInfo{term=1}
09:30:39,817 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower281: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4e7ae04f
09:30:39,817 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower281: Moving last applied index from -1 to -1
09:30:39,817 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower281: empty journal: appending 0 entries
09:30:39,817 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower281: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:39,818 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower281: journal recovery completedin 315.7 μs with journalIndex=1
09:30:39,818 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower282: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower282/snapshot-000000006864FC3F-29D7AB80.v1
09:30:39,818 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower282: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower282/snapshot-000000006864FC3F-29D7AB80.v1
09:30:39,818 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower281: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:39,818 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower282: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower282/journal-v1-1.log
09:30:39,818 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower282: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower282/metadata-v1-1.log
09:30:39,818 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower282: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:39.702Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/follower282/snapshot-000000006864FC3F-29D7AB80.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:39,818 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower282: local snapshot saved in 3.858 ms, deleting Pekko-persisted snapshots
09:30:39,818 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader279: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:39,818 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader279: journal open: applyTo=0
09:30:39,819 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/leader279/TermInfo.properties does not exist
09:30:39,819 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader279: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/leader279/journal-v1-1.log
09:30:39,819 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader279: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/leader279/metadata-v1-1.log
09:30:39,819 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader279: no eligible files found
09:30:39,819 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - leader279: SnapshotOffer called.
09:30:39,819 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - leader279: initializing from snapshot taken at 2025-07-02T09:30:39.702Z
09:30:39,819 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader279: Set currentTerm=1, votedFor=null
09:30:39,819 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - leader279: Updated server config: isVoting: true, peers: [PeerInfo [id=follower281, address=pekko://test/user/follower281, votingState=VOTING], PeerInfo [id=follower280, address=pekko://test/user/follower280, votingState=VOTING], PeerInfo [id=follower282, address=pekko://test/user/follower282, votingState=NON_VOTING]]
09:30:39,819 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for leader279 in 61.97 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:39,819 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader279: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:39.702Z
09:30:39,819 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader279: support() called
09:30:39,819 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower282: Recovery completed in 4.887 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:39,819 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader279: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/leader279/snapshot-000000006864FC3F-29D7AB80.tmp
09:30:39,819 AM [leader279-writer-133] [DEBUG] JournalWriteTask - leader279: journal writer started
09:30:39,819 AM [leader279-writer-133] [DEBUG] JournalWriteTask - leader279: waiting to receive commands
09:30:39,823 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader279: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/leader279/snapshot-000000006864FC3F-29D7AB80.v1
09:30:39,823 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader279: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/leader279/snapshot-000000006864FC3F-29D7AB80.v1
09:30:39,823 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader279: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/leader279/journal-v1-1.log
09:30:39,823 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader279: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/leader279/metadata-v1-1.log
09:30:39,823 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader279: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:39.702Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12386363761624880942/leader279/snapshot-000000006864FC3F-29D7AB80.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:39,823 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader279: local snapshot saved in 4.163 ms, deleting Pekko-persisted snapshots
09:30:39,824 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader279: Recovery completed in 4.852 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:39,824 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower282: Set currentTerm=1, votedFor=null
09:30:39,824 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower282: Local TermInfo store seeded with TermInfo{term=1}
09:30:39,824 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower282: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@72252e3c
09:30:39,824 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower282: Moving last applied index from -1 to -1
09:30:39,824 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower282: empty journal: appending 0 entries
09:30:39,824 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower282: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:39,824 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower282: journal recovery completedin 285.2 μs with journalIndex=1
09:30:39,825 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower282: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:39,826 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader279: Set currentTerm=1, votedFor=null
09:30:39,826 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader279: Local TermInfo store seeded with TermInfo{term=1}
09:30:39,826 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader279: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@1da3d7d3
09:30:39,826 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader279: Moving last applied index from -1 to -1
09:30:39,826 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - leader279: empty journal: appending 0 entries
09:30:39,826 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader279: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:39,826 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - leader279: journal recovery completedin 296.4 μs with journalIndex=1
09:30:39,826 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader279: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:40,172 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:30:40,172 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader279 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.82:17355, Removed)
09:30:40,172 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader279 (Follower): Received ElectionTimeout - switching to Candidate
09:30:40,173 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader279 (Candidate): Election: Candidate has following voting peers: [follower281, follower280]
09:30:40,176 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader279: Set currentTerm=2, votedFor=leader279
09:30:40,176 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - leader279 (Candidate): Starting new election term 2
09:30:40,177 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader279 (Candidate): Sending RequestVote{term=2, candidateId=leader279, lastLogIndex=-1, lastLogTerm=-1} to peer follower281
09:30:40,177 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader279 (Candidate): Sending RequestVote{term=2, candidateId=leader279, lastLogIndex=-1, lastLogTerm=-1} to peer follower280
09:30:40,177 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader279 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:30:40,177 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower280 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:30:40,177 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower280 (Follower): Cluster state: []
09:30:40,177 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower280 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader279, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:30:40,177 AM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - follower280 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader279, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:30:40,177 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower281 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:30:40,177 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower281 (Follower): Cluster state: []
09:30:40,177 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower281 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader279, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:30:40,177 AM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower281 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader279, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:30:40,180 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower280: Set currentTerm=2, votedFor=null
09:30:40,180 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower280 (Follower): In requestVote: RequestVote{term=2, candidateId=leader279, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:30:40,182 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower281: Set currentTerm=2, votedFor=null
09:30:40,182 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower281 (Follower): In requestVote: RequestVote{term=2, candidateId=leader279, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:30:40,183 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower280: Set currentTerm=2, votedFor=leader279
09:30:40,183 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower280 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:30:40,183 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader279 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
09:30:40,183 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader279 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
09:30:40,184 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader279 (Leader): Election: Leader has following peers: [follower281, follower280, follower282]
09:30:40,184 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader279 (Leader): Checking sendAppendEntries for follower follower281: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:40,184 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader279 (Leader): Checking sendAppendEntries for follower follower280: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:40,184 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader279 (Leader): Checking sendAppendEntries for follower follower282: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:40,184 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader279 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
09:30:40,184 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower280: Last sync leader does not match current leader leader279, need to catch up to -1
09:30:40,184 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower282 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader279, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
[WARN] [07/02/2025 09:30:40.184] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower280] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower280, initialSyncDone=false]
09:30:40,184 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower281: Set currentTerm=2, votedFor=leader279
09:30:40,184 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower281 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
[INFO] [pekkoDeadLetter][07/02/2025 09:30:40.184] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower280] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower280] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:30:40,185 AM [test-pekko.actor.default-dispatcher-6] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower280] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:30:40,185 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower281: Last sync leader does not match current leader leader279, need to catch up to -1
09:30:40,185 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader279 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower280 updated: matchIndex: -1, nextIndex: 0
09:30:40,185 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader279 (Leader): Checking sendAppendEntries for follower follower280: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:40.185] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower281] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower281, initialSyncDone=false]
09:30:40,185 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader279 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower281 updated: matchIndex: -1, nextIndex: 0
09:30:40,185 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader279 (Leader): Checking sendAppendEntries for follower follower281: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:40,187 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower282: Set currentTerm=2, votedFor=null
09:30:40,187 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower282: Last sync leader does not match current leader leader279, need to catch up to -1
09:30:40,187 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader279 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower282 updated: matchIndex: -1, nextIndex: 0
09:30:40,187 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader279 (Leader): Checking sendAppendEntries for follower follower282: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:40.187] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower282] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower282, initialSyncDone=false]
[INFO] [pekkoDeadLetter][07/02/2025 09:30:40.187] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower281] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower281] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[INFO] [pekkoDeadLetter][07/02/2025 09:30:40.187] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower282] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower282] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:30:40,187 AM [test-pekko.actor.default-dispatcher-12] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower281] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:30:40,187 AM [test-pekko.actor.default-dispatcher-12] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower282] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:30:40,218 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
09:30:40,218 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader279 starting
09:30:40,220 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader279: onShutDown
09:30:40,220 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader279: Initiating leader transfer
09:30:40,220 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorLeadershipTransferCohort - leader279: pauseLeader successfully completed - doing transfer
09:30:40,220 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Leader - leader279 (Leader): Attempting to transfer leadership
09:30:40,220 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader279 (Leader): Checking sendAppendEntries for follower follower281: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:40,220 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader279 (Leader): Checking sendAppendEntries for follower follower280: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:40,220 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader279 (Leader): Checking sendAppendEntries for follower follower282: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:40,220 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower281: Lagging 0 entries behind leader leader279 and reached -1 (of expected -1)
09:30:40,221 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower281: onLeaderTransitioning: LeaderTransitioning [leaderId=leader279]
09:30:40,221 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower280: Lagging 0 entries behind leader leader279 and reached -1 (of expected -1)
09:30:40,221 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower280: onLeaderTransitioning: LeaderTransitioning [leaderId=leader279]
09:30:40,221 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower282: Lagging 0 entries behind leader leader279 and reached -1 (of expected -1)
09:30:40,221 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower282: onLeaderTransitioning: LeaderTransitioning [leaderId=leader279]
[WARN] [07/02/2025 09:30:40.221] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower281] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower281, initialSyncDone=true]
[WARN] [07/02/2025 09:30:40.221] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower280] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower280, initialSyncDone=true]
[WARN] [07/02/2025 09:30:40.221] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower282] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower282, initialSyncDone=true]
[INFO] [pekkoDeadLetter][07/02/2025 09:30:40.221] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower281] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower281] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[INFO] [pekkoDeadLetter][07/02/2025 09:30:40.221] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower280] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower280] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[INFO] [pekkoDeadLetter][07/02/2025 09:30:40.221] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower282] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower282] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:30:40,222 AM [test-pekko.actor.default-dispatcher-12] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower281] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:30:40,222 AM [test-pekko.actor.default-dispatcher-12] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower280] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:30:40,222 AM [test-pekko.actor.default-dispatcher-12] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower282] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:30:40,302 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower281: Lagging 0 entries behind leader leader279 and reached -1 (of expected -1)
09:30:40,302 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower282: Lagging 0 entries behind leader leader279 and reached -1 (of expected -1)
09:30:40,302 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower280: Lagging 0 entries behind leader leader279 and reached -1 (of expected -1)
09:30:40,423 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower281: Lagging 0 entries behind leader leader279 and reached -1 (of expected -1)
09:30:40,423 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower280: Lagging 0 entries behind leader leader279 and reached -1 (of expected -1)
09:30:40,423 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower282: Lagging 0 entries behind leader leader279 and reached -1 (of expected -1)
09:30:40,542 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader279: leader transfer aborted
09:30:40,542 AM [test-pekko.actor.default-dispatcher-6] [WARN] RaftActorLeadershipTransferCohort - leader279: Failed to transfer leadership in 321.9 ms
09:30:40,542 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader279: leader transfer failed - sending PoisonPill
09:30:40,542 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Leader - leader279 (Leader): Leadership transfer expired
09:30:40,543 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower281: Lagging 0 entries behind leader leader279 and reached -1 (of expected -1)
09:30:40,543 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower280: Lagging 0 entries behind leader leader279 and reached -1 (of expected -1)
09:30:40,543 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower282: Lagging 0 entries behind leader leader279 and reached -1 (of expected -1)
09:30:40,543 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - leader279: terminating thread VirtualThread[#726,leader279-writer-133]/waiting
09:30:40,543 AM [leader279-writer-133] [DEBUG] JournalWriteTask - leader279: received 1 commands after 723.6 ms
09:30:40,543 AM [leader279-writer-133] [DEBUG] JournalWriteTask - leader279: completed 1 commands in 30.45 μs
09:30:40,543 AM [leader279-writer-133] [DEBUG] JournalWriteTask - leader279: journal writer stopped
09:30:40,543 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader279: journal closed
09:30:40,543 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader279: journal closed
09:30:40,543 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader279: stopped executor with 0 remaining tasks
09:30:40,543 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader279: stopped executor with 0 remaining tasks
[WARN] [07/02/2025 09:30:40.544] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/leader279] received dead letter from TestActor[pekko://test/user/follower281]: AppendEntriesReply{term=2, success=true, followerId=follower281, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
[WARN] [07/02/2025 09:30:40.544] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/leader279] received dead letter from TestActor[pekko://test/user/follower280]: AppendEntriesReply{term=2, success=true, followerId=follower280, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
[WARN] [07/02/2025 09:30:40.544] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/leader279] received dead letter from TestActor[pekko://test/user/follower282]: AppendEntriesReply{term=2, success=true, followerId=follower282, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:30:40,545 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader279 ending
09:30:40,546 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending
09:30:40,546 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower280-notifier283#906266497]
09:30:40,547 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower280-collector284#57028898]
09:30:40,548 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower280]
09:30:40,548 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRaftStorage - follower280: terminating thread VirtualThread[#721,follower280-writer-130]/waiting
09:30:40,548 AM [follower280-writer-130] [DEBUG] JournalWriteTask - follower280: received 1 commands after 839.1 ms
09:30:40,548 AM [follower280-writer-130] [DEBUG] JournalWriteTask - follower280: completed 1 commands in 12.40 μs
09:30:40,548 AM [follower280-writer-130] [DEBUG] JournalWriteTask - follower280: journal writer stopped
09:30:40,548 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower280: journal closed
09:30:40,548 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower280: journal closed
09:30:40,548 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower280: stopped executor with 0 remaining tasks
09:30:40,548 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower280: stopped executor with 0 remaining tasks
09:30:40,548 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower281-notifier285#-362330724]
09:30:40,548 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower281-collector286#-1953875459]
09:30:40,549 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower281]
09:30:40,549 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRaftStorage - follower281: terminating thread VirtualThread[#722,follower281-writer-131]/waiting
09:30:40,549 AM [follower281-writer-131] [DEBUG] JournalWriteTask - follower281: received 1 commands after 741.6 ms
09:30:40,549 AM [follower281-writer-131] [DEBUG] JournalWriteTask - follower281: completed 1 commands in 13.14 μs
09:30:40,549 AM [follower281-writer-131] [DEBUG] JournalWriteTask - follower281: journal writer stopped
09:30:40,549 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower281: journal closed
09:30:40,549 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower281: journal closed
09:30:40,549 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower281: stopped executor with 0 remaining tasks
09:30:40,549 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower281: stopped executor with 0 remaining tasks
09:30:40,549 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower282-notifier287#-983729617]
09:30:40,550 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower282-collector288#-796970556]
09:30:40,550 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower282]
09:30:40,550 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRaftStorage - follower282: terminating thread VirtualThread[#724,follower282-writer-132]/waiting
09:30:40,550 AM [follower282-writer-132] [DEBUG] JournalWriteTask - follower282: received 1 commands after 736.3 ms
09:30:40,550 AM [follower282-writer-132] [DEBUG] JournalWriteTask - follower282: completed 1 commands in 8.470 μs
09:30:40,550 AM [follower282-writer-132] [DEBUG] JournalWriteTask - follower282: journal writer stopped
09:30:40,550 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower282: journal closed
09:30:40,550 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower282: journal closed
09:30:40,550 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower282: stopped executor with 0 remaining tasks
09:30:40,550 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower282: stopped executor with 0 remaining tasks
09:30:40,550 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader279-notifier289#1624122805]
09:30:40,550 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader279-collector290#-1804042861]
09:30:40,551 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader279]
09:30:40,553 AM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 starting
09:30:40,553 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [07/02/2025 09:30:40.554] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower292]: org.opendaylight.controller.cluster.common.actor.Monitor@3f08fee7
09:30:40,555 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower292: Starting recovery with journal batch size 1000
09:30:40,555 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: started executor
09:30:40,555 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: started executor
09:30:40,555 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower292: metadata journal open: replayFrom=1 applyTo=0
09:30:40,555 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower292: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:40,555 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower292: journal open: applyTo=0
09:30:40,556 AM [follower292-writer-134] [DEBUG] JournalWriteTask - follower292: journal writer started
09:30:40,556 AM [follower292-writer-134] [DEBUG] JournalWriteTask - follower292: waiting to receive commands
09:30:40,556 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower292/TermInfo.properties does not exist
09:30:40,556 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower292/journal-v1-1.log
09:30:40,556 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower292/metadata-v1-1.log
09:30:40,556 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: no eligible files found
09:30:40,556 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower292: SnapshotOffer called.
09:30:40,556 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower292: initializing from snapshot taken at 2025-07-02T09:30:40.553Z
09:30:40,556 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower292: Set currentTerm=1, votedFor=null
09:30:40,556 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - follower292: Updated server config: isVoting: true, peers: [PeerInfo [id=follower294, address=pekko://test/user/follower294, votingState=NON_VOTING], PeerInfo [id=follower293, address=pekko://test/user/follower293, votingState=VOTING], PeerInfo [id=leader291, address=pekko://test/user/leader291, votingState=VOTING]]
09:30:40,557 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for follower292 in 99.35 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:40,557 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower292: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:40.553Z
09:30:40,557 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower292: support() called
09:30:40,557 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower292/snapshot-000000006864FC40-20F61C40.tmp
[WARN] [07/02/2025 09:30:40.559] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower293]: org.opendaylight.controller.cluster.common.actor.Monitor@259c7d5d
09:30:40,559 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower293: Starting recovery with journal batch size 1000
09:30:40,559 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: started executor
09:30:40,559 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: started executor
09:30:40,560 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower293: metadata journal open: replayFrom=1 applyTo=0
09:30:40,560 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower293: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:40,560 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower293: journal open: applyTo=0
09:30:40,561 AM [follower293-writer-135] [DEBUG] JournalWriteTask - follower293: journal writer started
09:30:40,561 AM [follower293-writer-135] [DEBUG] JournalWriteTask - follower293: waiting to receive commands
09:30:40,561 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower292/snapshot-000000006864FC40-20F61C40.v1
09:30:40,561 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower292/snapshot-000000006864FC40-20F61C40.v1
09:30:40,561 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower292/journal-v1-1.log
09:30:40,561 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower292/metadata-v1-1.log
09:30:40,561 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:40.553Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower292/snapshot-000000006864FC40-20F61C40.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:40,561 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower292: local snapshot saved in 4.195 ms, deleting Pekko-persisted snapshots
09:30:40,561 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower293/TermInfo.properties does not exist
09:30:40,561 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower293/journal-v1-1.log
09:30:40,561 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower293/metadata-v1-1.log
09:30:40,561 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: no eligible files found
09:30:40,561 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower293: SnapshotOffer called.
09:30:40,561 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower293: initializing from snapshot taken at 2025-07-02T09:30:40.553Z
09:30:40,561 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower293: Set currentTerm=1, votedFor=null
09:30:40,561 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PeerInfos - follower293: Updated server config: isVoting: true, peers: [PeerInfo [id=follower292, address=pekko://test/user/follower292, votingState=VOTING], PeerInfo [id=follower294, address=pekko://test/user/follower294, votingState=NON_VOTING], PeerInfo [id=leader291, address=pekko://test/user/leader291, votingState=VOTING]]
09:30:40,561 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower292: Recovery completed in 5.119 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:40,562 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - Recovery snapshot applied for follower293 in 92.92 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:40,562 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower293: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:40.553Z
09:30:40,562 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower293: support() called
09:30:40,562 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower293/snapshot-000000006864FC40-20F61C40.tmp
[WARN] [07/02/2025 09:30:40.562] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower294]: org.opendaylight.controller.cluster.common.actor.Monitor@65364e69
09:30:40,563 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower294: Starting recovery with journal batch size 1000
09:30:40,563 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower294: started executor
09:30:40,563 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower294: started executor
09:30:40,563 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower294: metadata journal open: replayFrom=1 applyTo=0
09:30:40,564 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower294: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:40,564 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower294: journal open: applyTo=0
09:30:40,564 AM [follower294-writer-136] [DEBUG] JournalWriteTask - follower294: journal writer started
09:30:40,564 AM [follower294-writer-136] [DEBUG] JournalWriteTask - follower294: waiting to receive commands
09:30:40,564 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower294/TermInfo.properties does not exist
09:30:40,564 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower294: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower294/journal-v1-1.log
09:30:40,564 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower294: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower294/metadata-v1-1.log
09:30:40,565 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower294: no eligible files found
09:30:40,565 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - follower294: SnapshotOffer called.
09:30:40,565 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - follower294: initializing from snapshot taken at 2025-07-02T09:30:40.553Z
09:30:40,565 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower294: Set currentTerm=1, votedFor=null
09:30:40,565 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - follower294: Updated server config: isVoting: false, peers: [PeerInfo [id=follower292, address=pekko://test/user/follower292, votingState=VOTING], PeerInfo [id=follower293, address=pekko://test/user/follower293, votingState=VOTING], PeerInfo [id=leader291, address=pekko://test/user/leader291, votingState=VOTING]]
09:30:40,565 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - Recovery snapshot applied for follower294 in 54.42 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:40,565 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower294: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:40.553Z
09:30:40,565 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower294: support() called
09:30:40,565 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower292: Set currentTerm=1, votedFor=null
09:30:40,565 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower292: Local TermInfo store seeded with TermInfo{term=1}
09:30:40,565 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower294: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower294/snapshot-000000006864FC40-20F61C40.tmp
09:30:40,565 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower292: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@49cfcedc
09:30:40,565 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower292: Moving last applied index from -1 to -1
09:30:40,565 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower292: empty journal: appending 0 entries
09:30:40,566 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower292: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:40,566 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower292: journal recovery completedin 479.1 μs with journalIndex=1
[WARN] [07/02/2025 09:30:40.566] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader291]: org.opendaylight.controller.cluster.common.actor.Monitor@53a1b865
09:30:40,566 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - leader291: Starting recovery with journal batch size 1000
09:30:40,566 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower292: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:40,566 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader291: started executor
09:30:40,567 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader291: started executor
09:30:40,567 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader291: metadata journal open: replayFrom=1 applyTo=0
09:30:40,567 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower293/snapshot-000000006864FC40-20F61C40.v1
09:30:40,567 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower293/snapshot-000000006864FC40-20F61C40.v1
09:30:40,567 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader291: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:40,567 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower293/journal-v1-1.log
09:30:40,567 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - leader291: journal open: applyTo=0
09:30:40,567 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower293/metadata-v1-1.log
09:30:40,568 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:40.553Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower293/snapshot-000000006864FC40-20F61C40.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:40,568 AM [leader291-writer-137] [DEBUG] JournalWriteTask - leader291: journal writer started
09:30:40,568 AM [leader291-writer-137] [DEBUG] JournalWriteTask - leader291: waiting to receive commands
09:30:40,568 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower293: local snapshot saved in 6.026 ms, deleting Pekko-persisted snapshots
09:30:40,568 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower294: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower294/snapshot-000000006864FC40-20F61C40.v1
09:30:40,568 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower294: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower294/snapshot-000000006864FC40-20F61C40.v1
09:30:40,568 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower294: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower294/journal-v1-1.log
09:30:40,568 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower294: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower294/metadata-v1-1.log
09:30:40,568 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower294: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:40.553Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/follower294/snapshot-000000006864FC40-20F61C40.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:40,568 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower294: local snapshot saved in 3.271 ms, deleting Pekko-persisted snapshots
09:30:40,568 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/leader291/TermInfo.properties does not exist
09:30:40,568 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower293: Recovery completed in 6.926 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:40,568 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader291: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/leader291/journal-v1-1.log
09:30:40,568 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader291: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/leader291/metadata-v1-1.log
09:30:40,568 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader291: no eligible files found
09:30:40,568 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - leader291: SnapshotOffer called.
09:30:40,568 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - leader291: initializing from snapshot taken at 2025-07-02T09:30:40.553Z
09:30:40,568 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader291: Set currentTerm=1, votedFor=null
09:30:40,568 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower294: Recovery completed in 3.905 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:40,568 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - leader291: Updated server config: isVoting: true, peers: [PeerInfo [id=follower292, address=pekko://test/user/follower292, votingState=VOTING], PeerInfo [id=follower294, address=pekko://test/user/follower294, votingState=NON_VOTING], PeerInfo [id=follower293, address=pekko://test/user/follower293, votingState=VOTING]]
09:30:40,569 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for leader291 in 115.8 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:40,569 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader291: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:40.553Z
09:30:40,569 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader291: support() called
09:30:40,569 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader291: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/leader291/snapshot-000000006864FC40-20F61C40.tmp
09:30:40,573 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower293: Set currentTerm=1, votedFor=null
09:30:40,573 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower293: Local TermInfo store seeded with TermInfo{term=1}
09:30:40,573 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower293: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@5965b6f4
09:30:40,574 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower293: Moving last applied index from -1 to -1
09:30:40,574 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower293: empty journal: appending 0 entries
09:30:40,574 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower293: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:40,574 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower293: journal recovery completedin 318.2 μs with journalIndex=1
09:30:40,574 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower293: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:40,574 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader291: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/leader291/snapshot-000000006864FC40-20F61C40.v1
09:30:40,574 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader291: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/leader291/snapshot-000000006864FC40-20F61C40.v1
09:30:40,574 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader291: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/leader291/journal-v1-1.log
09:30:40,574 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader291: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/leader291/metadata-v1-1.log
09:30:40,574 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader291: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:40.553Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest5011114254432386284/leader291/snapshot-000000006864FC40-20F61C40.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:40,575 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader291: local snapshot saved in 5.819 ms, deleting Pekko-persisted snapshots
09:30:40,575 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader291: Recovery completed in 6.686 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:40,577 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower294: Set currentTerm=1, votedFor=null
09:30:40,577 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower294: Local TermInfo store seeded with TermInfo{term=1}
09:30:40,577 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower294: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@1d955c2d
09:30:40,577 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower294: Moving last applied index from -1 to -1
09:30:40,577 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower294: empty journal: appending 0 entries
09:30:40,577 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower294: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:40,577 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower294: journal recovery completedin 452.0 μs with journalIndex=1
09:30:40,578 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower294: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:40,580 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader291: Set currentTerm=1, votedFor=null
09:30:40,580 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader291: Local TermInfo store seeded with TermInfo{term=1}
09:30:40,580 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader291: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@3c79a210
09:30:40,580 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - leader291: Moving last applied index from -1 to -1
09:30:40,580 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - leader291: empty journal: appending 0 entries
09:30:40,580 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader291: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:40,580 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - leader291: journal recovery completedin 235.2 μs with journalIndex=1
09:30:40,580 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader291: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:40,972 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:30:40,972 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - leader291 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.82:17355, Removed)
09:30:40,972 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - leader291 (Follower): Received ElectionTimeout - switching to Candidate
09:30:40,972 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader291 (Candidate): Election: Candidate has following voting peers: [follower292, follower293]
09:30:40,978 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader291: Set currentTerm=2, votedFor=leader291
09:30:40,978 AM [test-pekko.actor.default-dispatcher-12] [INFO] Candidate - leader291 (Candidate): Starting new election term 2
09:30:40,978 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader291 (Candidate): Sending RequestVote{term=2, candidateId=leader291, lastLogIndex=-1, lastLogTerm=-1} to peer follower292
09:30:40,978 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader291 (Candidate): Sending RequestVote{term=2, candidateId=leader291, lastLogIndex=-1, lastLogTerm=-1} to peer follower293
09:30:40,978 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActorBehavior - leader291 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:30:40,978 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower292 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:30:40,978 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower292 (Follower): Cluster state: []
09:30:40,978 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower292 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader291, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:30:40,978 AM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower292 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader291, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:30:40,979 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower293 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:30:40,979 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower293 (Follower): Cluster state: []
09:30:40,979 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower293 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader291, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:30:40,979 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower293 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader291, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:30:40,982 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower292: Set currentTerm=2, votedFor=null
09:30:40,982 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower292 (Follower): In requestVote: RequestVote{term=2, candidateId=leader291, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:30:40,983 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower293: Set currentTerm=2, votedFor=null
09:30:40,984 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower293 (Follower): In requestVote: RequestVote{term=2, candidateId=leader291, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:30:40,985 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower292: Set currentTerm=2, votedFor=leader291
09:30:40,985 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower292 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:30:40,986 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader291 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
09:30:40,986 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader291 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
09:30:40,986 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader291 (Leader): Election: Leader has following peers: [follower292, follower294, follower293]
09:30:40,986 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader291 (Leader): Checking sendAppendEntries for follower follower292: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:40,986 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader291 (Leader): Checking sendAppendEntries for follower follower294: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:40,986 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader291 (Leader): Checking sendAppendEntries for follower follower293: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:40,986 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader291 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
09:30:40,986 AM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower294 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader291, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
09:30:40,986 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower292: Last sync leader does not match current leader leader291, need to catch up to -1
09:30:40,986 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader291 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower292 updated: matchIndex: -1, nextIndex: 0
09:30:40,986 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader291 (Leader): Checking sendAppendEntries for follower follower292: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:40,986 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower293: Set currentTerm=2, votedFor=leader291
09:30:40,986 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower293 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:30:40,987 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower293: Last sync leader does not match current leader leader291, need to catch up to -1
[WARN] [07/02/2025 09:30:40.986] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower292] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower292, initialSyncDone=false]
09:30:40,987 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader291 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower293 updated: matchIndex: -1, nextIndex: 0
09:30:40,987 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader291 (Leader): Checking sendAppendEntries for follower follower293: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:40.987] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower293] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower293, initialSyncDone=false]
09:30:40,989 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower294: Set currentTerm=2, votedFor=null
09:30:40,989 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower294: Last sync leader does not match current leader leader291, need to catch up to -1
09:30:40,989 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader291 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower294 updated: matchIndex: -1, nextIndex: 0
09:30:40,989 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader291 (Leader): Checking sendAppendEntries for follower follower294: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:40.989] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower294] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower294, initialSyncDone=false]
09:30:41,33 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
09:30:41,33 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
09:30:41,34 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
09:30:41,34 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
09:30:41,34 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
09:30:41,34 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader291: onRequestLeadership RequestLeadership [requestedFollowerId=follower293, replyTo=Actor[pekko://test/user/$a#397752816]]
09:30:41,36 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader291: Initiating leader transfer
09:30:41,37 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower294: onLeaderTransitioning: LeaderTransitioning [leaderId=leader291]
09:30:41,37 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower292: onLeaderTransitioning: LeaderTransitioning [leaderId=leader291]
09:30:41,37 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorLeadershipTransferCohort - leader291: pauseLeader successfully completed - doing transfer
09:30:41,37 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Leader - leader291 (Leader): Attempting to transfer leadership
09:30:41,37 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower293: onLeaderTransitioning: LeaderTransitioning [leaderId=leader291]
09:30:41,37 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader291 (Leader): Checking sendAppendEntries for follower follower292: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:41,37 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader291 (Leader): Checking sendAppendEntries for follower follower294: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:41,37 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower292: Lagging 0 entries behind leader leader291 and reached -1 (of expected -1)
09:30:41,37 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower294: Lagging 0 entries behind leader leader291 and reached -1 (of expected -1)
[WARN] [07/02/2025 09:30:41.037] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower292] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower292, initialSyncDone=true]
09:30:41,37 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader291 (Leader): Checking sendAppendEntries for follower follower293: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:41.037] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower294] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower294, initialSyncDone=true]
09:30:41,37 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower293: Lagging 0 entries behind leader leader291 and reached -1 (of expected -1)
[WARN] [07/02/2025 09:30:41.038] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower293] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower293, initialSyncDone=true]
09:30:41,38 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Leader - leader291 (Leader): tryToCompleteLeadershipTransfer: followerId: follower293, matchIndex: -1, lastIndex: -1, isVoting: true
09:30:41,38 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Leader - leader291 (Leader): Follower's log matches - sending ElectionTimeout
09:30:41,38 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader291 (Leader): Checking sendAppendEntries for follower follower292: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:41,38 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader291 (Leader): Checking sendAppendEntries for follower follower294: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:41,38 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader291 (Leader): Checking sendAppendEntries for follower follower293: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:41,38 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower294: Lagging 0 entries behind leader leader291 and reached -1 (of expected -1)
09:30:41,38 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower293: Lagging 0 entries behind leader leader291 and reached -1 (of expected -1)
09:30:41,38 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:30:41,39 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower293 (Follower): Received TimeoutNow - switching to Candidate
09:30:41,38 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Leader - leader291 (Leader): Leader transfer complete
09:30:41,39 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - follower293 (Candidate): Election: Candidate has following voting peers: [follower292, leader291]
09:30:41,39 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorLeadershipTransferCohort - leader291: leader transfer complete - waiting for new leader
09:30:41,38 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower292: Lagging 0 entries behind leader leader291 and reached -1 (of expected -1)
09:30:41,42 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower293: Set currentTerm=3, votedFor=follower293
09:30:41,42 AM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - follower293 (Candidate): Starting new election term 3
09:30:41,42 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - follower293 (Candidate): Sending RequestVote{term=3, candidateId=follower293, lastLogIndex=-1, lastLogTerm=-1} to peer follower292
09:30:41,42 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - follower293 (Candidate): Sending RequestVote{term=3, candidateId=follower293, lastLogIndex=-1, lastLogTerm=-1} to peer leader291
09:30:41,42 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - follower293 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
09:30:41,42 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower292 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:30:41,42 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower292 (Follower): Cluster state: []
09:30:41,42 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower292 (Follower): Candidate in requestVote:RequestVote{term=3, candidateId=follower293, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:30:41,42 AM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - follower292 (Follower): Term 3 in "RequestVote{term=3, candidateId=follower293, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 2 - updating term
09:30:41,42 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - leader291 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:30:41,42 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - leader291 (Leader): Cluster state: []
09:30:41,42 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - leader291 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower293, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:30:41,42 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractLeader - leader291 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower293, lastLogIndex=-1, lastLogTerm=-1}" message is greater than leader's term 2 - switching to Follower
09:30:41,45 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower292: Set currentTerm=3, votedFor=null
09:30:41,45 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower292 (Follower): In requestVote: RequestVote{term=3, candidateId=follower293, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
09:30:41,46 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader291: Set currentTerm=3, votedFor=null
09:30:41,46 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader291 (Leader): Leadership transfer in progress - processing RequestVote
09:30:41,46 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - leader291 (Leader): In requestVote: RequestVote{term=3, candidateId=follower293, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
09:30:41,48 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower292: Set currentTerm=3, votedFor=follower293
09:30:41,48 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower292 (Follower): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
09:30:41,48 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - follower293 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3
09:30:41,48 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - follower293 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1
09:30:41,49 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower293 (Leader): Election: Leader has following peers: [follower292, follower294, leader291]
09:30:41,49 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower293 (Leader): Checking sendAppendEntries for follower follower292: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:41,49 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower293 (Leader): Checking sendAppendEntries for follower follower294: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:41,49 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower293 (Leader): Checking sendAppendEntries for follower leader291: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:41,49 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - follower293 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
09:30:41,49 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader291: Set currentTerm=3, votedFor=follower293
09:30:41,49 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - leader291 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
09:30:41,49 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower292: Last sync leader does not match current leader follower293, need to catch up to -1
09:30:41,49 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - leader291 (Leader) :- Switching from behavior Leader to Follower, election term: 3
09:30:41,49 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - follower293 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower292 updated: matchIndex: -1, nextIndex: 0
09:30:41,49 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - leader291: Last sync leader does not match current leader follower293, need to catch up to -1
09:30:41,49 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader291: leader changed to follower293
09:30:41,49 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - follower293 (Leader): Checking sendAppendEntries for follower follower292: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:41,49 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorLeadershipTransferCohort - leader291: Successfully transferred leadership to follower293 in 12.97 ms
09:30:41,49 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - follower293 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader291 updated: matchIndex: -1, nextIndex: 0
09:30:41,49 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader291: Leadership transferred successfully to follower293
09:30:41,49 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - follower293 (Leader): Checking sendAppendEntries for follower leader291: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:41.049] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower292] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower292, initialSyncDone=false]
09:30:41,49 AM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - follower294 (Follower): Term 3 in "AppendEntries{term=3, leaderId=follower293, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 2 - updating term
[WARN] [07/02/2025 09:30:41.050] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/leader291] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=leader291, initialSyncDone=false]
09:30:41,52 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower294: Set currentTerm=3, votedFor=null
09:30:41,52 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower294: Last sync leader does not match current leader follower293, need to catch up to -1
09:30:41,52 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower293 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower294 updated: matchIndex: -1, nextIndex: 0
[WARN] [07/02/2025 09:30:41.052] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower294] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower294, initialSyncDone=false]
09:30:41,52 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower293 (Leader): Checking sendAppendEntries for follower follower294: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:41,85 AM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 ending
09:30:41,85 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower292-notifier295#2075744270]
09:30:41,96 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower292-collector296#208442907]
09:30:41,97 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower292]
09:30:41,97 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - follower292: terminating thread VirtualThread[#728,follower292-writer-134]/waiting
09:30:41,97 AM [follower292-writer-134] [DEBUG] JournalWriteTask - follower292: received 1 commands after 541.3 ms
09:30:41,97 AM [follower292-writer-134] [DEBUG] JournalWriteTask - follower292: completed 1 commands in 28.92 μs
09:30:41,97 AM [follower292-writer-134] [DEBUG] JournalWriteTask - follower292: journal writer stopped
09:30:41,97 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower292: journal closed
09:30:41,97 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower292: journal closed
09:30:41,97 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower292: stopped executor with 0 remaining tasks
09:30:41,97 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower292: stopped executor with 0 remaining tasks
09:30:41,98 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower293-notifier297#1361295252]
09:30:41,98 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower293-collector298#-1233536243]
09:30:41,98 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower293]
09:30:41,98 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - follower293: terminating thread VirtualThread[#729,follower293-writer-135]/waiting
09:30:41,98 AM [follower293-writer-135] [DEBUG] JournalWriteTask - follower293: received 1 commands after 537.7 ms
09:30:41,98 AM [follower293-writer-135] [DEBUG] JournalWriteTask - follower293: completed 1 commands in 19.27 μs
09:30:41,98 AM [follower293-writer-135] [DEBUG] JournalWriteTask - follower293: journal writer stopped
09:30:41,99 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower293: journal closed
09:30:41,99 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower293: journal closed
09:30:41,99 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower293: stopped executor with 0 remaining tasks
09:30:41,99 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower293: stopped executor with 0 remaining tasks
09:30:41,99 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower294-notifier299#-258482421]
09:30:41,99 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower294-collector300#-928500743]
09:30:41,99 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower294]
09:30:41,99 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - follower294: terminating thread VirtualThread[#730,follower294-writer-136]/waiting
09:30:41,99 AM [follower294-writer-136] [DEBUG] JournalWriteTask - follower294: received 1 commands after 535.3 ms
09:30:41,99 AM [follower294-writer-136] [DEBUG] JournalWriteTask - follower294: completed 1 commands in 19.14 μs
09:30:41,99 AM [follower294-writer-136] [DEBUG] JournalWriteTask - follower294: journal writer stopped
09:30:41,99 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower294: journal closed
09:30:41,100 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower294: journal closed
09:30:41,100 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower294: stopped executor with 0 remaining tasks
09:30:41,100 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower294: stopped executor with 0 remaining tasks
09:30:41,100 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader291-notifier301#255957794]
09:30:41,100 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader291-collector302#-1948967598]
09:30:41,100 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader291]
09:30:41,100 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - leader291: terminating thread VirtualThread[#731,leader291-writer-137]/waiting
09:30:41,100 AM [leader291-writer-137] [DEBUG] JournalWriteTask - leader291: received 1 commands after 532.5 ms
09:30:41,100 AM [leader291-writer-137] [DEBUG] JournalWriteTask - leader291: completed 1 commands in 18.69 μs
09:30:41,100 AM [leader291-writer-137] [DEBUG] JournalWriteTask - leader291: journal writer stopped
09:30:41,100 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader291: journal closed
09:30:41,100 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - leader291: journal closed
09:30:41,100 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader291: stopped executor with 0 remaining tasks
09:30:41,100 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader291: stopped executor with 0 remaining tasks
09:30:41,101 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$a#397752816]
09:30:41,104 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown starting
09:30:41,104 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
09:30:41,107 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower304: Starting recovery with journal batch size 1000
[WARN] [07/02/2025 09:30:41.107] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower304]: org.opendaylight.controller.cluster.common.actor.Monitor@dc1f979
09:30:41,107 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: started executor
09:30:41,107 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: started executor
09:30:41,108 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower304: metadata journal open: replayFrom=1 applyTo=0
09:30:41,108 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower304: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:41,108 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower304: journal open: applyTo=0
09:30:41,108 AM [follower304-writer-138] [DEBUG] JournalWriteTask - follower304: journal writer started
09:30:41,108 AM [follower304-writer-138] [DEBUG] JournalWriteTask - follower304: waiting to receive commands
09:30:41,109 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower304/TermInfo.properties does not exist
09:30:41,109 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower304/journal-v1-1.log
09:30:41,109 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower304/metadata-v1-1.log
09:30:41,109 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: no eligible files found
09:30:41,109 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower304: SnapshotOffer called.
09:30:41,109 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower304: initializing from snapshot taken at 2025-07-02T09:30:41.104Z
09:30:41,109 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower304: Set currentTerm=1, votedFor=null
09:30:41,109 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PeerInfos - follower304: Updated server config: isVoting: true, peers: [PeerInfo [id=follower306, address=pekko://test/user/follower306, votingState=NON_VOTING], PeerInfo [id=follower305, address=pekko://test/user/follower305, votingState=VOTING], PeerInfo [id=leader303, address=pekko://test/user/leader303, votingState=VOTING]]
09:30:41,109 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - Recovery snapshot applied for follower304 in 85.20 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:41,110 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower304: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:41.104Z
09:30:41,110 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower304: support() called
09:30:41,110 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower304/snapshot-000000006864FC41-0632EA00.tmp
09:30:41,114 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower304/snapshot-000000006864FC41-0632EA00.v1
09:30:41,114 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower304/snapshot-000000006864FC41-0632EA00.v1
[WARN] [07/02/2025 09:30:41.114] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower305]: org.opendaylight.controller.cluster.common.actor.Monitor@154163c3
09:30:41,114 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower304/journal-v1-1.log
09:30:41,114 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower304/metadata-v1-1.log
09:30:41,114 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:41.104Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower304/snapshot-000000006864FC41-0632EA00.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:41,114 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower304: local snapshot saved in 4.221 ms, deleting Pekko-persisted snapshots
09:30:41,115 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower305: Starting recovery with journal batch size 1000
09:30:41,115 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower305: started executor
09:30:41,115 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower305: started executor
09:30:41,115 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower304: Recovery completed in 5.541 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:41,115 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower305: metadata journal open: replayFrom=1 applyTo=0
09:30:41,116 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower305: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:41,116 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower305: journal open: applyTo=0
09:30:41,116 AM [follower305-writer-139] [DEBUG] JournalWriteTask - follower305: journal writer started
09:30:41,116 AM [follower305-writer-139] [DEBUG] JournalWriteTask - follower305: waiting to receive commands
09:30:41,116 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower305/TermInfo.properties does not exist
09:30:41,117 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower305: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower305/journal-v1-1.log
09:30:41,117 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower305: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower305/metadata-v1-1.log
09:30:41,117 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower305: no eligible files found
09:30:41,117 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower305: SnapshotOffer called.
09:30:41,117 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower305: initializing from snapshot taken at 2025-07-02T09:30:41.104Z
09:30:41,117 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower305: Set currentTerm=1, votedFor=null
09:30:41,117 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - follower305: Updated server config: isVoting: true, peers: [PeerInfo [id=follower304, address=pekko://test/user/follower304, votingState=VOTING], PeerInfo [id=follower306, address=pekko://test/user/follower306, votingState=NON_VOTING], PeerInfo [id=leader303, address=pekko://test/user/leader303, votingState=VOTING]]
09:30:41,117 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for follower305 in 94.73 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:41,117 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower305: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:41.104Z
09:30:41,117 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower305: support() called
09:30:41,117 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower304: Set currentTerm=1, votedFor=null
09:30:41,117 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower304: Local TermInfo store seeded with TermInfo{term=1}
09:30:41,117 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower304: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@5e71f3f9
09:30:41,117 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower304: Moving last applied index from -1 to -1
09:30:41,117 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower305: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower305/snapshot-000000006864FC41-0632EA00.tmp
09:30:41,117 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - follower304: empty journal: appending 0 entries
09:30:41,118 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower304: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:41,118 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - follower304: journal recovery completedin 311.7 μs with journalIndex=1
[WARN] [07/02/2025 09:30:41.118] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower306]: org.opendaylight.controller.cluster.common.actor.Monitor@e2a62c5
09:30:41,118 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower306: Starting recovery with journal batch size 1000
09:30:41,119 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower304: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:41,119 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower306: started executor
09:30:41,119 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower306: started executor
09:30:41,119 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower306: metadata journal open: replayFrom=1 applyTo=0
09:30:41,120 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower306: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:41,120 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower306: journal open: applyTo=0
09:30:41,120 AM [follower306-writer-140] [DEBUG] JournalWriteTask - follower306: journal writer started
09:30:41,120 AM [follower306-writer-140] [DEBUG] JournalWriteTask - follower306: waiting to receive commands
09:30:41,120 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower305: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower305/snapshot-000000006864FC41-0632EA00.v1
09:30:41,120 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower305: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower305/snapshot-000000006864FC41-0632EA00.v1
09:30:41,120 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower306/TermInfo.properties does not exist
09:30:41,120 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower305: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower305/journal-v1-1.log
09:30:41,120 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower305: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower305/metadata-v1-1.log
09:30:41,120 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower305: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:41.104Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower305/snapshot-000000006864FC41-0632EA00.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:41,120 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower306: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower306/journal-v1-1.log
09:30:41,120 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower306: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower306/metadata-v1-1.log
09:30:41,120 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower306: no eligible files found
09:30:41,120 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower305: local snapshot saved in 3.376 ms, deleting Pekko-persisted snapshots
09:30:41,121 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower306: SnapshotOffer called.
09:30:41,121 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower306: initializing from snapshot taken at 2025-07-02T09:30:41.104Z
09:30:41,121 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower306: Set currentTerm=1, votedFor=null
09:30:41,121 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PeerInfos - follower306: Updated server config: isVoting: false, peers: [PeerInfo [id=follower304, address=pekko://test/user/follower304, votingState=VOTING], PeerInfo [id=follower305, address=pekko://test/user/follower305, votingState=VOTING], PeerInfo [id=leader303, address=pekko://test/user/leader303, votingState=VOTING]]
09:30:41,121 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - Recovery snapshot applied for follower306 in 67.70 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:41,121 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower306: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:41.104Z
09:30:41,121 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower306: support() called
09:30:41,121 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower306: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower306/snapshot-000000006864FC41-0632EA00.tmp
[WARN] [07/02/2025 09:30:41.122] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader303]: org.opendaylight.controller.cluster.common.actor.Monitor@68dfd865
09:30:41,122 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower305: Recovery completed in 5.024 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:41,122 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader303: Starting recovery with journal batch size 1000
09:30:41,122 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader303: started executor
09:30:41,122 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader303: started executor
09:30:41,123 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader303: metadata journal open: replayFrom=1 applyTo=0
09:30:41,124 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower306: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower306/snapshot-000000006864FC41-0632EA00.v1
09:30:41,124 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader303: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:41,124 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader303: journal open: applyTo=0
09:30:41,124 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower306: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower306/snapshot-000000006864FC41-0632EA00.v1
09:30:41,124 AM [leader303-writer-141] [DEBUG] JournalWriteTask - leader303: journal writer started
09:30:41,124 AM [leader303-writer-141] [DEBUG] JournalWriteTask - leader303: waiting to receive commands
09:30:41,124 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower306: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower306/journal-v1-1.log
09:30:41,124 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower306: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower306/metadata-v1-1.log
09:30:41,124 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower306: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:41.104Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/follower306/snapshot-000000006864FC41-0632EA00.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:41,124 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower306: local snapshot saved in 3.422 ms, deleting Pekko-persisted snapshots
09:30:41,124 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/leader303/TermInfo.properties does not exist
09:30:41,124 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader303: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/leader303/journal-v1-1.log
09:30:41,124 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader303: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/leader303/metadata-v1-1.log
09:30:41,124 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader303: no eligible files found
09:30:41,124 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader303: SnapshotOffer called.
09:30:41,124 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader303: initializing from snapshot taken at 2025-07-02T09:30:41.104Z
09:30:41,125 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader303: Set currentTerm=1, votedFor=null
09:30:41,125 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - leader303: Updated server config: isVoting: true, peers: [PeerInfo [id=follower304, address=pekko://test/user/follower304, votingState=VOTING], PeerInfo [id=follower306, address=pekko://test/user/follower306, votingState=NON_VOTING], PeerInfo [id=follower305, address=pekko://test/user/follower305, votingState=VOTING]]
09:30:41,125 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower305: Set currentTerm=1, votedFor=null
09:30:41,125 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower305: Local TermInfo store seeded with TermInfo{term=1}
09:30:41,125 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for leader303 in 61.24 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:41,125 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower305: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@78d6d162
09:30:41,125 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader303: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:41.104Z
09:30:41,125 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader303: support() called
09:30:41,125 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - follower305: Moving last applied index from -1 to -1
09:30:41,125 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader303: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/leader303/snapshot-000000006864FC41-0632EA00.tmp
09:30:41,125 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - follower305: empty journal: appending 0 entries
09:30:41,125 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower305: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:41,125 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - follower305: journal recovery completedin 375.4 μs with journalIndex=1
09:30:41,126 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower305: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:41,126 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower306: Recovery completed in 5.008 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:41,128 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader303: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/leader303/snapshot-000000006864FC41-0632EA00.v1
09:30:41,128 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader303: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/leader303/snapshot-000000006864FC41-0632EA00.v1
09:30:41,128 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader303: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/leader303/journal-v1-1.log
09:30:41,128 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader303: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/leader303/metadata-v1-1.log
09:30:41,128 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader303: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:41.104Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1211295146244905222/leader303/snapshot-000000006864FC41-0632EA00.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:41,128 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader303: local snapshot saved in 3.660 ms, deleting Pekko-persisted snapshots
09:30:41,128 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower306: Set currentTerm=1, votedFor=null
09:30:41,128 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower306: Local TermInfo store seeded with TermInfo{term=1}
09:30:41,128 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower306: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@6c07f382
09:30:41,129 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower306: Moving last applied index from -1 to -1
09:30:41,129 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower306: empty journal: appending 0 entries
09:30:41,129 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower306: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:41,129 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower306: journal recovery completedin 440.2 μs with journalIndex=1
09:30:41,129 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader303: Recovery completed in 4.868 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:41,129 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower306: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:41,133 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader303: Set currentTerm=1, votedFor=null
09:30:41,133 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader303: Local TermInfo store seeded with TermInfo{term=1}
09:30:41,133 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader303: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@757392c
09:30:41,133 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader303: Moving last applied index from -1 to -1
09:30:41,133 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader303: empty journal: appending 0 entries
09:30:41,133 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader303: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:41,133 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader303: journal recovery completedin 275.5 μs with journalIndex=1
09:30:41,134 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader303: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:41,522 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:30:41,522 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader303 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.82:17355, Removed)
09:30:41,523 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader303 (Follower): Received ElectionTimeout - switching to Candidate
09:30:41,523 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader303 (Candidate): Election: Candidate has following voting peers: [follower304, follower305]
09:30:41,525 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader303: Set currentTerm=2, votedFor=leader303
09:30:41,525 AM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader303 (Candidate): Starting new election term 2
09:30:41,525 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader303 (Candidate): Sending RequestVote{term=2, candidateId=leader303, lastLogIndex=-1, lastLogTerm=-1} to peer follower304
09:30:41,526 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader303 (Candidate): Sending RequestVote{term=2, candidateId=leader303, lastLogIndex=-1, lastLogTerm=-1} to peer follower305
09:30:41,526 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader303 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:30:41,526 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower305 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:30:41,526 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower304 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:30:41,526 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower305 (Follower): Cluster state: []
09:30:41,526 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower304 (Follower): Cluster state: []
09:30:41,526 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower305 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader303, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:30:41,526 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower304 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader303, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:30:41,526 AM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - follower305 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader303, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:30:41,526 AM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower304 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader303, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:30:41,529 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower305: Set currentTerm=2, votedFor=null
09:30:41,529 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower305 (Follower): In requestVote: RequestVote{term=2, candidateId=leader303, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:30:41,530 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower304: Set currentTerm=2, votedFor=null
09:30:41,530 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower304 (Follower): In requestVote: RequestVote{term=2, candidateId=leader303, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:30:41,532 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower305: Set currentTerm=2, votedFor=leader303
09:30:41,532 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower305 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:30:41,532 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader303 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
09:30:41,532 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader303 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
09:30:41,532 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader303 (Leader): Election: Leader has following peers: [follower304, follower306, follower305]
09:30:41,532 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader303 (Leader): Checking sendAppendEntries for follower follower304: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:41,532 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader303 (Leader): Checking sendAppendEntries for follower follower306: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:41,532 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader303 (Leader): Checking sendAppendEntries for follower follower305: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:41,532 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - leader303 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
09:30:41,533 AM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - follower306 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader303, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
09:30:41,533 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower304: Set currentTerm=2, votedFor=leader303
09:30:41,533 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower304 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:30:41,533 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower305: Last sync leader does not match current leader leader303, need to catch up to -1
09:30:41,533 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower304: Last sync leader does not match current leader leader303, need to catch up to -1
09:30:41,533 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader303 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower305 updated: matchIndex: -1, nextIndex: 0
09:30:41,533 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader303 (Leader): Checking sendAppendEntries for follower follower305: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:41,533 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader303 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower304 updated: matchIndex: -1, nextIndex: 0
09:30:41,533 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader303 (Leader): Checking sendAppendEntries for follower follower304: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:41.533] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower305] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower305, initialSyncDone=false]
[WARN] [07/02/2025 09:30:41.534] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower304] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower304, initialSyncDone=false]
09:30:41,535 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower306: Set currentTerm=2, votedFor=null
09:30:41,535 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower306: Last sync leader does not match current leader leader303, need to catch up to -1
09:30:41,535 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader303 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower306 updated: matchIndex: -1, nextIndex: 0
[WARN] [07/02/2025 09:30:41.535] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower306] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower306, initialSyncDone=false]
09:30:41,535 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader303 (Leader): Checking sendAppendEntries for follower follower306: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:41,538 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
09:30:41,538 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
09:30:41,538 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
09:30:41,538 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower305 starting
09:30:41,538 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower305: onShutDown
09:30:41,538 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - follower305: terminating thread VirtualThread[#734,follower305-writer-139]/waiting
09:30:41,539 AM [follower305-writer-139] [DEBUG] JournalWriteTask - follower305: received 1 commands after 422.6 ms
09:30:41,539 AM [follower305-writer-139] [DEBUG] JournalWriteTask - follower305: completed 1 commands in 20.82 μs
09:30:41,539 AM [follower305-writer-139] [DEBUG] JournalWriteTask - follower305: journal writer stopped
09:30:41,539 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower305: journal closed
09:30:41,539 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower305: journal closed
09:30:41,539 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower305: stopped executor with 0 remaining tasks
09:30:41,539 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower305: stopped executor with 0 remaining tasks
09:30:41,539 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower305 ending
09:30:41,539 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
09:30:41,539 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
09:30:41,539 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader303: onRequestLeadership RequestLeadership [requestedFollowerId=follower305, replyTo=Actor[pekko://test/user/$b#1706924070]]
09:30:41,539 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader303: Initiating leader transfer
09:30:41,540 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower304: onLeaderTransitioning: LeaderTransitioning [leaderId=leader303]
09:30:41,540 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower306: onLeaderTransitioning: LeaderTransitioning [leaderId=leader303]
[WARN] [07/02/2025 09:30:41.540] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower305] received dead letter from TestActor[pekko://test/user/leader303]: LeaderTransitioning [leaderId=leader303]
09:30:41,540 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader303: pauseLeader successfully completed - doing transfer
09:30:41,540 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Leader - leader303 (Leader): Attempting to transfer leadership
09:30:41,540 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader303 (Leader): Checking sendAppendEntries for follower follower304: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:41,540 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower304: Lagging 0 entries behind leader leader303 and reached -1 (of expected -1)
[WARN] [07/02/2025 09:30:41.541] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower304] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower304, initialSyncDone=true]
09:30:41,541 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader303 (Leader): Checking sendAppendEntries for follower follower306: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:41,541 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower306: Lagging 0 entries behind leader leader303 and reached -1 (of expected -1)
[WARN] [07/02/2025 09:30:41.541] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower306] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower306, initialSyncDone=true]
09:30:41,541 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader303 (Leader): Checking sendAppendEntries for follower follower305: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:41.542] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower305] received dead letter from TestActor[pekko://test/user/leader303]: AppendEntries{term=2, leaderId=leader303, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
09:30:41,652 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower304: Lagging 0 entries behind leader leader303 and reached -1 (of expected -1)
09:30:41,652 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower306: Lagging 0 entries behind leader leader303 and reached -1 (of expected -1)
[WARN] [07/02/2025 09:30:41.652] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower305] received dead letter from TestActor[pekko://test/user/leader303]: AppendEntries{term=2, leaderId=leader303, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
09:30:41,773 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower306: Lagging 0 entries behind leader leader303 and reached -1 (of expected -1)
09:30:41,773 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower304: Lagging 0 entries behind leader leader303 and reached -1 (of expected -1)
[WARN] [07/02/2025 09:30:41.773] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower305] received dead letter from TestActor[pekko://test/user/leader303]: AppendEntries{term=2, leaderId=leader303, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
09:30:41,892 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorLeadershipTransferCohort - leader303: leader transfer aborted
09:30:41,892 AM [test-pekko.actor.default-dispatcher-5] [WARN] RaftActorLeadershipTransferCohort - leader303: Failed to transfer leadership in 353.0 ms
09:30:41,893 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader303: LeadershipTransfer request from follower305 failed
09:30:41,893 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Leader - leader303 (Leader): Leadership transfer expired
09:30:41,893 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower304: Lagging 0 entries behind leader leader303 and reached -1 (of expected -1)
09:30:41,893 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower306: Lagging 0 entries behind leader leader303 and reached -1 (of expected -1)
[WARN] [07/02/2025 09:30:41.894] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower305] received dead letter from TestActor[pekko://test/user/leader303]: AppendEntries{term=2, leaderId=leader303, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
09:30:41,941 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown ending
09:30:41,941 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower304-notifier307#2045931020]
09:30:41,952 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower304-collector308#-145656448]
09:30:41,953 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower304]
09:30:41,953 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - follower304: terminating thread VirtualThread[#733,follower304-writer-138]/waiting
09:30:41,953 AM [follower304-writer-138] [DEBUG] JournalWriteTask - follower304: received 1 commands after 844.5 ms
09:30:41,953 AM [follower304-writer-138] [DEBUG] JournalWriteTask - follower304: completed 1 commands in 36.86 μs
09:30:41,953 AM [follower304-writer-138] [DEBUG] JournalWriteTask - follower304: journal writer stopped
09:30:41,953 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower304: journal closed
09:30:41,953 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - follower304: journal closed
09:30:41,953 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower304: stopped executor with 0 remaining tasks
09:30:41,953 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower304: stopped executor with 0 remaining tasks
09:30:41,954 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower305-notifier309#2100149535]
09:30:41,954 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower305-collector310#-1652917718]
09:30:41,954 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower305]
09:30:41,954 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower306-notifier311#1810432166]
09:30:41,954 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower306-collector312#2041014399]
09:30:41,954 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower306]
09:30:41,955 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - follower306: terminating thread VirtualThread[#735,follower306-writer-140]/waiting
09:30:41,955 AM [follower306-writer-140] [DEBUG] JournalWriteTask - follower306: received 1 commands after 834.9 ms
09:30:41,955 AM [follower306-writer-140] [DEBUG] JournalWriteTask - follower306: completed 1 commands in 12.73 μs
09:30:41,955 AM [follower306-writer-140] [DEBUG] JournalWriteTask - follower306: journal writer stopped
09:30:41,955 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower306: journal closed
09:30:41,955 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - follower306: journal closed
09:30:41,955 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower306: stopped executor with 0 remaining tasks
09:30:41,955 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower306: stopped executor with 0 remaining tasks
09:30:41,955 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader303-notifier313#681522126]
09:30:41,955 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader303-collector314#-196031362]
09:30:41,956 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader303]
09:30:41,956 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - leader303: terminating thread VirtualThread[#736,leader303-writer-141]/waiting
09:30:41,956 AM [leader303-writer-141] [DEBUG] JournalWriteTask - leader303: received 1 commands after 831.8 ms
09:30:41,956 AM [leader303-writer-141] [DEBUG] JournalWriteTask - leader303: completed 1 commands in 11.84 μs
09:30:41,956 AM [leader303-writer-141] [DEBUG] JournalWriteTask - leader303: journal writer stopped
09:30:41,956 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader303: journal closed
09:30:41,956 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader303: journal closed
09:30:41,956 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader303: stopped executor with 0 remaining tasks
09:30:41,956 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader303: stopped executor with 0 remaining tasks
09:30:41,956 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$b#1706924070]
09:30:41,959 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown starting
09:30:41,959 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [07/02/2025 09:30:41.960] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower316]: org.opendaylight.controller.cluster.common.actor.Monitor@3cc16d71
09:30:41,961 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - follower316: Starting recovery with journal batch size 1000
09:30:41,961 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower316: started executor
09:30:41,961 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower316: started executor
09:30:41,962 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower316: metadata journal open: replayFrom=1 applyTo=0
09:30:41,963 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower316: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:41,963 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - follower316: journal open: applyTo=0
09:30:41,963 AM [follower316-writer-142] [DEBUG] JournalWriteTask - follower316: journal writer started
09:30:41,963 AM [follower316-writer-142] [DEBUG] JournalWriteTask - follower316: waiting to receive commands
09:30:41,964 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower316/TermInfo.properties does not exist
09:30:41,964 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower316: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower316/journal-v1-1.log
09:30:41,964 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower316: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower316/metadata-v1-1.log
09:30:41,964 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower316: no eligible files found
09:30:41,964 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRecovery - follower316: SnapshotOffer called.
09:30:41,964 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRecovery - follower316: initializing from snapshot taken at 2025-07-02T09:30:41.959Z
09:30:41,964 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower316: Set currentTerm=1, votedFor=null
09:30:41,964 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PeerInfos - follower316: Updated server config: isVoting: true, peers: [PeerInfo [id=follower318, address=pekko://test/user/follower318, votingState=NON_VOTING], PeerInfo [id=leader315, address=pekko://test/user/leader315, votingState=VOTING], PeerInfo [id=follower317, address=pekko://test/user/follower317, votingState=VOTING]]
09:30:41,964 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - Recovery snapshot applied for follower316 in 108.6 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:41,964 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower316: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:41.959Z
09:30:41,964 AM [test-pekko.actor.default-dispatcher-7] [INFO] MockRaftActor - follower316: support() called
09:30:41,965 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower316: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower316/snapshot-000000006864FC41-39292DC0.tmp
[WARN] [07/02/2025 09:30:41.966] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower317]: org.opendaylight.controller.cluster.common.actor.Monitor@30d8c717
09:30:41,966 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower317: Starting recovery with journal batch size 1000
09:30:41,967 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: started executor
09:30:41,967 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: started executor
09:30:41,968 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower317: metadata journal open: replayFrom=1 applyTo=0
09:30:41,968 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower317: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:41,968 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower317: journal open: applyTo=0
09:30:41,968 AM [follower317-writer-143] [DEBUG] JournalWriteTask - follower317: journal writer started
09:30:41,968 AM [follower317-writer-143] [DEBUG] JournalWriteTask - follower317: waiting to receive commands
09:30:41,969 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower317/TermInfo.properties does not exist
09:30:41,969 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower317/journal-v1-1.log
09:30:41,969 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower317/metadata-v1-1.log
09:30:41,969 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: no eligible files found
09:30:41,969 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower317: SnapshotOffer called.
09:30:41,969 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower317: initializing from snapshot taken at 2025-07-02T09:30:41.959Z
09:30:41,969 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower317: Set currentTerm=1, votedFor=null
09:30:41,969 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PeerInfos - follower317: Updated server config: isVoting: true, peers: [PeerInfo [id=follower318, address=pekko://test/user/follower318, votingState=NON_VOTING], PeerInfo [id=leader315, address=pekko://test/user/leader315, votingState=VOTING], PeerInfo [id=follower316, address=pekko://test/user/follower316, votingState=VOTING]]
09:30:41,969 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - Recovery snapshot applied for follower317 in 85.97 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:41,969 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower317: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:41.959Z
09:30:41,969 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower317: support() called
09:30:41,969 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower317/snapshot-000000006864FC41-39292DC0.tmp
[WARN] [07/02/2025 09:30:41.970] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower318]: org.opendaylight.controller.cluster.common.actor.Monitor@4ab13ff1
09:30:41,971 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - follower318: Starting recovery with journal batch size 1000
09:30:41,971 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower318: started executor
09:30:41,971 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower318: started executor
09:30:41,971 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower318: metadata journal open: replayFrom=1 applyTo=0
09:30:41,972 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower318: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:41,972 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower318: journal open: applyTo=0
09:30:41,972 AM [follower318-writer-144] [DEBUG] JournalWriteTask - follower318: journal writer started
09:30:41,972 AM [follower318-writer-144] [DEBUG] JournalWriteTask - follower318: waiting to receive commands
09:30:41,973 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower318/TermInfo.properties does not exist
09:30:41,973 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower318: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower318/journal-v1-1.log
09:30:41,973 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower318: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower318/metadata-v1-1.log
09:30:41,973 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower318: no eligible files found
09:30:41,973 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower318: SnapshotOffer called.
09:30:41,973 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower318: initializing from snapshot taken at 2025-07-02T09:30:41.959Z
09:30:41,973 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower318: Set currentTerm=1, votedFor=null
09:30:41,973 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - follower318: Updated server config: isVoting: false, peers: [PeerInfo [id=leader315, address=pekko://test/user/leader315, votingState=VOTING], PeerInfo [id=follower317, address=pekko://test/user/follower317, votingState=VOTING], PeerInfo [id=follower316, address=pekko://test/user/follower316, votingState=VOTING]]
09:30:41,973 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - Recovery snapshot applied for follower318 in 91.74 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:41,973 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower318: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:41.959Z
09:30:41,973 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower318: support() called
09:30:41,973 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower318: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower318/snapshot-000000006864FC41-39292DC0.tmp
[WARN] [07/02/2025 09:30:41.975] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader315]: org.opendaylight.controller.cluster.common.actor.Monitor@771f8112
09:30:41,976 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - leader315: Starting recovery with journal batch size 1000
09:30:41,976 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader315: started executor
09:30:41,976 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader315: started executor
09:30:41,976 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower316: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower316/snapshot-000000006864FC41-39292DC0.v1
09:30:41,978 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower318: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower318/snapshot-000000006864FC41-39292DC0.v1
09:30:41,978 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower318: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower318/snapshot-000000006864FC41-39292DC0.v1
09:30:41,978 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader315: metadata journal open: replayFrom=1 applyTo=0
09:30:41,978 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower318: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower318/journal-v1-1.log
09:30:41,978 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower318: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower318/metadata-v1-1.log
09:30:41,978 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower318: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:41.959Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower318/snapshot-000000006864FC41-39292DC0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:41,978 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower316: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower316/snapshot-000000006864FC41-39292DC0.v1
09:30:41,978 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower318: local snapshot saved in 4.848 ms, deleting Pekko-persisted snapshots
09:30:41,978 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower316: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower316/journal-v1-1.log
09:30:41,978 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower316: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower316/metadata-v1-1.log
09:30:41,978 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower316: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:41.959Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower316/snapshot-000000006864FC41-39292DC0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:41,978 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower316: local snapshot saved in 13.98 ms, deleting Pekko-persisted snapshots
09:30:41,978 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower317/snapshot-000000006864FC41-39292DC0.v1
09:30:41,978 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower317/snapshot-000000006864FC41-39292DC0.v1
09:30:41,979 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower317/journal-v1-1.log
09:30:41,979 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower317/metadata-v1-1.log
09:30:41,979 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower317: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:41.959Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/follower317/snapshot-000000006864FC41-39292DC0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:41,979 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower317: local snapshot saved in 9.328 ms, deleting Pekko-persisted snapshots
09:30:41,979 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader315: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:41,979 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader315: journal open: applyTo=0
09:30:41,979 AM [leader315-writer-145] [DEBUG] JournalWriteTask - leader315: journal writer started
09:30:41,979 AM [leader315-writer-145] [DEBUG] JournalWriteTask - leader315: waiting to receive commands
09:30:41,979 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower317: Recovery completed in 10.46 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:41,980 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower316: Recovery completed in 15.77 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:41,981 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower318: Recovery completed in 7.806 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:41,983 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower317: Set currentTerm=1, votedFor=null
09:30:41,983 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower317: Local TermInfo store seeded with TermInfo{term=1}
09:30:41,983 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower317: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@28f72f3e
09:30:41,983 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower317: Moving last applied index from -1 to -1
09:30:41,983 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower317: empty journal: appending 0 entries
09:30:41,983 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower317: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:41,983 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower317: journal recovery completedin 279.5 μs with journalIndex=1
09:30:41,984 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/leader315/TermInfo.properties does not exist
09:30:41,984 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader315: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/leader315/journal-v1-1.log
09:30:41,984 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower317: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:41,984 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader315: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/leader315/metadata-v1-1.log
09:30:41,984 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader315: no eligible files found
09:30:41,984 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower316: Set currentTerm=1, votedFor=null
09:30:41,984 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader315: SnapshotOffer called.
09:30:41,984 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower316: Local TermInfo store seeded with TermInfo{term=1}
09:30:41,984 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower316: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4ba67b9e
09:30:41,984 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader315: initializing from snapshot taken at 2025-07-02T09:30:41.959Z
09:30:41,984 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower316: Moving last applied index from -1 to -1
09:30:41,984 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader315: Set currentTerm=1, votedFor=null
09:30:41,984 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - leader315: Updated server config: isVoting: true, peers: [PeerInfo [id=follower318, address=pekko://test/user/follower318, votingState=NON_VOTING], PeerInfo [id=follower317, address=pekko://test/user/follower317, votingState=VOTING], PeerInfo [id=follower316, address=pekko://test/user/follower316, votingState=VOTING]]
09:30:41,984 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower316: empty journal: appending 0 entries
09:30:41,984 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower316: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:41,984 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower316: journal recovery completedin 224.9 μs with journalIndex=1
09:30:41,984 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for leader315 in 98.69 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:41,984 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader315: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:41.959Z
09:30:41,984 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader315: support() called
09:30:41,984 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower316: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:41,984 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader315: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/leader315/snapshot-000000006864FC41-39292DC0.tmp
09:30:41,985 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower318: Set currentTerm=1, votedFor=null
09:30:41,985 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower318: Local TermInfo store seeded with TermInfo{term=1}
09:30:41,985 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower318: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@5e0e06c1
09:30:41,985 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - follower318: Moving last applied index from -1 to -1
09:30:41,985 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - follower318: empty journal: appending 0 entries
09:30:41,985 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower318: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:41,985 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - follower318: journal recovery completedin 202.2 μs with journalIndex=1
09:30:41,985 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower318: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:41,986 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader315: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/leader315/snapshot-000000006864FC41-39292DC0.v1
09:30:41,986 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader315: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/leader315/snapshot-000000006864FC41-39292DC0.v1
09:30:41,986 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader315: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/leader315/journal-v1-1.log
09:30:41,986 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader315: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/leader315/metadata-v1-1.log
09:30:41,986 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader315: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:41.959Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest2937760919628752783/leader315/snapshot-000000006864FC41-39292DC0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:41,986 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader315: local snapshot saved in 2.316 ms, deleting Pekko-persisted snapshots
09:30:41,987 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader315: Recovery completed in 3.114 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:41,989 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader315: Set currentTerm=1, votedFor=null
09:30:41,989 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader315: Local TermInfo store seeded with TermInfo{term=1}
09:30:41,989 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader315: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@39ccf246
09:30:41,989 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader315: Moving last applied index from -1 to -1
09:30:41,989 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader315: empty journal: appending 0 entries
09:30:41,989 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader315: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:41,989 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader315: journal recovery completedin 338.7 μs with journalIndex=1
09:30:41,990 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader315: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:42,342 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:30:42,342 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - leader315 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.82:17355, Removed)
09:30:42,342 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - leader315 (Follower): Received ElectionTimeout - switching to Candidate
09:30:42,342 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader315 (Candidate): Election: Candidate has following voting peers: [follower317, follower316]
09:30:42,347 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader315: Set currentTerm=2, votedFor=leader315
09:30:42,347 AM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - leader315 (Candidate): Starting new election term 2
09:30:42,347 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader315 (Candidate): Sending RequestVote{term=2, candidateId=leader315, lastLogIndex=-1, lastLogTerm=-1} to peer follower317
09:30:42,347 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader315 (Candidate): Sending RequestVote{term=2, candidateId=leader315, lastLogIndex=-1, lastLogTerm=-1} to peer follower316
09:30:42,347 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - leader315 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:30:42,348 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower317 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:30:42,348 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower317 (Follower): Cluster state: []
09:30:42,348 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower317 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader315, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:30:42,348 AM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - follower317 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader315, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:30:42,349 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower316 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:30:42,349 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower316 (Follower): Cluster state: []
09:30:42,349 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower316 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader315, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:30:42,349 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower316 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader315, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:30:42,351 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower317: Set currentTerm=2, votedFor=null
09:30:42,351 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower317 (Follower): In requestVote: RequestVote{term=2, candidateId=leader315, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:30:42,352 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower316: Set currentTerm=2, votedFor=null
09:30:42,352 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower316 (Follower): In requestVote: RequestVote{term=2, candidateId=leader315, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:30:42,355 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower317: Set currentTerm=2, votedFor=leader315
09:30:42,355 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower317 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:30:42,355 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader315 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
09:30:42,356 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader315 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
09:30:42,356 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader315 (Leader): Election: Leader has following peers: [follower318, follower317, follower316]
09:30:42,356 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader315 (Leader): Checking sendAppendEntries for follower follower318: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:42,356 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader315 (Leader): Checking sendAppendEntries for follower follower317: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:42,356 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader315 (Leader): Checking sendAppendEntries for follower follower316: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:42,356 AM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - follower318 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader315, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
09:30:42,356 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActorBehavior - leader315 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
09:30:42,356 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower317: Last sync leader does not match current leader leader315, need to catch up to -1
09:30:42,356 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader315 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower317 updated: matchIndex: -1, nextIndex: 0
09:30:42,356 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader315 (Leader): Checking sendAppendEntries for follower follower317: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:42.356] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower317] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower317, initialSyncDone=false]
09:30:42,356 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower316: Set currentTerm=2, votedFor=leader315
09:30:42,357 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower316 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:30:42,357 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader315 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower316 updated: matchIndex: -1, nextIndex: 0
09:30:42,357 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader315 (Leader): Checking sendAppendEntries for follower follower316: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:42,357 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower316: Last sync leader does not match current leader leader315, need to catch up to -1
[WARN] [07/02/2025 09:30:42.357] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower316] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower316, initialSyncDone=false]
09:30:42,359 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower318: Set currentTerm=2, votedFor=null
09:30:42,359 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower318: Last sync leader does not match current leader leader315, need to catch up to -1
09:30:42,359 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower318 updated: matchIndex: -1, nextIndex: 0
09:30:42,359 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Checking sendAppendEntries for follower follower318: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:42.359] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower318] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower318, initialSyncDone=false]
09:30:42,392 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
09:30:42,392 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting
09:30:42,392 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader315: Persist data index=0 term=2 command=zero
09:30:42,392 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader315: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
09:30:42,392 AM [leader315-writer-145] [DEBUG] JournalWriteTask - leader315: received 1 commands after 412.5 ms
09:30:42,392 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
09:30:42,393 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Checking sendAppendEntries for follower follower318: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:42,393 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): sendAppendEntries: 0 is present for follower follower318
09:30:42,393 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Sending AppendEntries to follower follower318: AppendEntries{term=2, leaderId=leader315, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:30:42,393 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Checking sendAppendEntries for follower follower317: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:42,393 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): sendAppendEntries: 0 is present for follower follower317
09:30:42,393 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Sending AppendEntries to follower follower317: AppendEntries{term=2, leaderId=leader315, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:30:42,393 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Checking sendAppendEntries for follower follower316: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:42,393 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): sendAppendEntries: 0 is present for follower follower316
09:30:42,393 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Sending AppendEntries to follower follower316: AppendEntries{term=2, leaderId=leader315, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:30:42,393 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader315: awaiting more completions to resolve 1 synchronized callback(s)
09:30:42,393 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower318 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader315, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:30:42,393 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower318 (Follower): Number of entries to be appended = 1
09:30:42,393 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower318 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:30:42,393 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower318 (Follower): Append entry to log zero
09:30:42,393 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower318: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
09:30:42,393 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower318 (Follower): Log size is now 1
09:30:42,393 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower318 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower318, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:30:42,393 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower318: Lagging 0 entries behind leader leader315 and reached -1 (of expected -1)
[WARN] [07/02/2025 09:30:42.393] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower318] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower318, initialSyncDone=true]
09:30:42,393 AM [follower318-writer-144] [DEBUG] JournalWriteTask - follower318: received 1 commands after 421.5 ms
09:30:42,393 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower316 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader315, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:30:42,393 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower316 (Follower): Number of entries to be appended = 1
09:30:42,393 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower316 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:30:42,393 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower316 (Follower): Append entry to log zero
09:30:42,393 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower316: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
09:30:42,394 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower316 (Follower): Log size is now 1
09:30:42,394 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower316 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower316, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:30:42,394 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower316: Lagging 0 entries behind leader leader315 and reached -1 (of expected -1)
[WARN] [07/02/2025 09:30:42.394] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower316] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower316, initialSyncDone=true]
09:30:42,394 AM [follower316-writer-142] [DEBUG] JournalWriteTask - follower316: received 1 commands after 431.0 ms
09:30:42,397 AM [leader315-writer-145] [DEBUG] RaftStorageCompleter - leader315: 1 completion(s) pending
09:30:42,397 AM [leader315-writer-145] [DEBUG] JournalWriteTask - leader315: completed 1 commands in 5.413 ms
09:30:42,397 AM [leader315-writer-145] [DEBUG] JournalWriteTask - leader315: waiting to receive commands
09:30:42,397 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader315: running 1 completion(s)
09:30:42,397 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader315: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=true}
09:30:42,398 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader315: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=0, term=2, command=zero, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@3c0c791e}
09:30:42,398 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower318 updated: matchIndex: 0, nextIndex: 1
09:30:42,398 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Checking sendAppendEntries for follower follower318: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:42,398 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower316 updated: matchIndex: 0, nextIndex: 1
09:30:42,398 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
09:30:42,398 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - leader315 (Leader): Setting last applied to 0
09:30:42,398 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - leader315: Moving last applied index from -1 to 0
09:30:42,398 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader315: Applying state for log index 0 data zero
09:30:42,398 AM [test-pekko.actor.default-dispatcher-7] [INFO] MockRaftActor - leader315: applyState called: zero
09:30:42,398 AM [leader315-writer-145] [DEBUG] JournalWriteTask - leader315: received 1 commands after 567.5 μs
09:30:42,398 AM [leader315-writer-145] [DEBUG] EntryJournalV1 - leader315: updated meta to JournalMeta[replayFrom=1, applyTo=1]
09:30:42,398 AM [leader315-writer-145] [DEBUG] RaftStorageCompleter - leader315: 1 completion(s) pending
09:30:42,398 AM [leader315-writer-145] [DEBUG] JournalWriteTask - leader315: completed 1 commands in 138.2 μs
09:30:42,398 AM [leader315-writer-145] [DEBUG] JournalWriteTask - leader315: waiting to receive commands
09:30:42,398 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Checking sendAppendEntries for follower follower316: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:42,398 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader315: running 1 completion(s)
09:30:42,398 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower316 (Follower): Commit index set to 0
09:30:42,398 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower316: Lagging 0 entries behind leader leader315 and reached 0 (of expected -1)
09:30:42,398 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower316 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:30:42,398 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower316 (Follower): Setting last applied to 0
09:30:42,398 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower316: Moving last applied index from -1 to 0
09:30:42,399 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower316: Applying state for log index 0 data zero
09:30:42,399 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower316: applyState called: zero
09:30:42,399 AM [follower316-writer-142] [DEBUG] RaftStorageCompleter - follower316: 1 completion(s) pending
09:30:42,399 AM [follower318-writer-144] [DEBUG] RaftStorageCompleter - follower318: 1 completion(s) pending
09:30:42,399 AM [follower316-writer-142] [DEBUG] JournalWriteTask - follower316: completed 1 commands in 5.123 ms
09:30:42,399 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - follower318: running 1 completion(s)
09:30:42,399 AM [follower318-writer-144] [DEBUG] JournalWriteTask - follower318: completed 1 commands in 5.422 ms
09:30:42,399 AM [follower316-writer-142] [DEBUG] JournalWriteTask - follower316: received 1 commands after 4.820 μs
09:30:42,399 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - follower318: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
09:30:42,399 AM [follower318-writer-144] [DEBUG] JournalWriteTask - follower318: waiting to receive commands
09:30:42,399 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - follower316: running 1 completion(s)
09:30:42,399 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - follower316: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
09:30:42,399 AM [follower316-writer-142] [DEBUG] EntryJournalV1 - follower316: updated meta to JournalMeta[replayFrom=1, applyTo=1]
09:30:42,399 AM [follower316-writer-142] [DEBUG] RaftStorageCompleter - follower316: 1 completion(s) pending
09:30:42,399 AM [follower316-writer-142] [DEBUG] JournalWriteTask - follower316: completed 1 commands in 139.5 μs
09:30:42,399 AM [follower316-writer-142] [DEBUG] JournalWriteTask - follower316: waiting to receive commands
09:30:42,399 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - follower316: running 1 completion(s)
09:30:42,472 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader315 (Leader): sendAppendEntries: 0 is present for follower follower317
09:30:42,472 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader315 (Leader): Sending AppendEntries to follower follower317: AppendEntries{term=2, leaderId=leader315, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
09:30:42,593 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): sendAppendEntries: 0 is present for follower follower317
09:30:42,593 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Sending AppendEntries to follower follower317: AppendEntries{term=2, leaderId=leader315, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
09:30:42,593 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower318 (Follower): Commit index set to 0
09:30:42,593 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower318: Lagging 0 entries behind leader leader315 and reached 0 (of expected -1)
09:30:42,593 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower318 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:30:42,593 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower318 (Follower): Setting last applied to 0
09:30:42,593 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower318: Moving last applied index from -1 to 0
09:30:42,593 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower318: Applying state for log index 0 data zero
09:30:42,593 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower318: applyState called: zero
09:30:42,593 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower316: Lagging 0 entries behind leader leader315 and reached 0 (of expected -1)
09:30:42,594 AM [follower318-writer-144] [DEBUG] JournalWriteTask - follower318: received 1 commands after 194.7 ms
09:30:42,594 AM [follower318-writer-144] [DEBUG] EntryJournalV1 - follower318: updated meta to JournalMeta[replayFrom=1, applyTo=1]
09:30:42,594 AM [follower318-writer-144] [DEBUG] RaftStorageCompleter - follower318: 1 completion(s) pending
09:30:42,594 AM [follower318-writer-144] [DEBUG] JournalWriteTask - follower318: completed 1 commands in 348.5 μs
09:30:42,594 AM [follower318-writer-144] [DEBUG] JournalWriteTask - follower318: waiting to receive commands
09:30:42,594 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - follower318: running 1 completion(s)
09:30:42,644 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending
09:30:42,644 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 starting
09:30:42,644 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader315: onShutDown
09:30:42,644 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader315: Initiating leader transfer
09:30:42,644 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower318: onLeaderTransitioning: LeaderTransitioning [leaderId=leader315]
09:30:42,645 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader315: pauseLeader successfully completed - doing transfer
09:30:42,645 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Leader - leader315 (Leader): Attempting to transfer leadership
09:30:42,645 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower316: onLeaderTransitioning: LeaderTransitioning [leaderId=leader315]
09:30:42,645 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Checking sendAppendEntries for follower follower318: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:42,645 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Checking sendAppendEntries for follower follower317: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:42,645 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): sendAppendEntries: 0 is present for follower follower317
09:30:42,645 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Checking sendAppendEntries for follower follower316: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:42,645 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower318: Lagging 0 entries behind leader leader315 and reached 0 (of expected -1)
09:30:42,645 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower316: Lagging 0 entries behind leader leader315 and reached 0 (of expected -1)
09:30:42,645 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Leader - leader315 (Leader): tryToCompleteLeadershipTransfer: followerId: follower318, matchIndex: 0, lastIndex: 0, isVoting: false
09:30:42,645 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Leader - leader315 (Leader): tryToCompleteLeadershipTransfer: followerId: follower316, matchIndex: 0, lastIndex: 0, isVoting: true
09:30:42,645 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Leader - leader315 (Leader): Follower's log matches - sending ElectionTimeout
09:30:42,645 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Checking sendAppendEntries for follower follower318: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:42,645 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Checking sendAppendEntries for follower follower317: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:42,645 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): sendAppendEntries: 0 is present for follower follower317
09:30:42,646 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader315 (Leader): Checking sendAppendEntries for follower follower316: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:42,646 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower318: Lagging 0 entries behind leader leader315 and reached 0 (of expected -1)
09:30:42,646 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower316: Lagging 0 entries behind leader leader315 and reached 0 (of expected -1)
09:30:42,646 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:30:42,646 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower316 (Follower): Received TimeoutNow - switching to Candidate
09:30:42,646 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower316 (Candidate): Election: Candidate has following voting peers: [leader315, follower317]
09:30:42,647 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Leader - leader315 (Leader): Leader transfer complete
09:30:42,647 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader315: leader transfer complete - waiting for new leader
09:30:42,650 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower316: Set currentTerm=3, votedFor=follower316
09:30:42,650 AM [test-pekko.actor.default-dispatcher-18] [INFO] Candidate - follower316 (Candidate): Starting new election term 3
09:30:42,650 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower316 (Candidate): Sending RequestVote{term=3, candidateId=follower316, lastLogIndex=0, lastLogTerm=2} to peer leader315
09:30:42,650 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower316 (Candidate): Sending RequestVote{term=3, candidateId=follower316, lastLogIndex=0, lastLogTerm=2} to peer follower317
09:30:42,650 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - follower316 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
09:30:42,650 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader315 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:30:42,650 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader315 (Leader): Cluster state: []
09:30:42,650 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader315 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower316, lastLogIndex=0, lastLogTerm=2} with higher term appears reachable, updating term.
09:30:42,650 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractLeader - leader315 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower316, lastLogIndex=0, lastLogTerm=2}" message is greater than leader's term 2 - switching to Follower
09:30:42,651 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower317 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:30:42,651 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower317 (Follower): Cluster state: []
09:30:42,651 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower317 (Follower): Candidate in requestVote:RequestVote{term=3, candidateId=follower316, lastLogIndex=0, lastLogTerm=2} with higher term appears reachable, updating term.
09:30:42,651 AM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - follower317 (Follower): Term 3 in "RequestVote{term=3, candidateId=follower316, lastLogIndex=0, lastLogTerm=2}" message is greater than follower's term 2 - updating term
09:30:42,653 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader315: Set currentTerm=3, votedFor=null
09:30:42,653 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader315 (Leader): Leadership transfer in progress - processing RequestVote
09:30:42,653 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader315 (Leader): In requestVote: RequestVote{term=3, candidateId=follower316, lastLogIndex=0, lastLogTerm=2} - currentTerm: 3, votedFor: null, lastIndex: 0, lastTerm: 2
09:30:42,654 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower317: Set currentTerm=3, votedFor=null
09:30:42,654 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower317 (Follower): In requestVote: RequestVote{term=3, candidateId=follower316, lastLogIndex=0, lastLogTerm=2} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
09:30:42,655 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader315: Set currentTerm=3, votedFor=follower316
09:30:42,655 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader315 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
09:30:42,655 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader315 (Leader) :- Switching from behavior Leader to Follower, election term: 3
09:30:42,656 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - follower316 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3
09:30:42,656 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - follower316 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1
09:30:42,656 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - follower316 (Leader): Election: Leader has following peers: [follower318, leader315, follower317]
09:30:42,656 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - follower316 (Leader): Checking sendAppendEntries for follower follower318: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:42,656 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower317: Set currentTerm=3, votedFor=follower316
09:30:42,656 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower317 (Follower): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
09:30:42,656 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - follower316 (Leader): Checking sendAppendEntries for follower leader315: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:42,656 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - follower316 (Leader): Checking sendAppendEntries for follower follower317: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:42,656 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - follower316 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
09:30:42,656 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - leader315: Last sync leader does not match current leader follower316, need to catch up to -1
09:30:42,656 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader315: leader changed to follower316
09:30:42,656 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorLeadershipTransferCohort - leader315: Successfully transferred leadership to follower316 in 11.96 ms
09:30:42,656 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader315: leader transfer succeeded - sending PoisonPill
09:30:42,656 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - follower316 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader315 updated: matchIndex: 0, nextIndex: 1
09:30:42,656 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - follower316 (Leader): Checking sendAppendEntries for follower leader315: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:42.657] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/leader315] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=leader315, initialSyncDone=false]
09:30:42,657 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - leader315: terminating thread VirtualThread[#740,leader315-writer-145]/waiting
09:30:42,657 AM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower318 (Follower): Term 3 in "AppendEntries{term=3, leaderId=follower316, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 2 - updating term
09:30:42,657 AM [leader315-writer-145] [DEBUG] JournalWriteTask - leader315: received 1 commands after 258.6 ms
09:30:42,657 AM [leader315-writer-145] [DEBUG] JournalWriteTask - leader315: completed 1 commands in 20.12 μs
09:30:42,657 AM [leader315-writer-145] [DEBUG] JournalWriteTask - leader315: journal writer stopped
09:30:42,657 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader315: journal closed
09:30:42,657 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - leader315: journal closed
09:30:42,657 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader315: stopped executor with 0 remaining tasks
09:30:42,657 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader315: stopped executor with 0 remaining tasks
[WARN] [07/02/2025 09:30:42.657] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/leader315] received dead letter from TestActor[pekko://test/user/follower316]: AppendEntries{term=3, leaderId=follower316, prevLogIndex=0, prevLogTerm=2, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
09:30:42,659 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower318: Set currentTerm=3, votedFor=null
09:30:42,659 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower318: Last sync leader does not match current leader follower316, need to catch up to -1
09:30:42,659 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - follower316 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower318 updated: matchIndex: 0, nextIndex: 1
09:30:42,659 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - follower316 (Leader): Checking sendAppendEntries for follower follower318: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:42.660] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower318] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower318, initialSyncDone=false]
09:30:42,660 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower318: Lagging 0 entries behind leader follower316 and reached 0 (of expected -1)
[WARN] [07/02/2025 09:30:42.660] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower318] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower318, initialSyncDone=true]
09:30:43,173 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower318: Lagging 0 entries behind leader follower316 and reached 0 (of expected -1)
09:30:43,173 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower317: Last sync leader does not match current leader follower316, need to catch up to -1
[WARN] [07/02/2025 09:30:43.173] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/leader315] received dead letter from TestActor[pekko://test/user/follower316]: AppendEntries{term=3, leaderId=follower316, prevLogIndex=0, prevLogTerm=2, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
09:30:43,173 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower316 (Leader): sendAppendEntries: 0 is present for follower follower317
09:30:43,173 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - follower316 (Leader): Sending AppendEntries to follower follower317: AppendEntries{term=3, leaderId=follower316, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
[WARN] [07/02/2025 09:30:43.173] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower317] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower317, initialSyncDone=false]
09:30:43,174 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower317 (Follower): handleAppendEntries: AppendEntries{term=3, leaderId=follower316, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
09:30:43,174 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower317 (Follower): Number of entries to be appended = 1
09:30:43,174 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower317 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:30:43,174 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower317 (Follower): Append entry to log zero
09:30:43,174 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower317: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=false} 
09:30:43,174 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower317 (Follower): Log size is now 1
09:30:43,174 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower317 (Follower): Commit index set to 0
09:30:43,174 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower317 (Follower): handleAppendEntries returning : AppendEntriesReply{term=3, success=true, followerId=follower317, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:30:43,174 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower317: Lagging 0 entries behind leader follower316 and reached 0 (of expected -1)
09:30:43,174 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower317 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:30:43,174 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower317 (Follower): Setting last applied to 0
09:30:43,174 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower317: Moving last applied index from -1 to 0
09:30:43,174 AM [follower317-writer-143] [DEBUG] JournalWriteTask - follower317: received 1 commands after 1.206 s
09:30:43,174 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower317: Applying state for log index 0 data zero
09:30:43,174 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower317: applyState called: zero
09:30:43,174 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - follower316 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower317 updated: matchIndex: 0, nextIndex: 1
[WARN] [07/02/2025 09:30:43.174] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower317] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower317, initialSyncDone=true]
09:30:43,174 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - follower316 (Leader): Checking sendAppendEntries for follower follower317: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:43,179 AM [follower317-writer-143] [DEBUG] RaftStorageCompleter - follower317: 1 completion(s) pending
09:30:43,179 AM [follower317-writer-143] [DEBUG] JournalWriteTask - follower317: completed 1 commands in 5.546 ms
09:30:43,179 AM [follower317-writer-143] [DEBUG] JournalWriteTask - follower317: received 1 commands after 4.691 μs
09:30:43,179 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower317: running 1 completion(s)
09:30:43,180 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower317: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
09:30:43,180 AM [follower317-writer-143] [DEBUG] EntryJournalV1 - follower317: updated meta to JournalMeta[replayFrom=1, applyTo=1]
09:30:43,180 AM [follower317-writer-143] [DEBUG] RaftStorageCompleter - follower317: 1 completion(s) pending
09:30:43,180 AM [follower317-writer-143] [DEBUG] JournalWriteTask - follower317: completed 1 commands in 131.0 μs
09:30:43,180 AM [follower317-writer-143] [DEBUG] JournalWriteTask - follower317: waiting to receive commands
09:30:43,180 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower317: running 1 completion(s)
09:30:43,198 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower317: onLeaderTransitioning: LeaderTransitioning [leaderId=leader315]
09:30:43,198 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 ending
09:30:43,198 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower317 starting
09:30:43,199 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower317: onShutDown
09:30:43,199 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - follower317: terminating thread VirtualThread[#738,follower317-writer-143]/waiting
09:30:43,199 AM [follower317-writer-143] [DEBUG] JournalWriteTask - follower317: received 1 commands after 19.51 ms
09:30:43,199 AM [follower317-writer-143] [DEBUG] JournalWriteTask - follower317: completed 1 commands in 18.10 μs
09:30:43,199 AM [follower317-writer-143] [DEBUG] JournalWriteTask - follower317: journal writer stopped
09:30:43,199 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower317: journal closed
09:30:43,199 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower317: journal closed
09:30:43,199 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower317: stopped executor with 0 remaining tasks
09:30:43,199 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower317: stopped executor with 0 remaining tasks
09:30:43,200 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower317 ending
09:30:43,200 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending
09:30:43,200 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower316-notifier319#1821581490]
09:30:43,211 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower316-collector320#1588265584]
09:30:43,211 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower316]
09:30:43,211 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - follower316: terminating thread VirtualThread[#737,follower316-writer-142]/waiting
09:30:43,211 AM [follower316-writer-142] [DEBUG] JournalWriteTask - follower316: received 1 commands after 812.1 ms
09:30:43,211 AM [follower316-writer-142] [DEBUG] JournalWriteTask - follower316: completed 1 commands in 66.00 μs
09:30:43,211 AM [follower316-writer-142] [DEBUG] JournalWriteTask - follower316: journal writer stopped
09:30:43,212 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower316: journal closed
09:30:43,212 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower316: journal closed
09:30:43,212 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower316: stopped executor with 0 remaining tasks
09:30:43,212 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower316: stopped executor with 0 remaining tasks
09:30:43,212 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower317-notifier321#1365857366]
09:30:43,212 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower317-collector322#-903706679]
09:30:43,212 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower317]
09:30:43,212 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower318-notifier323#-1542775854]
09:30:43,212 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower318-collector324#-906212665]
09:30:43,212 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower318]
09:30:43,213 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - follower318: terminating thread VirtualThread[#739,follower318-writer-144]/waiting
09:30:43,213 AM [follower318-writer-144] [DEBUG] JournalWriteTask - follower318: received 1 commands after 618.6 ms
09:30:43,213 AM [follower318-writer-144] [DEBUG] JournalWriteTask - follower318: completed 1 commands in 13.33 μs
09:30:43,213 AM [follower318-writer-144] [DEBUG] JournalWriteTask - follower318: journal writer stopped
09:30:43,213 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower318: journal closed
09:30:43,213 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower318: journal closed
09:30:43,213 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower318: stopped executor with 0 remaining tasks
09:30:43,213 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower318: stopped executor with 0 remaining tasks
09:30:43,213 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader315-notifier325#153092729]
09:30:43,213 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader315-collector326#-870409592]
09:30:43,213 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader315]
09:30:43,216 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers starting
[WARN] [07/02/2025 09:30:43.220] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader327]: org.opendaylight.controller.cluster.common.actor.Monitor@2a1b41e7
09:30:43,220 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader327: Starting recovery with journal batch size 1000
09:30:43,220 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader327: started executor
09:30:43,220 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader327: started executor
09:30:43,221 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader327: metadata journal open: replayFrom=1 applyTo=0
09:30:43,221 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader327: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:43,221 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader327: journal open: applyTo=0
09:30:43,221 AM [leader327-writer-146] [DEBUG] JournalWriteTask - leader327: journal writer started
09:30:43,221 AM [leader327-writer-146] [DEBUG] JournalWriteTask - leader327: waiting to receive commands
09:30:43,223 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest7543793683238594854/leader327/TermInfo.properties does not exist
09:30:43,223 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader327: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest7543793683238594854/leader327/journal-v1-1.log
09:30:43,223 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader327: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest7543793683238594854/leader327/metadata-v1-1.log
09:30:43,223 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader327: no eligible files found
09:30:43,223 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader327: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:43,225 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader327: Set currentTerm=0, votedFor=null
09:30:43,225 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader327: Local TermInfo store seeded with TermInfo{term=0}
09:30:43,225 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader327: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4dc686ca
09:30:43,225 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader327: Moving last applied index from -1 to -1
09:30:43,226 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - leader327: empty journal: appending 0 entries
09:30:43,226 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader327: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:43,226 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - leader327: journal recovery completedin 231.0 μs with journalIndex=1
09:30:43,226 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:30:43,226 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader327 (Follower): Received TimeoutNow - switching to Candidate
09:30:43,226 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader327 (Candidate): Election: Candidate has following voting peers: []
09:30:43,228 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader327: Set currentTerm=1, votedFor=leader327
09:30:43,228 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - leader327 (Candidate): Starting new election term 1
09:30:43,228 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader327 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
09:30:43,228 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader327 (Candidate): Received ElectionTimeout
09:30:43,228 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader327 (Leader): Election: Leader has following peers: []
09:30:43,228 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader327 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
09:30:43,229 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader327 starting
09:30:43,229 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader327: onShutDown
09:30:43,229 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRaftStorage - leader327: terminating thread VirtualThread[#741,leader327-writer-146]/waiting
09:30:43,229 AM [leader327-writer-146] [DEBUG] JournalWriteTask - leader327: received 1 commands after 7.838 ms
09:30:43,229 AM [leader327-writer-146] [DEBUG] JournalWriteTask - leader327: completed 1 commands in 22.25 μs
09:30:43,229 AM [leader327-writer-146] [DEBUG] JournalWriteTask - leader327: journal writer stopped
09:30:43,229 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader327: journal closed
09:30:43,229 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - leader327: journal closed
09:30:43,229 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader327: stopped executor with 0 remaining tasks
09:30:43,229 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader327: stopped executor with 0 remaining tasks
09:30:43,230 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader327 ending
09:30:43,230 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers ending
09:30:43,230 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader327-collector331#-842837360]
09:30:43,231 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader327]
09:30:43,232 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging starting
09:30:43,232 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [07/02/2025 09:30:43.233] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower333]: org.opendaylight.controller.cluster.common.actor.Monitor@48371cec
09:30:43,234 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower333: Starting recovery with journal batch size 1000
09:30:43,234 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower333: started executor
09:30:43,234 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower333: started executor
09:30:43,234 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower333: metadata journal open: replayFrom=1 applyTo=0
09:30:43,235 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower333: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:43,235 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower333: journal open: applyTo=0
09:30:43,235 AM [follower333-writer-147] [DEBUG] JournalWriteTask - follower333: journal writer started
09:30:43,235 AM [follower333-writer-147] [DEBUG] JournalWriteTask - follower333: waiting to receive commands
09:30:43,236 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower333/TermInfo.properties does not exist
09:30:43,236 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower333: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower333/journal-v1-1.log
09:30:43,236 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower333: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower333/metadata-v1-1.log
09:30:43,236 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower333: no eligible files found
09:30:43,236 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower333: SnapshotOffer called.
09:30:43,236 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower333: initializing from snapshot taken at 2025-07-02T09:30:43.232Z
09:30:43,236 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower333: Set currentTerm=1, votedFor=null
09:30:43,236 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - follower333: Updated server config: isVoting: true, peers: [PeerInfo [id=leader332, address=pekko://test/user/leader332, votingState=VOTING], PeerInfo [id=follower335, address=pekko://test/user/follower335, votingState=NON_VOTING], PeerInfo [id=follower334, address=pekko://test/user/follower334, votingState=VOTING]]
09:30:43,236 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for follower333 in 84.46 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:43,236 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower333: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:43.232Z
09:30:43,236 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower333: support() called
09:30:43,237 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower333: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower333/snapshot-000000006864FC43-0DD40A00.tmp
[WARN] [07/02/2025 09:30:43.237] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower334]: org.opendaylight.controller.cluster.common.actor.Monitor@a5a912c
09:30:43,238 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower334: Starting recovery with journal batch size 1000
09:30:43,238 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower334: started executor
09:30:43,238 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower334: started executor
09:30:43,239 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower334: metadata journal open: replayFrom=1 applyTo=0
09:30:43,240 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower334: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:43,240 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower334: journal open: applyTo=0
09:30:43,240 AM [follower334-writer-148] [DEBUG] JournalWriteTask - follower334: journal writer started
09:30:43,240 AM [follower334-writer-148] [DEBUG] JournalWriteTask - follower334: waiting to receive commands
09:30:43,241 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower333: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower333/snapshot-000000006864FC43-0DD40A00.v1
09:30:43,241 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower333: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower333/snapshot-000000006864FC43-0DD40A00.v1
09:30:43,241 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower333: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower333/journal-v1-1.log
09:30:43,241 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower334/TermInfo.properties does not exist
09:30:43,241 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower333: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower333/metadata-v1-1.log
09:30:43,241 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower333: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:43.232Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower333/snapshot-000000006864FC43-0DD40A00.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:43,241 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower334: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower334/journal-v1-1.log
09:30:43,241 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower334: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower334/metadata-v1-1.log
09:30:43,241 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower334: no eligible files found
09:30:43,241 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower333: local snapshot saved in 4.783 ms, deleting Pekko-persisted snapshots
09:30:43,241 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower334: SnapshotOffer called.
09:30:43,241 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower334: initializing from snapshot taken at 2025-07-02T09:30:43.232Z
09:30:43,241 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower334: Set currentTerm=1, votedFor=null
09:30:43,241 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - follower334: Updated server config: isVoting: true, peers: [PeerInfo [id=leader332, address=pekko://test/user/leader332, votingState=VOTING], PeerInfo [id=follower333, address=pekko://test/user/follower333, votingState=VOTING], PeerInfo [id=follower335, address=pekko://test/user/follower335, votingState=NON_VOTING]]
09:30:43,241 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for follower334 in 105.8 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:43,242 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower334: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:43.232Z
09:30:43,242 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower334: support() called
09:30:43,242 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower334: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower334/snapshot-000000006864FC43-0DD40A00.tmp
09:30:43,242 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower333: Recovery completed in 5.878 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [07/02/2025 09:30:43.243] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower335]: org.opendaylight.controller.cluster.common.actor.Monitor@6c6aed59
09:30:43,244 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower335: Starting recovery with journal batch size 1000
09:30:43,244 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower335: started executor
09:30:43,244 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower335: started executor
09:30:43,244 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower335: metadata journal open: replayFrom=1 applyTo=0
09:30:43,245 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower334: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower334/snapshot-000000006864FC43-0DD40A00.v1
09:30:43,245 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower334: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower334/snapshot-000000006864FC43-0DD40A00.v1
09:30:43,245 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower334: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower334/journal-v1-1.log
09:30:43,245 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower334: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower334/metadata-v1-1.log
09:30:43,245 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower334: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:43.232Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower334/snapshot-000000006864FC43-0DD40A00.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:43,245 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower334: local snapshot saved in 3.329 ms, deleting Pekko-persisted snapshots
09:30:43,245 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower334: Recovery completed in 4.016 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:43,245 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower333: Set currentTerm=1, votedFor=null
09:30:43,245 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower333: Local TermInfo store seeded with TermInfo{term=1}
09:30:43,245 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower333: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@7d13c156
09:30:43,245 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower333: Moving last applied index from -1 to -1
09:30:43,246 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower335: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:43,246 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower335: journal open: applyTo=0
09:30:43,246 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower333: empty journal: appending 0 entries
09:30:43,246 AM [follower335-writer-149] [DEBUG] JournalWriteTask - follower335: journal writer started
09:30:43,246 AM [follower335-writer-149] [DEBUG] JournalWriteTask - follower335: waiting to receive commands
09:30:43,246 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower333: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:43,246 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower333: journal recovery completedin 412.1 μs with journalIndex=1
09:30:43,246 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower335/TermInfo.properties does not exist
09:30:43,246 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower335: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower335/journal-v1-1.log
09:30:43,246 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower335: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower335/metadata-v1-1.log
09:30:43,246 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower335: no eligible files found
09:30:43,246 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower335: SnapshotOffer called.
09:30:43,246 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower335: initializing from snapshot taken at 2025-07-02T09:30:43.232Z
09:30:43,246 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower335: Set currentTerm=1, votedFor=null
09:30:43,246 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - follower335: Updated server config: isVoting: false, peers: [PeerInfo [id=leader332, address=pekko://test/user/leader332, votingState=VOTING], PeerInfo [id=follower333, address=pekko://test/user/follower333, votingState=VOTING], PeerInfo [id=follower334, address=pekko://test/user/follower334, votingState=VOTING]]
09:30:43,246 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower333: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:43,247 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for follower335 in 73.81 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:43,247 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower335: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:43.232Z
09:30:43,247 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower335: support() called
09:30:43,247 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower335: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower335/snapshot-000000006864FC43-0DD40A00.tmp
09:30:43,247 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower334: Set currentTerm=1, votedFor=null
09:30:43,247 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower334: Local TermInfo store seeded with TermInfo{term=1}
09:30:43,247 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower334: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@207f6ae0
09:30:43,247 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower334: Moving last applied index from -1 to -1
09:30:43,248 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower334: empty journal: appending 0 entries
09:30:43,248 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower334: updated meta to JournalMeta[replayFrom=1, applyTo=0]
[WARN] [07/02/2025 09:30:43.248] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader332]: org.opendaylight.controller.cluster.common.actor.Monitor@7afaa93a
09:30:43,248 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower334: journal recovery completedin 255.4 μs with journalIndex=1
09:30:43,248 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower334: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:43,248 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - leader332: Starting recovery with journal batch size 1000
09:30:43,248 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader332: started executor
09:30:43,249 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader332: started executor
09:30:43,249 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader332: metadata journal open: replayFrom=1 applyTo=0
09:30:43,249 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader332: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:43,249 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - leader332: journal open: applyTo=0
09:30:43,249 AM [leader332-writer-150] [DEBUG] JournalWriteTask - leader332: journal writer started
09:30:43,249 AM [leader332-writer-150] [DEBUG] JournalWriteTask - leader332: waiting to receive commands
09:30:43,250 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/leader332/TermInfo.properties does not exist
09:30:43,250 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader332: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/leader332/journal-v1-1.log
09:30:43,250 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader332: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/leader332/metadata-v1-1.log
09:30:43,250 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader332: no eligible files found
09:30:43,250 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - leader332: SnapshotOffer called.
09:30:43,250 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - leader332: initializing from snapshot taken at 2025-07-02T09:30:43.232Z
09:30:43,250 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader332: Set currentTerm=1, votedFor=null
09:30:43,250 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - leader332: Updated server config: isVoting: true, peers: [PeerInfo [id=follower333, address=pekko://test/user/follower333, votingState=VOTING], PeerInfo [id=follower335, address=pekko://test/user/follower335, votingState=NON_VOTING], PeerInfo [id=follower334, address=pekko://test/user/follower334, votingState=VOTING]]
09:30:43,250 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - Recovery snapshot applied for leader332 in 61.01 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:43,250 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader332: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:43.232Z
09:30:43,250 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - leader332: support() called
09:30:43,250 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader332: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/leader332/snapshot-000000006864FC43-0DD40A00.tmp
09:30:43,252 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower335: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower335/snapshot-000000006864FC43-0DD40A00.v1
09:30:43,252 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower335: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower335/snapshot-000000006864FC43-0DD40A00.v1
09:30:43,252 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower335: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower335/journal-v1-1.log
09:30:43,252 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower335: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower335/metadata-v1-1.log
09:30:43,252 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower335: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:43.232Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/follower335/snapshot-000000006864FC43-0DD40A00.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:43,253 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower335: local snapshot saved in 5.942 ms, deleting Pekko-persisted snapshots
09:30:43,253 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader332: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/leader332/snapshot-000000006864FC43-0DD40A00.v1
09:30:43,253 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader332: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/leader332/snapshot-000000006864FC43-0DD40A00.v1
09:30:43,253 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader332: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/leader332/journal-v1-1.log
09:30:43,253 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader332: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/leader332/metadata-v1-1.log
09:30:43,253 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader332: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:43.232Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest12130353756960967184/leader332/snapshot-000000006864FC43-0DD40A00.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:43,253 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader332: local snapshot saved in 3.059 ms, deleting Pekko-persisted snapshots
09:30:43,253 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower335: Recovery completed in 6.823 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:43,256 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower335: Set currentTerm=1, votedFor=null
09:30:43,256 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower335: Local TermInfo store seeded with TermInfo{term=1}
09:30:43,256 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower335: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@1d127cb4
09:30:43,256 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower335: Moving last applied index from -1 to -1
09:30:43,256 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower335: empty journal: appending 0 entries
09:30:43,256 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower335: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:43,256 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower335: journal recovery completedin 371.4 μs with journalIndex=1
09:30:43,257 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader332: Recovery completed in 6.696 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:43,257 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower335: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:43,261 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader332: Set currentTerm=1, votedFor=null
09:30:43,261 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader332: Local TermInfo store seeded with TermInfo{term=1}
09:30:43,261 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader332: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@6e9e3385
09:30:43,261 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader332: Moving last applied index from -1 to -1
09:30:43,262 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - leader332: empty journal: appending 0 entries
09:30:43,262 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader332: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:43,262 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - leader332: journal recovery completedin 1.041 ms with journalIndex=1
09:30:43,263 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader332: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:43,612 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:30:43,612 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - leader332 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.82:17355, Removed)
09:30:43,613 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - leader332 (Follower): Received ElectionTimeout - switching to Candidate
09:30:43,613 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader332 (Candidate): Election: Candidate has following voting peers: [follower333, follower334]
09:30:43,627 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader332: Set currentTerm=2, votedFor=leader332
09:30:43,627 AM [test-pekko.actor.default-dispatcher-12] [INFO] Candidate - leader332 (Candidate): Starting new election term 2
09:30:43,627 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader332 (Candidate): Sending RequestVote{term=2, candidateId=leader332, lastLogIndex=-1, lastLogTerm=-1} to peer follower333
09:30:43,627 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader332 (Candidate): Sending RequestVote{term=2, candidateId=leader332, lastLogIndex=-1, lastLogTerm=-1} to peer follower334
09:30:43,627 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActorBehavior - leader332 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:30:43,627 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower333 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:30:43,628 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower333 (Follower): Cluster state: []
09:30:43,628 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower333 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader332, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:30:43,628 AM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - follower333 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader332, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:30:43,628 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower334 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:30:43,628 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower334 (Follower): Cluster state: []
09:30:43,628 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower334 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader332, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:30:43,628 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower334 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader332, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:30:43,631 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower333: Set currentTerm=2, votedFor=null
09:30:43,631 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower333 (Follower): In requestVote: RequestVote{term=2, candidateId=leader332, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:30:43,631 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower334: Set currentTerm=2, votedFor=null
09:30:43,632 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower334 (Follower): In requestVote: RequestVote{term=2, candidateId=leader332, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:30:43,635 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower333: Set currentTerm=2, votedFor=leader332
09:30:43,635 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower333 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:30:43,635 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader332 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
09:30:43,635 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader332 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
09:30:43,635 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): Election: Leader has following peers: [follower333, follower335, follower334]
09:30:43,635 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): Checking sendAppendEntries for follower follower333: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:43,635 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): Checking sendAppendEntries for follower follower335: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:43,635 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): Checking sendAppendEntries for follower follower334: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:43,635 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader332 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
09:30:43,635 AM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower335 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader332, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
09:30:43,635 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower333: Last sync leader does not match current leader leader332, need to catch up to -1
09:30:43,636 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader332 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower333 updated: matchIndex: -1, nextIndex: 0
09:30:43,636 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader332 (Leader): Checking sendAppendEntries for follower follower333: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:43.636] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower333] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower333, initialSyncDone=false]
09:30:43,636 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower334: Set currentTerm=2, votedFor=leader332
09:30:43,636 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower334 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:30:43,636 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower334: Last sync leader does not match current leader leader332, need to catch up to -1
09:30:43,636 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader332 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower334 updated: matchIndex: -1, nextIndex: 0
09:30:43,636 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader332 (Leader): Checking sendAppendEntries for follower follower334: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:43.636] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower334] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower334, initialSyncDone=false]
09:30:43,640 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower335: Set currentTerm=2, votedFor=null
09:30:43,640 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower335: Last sync leader does not match current leader leader332, need to catch up to -1
09:30:43,640 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader332 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower335 updated: matchIndex: -1, nextIndex: 0
09:30:43,640 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader332 (Leader): Checking sendAppendEntries for follower follower335: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:43.640] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower335] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower335, initialSyncDone=false]
09:30:43,678 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
09:30:43,678 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
09:30:43,679 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
09:30:43,679 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting
09:30:43,679 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader332: Persist data index=0 term=2 command=zero
09:30:43,679 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader332: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
09:30:43,679 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
09:30:43,679 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): Checking sendAppendEntries for follower follower333: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:43,679 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): sendAppendEntries: 0 is present for follower follower333
09:30:43,679 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): Sending AppendEntries to follower follower333: AppendEntries{term=2, leaderId=leader332, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:30:43,679 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): Checking sendAppendEntries for follower follower335: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:43,679 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): sendAppendEntries: 0 is present for follower follower335
09:30:43,679 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): Sending AppendEntries to follower follower335: AppendEntries{term=2, leaderId=leader332, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:30:43,679 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): Checking sendAppendEntries for follower follower334: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:43,679 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): sendAppendEntries: 0 is present for follower follower334
09:30:43,679 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): Sending AppendEntries to follower follower334: AppendEntries{term=2, leaderId=leader332, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:30:43,679 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader332: awaiting more completions to resolve 1 synchronized callback(s)
09:30:43,679 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower335 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader332, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:30:43,679 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower335 (Follower): Number of entries to be appended = 1
09:30:43,679 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower335 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:30:43,679 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower333 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader332, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
09:30:43,679 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower335 (Follower): Append entry to log zero
09:30:43,679 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower333 (Follower): Number of entries to be appended = 1
09:30:43,679 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower335: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
09:30:43,679 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower333 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:30:43,679 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower333 (Follower): Append entry to log zero
09:30:43,680 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower333: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
09:30:43,679 AM [leader332-writer-150] [DEBUG] JournalWriteTask - leader332: received 1 commands after 430.1 ms
09:30:43,680 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower335 (Follower): Log size is now 1
09:30:43,680 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower335 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower335, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:30:43,680 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower335: Lagging 0 entries behind leader leader332 and reached -1 (of expected -1)
09:30:43,680 AM [follower333-writer-147] [DEBUG] JournalWriteTask - follower333: received 1 commands after 444.6 ms
09:30:43,680 AM [follower335-writer-149] [DEBUG] JournalWriteTask - follower335: received 1 commands after 433.8 ms
[WARN] [07/02/2025 09:30:43.680] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower335] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower335, initialSyncDone=true]
09:30:43,680 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower333 (Follower): Log size is now 1
09:30:43,680 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower333 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower333, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:30:43,680 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower333: Lagging 0 entries behind leader leader332 and reached -1 (of expected -1)
[WARN] [07/02/2025 09:30:43.680] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower333] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower333, initialSyncDone=true]
09:30:43,683 AM [leader332-writer-150] [DEBUG] RaftStorageCompleter - leader332: 1 completion(s) pending
09:30:43,683 AM [follower333-writer-147] [DEBUG] RaftStorageCompleter - follower333: 1 completion(s) pending
09:30:43,683 AM [follower335-writer-149] [DEBUG] RaftStorageCompleter - follower335: 1 completion(s) pending
09:30:43,683 AM [leader332-writer-150] [DEBUG] JournalWriteTask - leader332: completed 1 commands in 3.080 ms
09:30:43,683 AM [leader332-writer-150] [DEBUG] JournalWriteTask - leader332: waiting to receive commands
09:30:43,683 AM [follower333-writer-147] [DEBUG] JournalWriteTask - follower333: completed 1 commands in 2.976 ms
09:30:43,683 AM [follower333-writer-147] [DEBUG] JournalWriteTask - follower333: waiting to receive commands
09:30:43,683 AM [follower335-writer-149] [DEBUG] JournalWriteTask - follower335: completed 1 commands in 2.956 ms
09:30:43,683 AM [follower335-writer-149] [DEBUG] JournalWriteTask - follower335: waiting to receive commands
09:30:43,683 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - follower335: running 1 completion(s)
09:30:43,683 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower335: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
09:30:43,683 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - follower333: running 1 completion(s)
09:30:43,683 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower333: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader332: running 1 completion(s)
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader332: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=true}
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader332: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=0, term=2, command=zero, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@73833b9d}
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower335 updated: matchIndex: 0, nextIndex: 1
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): Checking sendAppendEntries for follower follower335: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower333 updated: matchIndex: 0, nextIndex: 1
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader332 (Leader): Setting last applied to 0
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader332: Moving last applied index from -1 to 0
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader332: Applying state for log index 0 data zero
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader332: applyState called: zero
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader332 (Leader): Checking sendAppendEntries for follower follower333: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:43,683 AM [leader332-writer-150] [DEBUG] JournalWriteTask - leader332: received 1 commands after 514.8 μs
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower333 (Follower): Commit index set to 0
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower333: Lagging 0 entries behind leader leader332 and reached 0 (of expected -1)
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower333 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower333 (Follower): Setting last applied to 0
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower333: Moving last applied index from -1 to 0
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower333: Applying state for log index 0 data zero
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower333: applyState called: zero
09:30:43,683 AM [leader332-writer-150] [DEBUG] EntryJournalV1 - leader332: updated meta to JournalMeta[replayFrom=1, applyTo=1]
09:30:43,683 AM [leader332-writer-150] [DEBUG] RaftStorageCompleter - leader332: 1 completion(s) pending
09:30:43,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader332: running 1 completion(s)
09:30:43,683 AM [leader332-writer-150] [DEBUG] JournalWriteTask - leader332: completed 1 commands in 170.5 μs
09:30:43,683 AM [leader332-writer-150] [DEBUG] JournalWriteTask - leader332: waiting to receive commands
09:30:43,683 AM [follower333-writer-147] [DEBUG] JournalWriteTask - follower333: received 1 commands after 709.1 μs
09:30:43,684 AM [follower333-writer-147] [DEBUG] EntryJournalV1 - follower333: updated meta to JournalMeta[replayFrom=1, applyTo=1]
09:30:43,684 AM [follower333-writer-147] [DEBUG] RaftStorageCompleter - follower333: 1 completion(s) pending
09:30:43,684 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - follower333: running 1 completion(s)
09:30:43,684 AM [follower333-writer-147] [DEBUG] JournalWriteTask - follower333: completed 1 commands in 196.6 μs
09:30:43,684 AM [follower333-writer-147] [DEBUG] JournalWriteTask - follower333: waiting to receive commands
09:30:43,752 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader332 (Leader): sendAppendEntries: 0 is present for follower follower334
09:30:43,752 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader332 (Leader): Sending AppendEntries to follower follower334: AppendEntries{term=2, leaderId=leader332, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
09:30:43,873 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader332 (Leader): sendAppendEntries: 0 is present for follower follower334
09:30:43,873 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower333: Lagging 0 entries behind leader leader332 and reached 0 (of expected -1)
09:30:43,873 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader332 (Leader): Sending AppendEntries to follower follower334: AppendEntries{term=2, leaderId=leader332, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
09:30:43,873 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower335 (Follower): Commit index set to 0
09:30:43,873 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower335: Lagging 0 entries behind leader leader332 and reached 0 (of expected -1)
09:30:43,873 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower335 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:30:43,873 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower335 (Follower): Setting last applied to 0
09:30:43,873 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower335: Moving last applied index from -1 to 0
09:30:43,873 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower335: Applying state for log index 0 data zero
09:30:43,873 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower335: applyState called: zero
09:30:43,873 AM [follower335-writer-149] [DEBUG] JournalWriteTask - follower335: received 1 commands after 190.6 ms
09:30:43,874 AM [follower335-writer-149] [DEBUG] EntryJournalV1 - follower335: updated meta to JournalMeta[replayFrom=1, applyTo=1]
09:30:43,874 AM [follower335-writer-149] [DEBUG] RaftStorageCompleter - follower335: 1 completion(s) pending
09:30:43,874 AM [follower335-writer-149] [DEBUG] JournalWriteTask - follower335: completed 1 commands in 316.1 μs
09:30:43,874 AM [follower335-writer-149] [DEBUG] JournalWriteTask - follower335: waiting to receive commands
09:30:43,874 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - follower335: running 1 completion(s)
09:30:43,880 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending
09:30:43,880 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
09:30:43,880 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
09:30:43,880 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader332: onRequestLeadership RequestLeadership [requestedFollowerId=follower334, replyTo=Actor[pekko://test/user/$c#-428882200]]
09:30:43,880 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader332: Initiating leader transfer
09:30:43,881 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower333: onLeaderTransitioning: LeaderTransitioning [leaderId=leader332]
09:30:43,882 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorLeadershipTransferCohort - leader332: pauseLeader successfully completed - doing transfer
09:30:43,882 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Leader - leader332 (Leader): Attempting to transfer leadership
09:30:43,882 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader332 (Leader): Checking sendAppendEntries for follower follower333: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:43,882 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader332 (Leader): Checking sendAppendEntries for follower follower335: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:43,882 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader332 (Leader): Checking sendAppendEntries for follower follower334: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:30:43,882 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader332 (Leader): sendAppendEntries: 0 is present for follower follower334
09:30:43,882 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower335: Lagging 0 entries behind leader leader332 and reached 0 (of expected -1)
09:30:43,882 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower335: onLeaderTransitioning: LeaderTransitioning [leaderId=leader332]
09:30:43,882 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower334: onLeaderTransitioning: LeaderTransitioning [leaderId=leader332]
09:30:43,882 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower333: Lagging 0 entries behind leader leader332 and reached 0 (of expected -1)
09:30:43,993 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower333: Lagging 0 entries behind leader leader332 and reached 0 (of expected -1)
09:30:43,993 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower335: Lagging 0 entries behind leader leader332 and reached 0 (of expected -1)
09:30:44,112 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower333: Lagging 0 entries behind leader leader332 and reached 0 (of expected -1)
09:30:44,112 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower335: Lagging 0 entries behind leader leader332 and reached 0 (of expected -1)
09:30:44,232 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorLeadershipTransferCohort - leader332: leader transfer aborted
09:30:44,232 AM [test-pekko.actor.default-dispatcher-12] [WARN] RaftActorLeadershipTransferCohort - leader332: Failed to transfer leadership in 351.6 ms
09:30:44,232 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader332: LeadershipTransfer request from follower334 failed
09:30:44,232 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Leader - leader332 (Leader): Leadership transfer expired
09:30:44,233 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower335: Lagging 0 entries behind leader leader332 and reached 0 (of expected -1)
09:30:44,233 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower333: Lagging 0 entries behind leader leader332 and reached 0 (of expected -1)
09:30:44,233 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging ending
09:30:44,233 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower333-notifier336#1317993915]
09:30:44,235 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower333-collector337#-1326110258]
09:30:44,235 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower333]
09:30:44,235 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRaftStorage - follower333: terminating thread VirtualThread[#742,follower333-writer-147]/waiting
09:30:44,235 AM [follower333-writer-147] [DEBUG] JournalWriteTask - follower333: received 1 commands after 551.6 ms
09:30:44,235 AM [follower333-writer-147] [DEBUG] JournalWriteTask - follower333: completed 1 commands in 29.09 μs
09:30:44,235 AM [follower333-writer-147] [DEBUG] JournalWriteTask - follower333: journal writer stopped
09:30:44,236 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower333: journal closed
09:30:44,236 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower333: journal closed
09:30:44,236 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower333: stopped executor with 0 remaining tasks
09:30:44,236 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower333: stopped executor with 0 remaining tasks
09:30:44,236 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower334-notifier338#2135689424]
09:30:44,236 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower334-collector339#1998093423]
09:30:44,236 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower334]
09:30:44,237 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRaftStorage - follower334: terminating thread VirtualThread[#743,follower334-writer-148]/waiting
09:30:44,237 AM [follower334-writer-148] [DEBUG] JournalWriteTask - follower334: received 1 commands after 996.6 ms
09:30:44,237 AM [follower334-writer-148] [DEBUG] JournalWriteTask - follower334: completed 1 commands in 12.88 μs
09:30:44,237 AM [follower334-writer-148] [DEBUG] JournalWriteTask - follower334: journal writer stopped
09:30:44,237 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower334: journal closed
09:30:44,237 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower334: journal closed
09:30:44,237 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower334: stopped executor with 0 remaining tasks
09:30:44,237 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower334: stopped executor with 0 remaining tasks
09:30:44,237 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower335-notifier340#-1651315438]
09:30:44,237 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower335-collector341#-1275163983]
09:30:44,238 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower335]
09:30:44,238 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRaftStorage - follower335: terminating thread VirtualThread[#744,follower335-writer-149]/waiting
09:30:44,238 AM [follower335-writer-149] [DEBUG] JournalWriteTask - follower335: received 1 commands after 364.1 ms
09:30:44,238 AM [follower335-writer-149] [DEBUG] JournalWriteTask - follower335: completed 1 commands in 10.03 μs
09:30:44,238 AM [follower335-writer-149] [DEBUG] JournalWriteTask - follower335: journal writer stopped
09:30:44,238 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower335: journal closed
09:30:44,238 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower335: journal closed
09:30:44,238 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower335: stopped executor with 0 remaining tasks
09:30:44,238 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower335: stopped executor with 0 remaining tasks
09:30:44,238 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader332-notifier342#-1900234901]
09:30:44,238 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader332-collector343#-1768253702]
09:30:44,239 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader332]
09:30:44,239 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - leader332: terminating thread VirtualThread[#745,leader332-writer-150]/waiting
09:30:44,239 AM [leader332-writer-150] [DEBUG] JournalWriteTask - leader332: received 1 commands after 555.7 ms
09:30:44,239 AM [leader332-writer-150] [DEBUG] JournalWriteTask - leader332: completed 1 commands in 10.07 μs
09:30:44,239 AM [leader332-writer-150] [DEBUG] JournalWriteTask - leader332: journal writer stopped
09:30:44,239 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader332: journal closed
09:30:44,239 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader332: journal closed
09:30:44,239 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader332: stopped executor with 0 remaining tasks
09:30:44,239 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader332: stopped executor with 0 remaining tasks
09:30:44,240 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$c#-428882200]
09:30:44,242 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown starting
09:30:44,242 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [07/02/2025 09:30:44.244] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower345]: org.opendaylight.controller.cluster.common.actor.Monitor@112ac699
09:30:44,245 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower345: Starting recovery with journal batch size 1000
09:30:44,245 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower345: started executor
09:30:44,245 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower345: started executor
09:30:44,246 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower345: metadata journal open: replayFrom=1 applyTo=0
09:30:44,247 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower345: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:44,247 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower345: journal open: applyTo=0
09:30:44,247 AM [follower345-writer-151] [DEBUG] JournalWriteTask - follower345: journal writer started
09:30:44,247 AM [follower345-writer-151] [DEBUG] JournalWriteTask - follower345: waiting to receive commands
09:30:44,247 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower345/TermInfo.properties does not exist
09:30:44,248 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower345: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower345/journal-v1-1.log
09:30:44,248 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower345: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower345/metadata-v1-1.log
09:30:44,248 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower345: no eligible files found
09:30:44,248 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower345: SnapshotOffer called.
09:30:44,248 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower345: initializing from snapshot taken at 2025-07-02T09:30:44.242Z
09:30:44,248 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower345: Set currentTerm=1, votedFor=null
09:30:44,248 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - follower345: Updated server config: isVoting: true, peers: [PeerInfo [id=leader344, address=pekko://test/user/leader344, votingState=VOTING], PeerInfo [id=follower347, address=pekko://test/user/follower347, votingState=NON_VOTING], PeerInfo [id=follower346, address=pekko://test/user/follower346, votingState=VOTING]]
09:30:44,248 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for follower345 in 105.2 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:44,248 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower345: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:44.242Z
09:30:44,248 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower345: support() called
09:30:44,248 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower345: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower345/snapshot-000000006864FC44-0E6CA080.tmp
[WARN] [07/02/2025 09:30:44.249] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower346]: org.opendaylight.controller.cluster.common.actor.Monitor@448eb5fe
09:30:44,249 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - follower346: Starting recovery with journal batch size 1000
09:30:44,249 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower346: started executor
09:30:44,249 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower346: started executor
09:30:44,250 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower346: metadata journal open: replayFrom=1 applyTo=0
09:30:44,250 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower346: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:44,250 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower346: journal open: applyTo=0
09:30:44,250 AM [follower346-writer-152] [DEBUG] JournalWriteTask - follower346: journal writer started
09:30:44,250 AM [follower346-writer-152] [DEBUG] JournalWriteTask - follower346: waiting to receive commands
09:30:44,251 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower346/TermInfo.properties does not exist
09:30:44,251 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower346: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower346/journal-v1-1.log
09:30:44,251 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower346: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower346/metadata-v1-1.log
09:30:44,251 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower346: no eligible files found
09:30:44,251 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower346: SnapshotOffer called.
09:30:44,251 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower346: initializing from snapshot taken at 2025-07-02T09:30:44.242Z
09:30:44,251 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower346: Set currentTerm=1, votedFor=null
09:30:44,251 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - follower346: Updated server config: isVoting: true, peers: [PeerInfo [id=leader344, address=pekko://test/user/leader344, votingState=VOTING], PeerInfo [id=follower347, address=pekko://test/user/follower347, votingState=NON_VOTING], PeerInfo [id=follower345, address=pekko://test/user/follower345, votingState=VOTING]]
09:30:44,251 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - Recovery snapshot applied for follower346 in 166.0 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:44,251 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower346: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:44.242Z
09:30:44,251 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower346: support() called
09:30:44,251 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower346: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower346/snapshot-000000006864FC44-0E6CA080.tmp
[WARN] [07/02/2025 09:30:44.252] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower347]: org.opendaylight.controller.cluster.common.actor.Monitor@27e73a16
09:30:44,253 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower347: Starting recovery with journal batch size 1000
09:30:44,253 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower347: started executor
09:30:44,253 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower347: started executor
09:30:44,254 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower347: metadata journal open: replayFrom=1 applyTo=0
09:30:44,254 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower345: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower345/snapshot-000000006864FC44-0E6CA080.v1
09:30:44,254 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower345: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower345/snapshot-000000006864FC44-0E6CA080.v1
09:30:44,254 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower345: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower345/journal-v1-1.log
09:30:44,254 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower345: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower345/metadata-v1-1.log
09:30:44,254 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower345: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:44.242Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower345/snapshot-000000006864FC44-0E6CA080.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:44,254 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower345: local snapshot saved in 6.341 ms, deleting Pekko-persisted snapshots
09:30:44,255 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower347: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:44,255 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower347: journal open: applyTo=0
09:30:44,255 AM [follower347-writer-153] [DEBUG] JournalWriteTask - follower347: journal writer started
09:30:44,255 AM [follower347-writer-153] [DEBUG] JournalWriteTask - follower347: waiting to receive commands
09:30:44,255 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower345: Recovery completed in 7.460 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:44,256 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower347/TermInfo.properties does not exist
09:30:44,256 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower347: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower347/journal-v1-1.log
09:30:44,256 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower347: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower347/metadata-v1-1.log
09:30:44,256 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower347: no eligible files found
09:30:44,256 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - follower347: SnapshotOffer called.
09:30:44,256 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - follower347: initializing from snapshot taken at 2025-07-02T09:30:44.242Z
09:30:44,256 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower347: Set currentTerm=1, votedFor=null
09:30:44,256 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - follower347: Updated server config: isVoting: false, peers: [PeerInfo [id=leader344, address=pekko://test/user/leader344, votingState=VOTING], PeerInfo [id=follower346, address=pekko://test/user/follower346, votingState=VOTING], PeerInfo [id=follower345, address=pekko://test/user/follower345, votingState=VOTING]]
09:30:44,257 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - Recovery snapshot applied for follower347 in 129.0 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:44,257 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower347: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:44.242Z
09:30:44,257 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower347: support() called
09:30:44,257 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower347: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower347/snapshot-000000006864FC44-0E6CA080.tmp
09:30:44,257 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower346: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower346/snapshot-000000006864FC44-0E6CA080.v1
09:30:44,258 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower346: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower346/snapshot-000000006864FC44-0E6CA080.v1
09:30:44,258 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower346: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower346/journal-v1-1.log
09:30:44,258 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower346: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower346/metadata-v1-1.log
09:30:44,258 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower346: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:44.242Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower346/snapshot-000000006864FC44-0E6CA080.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:44,258 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower346: local snapshot saved in 6.480 ms, deleting Pekko-persisted snapshots
09:30:44,258 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower346: Recovery completed in 7.229 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [07/02/2025 09:30:44.260] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader344]: org.opendaylight.controller.cluster.common.actor.Monitor@79ba0802
09:30:44,260 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - leader344: Starting recovery with journal batch size 1000
09:30:44,260 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader344: started executor
09:30:44,260 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader344: started executor
09:30:44,260 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower347: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower347/snapshot-000000006864FC44-0E6CA080.v1
09:30:44,260 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower345: Set currentTerm=1, votedFor=null
09:30:44,260 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower345: Local TermInfo store seeded with TermInfo{term=1}
09:30:44,260 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower345: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@584868d6
09:30:44,260 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower347: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower347/snapshot-000000006864FC44-0E6CA080.v1
09:30:44,261 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower345: Moving last applied index from -1 to -1
09:30:44,261 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader344: metadata journal open: replayFrom=1 applyTo=0
09:30:44,261 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower347: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower347/journal-v1-1.log
09:30:44,261 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower347: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower347/metadata-v1-1.log
09:30:44,261 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower347: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:44.242Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/follower347/snapshot-000000006864FC44-0E6CA080.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:44,261 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower347: local snapshot saved in 3.936 ms, deleting Pekko-persisted snapshots
09:30:44,261 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - follower345: empty journal: appending 0 entries
09:30:44,261 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower345: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:44,261 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower347: Recovery completed in 4.685 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:44,261 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower346: Set currentTerm=1, votedFor=null
09:30:44,261 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower346: Local TermInfo store seeded with TermInfo{term=1}
09:30:44,261 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower346: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@3ecabd3e
09:30:44,261 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower346: Moving last applied index from -1 to -1
09:30:44,261 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower346: empty journal: appending 0 entries
09:30:44,261 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower346: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:44,261 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower346: journal recovery completedin 273.5 μs with journalIndex=1
09:30:44,261 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - follower345: journal recovery completedin 349.9 μs with journalIndex=1
09:30:44,262 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower346: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:44,262 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower345: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:44,262 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader344: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:30:44,262 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - leader344: journal open: applyTo=0
09:30:44,262 AM [leader344-writer-154] [DEBUG] JournalWriteTask - leader344: journal writer started
09:30:44,262 AM [leader344-writer-154] [DEBUG] JournalWriteTask - leader344: waiting to receive commands
09:30:44,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower347: Set currentTerm=1, votedFor=null
09:30:44,263 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower347: Local TermInfo store seeded with TermInfo{term=1}
09:30:44,263 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/leader344/TermInfo.properties does not exist
09:30:44,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower347: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@495abe52
09:30:44,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower347: Moving last applied index from -1 to -1
09:30:44,263 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader344: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/leader344/journal-v1-1.log
09:30:44,263 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader344: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/leader344/metadata-v1-1.log
09:30:44,263 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader344: no eligible files found
09:30:44,263 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - leader344: SnapshotOffer called.
09:30:44,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower347: empty journal: appending 0 entries
09:30:44,263 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - leader344: initializing from snapshot taken at 2025-07-02T09:30:44.242Z
09:30:44,263 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader344: Set currentTerm=1, votedFor=null
09:30:44,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower347: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:44,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower347: journal recovery completedin 227.6 μs with journalIndex=1
09:30:44,263 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - leader344: Updated server config: isVoting: true, peers: [PeerInfo [id=follower347, address=pekko://test/user/follower347, votingState=NON_VOTING], PeerInfo [id=follower346, address=pekko://test/user/follower346, votingState=VOTING], PeerInfo [id=follower345, address=pekko://test/user/follower345, votingState=VOTING]]
09:30:44,263 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for leader344 in 68.32 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
09:30:44,263 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader344: migrating from Pekko persistent-snapshot taken at 2025-07-02T09:30:44.242Z
09:30:44,263 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader344: support() called
09:30:44,263 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower347: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:44,264 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader344: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/leader344/snapshot-000000006864FC44-0E6CA080.tmp
09:30:44,266 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader344: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/leader344/snapshot-000000006864FC44-0E6CA080.v1
09:30:44,266 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader344: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/leader344/snapshot-000000006864FC44-0E6CA080.v1
09:30:44,266 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader344: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/leader344/journal-v1-1.log
09:30:44,266 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader344: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/leader344/metadata-v1-1.log
09:30:44,266 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader344: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T09:30:44.242Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest15310854589584491285/leader344/snapshot-000000006864FC44-0E6CA080.v1, size=275, entryCompress=NONE, stateCompress=NONE}
09:30:44,266 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader344: local snapshot saved in 2.400 ms, deleting Pekko-persisted snapshots
09:30:44,266 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader344: Recovery completed in 3.080 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:30:44,268 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader344: Set currentTerm=1, votedFor=null
09:30:44,268 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader344: Local TermInfo store seeded with TermInfo{term=1}
09:30:44,268 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader344: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@43e46643
09:30:44,268 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader344: Moving last applied index from -1 to -1
09:30:44,268 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader344: empty journal: appending 0 entries
09:30:44,268 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader344: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:30:44,268 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader344: journal recovery completedin 218.7 μs with journalIndex=1
09:30:44,269 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader344: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
09:30:44,603 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:30:44,603 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader344 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.82:17355, Removed)
09:30:44,603 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader344 (Follower): Received ElectionTimeout - switching to Candidate
09:30:44,603 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader344 (Candidate): Election: Candidate has following voting peers: [follower346, follower345]
09:30:44,616 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader344: Set currentTerm=2, votedFor=leader344
09:30:44,616 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - leader344 (Candidate): Starting new election term 2
09:30:44,616 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader344 (Candidate): Sending RequestVote{term=2, candidateId=leader344, lastLogIndex=-1, lastLogTerm=-1} to peer follower346
09:30:44,616 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader344 (Candidate): Sending RequestVote{term=2, candidateId=leader344, lastLogIndex=-1, lastLogTerm=-1} to peer follower345
09:30:44,616 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader344 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:30:44,616 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower346 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:30:44,616 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower345 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:30:44,616 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower345 (Follower): Cluster state: []
09:30:44,616 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower346 (Follower): Cluster state: []
09:30:44,616 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower345 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader344, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:30:44,616 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower346 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader344, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:30:44,616 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower345 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader344, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:30:44,616 AM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower346 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader344, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
09:30:44,620 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower346: Set currentTerm=2, votedFor=null
09:30:44,620 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower346 (Follower): In requestVote: RequestVote{term=2, candidateId=leader344, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:30:44,621 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower345: Set currentTerm=2, votedFor=null
09:30:44,621 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower345 (Follower): In requestVote: RequestVote{term=2, candidateId=leader344, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
09:30:44,623 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower346: Set currentTerm=2, votedFor=leader344
09:30:44,623 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower346 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:30:44,624 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader344 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
09:30:44,624 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader344 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
09:30:44,624 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader344 (Leader): Election: Leader has following peers: [follower347, follower346, follower345]
09:30:44,624 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader344 (Leader): Checking sendAppendEntries for follower follower347: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:44,624 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader344 (Leader): Checking sendAppendEntries for follower follower346: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:44,624 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader344 (Leader): Checking sendAppendEntries for follower follower345: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:44,624 AM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower347 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader344, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
09:30:44,624 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActorBehavior - leader344 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
09:30:44,624 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower346: Last sync leader does not match current leader leader344, need to catch up to -1
09:30:44,624 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower345: Set currentTerm=2, votedFor=leader344
09:30:44,624 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader344 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower346 updated: matchIndex: -1, nextIndex: 0
09:30:44,624 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower345 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
09:30:44,625 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader344 (Leader): Checking sendAppendEntries for follower follower346: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:44,625 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower345: Last sync leader does not match current leader leader344, need to catch up to -1
[WARN] [07/02/2025 09:30:44.625] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower346] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower346, initialSyncDone=false]
09:30:44,625 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader344 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower345 updated: matchIndex: -1, nextIndex: 0
09:30:44,625 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader344 (Leader): Checking sendAppendEntries for follower follower345: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:44.625] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower345] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower345, initialSyncDone=false]
09:30:44,627 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower347: Set currentTerm=2, votedFor=null
09:30:44,627 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower347: Last sync leader does not match current leader leader344, need to catch up to -1
09:30:44,627 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader344 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower347 updated: matchIndex: -1, nextIndex: 0
[WARN] [07/02/2025 09:30:44.627] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower347] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower347, initialSyncDone=false]
09:30:44,627 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader344 (Leader): Checking sendAppendEntries for follower follower347: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:44,674 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
09:30:44,674 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
09:30:44,679 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
09:30:44,680 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower345]
09:30:44,690 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - follower345: terminating thread VirtualThread[#746,follower345-writer-151]/waiting
09:30:44,691 AM [follower345-writer-151] [DEBUG] JournalWriteTask - follower345: received 1 commands after 444.0 ms
09:30:44,691 AM [follower345-writer-151] [DEBUG] JournalWriteTask - follower345: completed 1 commands in 32.32 μs
09:30:44,691 AM [follower345-writer-151] [DEBUG] JournalWriteTask - follower345: journal writer stopped
09:30:44,691 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower345: journal closed
09:30:44,691 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower345: journal closed
09:30:44,691 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower345: stopped executor with 0 remaining tasks
09:30:44,691 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower345: stopped executor with 0 remaining tasks
09:30:44,692 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower347]
09:30:44,702 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - follower347: terminating thread VirtualThread[#748,follower347-writer-153]/waiting
09:30:44,702 AM [follower347-writer-153] [DEBUG] JournalWriteTask - follower347: received 1 commands after 447.4 ms
09:30:44,702 AM [follower347-writer-153] [DEBUG] JournalWriteTask - follower347: completed 1 commands in 20.76 μs
09:30:44,702 AM [follower347-writer-153] [DEBUG] JournalWriteTask - follower347: journal writer stopped
09:30:44,702 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower347: journal closed
09:30:44,702 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower347: journal closed
09:30:44,702 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower347: stopped executor with 0 remaining tasks
09:30:44,702 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower347: stopped executor with 0 remaining tasks
09:30:44,703 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
09:30:44,703 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
09:30:44,703 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader344: onRequestLeadership RequestLeadership [requestedFollowerId=follower346, replyTo=Actor[pekko://test/user/$d#1664387646]]
09:30:44,703 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader344: Initiating leader transfer
09:30:44,703 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader344: pauseLeader successfully completed - doing transfer
09:30:44,703 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader344 (Leader): Attempting to transfer leadership
[WARN] [07/02/2025 09:30:44.703] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower347] received dead letter from TestActor[pekko://test/user/leader344]: LeaderTransitioning [leaderId=leader344]
[WARN] [07/02/2025 09:30:44.703] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower345] received dead letter from TestActor[pekko://test/user/leader344]: LeaderTransitioning [leaderId=leader344]
09:30:44,703 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader344 (Leader): Checking sendAppendEntries for follower follower347: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:44,703 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower346: onLeaderTransitioning: LeaderTransitioning [leaderId=leader344]
09:30:44,703 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader344 (Leader): Checking sendAppendEntries for follower follower346: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:44,704 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader344 (Leader): Checking sendAppendEntries for follower follower345: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:44,704 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower346: Lagging 0 entries behind leader leader344 and reached -1 (of expected -1)
[WARN] [07/02/2025 09:30:44.704] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower347] received dead letter from TestActor[pekko://test/user/leader344]: AppendEntries{term=2, leaderId=leader344, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
[WARN] [07/02/2025 09:30:44.704] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower346] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower346, initialSyncDone=true]
[WARN] [07/02/2025 09:30:44.704] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower345] received dead letter from TestActor[pekko://test/user/leader344]: AppendEntries{term=2, leaderId=leader344, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
09:30:44,704 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader344 (Leader): tryToCompleteLeadershipTransfer: followerId: follower346, matchIndex: -1, lastIndex: -1, isVoting: true
09:30:44,704 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader344 (Leader): Follower's log matches - sending ElectionTimeout
09:30:44,704 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader344 (Leader): Checking sendAppendEntries for follower follower347: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:44,704 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader344 (Leader): Checking sendAppendEntries for follower follower346: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:44,704 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader344 (Leader): Checking sendAppendEntries for follower follower345: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:44.704] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower347] received dead letter from TestActor[pekko://test/user/leader344]: AppendEntries{term=2, leaderId=leader344, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
09:30:44,704 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader344 (Leader): Leader transfer complete
09:30:44,704 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader344: leader transfer complete - waiting for new leader
09:30:44,704 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower346: Lagging 0 entries behind leader leader344 and reached -1 (of expected -1)
09:30:44,704 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:30:44,704 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower346 (Follower): Received TimeoutNow - switching to Candidate
[WARN] [07/02/2025 09:30:44.704] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower345] received dead letter from TestActor[pekko://test/user/leader344]: AppendEntries{term=2, leaderId=leader344, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
09:30:44,704 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - follower346 (Candidate): Election: Candidate has following voting peers: [leader344, follower345]
09:30:44,709 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower346: Set currentTerm=3, votedFor=follower346
09:30:44,709 AM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - follower346 (Candidate): Starting new election term 3
09:30:44,709 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - follower346 (Candidate): Sending RequestVote{term=3, candidateId=follower346, lastLogIndex=-1, lastLogTerm=-1} to peer leader344
09:30:44,709 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - follower346 (Candidate): Sending RequestVote{term=3, candidateId=follower346, lastLogIndex=-1, lastLogTerm=-1} to peer follower345
09:30:44,709 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader344 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:30:44,709 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader344 (Leader): Cluster state: []
09:30:44,709 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - follower346 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
09:30:44,709 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader344 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower346, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:30:44,709 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractLeader - leader344 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower346, lastLogIndex=-1, lastLogTerm=-1}" message is greater than leader's term 2 - switching to Follower
[WARN] [07/02/2025 09:30:44.709] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower345] received dead letter from TestActor[pekko://test/user/follower346]: RequestVote{term=3, candidateId=follower346, lastLogIndex=-1, lastLogTerm=-1}
09:30:44,712 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader344: Set currentTerm=3, votedFor=null
09:30:44,712 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader344 (Leader): Leadership transfer in progress - processing RequestVote
09:30:44,712 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader344 (Leader): In requestVote: RequestVote{term=3, candidateId=follower346, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
09:30:44,716 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader344: Set currentTerm=3, votedFor=follower346
09:30:44,716 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader344 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
09:30:44,716 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - follower346 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3
09:30:44,716 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - follower346 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1
09:30:44,716 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower346 (Leader): Election: Leader has following peers: [leader344, follower347, follower345]
09:30:44,716 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower346 (Leader): Checking sendAppendEntries for follower leader344: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:44,716 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower346 (Leader): Checking sendAppendEntries for follower follower347: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:44,716 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower346 (Leader): Checking sendAppendEntries for follower follower345: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:30:44,716 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - follower346 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
[WARN] [07/02/2025 09:30:44.716] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower347] received dead letter from TestActor[pekko://test/user/follower346]: AppendEntries{term=3, leaderId=follower346, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
[WARN] [07/02/2025 09:30:44.717] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower345] received dead letter from TestActor[pekko://test/user/follower346]: AppendEntries{term=3, leaderId=follower346, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:30:44,717 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader344 (Leader) :- Switching from behavior Leader to Follower, election term: 3
09:30:44,717 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - leader344: Last sync leader does not match current leader follower346, need to catch up to -1
09:30:44,717 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorLeadershipTransferCohort - leader344: leader changed to follower346
09:30:44,717 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorLeadershipTransferCohort - leader344: Successfully transferred leadership to follower346 in 13.93 ms
09:30:44,717 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader344: Leadership transferred successfully to follower346
09:30:44,717 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower346 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader344 updated: matchIndex: -1, nextIndex: 0
09:30:44,717 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - follower346 (Leader): Checking sendAppendEntries for follower leader344: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 09:30:44.717] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/leader344] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=leader344, initialSyncDone=false]
09:30:44,756 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown ending
09:30:44,756 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower345-notifier348#1306756758]
09:30:44,767 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower345-collector349#-1811160865]
09:30:44,767 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower346-notifier350#529350449]
09:30:44,767 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower346-collector351#26281433]
09:30:44,767 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower346]
09:30:44,768 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - follower346: terminating thread VirtualThread[#747,follower346-writer-152]/waiting
09:30:44,768 AM [follower346-writer-152] [DEBUG] JournalWriteTask - follower346: received 1 commands after 517.5 ms
09:30:44,768 AM [follower346-writer-152] [DEBUG] JournalWriteTask - follower346: completed 1 commands in 24.09 μs
09:30:44,768 AM [follower346-writer-152] [DEBUG] JournalWriteTask - follower346: journal writer stopped
09:30:44,768 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower346: journal closed
09:30:44,768 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - follower346: journal closed
09:30:44,768 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower346: stopped executor with 0 remaining tasks
09:30:44,768 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower346: stopped executor with 0 remaining tasks
09:30:44,768 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower347-notifier352#-1344285869]
09:30:44,768 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower347-collector353#24819716]
09:30:44,769 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader344-notifier354#1781224717]
09:30:44,769 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader344-collector355#-1373815784]
09:30:44,769 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader344]
09:30:44,769 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - leader344: terminating thread VirtualThread[#749,leader344-writer-154]/waiting
09:30:44,769 AM [leader344-writer-154] [DEBUG] JournalWriteTask - leader344: received 1 commands after 507.0 ms
09:30:44,769 AM [leader344-writer-154] [DEBUG] JournalWriteTask - leader344: completed 1 commands in 19.15 μs
09:30:44,769 AM [leader344-writer-154] [DEBUG] JournalWriteTask - leader344: journal writer stopped
09:30:44,769 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader344: journal closed
09:30:44,769 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader344: journal closed
09:30:44,769 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader344: stopped executor with 0 remaining tasks
09:30:44,769 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader344: stopped executor with 0 remaining tasks
09:30:44,770 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$d#1664387646]
[INFO] [07/02/2025 09:30:44.771] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
09:30:44,771 AM [test-pekko.actor.default-dispatcher-7] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
[WARN] [07/02/2025 09:30:44.772] [test-pekko.actor.default-dispatcher-15] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.171.82:17355)
[INFO] [07/02/2025 09:30:44.773] [test-pekko.actor.internal-dispatcher-11] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.82:17355] - Exiting completed
09:30:44,773 AM [test-pekko.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.82:17355] - Exiting completed
[INFO] [07/02/2025 09:30:44.773] [test-pekko.actor.internal-dispatcher-11] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.82:17355] - Shutting down...
[INFO] [07/02/2025 09:30:44.773] [test-pekko.actor.internal-dispatcher-11] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.82:17355] - Successfully shut down
09:30:44,774 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.82:17355] - Shutting down...
09:30:44,774 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.82:17355] - Successfully shut down
[INFO] [07/02/2025 09:30:44.774] [test-pekko.remote.default-remote-dispatcher-8] [pekko://test@10.30.171.82:17355/system/remoting-terminator] Shutting down remote daemon.
[INFO] [07/02/2025 09:30:44.774] [test-pekko.remote.default-remote-dispatcher-8] [pekko://test@10.30.171.82:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports.
09:30:44,775 AM [test-pekko.actor.default-dispatcher-5] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
09:30:44,775 AM [test-pekko.actor.default-dispatcher-5] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
09:30:44,776 AM [test-pekko.actor.default-dispatcher-15] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[INFO] [07/02/2025 09:30:44.776] [test-pekko.remote.default-remote-dispatcher-9] [pekko://test@10.30.171.82:17355/system/remoting-terminator] Remoting shut down.
[DEBUG] [07/02/2025 09:30:44.776] [test-pekko.actor.internal-dispatcher-4] [EventStream] shutting down: StandardOutLogger