[DEBUG] [07/02/2025 00:00:50.648] [main] [EventStream(pekko://test)] logger log1-TestEventListener started
12:00:50,649 AM [test-pekko.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started
[DEBUG] [07/02/2025 00:00:50.649] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started
[DEBUG] [07/02/2025 00:00:50.649] [main] [EventStream(pekko://test)] Default Loggers started
[INFO] [07/02/2025 00:00:50.667] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.171.227:17355] with UID [-5436439061851084262]
[INFO] [07/02/2025 00:00:50.667] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.227:17355] - Starting up, Pekko version [1.0.3] ...
12:00:50,669 AM [test-pekko.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.171.227:17355] with UID [-5436439061851084262]
12:00:50,669 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.227:17355] - Starting up, Pekko version [1.0.3] ...
[INFO] [07/02/2025 00:00:50.676] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.227:17355] - Registered cluster JMX MBean [pekko:type=Cluster]
[INFO] [07/02/2025 00:00:50.676] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.227:17355] - Started up successfully
12:00:50,676 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.227:17355] - Registered cluster JMX MBean [pekko:type=Cluster]
12:00:50,677 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.227:17355] - Started up successfully
12:00:50,677 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.227:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing
12:00:50,677 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.227:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining
[INFO] [07/02/2025 00:00:50.677] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.227:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing
[INFO] [07/02/2025 00:00:50.677] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.227:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining
12:00:50,691 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferAborted starting
12:00:50,691 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [07/02/2025 00:00:50.700] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower279]: org.opendaylight.controller.cluster.common.actor.Monitor@69e8bc9f
[INFO] [pekkoDeadLetter][07/02/2025 00:00:50.700] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower279] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
12:00:50,700 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower279] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
12:00:50,703 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower279: Starting recovery with journal batch size 1000
12:00:50,703 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower279: started executor
12:00:50,703 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower279: started executor
12:00:50,703 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower279: metadata journal open: replayFrom=1 applyTo=0
12:00:50,704 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower279: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:50,704 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower279: journal open: applyTo=0
12:00:50,704 AM [follower279-writer-128] [DEBUG] JournalWriteTask - follower279: journal writer started
12:00:50,704 AM [follower279-writer-128] [DEBUG] JournalWriteTask - follower279: waiting to receive commands
[WARN] [07/02/2025 00:00:50.707] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower280]: org.opendaylight.controller.cluster.common.actor.Monitor@66253787
[INFO] [pekkoDeadLetter][07/02/2025 00:00:50.707] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower280] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
12:00:50,707 AM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower280] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
12:00:50,708 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower280: Starting recovery with journal batch size 1000
12:00:50,708 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower280: started executor
12:00:50,708 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower280: started executor
12:00:50,708 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower280: metadata journal open: replayFrom=1 applyTo=0
12:00:50,709 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower280: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:50,709 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower280: journal open: applyTo=0
12:00:50,709 AM [follower280-writer-129] [DEBUG] JournalWriteTask - follower280: journal writer started
12:00:50,709 AM [follower280-writer-129] [DEBUG] JournalWriteTask - follower280: waiting to receive commands
12:00:50,713 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower279/TermInfo.properties does not exist
12:00:50,713 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower279: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower279/journal-v1-1.log
12:00:50,713 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower279: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower279/metadata-v1-1.log
12:00:50,713 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower279: no eligible files found
12:00:50,713 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower279: SnapshotOffer called.
12:00:50,713 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower279: initializing from snapshot taken at 2025-07-02T00:00:50.691Z
12:00:50,713 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower279: Set currentTerm=1, votedFor=null
12:00:50,713 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PeerInfos - follower279: Updated server config: isVoting: true, peers: [PeerInfo [id=leader278, address=pekko://test/user/leader278, votingState=VOTING], PeerInfo [id=follower281, address=pekko://test/user/follower281, votingState=NON_VOTING], PeerInfo [id=follower280, address=pekko://test/user/follower280, votingState=VOTING]]
12:00:50,713 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - Recovery snapshot applied for follower279 in 84.63 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:50,713 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower279: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:50.691Z
12:00:50,713 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower279: support() called
12:00:50,714 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower279: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower279/snapshot-00000000686476B2-292FD2C0.tmp
12:00:50,714 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - follower281: Starting recovery with journal batch size 1000
12:00:50,714 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower280/TermInfo.properties does not exist
12:00:50,714 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower281: started executor
12:00:50,714 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower281: started executor
12:00:50,715 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower280/journal-v1-1.log
12:00:50,715 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower280/metadata-v1-1.log
12:00:50,715 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: no eligible files found
12:00:50,715 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower280: SnapshotOffer called.
12:00:50,715 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower280: initializing from snapshot taken at 2025-07-02T00:00:50.691Z
12:00:50,715 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower281: metadata journal open: replayFrom=1 applyTo=0
12:00:50,715 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower280: Set currentTerm=1, votedFor=null
12:00:50,715 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PeerInfos - follower280: Updated server config: isVoting: true, peers: [PeerInfo [id=leader278, address=pekko://test/user/leader278, votingState=VOTING], PeerInfo [id=follower281, address=pekko://test/user/follower281, votingState=NON_VOTING], PeerInfo [id=follower279, address=pekko://test/user/follower279, votingState=VOTING]]
12:00:50,716 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - Recovery snapshot applied for follower280 in 289.1 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:50,716 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower280: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:50.691Z
12:00:50,716 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower280: support() called
12:00:50,716 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower281: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:50,716 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower281: journal open: applyTo=0
12:00:50,716 AM [test-pekko.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower281] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
12:00:50,716 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower280/snapshot-00000000686476B2-292FD2C0.tmp
12:00:50,717 AM [follower281-writer-130] [DEBUG] JournalWriteTask - follower281: journal writer started
12:00:50,717 AM [follower281-writer-130] [DEBUG] JournalWriteTask - follower281: waiting to receive commands
12:00:50,718 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower279: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower279/snapshot-00000000686476B2-292FD2C0.v1
12:00:50,718 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower279: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower279/snapshot-00000000686476B2-292FD2C0.v1
12:00:50,718 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower281/TermInfo.properties does not exist
12:00:50,718 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower279: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower279/journal-v1-1.log
12:00:50,718 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower279: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower279/metadata-v1-1.log
12:00:50,718 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower281: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower281/journal-v1-1.log
12:00:50,718 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower281: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower281/metadata-v1-1.log
12:00:50,718 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower281: no eligible files found
12:00:50,718 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower279: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:50.691Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower279/snapshot-00000000686476B2-292FD2C0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:50,718 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower281: SnapshotOffer called.
12:00:50,718 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower279: local snapshot saved in 4.388 ms, deleting Pekko-persisted snapshots
12:00:50,718 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower281: initializing from snapshot taken at 2025-07-02T00:00:50.691Z
12:00:50,718 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower281: Set currentTerm=1, votedFor=null
12:00:50,718 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - follower281: Updated server config: isVoting: false, peers: [PeerInfo [id=leader278, address=pekko://test/user/leader278, votingState=VOTING], PeerInfo [id=follower280, address=pekko://test/user/follower280, votingState=VOTING], PeerInfo [id=follower279, address=pekko://test/user/follower279, votingState=VOTING]]
12:00:50,718 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - Recovery snapshot applied for follower281 in 144.4 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:50,718 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower281: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:50.691Z
12:00:50,718 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower281: support() called
12:00:50,718 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower281: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower281/snapshot-00000000686476B2-292FD2C0.tmp
12:00:50,719 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower280/snapshot-00000000686476B2-292FD2C0.v1
12:00:50,719 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower280/snapshot-00000000686476B2-292FD2C0.v1
12:00:50,719 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower280/journal-v1-1.log
12:00:50,720 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower280/metadata-v1-1.log
12:00:50,720 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower280: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:50.691Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower280/snapshot-00000000686476B2-292FD2C0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:50,720 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower280: local snapshot saved in 3.692 ms, deleting Pekko-persisted snapshots
12:00:50,720 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower279: Recovery completed in 6.605 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:50,721 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower279: Set currentTerm=1, votedFor=null
12:00:50,721 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower279: Local TermInfo store seeded with TermInfo{term=1}
12:00:50,721 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower279: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@7a8ef91a
12:00:50,721 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower279: Moving last applied index from -1 to -1
12:00:50,722 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower279: empty journal: appending 0 entries
12:00:50,722 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower279: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:50,722 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower279: journal recovery completedin 316.9 μs with journalIndex=1
12:00:50,722 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower279: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:50,723 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower280: Recovery completed in 7.229 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [07/02/2025 00:00:50.723] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower281]: org.opendaylight.controller.cluster.common.actor.Monitor@9e3fc91
[INFO] [pekkoDeadLetter][07/02/2025 00:00:50.716] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower281] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
12:00:50,723 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower281: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower281/snapshot-00000000686476B2-292FD2C0.v1
12:00:50,724 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower281: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower281/snapshot-00000000686476B2-292FD2C0.v1
12:00:50,724 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower281: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower281/journal-v1-1.log
12:00:50,724 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower281: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower281/metadata-v1-1.log
12:00:50,724 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower281: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:50.691Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/follower281/snapshot-00000000686476B2-292FD2C0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:50,724 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower281: local snapshot saved in 5.563 ms, deleting Pekko-persisted snapshots
12:00:50,724 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower280: Set currentTerm=1, votedFor=null
12:00:50,724 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower280: Local TermInfo store seeded with TermInfo{term=1}
12:00:50,724 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower280: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@12ce46b0
12:00:50,724 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower280: Moving last applied index from -1 to -1
12:00:50,724 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower280: empty journal: appending 0 entries
12:00:50,724 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower281: Recovery completed in 6.551 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:50,724 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower280: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:50,725 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower280: journal recovery completedin 257.4 μs with journalIndex=1
12:00:50,725 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower280: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
[WARN] [07/02/2025 00:00:50.726] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader278]: org.opendaylight.controller.cluster.common.actor.Monitor@2aa6f961
[INFO] [pekkoDeadLetter][07/02/2025 00:00:50.726] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader278] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
12:00:50,726 AM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader278] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
12:00:50,726 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader278: Starting recovery with journal batch size 1000
12:00:50,726 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader278: started executor
12:00:50,726 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader278: started executor
12:00:50,727 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader278: metadata journal open: replayFrom=1 applyTo=0
12:00:50,727 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader278: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:50,727 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader278: journal open: applyTo=0
12:00:50,727 AM [leader278-writer-131] [DEBUG] JournalWriteTask - leader278: journal writer started
12:00:50,727 AM [leader278-writer-131] [DEBUG] JournalWriteTask - leader278: waiting to receive commands
12:00:50,729 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower281: Set currentTerm=1, votedFor=null
12:00:50,729 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower281: Local TermInfo store seeded with TermInfo{term=1}
12:00:50,729 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower281: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@46a35bd8
12:00:50,729 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower281: Moving last applied index from -1 to -1
12:00:50,729 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower281: empty journal: appending 0 entries
12:00:50,729 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower281: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:50,729 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower281: journal recovery completedin 216.2 μs with journalIndex=1
12:00:50,731 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower281: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:50,731 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/leader278/TermInfo.properties does not exist
12:00:50,731 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader278: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/leader278/journal-v1-1.log
12:00:50,731 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader278: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/leader278/metadata-v1-1.log
12:00:50,731 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader278: no eligible files found
12:00:50,731 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - leader278: SnapshotOffer called.
12:00:50,731 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - leader278: initializing from snapshot taken at 2025-07-02T00:00:50.691Z
12:00:50,731 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader278: Set currentTerm=1, votedFor=null
12:00:50,731 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PeerInfos - leader278: Updated server config: isVoting: true, peers: [PeerInfo [id=follower281, address=pekko://test/user/follower281, votingState=NON_VOTING], PeerInfo [id=follower280, address=pekko://test/user/follower280, votingState=VOTING], PeerInfo [id=follower279, address=pekko://test/user/follower279, votingState=VOTING]]
12:00:50,732 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - Recovery snapshot applied for leader278 in 260.1 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:50,732 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader278: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:50.691Z
12:00:50,732 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader278: support() called
12:00:50,732 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader278: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/leader278/snapshot-00000000686476B2-292FD2C0.tmp
12:00:50,734 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader278: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/leader278/snapshot-00000000686476B2-292FD2C0.v1
12:00:50,734 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader278: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/leader278/snapshot-00000000686476B2-292FD2C0.v1
12:00:50,734 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader278: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/leader278/journal-v1-1.log
12:00:50,734 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader278: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/leader278/metadata-v1-1.log
12:00:50,734 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader278: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:50.691Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8996479318767853625/leader278/snapshot-00000000686476B2-292FD2C0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:50,734 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader278: local snapshot saved in 2.104 ms, deleting Pekko-persisted snapshots
12:00:50,734 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader278: Recovery completed in 3.169 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:50,737 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader278: Set currentTerm=1, votedFor=null
12:00:50,737 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader278: Local TermInfo store seeded with TermInfo{term=1}
12:00:50,737 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader278: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@e5e02d2
12:00:50,737 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader278: Moving last applied index from -1 to -1
12:00:50,738 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader278: empty journal: appending 0 entries
12:00:50,738 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader278: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:50,738 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader278: journal recovery completedin 867.5 μs with journalIndex=1
12:00:50,739 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader278: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:51,122 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
12:00:51,123 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - leader278 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.227:17355, Removed)
12:00:51,123 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - leader278 (Follower): Received ElectionTimeout - switching to Candidate
12:00:51,123 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader278 (Candidate): Election: Candidate has following voting peers: [follower280, follower279]
12:00:51,125 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader278: Set currentTerm=2, votedFor=leader278
12:00:51,125 AM [test-pekko.actor.default-dispatcher-17] [INFO] Candidate - leader278 (Candidate): Starting new election term 2
12:00:51,125 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader278 (Candidate): Sending RequestVote{term=2, candidateId=leader278, lastLogIndex=-1, lastLogTerm=-1} to peer follower280
12:00:51,126 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader278 (Candidate): Sending RequestVote{term=2, candidateId=leader278, lastLogIndex=-1, lastLogTerm=-1} to peer follower279
12:00:51,126 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower279 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
12:00:51,126 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower279 (Follower): Cluster state: []
12:00:51,126 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower280 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
12:00:51,126 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower280 (Follower): Cluster state: []
12:00:51,126 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower280 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader278, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
12:00:51,126 AM [test-pekko.actor.default-dispatcher-18] [INFO] Follower - follower280 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader278, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
12:00:51,126 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower279 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader278, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
12:00:51,127 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower279 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader278, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
12:00:51,127 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader278 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
12:00:51,128 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower280: Set currentTerm=2, votedFor=null
12:00:51,128 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower280 (Follower): In requestVote: RequestVote{term=2, candidateId=leader278, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
12:00:51,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower279: Set currentTerm=2, votedFor=null
12:00:51,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower279 (Follower): In requestVote: RequestVote{term=2, candidateId=leader278, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
12:00:51,132 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower280: Set currentTerm=2, votedFor=leader278
12:00:51,132 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower280 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
12:00:51,132 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader278 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
12:00:51,132 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader278 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
12:00:51,133 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader278 (Leader): Election: Leader has following peers: [follower281, follower280, follower279]
12:00:51,133 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower281: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,133 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower280: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,133 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower279: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,133 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader278 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
12:00:51,133 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower280: Last sync leader does not match current leader leader278, need to catch up to -1
12:00:51,133 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader278 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower280 updated: matchIndex: -1, nextIndex: 0
12:00:51,133 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower280: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:51.133] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower280] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower280, initialSyncDone=false]
[INFO] [pekkoDeadLetter][07/02/2025 00:00:51.133] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower280] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower280] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
12:00:51,133 AM [test-pekko.actor.default-dispatcher-11] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower280] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
12:00:51,133 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower281 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader278, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
12:00:51,134 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower279: Set currentTerm=2, votedFor=leader278
12:00:51,134 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower279 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
12:00:51,134 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower279: Last sync leader does not match current leader leader278, need to catch up to -1
12:00:51,134 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader278 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower279 updated: matchIndex: -1, nextIndex: 0
[WARN] [07/02/2025 00:00:51.134] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower279] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower279, initialSyncDone=false]
12:00:51,134 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower279: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[INFO] [pekkoDeadLetter][07/02/2025 00:00:51.134] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower279] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower279] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
12:00:51,134 AM [test-pekko.actor.default-dispatcher-12] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower279] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
12:00:51,137 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower281: Set currentTerm=2, votedFor=null
12:00:51,137 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower281: Last sync leader does not match current leader leader278, need to catch up to -1
12:00:51,137 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader278 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower281 updated: matchIndex: -1, nextIndex: 0
[WARN] [07/02/2025 00:00:51.137] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower281] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower281, initialSyncDone=false]
12:00:51,137 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower281: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[INFO] [pekkoDeadLetter][07/02/2025 00:00:51.137] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower281] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower281] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
12:00:51,137 AM [test-pekko.actor.default-dispatcher-11] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower281] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
12:00:51,178 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
12:00:51,178 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader278 starting
12:00:51,181 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader278: onShutDown
12:00:51,181 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader278: Initiating leader transfer
12:00:51,181 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorLeadershipTransferCohort - leader278: pauseLeader successfully completed - doing transfer
12:00:51,181 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Leader - leader278 (Leader): Attempting to transfer leadership
12:00:51,181 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower281: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,181 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower280: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,182 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader278 (Leader): Checking sendAppendEntries for follower follower279: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,182 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower281: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
12:00:51,182 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower281: onLeaderTransitioning: LeaderTransitioning [leaderId=leader278]
12:00:51,182 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower280: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
12:00:51,182 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower280: onLeaderTransitioning: LeaderTransitioning [leaderId=leader278]
12:00:51,182 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower279: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
12:00:51,182 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower279: onLeaderTransitioning: LeaderTransitioning [leaderId=leader278]
[WARN] [07/02/2025 00:00:51.182] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower281] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower281, initialSyncDone=true]
[WARN] [07/02/2025 00:00:51.182] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower280] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower280, initialSyncDone=true]
12:00:51,182 AM [test-pekko.actor.default-dispatcher-12] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower281] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[INFO] [pekkoDeadLetter][07/02/2025 00:00:51.182] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower281] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower281] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
12:00:51,182 AM [test-pekko.actor.default-dispatcher-12] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower280] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[WARN] [07/02/2025 00:00:51.182] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower279] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower279, initialSyncDone=true]
[INFO] [pekkoDeadLetter][07/02/2025 00:00:51.182] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower280] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower280] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
12:00:51,182 AM [test-pekko.actor.default-dispatcher-6] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower279] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[INFO] [pekkoDeadLetter][07/02/2025 00:00:51.182] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower279] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower279] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
12:00:51,252 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower280: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
12:00:51,252 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower279: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
12:00:51,252 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower281: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
12:00:51,372 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower279: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
12:00:51,372 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower280: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
12:00:51,372 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower281: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
12:00:51,492 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorLeadershipTransferCohort - leader278: leader transfer aborted
12:00:51,492 AM [test-pekko.actor.default-dispatcher-16] [WARN] RaftActorLeadershipTransferCohort - leader278: Failed to transfer leadership in 310.9 ms
12:00:51,492 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader278: leader transfer failed - sending PoisonPill
12:00:51,492 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Leader - leader278 (Leader): Leadership transfer expired
12:00:51,492 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower281: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
12:00:51,493 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower279: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
12:00:51,493 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower280: Lagging 0 entries behind leader leader278 and reached -1 (of expected -1)
12:00:51,493 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - leader278: terminating thread VirtualThread[#727,leader278-writer-131]/waiting
12:00:51,493 AM [leader278-writer-131] [DEBUG] JournalWriteTask - leader278: received 1 commands after 766.2 ms
12:00:51,494 AM [leader278-writer-131] [DEBUG] JournalWriteTask - leader278: completed 1 commands in 20.65 μs
12:00:51,494 AM [leader278-writer-131] [DEBUG] JournalWriteTask - leader278: journal writer stopped
12:00:51,494 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader278: journal closed
12:00:51,494 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader278: journal closed
12:00:51,494 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader278: stopped executor with 0 remaining tasks
12:00:51,494 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader278: stopped executor with 0 remaining tasks
12:00:51,496 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader278 ending
12:00:51,497 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending
12:00:51,498 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower279-notifier282#787775969]
12:00:51,509 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower279-collector283#-1739774021]
12:00:51,510 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower279]
12:00:51,510 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - follower279: terminating thread VirtualThread[#719,follower279-writer-128]/waiting
12:00:51,510 AM [follower279-writer-128] [DEBUG] JournalWriteTask - follower279: received 1 commands after 805.5 ms
12:00:51,510 AM [follower279-writer-128] [DEBUG] JournalWriteTask - follower279: completed 1 commands in 17.39 μs
12:00:51,510 AM [follower279-writer-128] [DEBUG] JournalWriteTask - follower279: journal writer stopped
12:00:51,510 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower279: journal closed
12:00:51,510 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower279: journal closed
12:00:51,510 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower279: stopped executor with 0 remaining tasks
12:00:51,510 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower279: stopped executor with 0 remaining tasks
12:00:51,510 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower280-notifier284#-702582888]
12:00:51,511 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower280-collector285#-2074711929]
12:00:51,511 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower280]
12:00:51,511 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - follower280: terminating thread VirtualThread[#720,follower280-writer-129]/waiting
12:00:51,511 AM [follower280-writer-129] [DEBUG] JournalWriteTask - follower280: received 1 commands after 801.9 ms
12:00:51,511 AM [follower280-writer-129] [DEBUG] JournalWriteTask - follower280: completed 1 commands in 9.700 μs
12:00:51,511 AM [follower280-writer-129] [DEBUG] JournalWriteTask - follower280: journal writer stopped
12:00:51,511 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower280: journal closed
12:00:51,511 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower280: journal closed
12:00:51,511 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower280: stopped executor with 0 remaining tasks
12:00:51,511 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower280: stopped executor with 0 remaining tasks
12:00:51,511 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower281-notifier286#2107030606]
12:00:51,511 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower281-collector287#-1669679797]
12:00:51,511 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower281]
12:00:51,512 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - follower281: terminating thread VirtualThread[#723,follower281-writer-130]/waiting
12:00:51,512 AM [follower281-writer-130] [DEBUG] JournalWriteTask - follower281: received 1 commands after 794.9 ms
12:00:51,512 AM [follower281-writer-130] [DEBUG] JournalWriteTask - follower281: completed 1 commands in 9.771 μs
12:00:51,512 AM [follower281-writer-130] [DEBUG] JournalWriteTask - follower281: journal writer stopped
12:00:51,512 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower281: journal closed
12:00:51,512 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower281: journal closed
12:00:51,512 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower281: stopped executor with 0 remaining tasks
12:00:51,512 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower281: stopped executor with 0 remaining tasks
12:00:51,512 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader278-notifier288#2052879618]
12:00:51,512 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader278-collector289#1525798702]
12:00:51,512 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader278]
12:00:51,515 AM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 starting
12:00:51,515 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [07/02/2025 00:00:51.517] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower291]: org.opendaylight.controller.cluster.common.actor.Monitor@717a5ebf
12:00:51,518 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower291: Starting recovery with journal batch size 1000
12:00:51,518 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower291: started executor
12:00:51,519 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower291: started executor
12:00:51,519 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower291: metadata journal open: replayFrom=1 applyTo=0
12:00:51,519 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower291: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:51,519 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower291: journal open: applyTo=0
12:00:51,520 AM [follower291-writer-132] [DEBUG] JournalWriteTask - follower291: journal writer started
12:00:51,520 AM [follower291-writer-132] [DEBUG] JournalWriteTask - follower291: waiting to receive commands
12:00:51,520 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower291/TermInfo.properties does not exist
12:00:51,520 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower291: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower291/journal-v1-1.log
12:00:51,520 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower291: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower291/metadata-v1-1.log
12:00:51,520 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower291: no eligible files found
12:00:51,520 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower291: SnapshotOffer called.
12:00:51,520 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower291: initializing from snapshot taken at 2025-07-02T00:00:51.515Z
12:00:51,520 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower291: Set currentTerm=1, votedFor=null
12:00:51,521 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - follower291: Updated server config: isVoting: true, peers: [PeerInfo [id=follower292, address=pekko://test/user/follower292, votingState=VOTING], PeerInfo [id=follower293, address=pekko://test/user/follower293, votingState=NON_VOTING], PeerInfo [id=leader290, address=pekko://test/user/leader290, votingState=VOTING]]
[WARN] [07/02/2025 00:00:51.521] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower292]: org.opendaylight.controller.cluster.common.actor.Monitor@54b19395
12:00:51,522 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower292: Starting recovery with journal batch size 1000
12:00:51,522 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: started executor
12:00:51,522 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: started executor
12:00:51,522 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower292: metadata journal open: replayFrom=1 applyTo=0
12:00:51,522 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower292: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:51,522 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower292: journal open: applyTo=0
12:00:51,523 AM [follower292-writer-133] [DEBUG] JournalWriteTask - follower292: journal writer started
12:00:51,523 AM [follower292-writer-133] [DEBUG] JournalWriteTask - follower292: waiting to receive commands
12:00:51,523 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for follower291 in 2.101 ms: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:51,523 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower292/TermInfo.properties does not exist
12:00:51,523 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower292/journal-v1-1.log
12:00:51,523 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower292/metadata-v1-1.log
12:00:51,523 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: no eligible files found
12:00:51,523 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower292: SnapshotOffer called.
12:00:51,523 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower292: initializing from snapshot taken at 2025-07-02T00:00:51.515Z
12:00:51,523 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower292: Set currentTerm=1, votedFor=null
12:00:51,523 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - follower292: Updated server config: isVoting: true, peers: [PeerInfo [id=follower291, address=pekko://test/user/follower291, votingState=VOTING], PeerInfo [id=follower293, address=pekko://test/user/follower293, votingState=NON_VOTING], PeerInfo [id=leader290, address=pekko://test/user/leader290, votingState=VOTING]]
12:00:51,523 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for follower292 in 47.97 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:51,523 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower292: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:51.515Z
12:00:51,523 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower292: support() called
12:00:51,524 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower292/snapshot-00000000686476B3-1EB246C0.tmp
12:00:51,523 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower291: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:51.515Z
12:00:51,524 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower291: support() called
[WARN] [07/02/2025 00:00:51.524] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower293]: org.opendaylight.controller.cluster.common.actor.Monitor@13edb7e
12:00:51,524 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower291: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower291/snapshot-00000000686476B3-1EB246C0.tmp
12:00:51,528 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower293: Starting recovery with journal batch size 1000
12:00:51,528 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower293: started executor
12:00:51,528 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower293: started executor
12:00:51,529 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower293: metadata journal open: replayFrom=1 applyTo=0
12:00:51,529 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower293: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:51,529 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower293: journal open: applyTo=0
12:00:51,530 AM [follower293-writer-134] [DEBUG] JournalWriteTask - follower293: journal writer started
12:00:51,530 AM [follower293-writer-134] [DEBUG] JournalWriteTask - follower293: waiting to receive commands
12:00:51,530 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower293/TermInfo.properties does not exist
12:00:51,530 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower293/journal-v1-1.log
12:00:51,530 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower293/metadata-v1-1.log
12:00:51,530 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: no eligible files found
12:00:51,531 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower293: SnapshotOffer called.
12:00:51,531 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower293: initializing from snapshot taken at 2025-07-02T00:00:51.515Z
12:00:51,531 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower293: Set currentTerm=1, votedFor=null
12:00:51,531 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PeerInfos - follower293: Updated server config: isVoting: false, peers: [PeerInfo [id=follower292, address=pekko://test/user/follower292, votingState=VOTING], PeerInfo [id=follower291, address=pekko://test/user/follower291, votingState=VOTING], PeerInfo [id=leader290, address=pekko://test/user/leader290, votingState=VOTING]]
12:00:51,531 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - Recovery snapshot applied for follower293 in 103.7 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:51,531 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower293: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:51.515Z
12:00:51,531 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower293: support() called
12:00:51,531 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower293/snapshot-00000000686476B3-1EB246C0.tmp
12:00:51,531 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower292/snapshot-00000000686476B3-1EB246C0.v1
12:00:51,532 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower292/snapshot-00000000686476B3-1EB246C0.v1
12:00:51,532 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower292/journal-v1-1.log
12:00:51,532 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower292/metadata-v1-1.log
12:00:51,532 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower292: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:51.515Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower292/snapshot-00000000686476B3-1EB246C0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:51,532 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower292: local snapshot saved in 8.471 ms, deleting Pekko-persisted snapshots
12:00:51,532 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower291: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower291/snapshot-00000000686476B3-1EB246C0.v1
12:00:51,532 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower291: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower291/snapshot-00000000686476B3-1EB246C0.v1
12:00:51,532 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower291: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower291/journal-v1-1.log
12:00:51,532 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower291: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower291/metadata-v1-1.log
12:00:51,533 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower292: Recovery completed in 9.405 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:51,532 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower291: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:51.515Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower291/snapshot-00000000686476B3-1EB246C0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:51,533 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower291: local snapshot saved in 8.723 ms, deleting Pekko-persisted snapshots
12:00:51,533 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - leader290: Starting recovery with journal batch size 1000
12:00:51,533 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader290: started executor
12:00:51,533 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader290: started executor
[WARN] [07/02/2025 00:00:51.533] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader290]: org.opendaylight.controller.cluster.common.actor.Monitor@1d04ed28
12:00:51,533 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower291: Recovery completed in 12.67 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:51,533 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader290: metadata journal open: replayFrom=1 applyTo=0
12:00:51,534 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader290: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:51,534 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - leader290: journal open: applyTo=0
12:00:51,534 AM [leader290-writer-135] [DEBUG] JournalWriteTask - leader290: journal writer started
12:00:51,534 AM [leader290-writer-135] [DEBUG] JournalWriteTask - leader290: waiting to receive commands
12:00:51,534 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower293/snapshot-00000000686476B3-1EB246C0.v1
12:00:51,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower293/snapshot-00000000686476B3-1EB246C0.v1
12:00:51,535 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower292: Set currentTerm=1, votedFor=null
12:00:51,535 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower292: Local TermInfo store seeded with TermInfo{term=1}
12:00:51,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower293/journal-v1-1.log
12:00:51,535 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower292: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@6c22524
12:00:51,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower293/metadata-v1-1.log
12:00:51,535 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower292: Moving last applied index from -1 to -1
12:00:51,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:51.515Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/follower293/snapshot-00000000686476B3-1EB246C0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:51,535 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower293: local snapshot saved in 3.855 ms, deleting Pekko-persisted snapshots
12:00:51,535 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower292: empty journal: appending 0 entries
12:00:51,535 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower292: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:51,535 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower292: journal recovery completedin 292.2 μs with journalIndex=1
12:00:51,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/leader290/TermInfo.properties does not exist
12:00:51,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader290: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/leader290/journal-v1-1.log
12:00:51,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader290: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/leader290/metadata-v1-1.log
12:00:51,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader290: no eligible files found
12:00:51,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - leader290: SnapshotOffer called.
12:00:51,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - leader290: initializing from snapshot taken at 2025-07-02T00:00:51.515Z
12:00:51,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader290: Set currentTerm=1, votedFor=null
12:00:51,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PeerInfos - leader290: Updated server config: isVoting: true, peers: [PeerInfo [id=follower292, address=pekko://test/user/follower292, votingState=VOTING], PeerInfo [id=follower291, address=pekko://test/user/follower291, votingState=VOTING], PeerInfo [id=follower293, address=pekko://test/user/follower293, votingState=NON_VOTING]]
12:00:51,536 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - Recovery snapshot applied for leader290 in 86.83 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:51,536 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader290: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:51.515Z
12:00:51,536 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader290: support() called
12:00:51,536 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader290: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/leader290/snapshot-00000000686476B3-1EB246C0.tmp
12:00:51,537 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower292: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:51,539 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower293: Recovery completed in 8.445 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:51,540 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader290: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/leader290/snapshot-00000000686476B3-1EB246C0.v1
12:00:51,540 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower291: Set currentTerm=1, votedFor=null
12:00:51,540 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower291: Local TermInfo store seeded with TermInfo{term=1}
12:00:51,540 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower291: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@7f709f4e
12:00:51,540 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower291: Moving last applied index from -1 to -1
12:00:51,540 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader290: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/leader290/snapshot-00000000686476B3-1EB246C0.v1
12:00:51,541 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader290: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/leader290/journal-v1-1.log
12:00:51,541 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader290: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/leader290/metadata-v1-1.log
12:00:51,541 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower291: empty journal: appending 0 entries
12:00:51,541 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader290: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:51.515Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest977019894023201669/leader290/snapshot-00000000686476B3-1EB246C0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:51,541 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower291: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:51,541 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader290: local snapshot saved in 5.055 ms, deleting Pekko-persisted snapshots
12:00:51,541 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower291: journal recovery completedin 215.7 μs with journalIndex=1
12:00:51,541 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower293: Set currentTerm=1, votedFor=null
12:00:51,541 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower293: Local TermInfo store seeded with TermInfo{term=1}
12:00:51,541 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower293: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@6dd8ddb
12:00:51,541 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower293: Moving last applied index from -1 to -1
12:00:51,541 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower291: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:51,542 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader290: Recovery completed in 6.191 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:51,542 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower293: empty journal: appending 0 entries
12:00:51,542 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower293: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:51,542 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower293: journal recovery completedin 504.4 μs with journalIndex=1
12:00:51,542 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower293: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:51,545 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader290: Set currentTerm=1, votedFor=null
12:00:51,545 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader290: Local TermInfo store seeded with TermInfo{term=1}
12:00:51,545 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader290: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@9069d76
12:00:51,545 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader290: Moving last applied index from -1 to -1
12:00:51,545 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader290: empty journal: appending 0 entries
12:00:51,545 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader290: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:51,545 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader290: journal recovery completedin 296.9 μs with journalIndex=1
12:00:51,545 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader290: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:51,922 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
12:00:51,922 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader290 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.227:17355, Removed)
12:00:51,922 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader290 (Follower): Received ElectionTimeout - switching to Candidate
12:00:51,922 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader290 (Candidate): Election: Candidate has following voting peers: [follower292, follower291]
12:00:51,927 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader290: Set currentTerm=2, votedFor=leader290
12:00:51,927 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader290 (Candidate): Starting new election term 2
12:00:51,927 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader290 (Candidate): Sending RequestVote{term=2, candidateId=leader290, lastLogIndex=-1, lastLogTerm=-1} to peer follower292
12:00:51,927 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader290 (Candidate): Sending RequestVote{term=2, candidateId=leader290, lastLogIndex=-1, lastLogTerm=-1} to peer follower291
12:00:51,927 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader290 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
12:00:51,927 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower292 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
12:00:51,927 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower291 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
12:00:51,928 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower292 (Follower): Cluster state: []
12:00:51,928 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower291 (Follower): Cluster state: []
12:00:51,928 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower292 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader290, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
12:00:51,928 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower291 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader290, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
12:00:51,928 AM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower292 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader290, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
12:00:51,928 AM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - follower291 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader290, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
12:00:51,930 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower291: Set currentTerm=2, votedFor=null
12:00:51,930 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower291 (Follower): In requestVote: RequestVote{term=2, candidateId=leader290, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
12:00:51,930 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower292: Set currentTerm=2, votedFor=null
12:00:51,930 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower292 (Follower): In requestVote: RequestVote{term=2, candidateId=leader290, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
12:00:51,932 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower292: Set currentTerm=2, votedFor=leader290
12:00:51,932 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower292 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
12:00:51,932 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader290 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
12:00:51,932 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader290 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
12:00:51,933 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader290 (Leader): Election: Leader has following peers: [follower292, follower291, follower293]
12:00:51,933 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower292: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,933 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower291: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,933 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower293: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,933 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader290 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
12:00:51,933 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower292: Last sync leader does not match current leader leader290, need to catch up to -1
12:00:51,933 AM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower293 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader290, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
12:00:51,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower293: Set currentTerm=2, votedFor=null
12:00:51,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower293: Last sync leader does not match current leader leader290, need to catch up to -1
12:00:51,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader290 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower292 updated: matchIndex: -1, nextIndex: 0
12:00:51,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower292: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader290 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower293 updated: matchIndex: -1, nextIndex: 0
12:00:51,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower293: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,936 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
12:00:51,937 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
[WARN] [07/02/2025 00:00:51.936] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower292] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower292, initialSyncDone=false]
[WARN] [07/02/2025 00:00:51.937] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower293] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower293, initialSyncDone=false]
12:00:51,937 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
12:00:51,937 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
12:00:51,937 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
12:00:51,937 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader290: onRequestLeadership RequestLeadership [requestedFollowerId=follower292, replyTo=Actor[pekko://test/user/$a#2015277694]]
12:00:51,938 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader290: Initiating leader transfer
12:00:51,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorLeadershipTransferCohort - leader290: pauseLeader successfully completed - doing transfer
12:00:51,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Leader - leader290 (Leader): Attempting to transfer leadership
12:00:51,939 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower292: onLeaderTransitioning: LeaderTransitioning [leaderId=leader290]
12:00:51,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower292: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower291: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower293: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,939 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower292: Lagging 0 entries behind leader leader290 and reached -1 (of expected -1)
12:00:51,939 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower293: onLeaderTransitioning: LeaderTransitioning [leaderId=leader290]
12:00:51,939 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower293: Lagging 0 entries behind leader leader290 and reached -1 (of expected -1)
12:00:51,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Leader - leader290 (Leader): tryToCompleteLeadershipTransfer: followerId: follower292, matchIndex: -1, lastIndex: -1, isVoting: true
12:00:51,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Leader - leader290 (Leader): Follower's log matches - sending ElectionTimeout
12:00:51,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower292: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower291: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,939 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower292: Lagging 0 entries behind leader leader290 and reached -1 (of expected -1)
[WARN] [07/02/2025 00:00:51.939] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower292] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower292, initialSyncDone=true]
12:00:51,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower293: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:51.939] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower293] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower293, initialSyncDone=true]
12:00:51,939 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower293: Lagging 0 entries behind leader leader290 and reached -1 (of expected -1)
12:00:51,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Leader - leader290 (Leader): Leader transfer complete
12:00:51,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorLeadershipTransferCohort - leader290: leader transfer complete - waiting for new leader
12:00:51,939 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
12:00:51,939 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower292 (Follower): Received TimeoutNow - switching to Candidate
12:00:51,939 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - follower292 (Candidate): Election: Candidate has following voting peers: [follower291, leader290]
12:00:51,941 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower291: Set currentTerm=2, votedFor=leader290
12:00:51,941 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower291 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
12:00:51,941 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower291: Last sync leader does not match current leader leader290, need to catch up to -1
12:00:51,941 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower291: Lagging 0 entries behind leader leader290 and reached -1 (of expected -1)
12:00:51,941 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower291: Lagging 0 entries behind leader leader290 and reached -1 (of expected -1)
12:00:51,941 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower291: onLeaderTransitioning: LeaderTransitioning [leaderId=leader290]
12:00:51,941 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader290 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower291 updated: matchIndex: -1, nextIndex: 0
12:00:51,941 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader290 (Leader): Checking sendAppendEntries for follower follower291: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:51.941] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower291] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower291, initialSyncDone=false]
[WARN] [07/02/2025 00:00:51.941] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower291] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower291, initialSyncDone=true]
12:00:51,952 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower292: Set currentTerm=3, votedFor=follower292
12:00:51,952 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - follower292 (Candidate): Starting new election term 3
12:00:51,952 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - follower292 (Candidate): Sending RequestVote{term=3, candidateId=follower292, lastLogIndex=-1, lastLogTerm=-1} to peer follower291
12:00:51,952 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - follower292 (Candidate): Sending RequestVote{term=3, candidateId=follower292, lastLogIndex=-1, lastLogTerm=-1} to peer leader290
12:00:51,952 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower291 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
12:00:51,952 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - follower292 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
12:00:51,952 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower291 (Follower): Cluster state: []
12:00:51,952 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower291 (Follower): Candidate in requestVote:RequestVote{term=3, candidateId=follower292, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
12:00:51,952 AM [test-pekko.actor.default-dispatcher-11] [INFO] Follower - follower291 (Follower): Term 3 in "RequestVote{term=3, candidateId=follower292, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 2 - updating term
12:00:51,952 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader290 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
12:00:51,952 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader290 (Leader): Cluster state: []
12:00:51,952 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader290 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower292, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
12:00:51,952 AM [test-pekko.actor.default-dispatcher-5] [INFO] AbstractLeader - leader290 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower292, lastLogIndex=-1, lastLogTerm=-1}" message is greater than leader's term 2 - switching to Follower
12:00:51,954 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower291: Set currentTerm=3, votedFor=null
12:00:51,954 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower291 (Follower): In requestVote: RequestVote{term=3, candidateId=follower292, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
12:00:51,955 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader290: Set currentTerm=3, votedFor=null
12:00:51,955 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader290 (Leader): Leadership transfer in progress - processing RequestVote
12:00:51,955 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader290 (Leader): In requestVote: RequestVote{term=3, candidateId=follower292, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
12:00:51,957 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower291: Set currentTerm=3, votedFor=follower292
12:00:51,957 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower291 (Follower): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
12:00:51,957 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - follower292 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3
12:00:51,957 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - follower292 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1
12:00:51,957 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - follower292 (Leader): Election: Leader has following peers: [follower291, follower293, leader290]
12:00:51,957 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - follower292 (Leader): Checking sendAppendEntries for follower follower291: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,957 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - follower292 (Leader): Checking sendAppendEntries for follower follower293: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,957 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - follower292 (Leader): Checking sendAppendEntries for follower leader290: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,958 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - follower292 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
12:00:51,958 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower291: Last sync leader does not match current leader follower292, need to catch up to -1
12:00:51,958 AM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower293 (Follower): Term 3 in "AppendEntries{term=3, leaderId=follower292, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 2 - updating term
12:00:51,958 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - follower292 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower291 updated: matchIndex: -1, nextIndex: 0
12:00:51,958 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - follower292 (Leader): Checking sendAppendEntries for follower follower291: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:51.958] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower291] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower291, initialSyncDone=false]
12:00:51,960 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader290: Set currentTerm=3, votedFor=follower292
12:00:51,960 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader290 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
12:00:51,960 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader290 (Leader) :- Switching from behavior Leader to Follower, election term: 3
12:00:51,960 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - leader290: Last sync leader does not match current leader follower292, need to catch up to -1
12:00:51,960 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorLeadershipTransferCohort - leader290: leader changed to follower292
12:00:51,960 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorLeadershipTransferCohort - leader290: Successfully transferred leadership to follower292 in 21.42 ms
12:00:51,960 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader290: Leadership transferred successfully to follower292
12:00:51,960 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower293: Set currentTerm=3, votedFor=null
12:00:51,960 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower292 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader290 updated: matchIndex: -1, nextIndex: 0
12:00:51,960 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower293: Last sync leader does not match current leader follower292, need to catch up to -1
12:00:51,960 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower292 (Leader): Checking sendAppendEntries for follower leader290: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:51,961 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower292 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower293 updated: matchIndex: -1, nextIndex: 0
12:00:51,961 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - follower292 (Leader): Checking sendAppendEntries for follower follower293: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:51.961] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/leader290] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=leader290, initialSyncDone=false]
[WARN] [07/02/2025 00:00:51.961] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower293] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower293, initialSyncDone=false]
12:00:51,988 AM [main] [INFO] LeadershipTransferIntegrationTest - testSuccessfulRequestLeadershipTransferToFollower2 ending
12:00:51,989 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower291-notifier294#1860679246]
12:00:51,990 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower291-collector295#-2055661594]
12:00:51,990 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower291]
12:00:51,990 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower291: terminating thread VirtualThread[#728,follower291-writer-132]/waiting
12:00:51,991 AM [follower291-writer-132] [DEBUG] JournalWriteTask - follower291: received 1 commands after 471.1 ms
12:00:51,991 AM [follower291-writer-132] [DEBUG] JournalWriteTask - follower291: completed 1 commands in 13.66 μs
12:00:51,991 AM [follower291-writer-132] [DEBUG] JournalWriteTask - follower291: journal writer stopped
12:00:51,991 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower291: journal closed
12:00:51,991 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower291: journal closed
12:00:51,991 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower291: stopped executor with 0 remaining tasks
12:00:51,991 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower291: stopped executor with 0 remaining tasks
12:00:51,991 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower292-notifier296#172931232]
12:00:51,991 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower292-collector297#-752001221]
12:00:51,992 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower292]
12:00:51,992 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower292: terminating thread VirtualThread[#729,follower292-writer-133]/waiting
12:00:51,992 AM [follower292-writer-133] [DEBUG] JournalWriteTask - follower292: received 1 commands after 469.5 ms
12:00:51,992 AM [follower292-writer-133] [DEBUG] JournalWriteTask - follower292: completed 1 commands in 9.760 μs
12:00:51,992 AM [follower292-writer-133] [DEBUG] JournalWriteTask - follower292: journal writer stopped
12:00:51,992 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower292: journal closed
12:00:51,992 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower292: journal closed
12:00:51,992 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower292: stopped executor with 0 remaining tasks
12:00:51,992 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower292: stopped executor with 0 remaining tasks
12:00:51,992 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower293-notifier298#-1354618761]
12:00:51,993 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower293-collector299#1273703034]
12:00:51,993 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower293]
12:00:51,993 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower293: terminating thread VirtualThread[#730,follower293-writer-134]/waiting
12:00:51,993 AM [follower293-writer-134] [DEBUG] JournalWriteTask - follower293: received 1 commands after 463.7 ms
12:00:51,993 AM [follower293-writer-134] [DEBUG] JournalWriteTask - follower293: completed 1 commands in 14.86 μs
12:00:51,993 AM [follower293-writer-134] [DEBUG] JournalWriteTask - follower293: journal writer stopped
12:00:51,993 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower293: journal closed
12:00:51,993 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower293: journal closed
12:00:51,993 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: stopped executor with 0 remaining tasks
12:00:51,994 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower293: stopped executor with 0 remaining tasks
12:00:51,994 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader290-notifier300#-1547477565]
12:00:51,994 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader290-collector301#305123809]
12:00:51,994 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader290]
12:00:51,994 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - leader290: terminating thread VirtualThread[#731,leader290-writer-135]/waiting
12:00:51,994 AM [leader290-writer-135] [DEBUG] JournalWriteTask - leader290: received 1 commands after 460.0 ms
12:00:51,994 AM [leader290-writer-135] [DEBUG] JournalWriteTask - leader290: completed 1 commands in 5.630 μs
12:00:51,994 AM [leader290-writer-135] [DEBUG] JournalWriteTask - leader290: journal writer stopped
12:00:51,995 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader290: journal closed
12:00:51,995 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader290: journal closed
12:00:51,995 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader290: stopped executor with 0 remaining tasks
12:00:51,995 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader290: stopped executor with 0 remaining tasks
12:00:51,995 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$a#2015277694]
12:00:51,996 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown starting
12:00:51,997 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [07/02/2025 00:00:51.998] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower303]: org.opendaylight.controller.cluster.common.actor.Monitor@3934ab2
12:00:51,999 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower303: Starting recovery with journal batch size 1000
12:00:51,999 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower303: started executor
12:00:51,999 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower303: started executor
12:00:51,999 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower303: metadata journal open: replayFrom=1 applyTo=0
12:00:52,0 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower303: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:52,0 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower303: journal open: applyTo=0
12:00:52,0 AM [follower303-writer-136] [DEBUG] JournalWriteTask - follower303: journal writer started
12:00:52,0 AM [follower303-writer-136] [DEBUG] JournalWriteTask - follower303: waiting to receive commands
12:00:52,1 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower303/TermInfo.properties does not exist
12:00:52,1 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower303: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower303/journal-v1-1.log
12:00:52,1 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower303: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower303/metadata-v1-1.log
12:00:52,1 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower303: no eligible files found
12:00:52,1 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower303: SnapshotOffer called.
12:00:52,1 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower303: initializing from snapshot taken at 2025-07-02T00:00:51.997Z
12:00:52,1 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower303: Set currentTerm=1, votedFor=null
12:00:52,1 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PeerInfos - follower303: Updated server config: isVoting: true, peers: [PeerInfo [id=follower304, address=pekko://test/user/follower304, votingState=VOTING], PeerInfo [id=leader302, address=pekko://test/user/leader302, votingState=VOTING], PeerInfo [id=follower305, address=pekko://test/user/follower305, votingState=NON_VOTING]]
12:00:52,1 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - Recovery snapshot applied for follower303 in 72.30 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:52,1 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower303: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:51.997Z
12:00:52,1 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower303: support() called
12:00:52,1 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower303: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower303/snapshot-00000000686476B3-3B6D0340.tmp
[WARN] [07/02/2025 00:00:52.003] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower304]: org.opendaylight.controller.cluster.common.actor.Monitor@51c44b52
12:00:52,4 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower304: Starting recovery with journal batch size 1000
12:00:52,4 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower304: started executor
12:00:52,4 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower304: started executor
12:00:52,5 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower304: metadata journal open: replayFrom=1 applyTo=0
12:00:52,6 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower304: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:52,6 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower304: journal open: applyTo=0
12:00:52,6 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower303: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower303/snapshot-00000000686476B3-3B6D0340.v1
12:00:52,6 AM [follower304-writer-137] [DEBUG] JournalWriteTask - follower304: journal writer started
12:00:52,6 AM [follower304-writer-137] [DEBUG] JournalWriteTask - follower304: waiting to receive commands
12:00:52,6 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower303: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower303/snapshot-00000000686476B3-3B6D0340.v1
12:00:52,6 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower303: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower303/journal-v1-1.log
12:00:52,6 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower303: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower303/metadata-v1-1.log
12:00:52,6 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower303: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:51.997Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower303/snapshot-00000000686476B3-3B6D0340.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:52,6 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower303: local snapshot saved in 5.104 ms, deleting Pekko-persisted snapshots
12:00:52,6 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower304/TermInfo.properties does not exist
12:00:52,7 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower304/journal-v1-1.log
12:00:52,7 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower304/metadata-v1-1.log
12:00:52,7 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: no eligible files found
12:00:52,7 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower304: SnapshotOffer called.
12:00:52,7 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower304: initializing from snapshot taken at 2025-07-02T00:00:51.997Z
12:00:52,7 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower304: Set currentTerm=1, votedFor=null
12:00:52,7 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PeerInfos - follower304: Updated server config: isVoting: true, peers: [PeerInfo [id=follower303, address=pekko://test/user/follower303, votingState=VOTING], PeerInfo [id=leader302, address=pekko://test/user/leader302, votingState=VOTING], PeerInfo [id=follower305, address=pekko://test/user/follower305, votingState=NON_VOTING]]
12:00:52,7 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - Recovery snapshot applied for follower304 in 92.56 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:52,7 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower304: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:51.997Z
12:00:52,7 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower304: support() called
12:00:52,7 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower303: Recovery completed in 6.069 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:52,7 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower304/snapshot-00000000686476B3-3B6D0340.tmp
[WARN] [07/02/2025 00:00:52.007] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower305]: org.opendaylight.controller.cluster.common.actor.Monitor@3622c559
12:00:52,8 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower305: Starting recovery with journal batch size 1000
12:00:52,8 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower305: started executor
12:00:52,8 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower305: started executor
12:00:52,8 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower305: metadata journal open: replayFrom=1 applyTo=0
12:00:52,9 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower305: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:52,9 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower305: journal open: applyTo=0
12:00:52,9 AM [follower305-writer-138] [DEBUG] JournalWriteTask - follower305: journal writer started
12:00:52,9 AM [follower305-writer-138] [DEBUG] JournalWriteTask - follower305: waiting to receive commands
12:00:52,11 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower305/TermInfo.properties does not exist
12:00:52,11 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower305: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower305/journal-v1-1.log
12:00:52,11 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower305: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower305/metadata-v1-1.log
12:00:52,11 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower305: no eligible files found
12:00:52,11 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower305: SnapshotOffer called.
12:00:52,11 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower305: initializing from snapshot taken at 2025-07-02T00:00:51.997Z
12:00:52,11 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower305: Set currentTerm=1, votedFor=null
12:00:52,12 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PeerInfos - follower305: Updated server config: isVoting: false, peers: [PeerInfo [id=follower304, address=pekko://test/user/follower304, votingState=VOTING], PeerInfo [id=follower303, address=pekko://test/user/follower303, votingState=VOTING], PeerInfo [id=leader302, address=pekko://test/user/leader302, votingState=VOTING]]
12:00:52,12 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - Recovery snapshot applied for follower305 in 79.67 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:52,12 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower305: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:51.997Z
12:00:52,12 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower305: support() called
12:00:52,12 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower305: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower305/snapshot-00000000686476B3-3B6D0340.tmp
12:00:52,13 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - leader302: Starting recovery with journal batch size 1000
12:00:52,13 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader302: started executor
12:00:52,13 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader302: started executor
12:00:52,14 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader302: metadata journal open: replayFrom=1 applyTo=0
12:00:52,14 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader302: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:52,14 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - leader302: journal open: applyTo=0
12:00:52,14 AM [leader302-writer-139] [DEBUG] JournalWriteTask - leader302: journal writer started
12:00:52,14 AM [leader302-writer-139] [DEBUG] JournalWriteTask - leader302: waiting to receive commands
[WARN] [07/02/2025 00:00:52.014] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader302]: org.opendaylight.controller.cluster.common.actor.Monitor@52e2086b
12:00:52,15 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/leader302/TermInfo.properties does not exist
12:00:52,15 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader302: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/leader302/journal-v1-1.log
12:00:52,15 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader302: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/leader302/metadata-v1-1.log
12:00:52,15 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader302: no eligible files found
12:00:52,15 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - leader302: SnapshotOffer called.
12:00:52,15 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - leader302: initializing from snapshot taken at 2025-07-02T00:00:51.997Z
12:00:52,15 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader302: Set currentTerm=1, votedFor=null
12:00:52,15 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - leader302: Updated server config: isVoting: true, peers: [PeerInfo [id=follower304, address=pekko://test/user/follower304, votingState=VOTING], PeerInfo [id=follower303, address=pekko://test/user/follower303, votingState=VOTING], PeerInfo [id=follower305, address=pekko://test/user/follower305, votingState=NON_VOTING]]
12:00:52,15 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for leader302 in 55.63 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:52,15 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader302: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:51.997Z
12:00:52,15 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader302: support() called
12:00:52,15 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader302: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/leader302/snapshot-00000000686476B3-3B6D0340.tmp
12:00:52,17 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower304/snapshot-00000000686476B3-3B6D0340.v1
12:00:52,17 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower304/snapshot-00000000686476B3-3B6D0340.v1
12:00:52,17 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower304/journal-v1-1.log
12:00:52,17 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower304/metadata-v1-1.log
12:00:52,17 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:51.997Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower304/snapshot-00000000686476B3-3B6D0340.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:52,17 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower304: local snapshot saved in 9.829 ms, deleting Pekko-persisted snapshots
12:00:52,17 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader302: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/leader302/snapshot-00000000686476B3-3B6D0340.v1
12:00:52,17 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader302: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/leader302/snapshot-00000000686476B3-3B6D0340.v1
12:00:52,17 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower305: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower305/snapshot-00000000686476B3-3B6D0340.v1
12:00:52,17 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader302: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/leader302/journal-v1-1.log
12:00:52,17 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader302: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/leader302/metadata-v1-1.log
12:00:52,17 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader302: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:51.997Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/leader302/snapshot-00000000686476B3-3B6D0340.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:52,17 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader302: local snapshot saved in 2.297 ms, deleting Pekko-persisted snapshots
12:00:52,18 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower304: Recovery completed in 10.89 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:52,18 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower303: Set currentTerm=1, votedFor=null
12:00:52,18 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower305: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower305/snapshot-00000000686476B3-3B6D0340.v1
12:00:52,18 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower303: Local TermInfo store seeded with TermInfo{term=1}
12:00:52,18 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader302: Recovery completed in 2.873 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:52,18 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower303: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@5b7bc2dc
12:00:52,18 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower303: Moving last applied index from -1 to -1
12:00:52,18 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower305: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower305/journal-v1-1.log
12:00:52,18 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower305: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower305/metadata-v1-1.log
12:00:52,18 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower305: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:51.997Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest16236025611042780653/follower305/snapshot-00000000686476B3-3B6D0340.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:52,18 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower305: local snapshot saved in 6.287 ms, deleting Pekko-persisted snapshots
12:00:52,18 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower303: empty journal: appending 0 entries
12:00:52,18 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower303: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:52,18 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower303: journal recovery completedin 299.0 μs with journalIndex=1
12:00:52,18 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower305: Recovery completed in 6.948 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:52,20 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower303: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:52,21 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower304: Set currentTerm=1, votedFor=null
12:00:52,21 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower304: Local TermInfo store seeded with TermInfo{term=1}
12:00:52,21 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader302: Set currentTerm=1, votedFor=null
12:00:52,21 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower304: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@59a704a7
12:00:52,21 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader302: Local TermInfo store seeded with TermInfo{term=1}
12:00:52,21 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader302: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@62f101a
12:00:52,21 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower304: Moving last applied index from -1 to -1
12:00:52,21 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader302: Moving last applied index from -1 to -1
12:00:52,21 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - follower304: empty journal: appending 0 entries
12:00:52,21 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader302: empty journal: appending 0 entries
12:00:52,22 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower304: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:52,22 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - follower304: journal recovery completedin 310.2 μs with journalIndex=1
12:00:52,22 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader302: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:52,22 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader302: journal recovery completedin 343.9 μs with journalIndex=1
12:00:52,22 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower305: Set currentTerm=1, votedFor=null
12:00:52,22 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower305: Local TermInfo store seeded with TermInfo{term=1}
12:00:52,22 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower305: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@1b07d2de
12:00:52,22 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower305: Moving last applied index from -1 to -1
12:00:52,22 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower305: empty journal: appending 0 entries
12:00:52,22 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower304: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:52,22 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower305: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:52,22 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower305: journal recovery completedin 228.7 μs with journalIndex=1
12:00:52,22 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader302: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:52,23 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower305: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:52,382 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
12:00:52,382 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader302 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.227:17355, Removed)
12:00:52,382 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader302 (Follower): Received ElectionTimeout - switching to Candidate
12:00:52,382 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader302 (Candidate): Election: Candidate has following voting peers: [follower304, follower303]
12:00:52,386 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader302: Set currentTerm=2, votedFor=leader302
12:00:52,386 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader302 (Candidate): Starting new election term 2
12:00:52,386 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader302 (Candidate): Sending RequestVote{term=2, candidateId=leader302, lastLogIndex=-1, lastLogTerm=-1} to peer follower304
12:00:52,386 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower304 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
12:00:52,386 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower304 (Follower): Cluster state: []
12:00:52,386 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower304 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader302, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
12:00:52,386 AM [test-pekko.actor.default-dispatcher-11] [INFO] Follower - follower304 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader302, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
12:00:52,388 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader302 (Candidate): Sending RequestVote{term=2, candidateId=leader302, lastLogIndex=-1, lastLogTerm=-1} to peer follower303
12:00:52,388 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower303 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
12:00:52,388 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower303 (Follower): Cluster state: []
12:00:52,388 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower303 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader302, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
12:00:52,388 AM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - follower303 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader302, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
12:00:52,388 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader302 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
12:00:52,393 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower304: Set currentTerm=2, votedFor=null
12:00:52,393 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower304 (Follower): In requestVote: RequestVote{term=2, candidateId=leader302, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
12:00:52,394 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower303: Set currentTerm=2, votedFor=null
12:00:52,395 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower303 (Follower): In requestVote: RequestVote{term=2, candidateId=leader302, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
12:00:52,396 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower304: Set currentTerm=2, votedFor=leader302
12:00:52,396 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower304 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
12:00:52,396 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader302 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
12:00:52,396 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader302 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
12:00:52,396 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader302 (Leader): Election: Leader has following peers: [follower304, follower303, follower305]
12:00:52,396 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower304: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:52,396 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower303: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:52,396 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower305: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:52,396 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader302 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
12:00:52,397 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower304: Last sync leader does not match current leader leader302, need to catch up to -1
12:00:52,397 AM [test-pekko.actor.default-dispatcher-18] [INFO] Follower - follower305 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader302, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
12:00:52,397 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower303: Set currentTerm=2, votedFor=leader302
12:00:52,397 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower303 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
12:00:52,397 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower303: Last sync leader does not match current leader leader302, need to catch up to -1
12:00:52,397 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader302 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower304 updated: matchIndex: -1, nextIndex: 0
12:00:52,397 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower304: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:52.397] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower304] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower304, initialSyncDone=false]
12:00:52,398 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader302 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower303 updated: matchIndex: -1, nextIndex: 0
[WARN] [07/02/2025 00:00:52.398] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower303] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower303, initialSyncDone=false]
12:00:52,398 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower303: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:52,400 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower305: Set currentTerm=2, votedFor=null
12:00:52,401 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower305: Last sync leader does not match current leader leader302, need to catch up to -1
12:00:52,401 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader302 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower305 updated: matchIndex: -1, nextIndex: 0
[WARN] [07/02/2025 00:00:52.401] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower305] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower305, initialSyncDone=false]
12:00:52,401 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower305: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:52,425 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
12:00:52,425 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
12:00:52,426 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
12:00:52,426 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower304 starting
12:00:52,426 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower304: onShutDown
12:00:52,427 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - follower304: terminating thread VirtualThread[#733,follower304-writer-137]/waiting
12:00:52,427 AM [follower304-writer-137] [DEBUG] JournalWriteTask - follower304: received 1 commands after 420.9 ms
12:00:52,427 AM [follower304-writer-137] [DEBUG] JournalWriteTask - follower304: completed 1 commands in 14.91 μs
12:00:52,427 AM [follower304-writer-137] [DEBUG] JournalWriteTask - follower304: journal writer stopped
12:00:52,427 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower304: journal closed
12:00:52,427 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower304: journal closed
12:00:52,427 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: stopped executor with 0 remaining tasks
12:00:52,427 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower304: stopped executor with 0 remaining tasks
12:00:52,427 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower304 ending
12:00:52,427 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
12:00:52,427 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
12:00:52,427 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader302: onRequestLeadership RequestLeadership [requestedFollowerId=follower304, replyTo=Actor[pekko://test/user/$b#920721614]]
12:00:52,428 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader302: Initiating leader transfer
12:00:52,428 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader302: pauseLeader successfully completed - doing transfer
12:00:52,428 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower303: onLeaderTransitioning: LeaderTransitioning [leaderId=leader302]
12:00:52,428 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Leader - leader302 (Leader): Attempting to transfer leadership
[WARN] [07/02/2025 00:00:52.428] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower304] received dead letter from TestActor[pekko://test/user/leader302]: LeaderTransitioning [leaderId=leader302]
12:00:52,428 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower304: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:52,428 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower303: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:52,428 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader302 (Leader): Checking sendAppendEntries for follower follower305: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:52.428] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower304] received dead letter from TestActor[pekko://test/user/leader302]: AppendEntries{term=2, leaderId=leader302, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
12:00:52,428 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower303: Lagging 0 entries behind leader leader302 and reached -1 (of expected -1)
[WARN] [07/02/2025 00:00:52.428] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower303] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower303, initialSyncDone=true]
12:00:52,429 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower305: Lagging 0 entries behind leader leader302 and reached -1 (of expected -1)
12:00:52,429 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower305: onLeaderTransitioning: LeaderTransitioning [leaderId=leader302]
[WARN] [07/02/2025 00:00:52.429] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower305] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower305, initialSyncDone=true]
[WARN] [07/02/2025 00:00:52.513] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower304] received dead letter from TestActor[pekko://test/user/leader302]: AppendEntries{term=2, leaderId=leader302, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
[WARN] [07/02/2025 00:00:52.632] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower304] received dead letter from TestActor[pekko://test/user/leader302]: AppendEntries{term=2, leaderId=leader302, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
12:00:52,632 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower303: Lagging 0 entries behind leader leader302 and reached -1 (of expected -1)
12:00:52,632 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower305: Lagging 0 entries behind leader leader302 and reached -1 (of expected -1)
12:00:52,752 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorLeadershipTransferCohort - leader302: leader transfer aborted
12:00:52,752 AM [test-pekko.actor.default-dispatcher-12] [WARN] RaftActorLeadershipTransferCohort - leader302: Failed to transfer leadership in 324.5 ms
12:00:52,752 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader302: LeadershipTransfer request from follower304 failed
12:00:52,753 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Leader - leader302 (Leader): Leadership transfer expired
12:00:52,753 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower303: Lagging 0 entries behind leader leader302 and reached -1 (of expected -1)
12:00:52,753 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower305: Lagging 0 entries behind leader leader302 and reached -1 (of expected -1)
[WARN] [07/02/2025 00:00:52.753] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower304] received dead letter from TestActor[pekko://test/user/leader302]: AppendEntries{term=2, leaderId=leader302, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
12:00:52,781 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Shutdown ending
12:00:52,781 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower303-notifier306#1828756720]
12:00:52,782 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower303-collector307#1544923868]
12:00:52,783 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower303]
12:00:52,783 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower303: terminating thread VirtualThread[#732,follower303-writer-136]/waiting
12:00:52,783 AM [follower303-writer-136] [DEBUG] JournalWriteTask - follower303: received 1 commands after 783.1 ms
12:00:52,783 AM [follower303-writer-136] [DEBUG] JournalWriteTask - follower303: completed 1 commands in 15.89 μs
12:00:52,783 AM [follower303-writer-136] [DEBUG] JournalWriteTask - follower303: journal writer stopped
12:00:52,784 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower303: journal closed
12:00:52,784 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower303: journal closed
12:00:52,784 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower303: stopped executor with 0 remaining tasks
12:00:52,784 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower303: stopped executor with 0 remaining tasks
12:00:52,784 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower304-notifier308#551922033]
12:00:52,784 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower304-collector309#-1443824373]
12:00:52,784 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower304]
12:00:52,785 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower305-notifier310#1462716585]
12:00:52,785 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower305-collector311#-495509354]
12:00:52,785 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower305]
12:00:52,785 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower305: terminating thread VirtualThread[#734,follower305-writer-138]/waiting
12:00:52,785 AM [follower305-writer-138] [DEBUG] JournalWriteTask - follower305: received 1 commands after 776.2 ms
12:00:52,785 AM [follower305-writer-138] [DEBUG] JournalWriteTask - follower305: completed 1 commands in 9.230 μs
12:00:52,785 AM [follower305-writer-138] [DEBUG] JournalWriteTask - follower305: journal writer stopped
12:00:52,786 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower305: journal closed
12:00:52,786 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower305: journal closed
12:00:52,786 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower305: stopped executor with 0 remaining tasks
12:00:52,786 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower305: stopped executor with 0 remaining tasks
12:00:52,786 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader302-notifier312#252349798]
12:00:52,786 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader302-collector313#-318604151]
12:00:52,786 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader302]
12:00:52,786 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - leader302: terminating thread VirtualThread[#735,leader302-writer-139]/waiting
12:00:52,786 AM [leader302-writer-139] [DEBUG] JournalWriteTask - leader302: received 1 commands after 772.2 ms
12:00:52,787 AM [leader302-writer-139] [DEBUG] JournalWriteTask - leader302: completed 1 commands in 8.600 μs
12:00:52,787 AM [leader302-writer-139] [DEBUG] JournalWriteTask - leader302: journal writer stopped
12:00:52,787 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader302: journal closed
12:00:52,787 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader302: journal closed
12:00:52,787 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader302: stopped executor with 0 remaining tasks
12:00:52,787 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader302: stopped executor with 0 remaining tasks
12:00:52,787 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$b#920721614]
12:00:52,790 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown starting
12:00:52,790 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [07/02/2025 00:00:52.792] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower315]: org.opendaylight.controller.cluster.common.actor.Monitor@749a1c2d
12:00:52,793 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower315: Starting recovery with journal batch size 1000
12:00:52,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower315: started executor
12:00:52,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower315: started executor
12:00:52,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower315: metadata journal open: replayFrom=1 applyTo=0
12:00:52,794 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower315: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:52,794 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower315: journal open: applyTo=0
12:00:52,794 AM [follower315-writer-140] [DEBUG] JournalWriteTask - follower315: journal writer started
12:00:52,794 AM [follower315-writer-140] [DEBUG] JournalWriteTask - follower315: waiting to receive commands
12:00:52,794 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower315/TermInfo.properties does not exist
12:00:52,795 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower315: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower315/journal-v1-1.log
12:00:52,795 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower315: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower315/metadata-v1-1.log
12:00:52,795 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower315: no eligible files found
12:00:52,795 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower315: SnapshotOffer called.
12:00:52,795 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower315: initializing from snapshot taken at 2025-07-02T00:00:52.790Z
12:00:52,795 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower315: Set currentTerm=1, votedFor=null
12:00:52,795 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PeerInfos - follower315: Updated server config: isVoting: true, peers: [PeerInfo [id=follower317, address=pekko://test/user/follower317, votingState=NON_VOTING], PeerInfo [id=follower316, address=pekko://test/user/follower316, votingState=VOTING], PeerInfo [id=leader314, address=pekko://test/user/leader314, votingState=VOTING]]
12:00:52,795 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - Recovery snapshot applied for follower315 in 74.73 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:52,795 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower315: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:52.790Z
12:00:52,795 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower315: support() called
12:00:52,795 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower315: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower315/snapshot-00000000686476B4-2F167180.tmp
[WARN] [07/02/2025 00:00:52.796] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower316]: org.opendaylight.controller.cluster.common.actor.Monitor@19005de
12:00:52,796 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - follower316: Starting recovery with journal batch size 1000
12:00:52,797 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower316: started executor
12:00:52,797 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower316: started executor
12:00:52,797 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower316: metadata journal open: replayFrom=1 applyTo=0
12:00:52,798 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower316: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:52,798 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower316: journal open: applyTo=0
12:00:52,798 AM [follower316-writer-141] [DEBUG] JournalWriteTask - follower316: journal writer started
12:00:52,798 AM [follower316-writer-141] [DEBUG] JournalWriteTask - follower316: waiting to receive commands
12:00:52,799 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower316/TermInfo.properties does not exist
12:00:52,799 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower316: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower316/journal-v1-1.log
12:00:52,799 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower316: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower316/metadata-v1-1.log
12:00:52,799 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower316: no eligible files found
12:00:52,799 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower316: SnapshotOffer called.
12:00:52,799 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - follower316: initializing from snapshot taken at 2025-07-02T00:00:52.790Z
12:00:52,799 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower316: Set currentTerm=1, votedFor=null
12:00:52,799 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - follower316: Updated server config: isVoting: true, peers: [PeerInfo [id=follower315, address=pekko://test/user/follower315, votingState=VOTING], PeerInfo [id=follower317, address=pekko://test/user/follower317, votingState=NON_VOTING], PeerInfo [id=leader314, address=pekko://test/user/leader314, votingState=VOTING]]
12:00:52,799 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for follower316 in 138.6 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:52,799 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower316: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:52.790Z
12:00:52,799 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower316: support() called
12:00:52,800 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower315: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower315/snapshot-00000000686476B4-2F167180.v1
[WARN] [07/02/2025 00:00:52.800] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower317]: org.opendaylight.controller.cluster.common.actor.Monitor@7aef8398
12:00:52,800 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower316: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower316/snapshot-00000000686476B4-2F167180.tmp
12:00:52,800 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower315: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower315/snapshot-00000000686476B4-2F167180.v1
12:00:52,800 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower315: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower315/journal-v1-1.log
12:00:52,800 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower315: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower315/metadata-v1-1.log
12:00:52,800 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - follower317: Starting recovery with journal batch size 1000
12:00:52,800 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower317: started executor
12:00:52,800 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower317: started executor
12:00:52,800 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower315: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:52.790Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower315/snapshot-00000000686476B4-2F167180.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:52,800 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower315: local snapshot saved in 5.491 ms, deleting Pekko-persisted snapshots
12:00:52,801 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower317: metadata journal open: replayFrom=1 applyTo=0
12:00:52,801 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower317: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:52,802 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower317: journal open: applyTo=0
12:00:52,802 AM [follower317-writer-142] [DEBUG] JournalWriteTask - follower317: journal writer started
12:00:52,802 AM [follower317-writer-142] [DEBUG] JournalWriteTask - follower317: waiting to receive commands
12:00:52,802 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower315: Recovery completed in 6.898 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:52,802 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower317/TermInfo.properties does not exist
12:00:52,802 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower316: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower316/snapshot-00000000686476B4-2F167180.v1
12:00:52,802 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower317: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower317/journal-v1-1.log
12:00:52,802 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower317: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower317/metadata-v1-1.log
12:00:52,802 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower317: no eligible files found
12:00:52,802 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower317: SnapshotOffer called.
12:00:52,802 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower316: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower316/snapshot-00000000686476B4-2F167180.v1
12:00:52,802 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - follower317: initializing from snapshot taken at 2025-07-02T00:00:52.790Z
12:00:52,802 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower317: Set currentTerm=1, votedFor=null
12:00:52,802 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower316: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower316/journal-v1-1.log
12:00:52,802 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - follower317: Updated server config: isVoting: false, peers: [PeerInfo [id=follower315, address=pekko://test/user/follower315, votingState=VOTING], PeerInfo [id=follower316, address=pekko://test/user/follower316, votingState=VOTING], PeerInfo [id=leader314, address=pekko://test/user/leader314, votingState=VOTING]]
12:00:52,802 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower316: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower316/metadata-v1-1.log
12:00:52,802 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower316: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:52.790Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower316/snapshot-00000000686476B4-2F167180.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:52,802 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - Recovery snapshot applied for follower317 in 74.70 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:52,802 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower317: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:52.790Z
12:00:52,802 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower317: support() called
12:00:52,802 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower316: local snapshot saved in 3.052 ms, deleting Pekko-persisted snapshots
12:00:52,803 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower317: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower317/snapshot-00000000686476B4-2F167180.tmp
12:00:52,803 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower316: Recovery completed in 4.141 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [07/02/2025 00:00:52.805] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader314]: org.opendaylight.controller.cluster.common.actor.Monitor@2bee3797
12:00:52,805 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower315: Set currentTerm=1, votedFor=null
12:00:52,805 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower315: Local TermInfo store seeded with TermInfo{term=1}
12:00:52,805 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower315: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@5800b091
12:00:52,805 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower315: Moving last applied index from -1 to -1
12:00:52,806 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower315: empty journal: appending 0 entries
12:00:52,806 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - leader314: Starting recovery with journal batch size 1000
12:00:52,806 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader314: started executor
12:00:52,806 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader314: started executor
12:00:52,806 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower317: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower317/snapshot-00000000686476B4-2F167180.v1
12:00:52,806 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower315: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:52,806 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower317: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower317/snapshot-00000000686476B4-2F167180.v1
12:00:52,806 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower315: journal recovery completedin 888.4 μs with journalIndex=1
12:00:52,806 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower317: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower317/journal-v1-1.log
12:00:52,806 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower317: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower317/metadata-v1-1.log
12:00:52,806 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader314: metadata journal open: replayFrom=1 applyTo=0
12:00:52,806 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower317: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:52.790Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/follower317/snapshot-00000000686476B4-2F167180.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:52,806 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower317: local snapshot saved in 4.024 ms, deleting Pekko-persisted snapshots
12:00:52,807 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower316: Set currentTerm=1, votedFor=null
12:00:52,807 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower316: Local TermInfo store seeded with TermInfo{term=1}
12:00:52,807 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader314: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:52,807 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - leader314: journal open: applyTo=0
12:00:52,807 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower316: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@55053691
12:00:52,807 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower316: Moving last applied index from -1 to -1
12:00:52,807 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower315: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:52,807 AM [leader314-writer-143] [DEBUG] JournalWriteTask - leader314: journal writer started
12:00:52,807 AM [leader314-writer-143] [DEBUG] JournalWriteTask - leader314: waiting to receive commands
12:00:52,807 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower316: empty journal: appending 0 entries
12:00:52,807 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower316: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:52,807 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/leader314/TermInfo.properties does not exist
12:00:52,808 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower316: journal recovery completedin 390.3 μs with journalIndex=1
12:00:52,808 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader314: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/leader314/journal-v1-1.log
12:00:52,808 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader314: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/leader314/metadata-v1-1.log
12:00:52,808 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader314: no eligible files found
12:00:52,808 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - leader314: SnapshotOffer called.
12:00:52,808 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - leader314: initializing from snapshot taken at 2025-07-02T00:00:52.790Z
12:00:52,808 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader314: Set currentTerm=1, votedFor=null
12:00:52,808 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - leader314: Updated server config: isVoting: true, peers: [PeerInfo [id=follower315, address=pekko://test/user/follower315, votingState=VOTING], PeerInfo [id=follower317, address=pekko://test/user/follower317, votingState=NON_VOTING], PeerInfo [id=follower316, address=pekko://test/user/follower316, votingState=VOTING]]
12:00:52,808 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - Recovery snapshot applied for leader314 in 49.54 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:52,808 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader314: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:52.790Z
12:00:52,808 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower317: Recovery completed in 5.512 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:52,808 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - leader314: support() called
12:00:52,808 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower316: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:52,808 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader314: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/leader314/snapshot-00000000686476B4-2F167180.tmp
12:00:52,812 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader314: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/leader314/snapshot-00000000686476B4-2F167180.v1
12:00:52,812 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader314: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/leader314/snapshot-00000000686476B4-2F167180.v1
12:00:52,812 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader314: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/leader314/journal-v1-1.log
12:00:52,812 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader314: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/leader314/metadata-v1-1.log
12:00:52,812 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader314: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:52.790Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest10389222330829532221/leader314/snapshot-00000000686476B4-2F167180.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:52,812 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader314: local snapshot saved in 4.114 ms, deleting Pekko-persisted snapshots
12:00:52,812 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader314: Recovery completed in 4.706 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:52,812 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower317: Set currentTerm=1, votedFor=null
12:00:52,812 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower317: Local TermInfo store seeded with TermInfo{term=1}
12:00:52,812 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower317: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@7db0c7e
12:00:52,812 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower317: Moving last applied index from -1 to -1
12:00:52,813 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - follower317: empty journal: appending 0 entries
12:00:52,813 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower317: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:52,813 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - follower317: journal recovery completedin 234.9 μs with journalIndex=1
12:00:52,813 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower317: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:52,815 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader314: Set currentTerm=1, votedFor=null
12:00:52,816 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader314: Local TermInfo store seeded with TermInfo{term=1}
12:00:52,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader314: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@6bba9f89
12:00:52,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - leader314: Moving last applied index from -1 to -1
12:00:52,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - leader314: empty journal: appending 0 entries
12:00:52,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader314: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:52,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - leader314: journal recovery completedin 259.8 μs with journalIndex=1
12:00:52,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader314: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:53,162 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
12:00:53,162 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - leader314 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.227:17355, Removed)
12:00:53,162 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - leader314 (Follower): Received ElectionTimeout - switching to Candidate
12:00:53,162 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader314 (Candidate): Election: Candidate has following voting peers: [follower315, follower316]
12:00:53,166 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader314: Set currentTerm=2, votedFor=leader314
12:00:53,166 AM [test-pekko.actor.default-dispatcher-18] [INFO] Candidate - leader314 (Candidate): Starting new election term 2
12:00:53,166 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader314 (Candidate): Sending RequestVote{term=2, candidateId=leader314, lastLogIndex=-1, lastLogTerm=-1} to peer follower315
12:00:53,166 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader314 (Candidate): Sending RequestVote{term=2, candidateId=leader314, lastLogIndex=-1, lastLogTerm=-1} to peer follower316
12:00:53,167 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader314 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
12:00:53,167 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower315 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
12:00:53,167 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower315 (Follower): Cluster state: []
12:00:53,167 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower315 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader314, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
12:00:53,167 AM [test-pekko.actor.default-dispatcher-18] [INFO] Follower - follower315 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader314, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
12:00:53,167 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower316 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
12:00:53,167 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower316 (Follower): Cluster state: []
12:00:53,167 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower316 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader314, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
12:00:53,167 AM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower316 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader314, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
12:00:53,169 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower315: Set currentTerm=2, votedFor=null
12:00:53,169 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower315 (Follower): In requestVote: RequestVote{term=2, candidateId=leader314, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
12:00:53,170 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower316: Set currentTerm=2, votedFor=null
12:00:53,170 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower316 (Follower): In requestVote: RequestVote{term=2, candidateId=leader314, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
12:00:53,172 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower315: Set currentTerm=2, votedFor=leader314
12:00:53,172 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower315 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
12:00:53,172 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader314 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
12:00:53,172 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader314 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
12:00:53,172 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Election: Leader has following peers: [follower315, follower317, follower316]
12:00:53,173 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower315: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:53,173 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower317: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:53,173 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower317 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader314, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
12:00:53,173 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower315: Last sync leader does not match current leader leader314, need to catch up to -1
12:00:53,173 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower316: Set currentTerm=2, votedFor=leader314
12:00:53,173 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower316 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
[WARN] [07/02/2025 00:00:53.173] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower315] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower315, initialSyncDone=false]
12:00:53,173 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower316: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:53,173 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader314 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
12:00:53,174 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower315 updated: matchIndex: -1, nextIndex: 0
12:00:53,174 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower315: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:53,174 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower316: Last sync leader does not match current leader leader314, need to catch up to -1
12:00:53,174 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower316 updated: matchIndex: -1, nextIndex: 0
12:00:53,174 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower316: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:53,175 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower317: Set currentTerm=2, votedFor=null
12:00:53,175 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower317: Last sync leader does not match current leader leader314, need to catch up to -1
12:00:53,175 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader314 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower317 updated: matchIndex: -1, nextIndex: 0
12:00:53,175 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower317: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:53.175] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower317] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower317, initialSyncDone=false]
[WARN] [07/02/2025 00:00:53.176] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower316] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower316, initialSyncDone=false]
12:00:53,219 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
12:00:53,219 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting
12:00:53,219 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader314: Persist data index=0 term=2 command=zero
12:00:53,219 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader314: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
12:00:53,219 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
12:00:53,219 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower315: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:53,219 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): sendAppendEntries: 0 is present for follower follower315
12:00:53,219 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Sending AppendEntries to follower follower315: AppendEntries{term=2, leaderId=leader314, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
12:00:53,219 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower317: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:53,220 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): sendAppendEntries: 0 is present for follower follower317
12:00:53,220 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Sending AppendEntries to follower follower317: AppendEntries{term=2, leaderId=leader314, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
12:00:53,220 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower316: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:53,220 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): sendAppendEntries: 0 is present for follower follower316
12:00:53,220 AM [leader314-writer-143] [DEBUG] JournalWriteTask - leader314: received 1 commands after 412.2 ms
12:00:53,220 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Sending AppendEntries to follower follower316: AppendEntries{term=2, leaderId=leader314, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
12:00:53,220 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader314: awaiting more completions to resolve 1 synchronized callback(s)
12:00:53,220 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower315 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader314, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
12:00:53,220 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower315 (Follower): Number of entries to be appended = 1
12:00:53,220 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower315 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
12:00:53,220 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower315 (Follower): Append entry to log zero
12:00:53,220 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower315: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
12:00:53,220 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower317 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader314, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
12:00:53,220 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower317 (Follower): Number of entries to be appended = 1
12:00:53,220 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower317 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
12:00:53,220 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower315 (Follower): Log size is now 1
12:00:53,220 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower315 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower315, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
12:00:53,220 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower315: Lagging 0 entries behind leader leader314 and reached -1 (of expected -1)
12:00:53,220 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower317 (Follower): Append entry to log zero
12:00:53,220 AM [follower315-writer-140] [DEBUG] JournalWriteTask - follower315: received 1 commands after 426.2 ms
12:00:53,220 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower317: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
12:00:53,220 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower317 (Follower): Log size is now 1
12:00:53,220 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower317 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower317, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
12:00:53,220 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower317: Lagging 0 entries behind leader leader314 and reached -1 (of expected -1)
[WARN] [07/02/2025 00:00:53.220] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower315] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower315, initialSyncDone=true]
12:00:53,220 AM [follower317-writer-142] [DEBUG] JournalWriteTask - follower317: received 1 commands after 418.5 ms
[WARN] [07/02/2025 00:00:53.220] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower317] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower317, initialSyncDone=true]
12:00:53,224 AM [leader314-writer-143] [DEBUG] RaftStorageCompleter - leader314: 1 completion(s) pending
12:00:53,224 AM [leader314-writer-143] [DEBUG] JournalWriteTask - leader314: completed 1 commands in 4.119 ms
12:00:53,224 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader314: running 1 completion(s)
12:00:53,224 AM [leader314-writer-143] [DEBUG] JournalWriteTask - leader314: waiting to receive commands
12:00:53,224 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader314: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=true}
12:00:53,224 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader314: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=0, term=2, command=zero, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e110@e794485}
12:00:53,224 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower315 updated: matchIndex: 0, nextIndex: 1
12:00:53,224 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
12:00:53,224 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader314 (Leader): Setting last applied to 0
12:00:53,224 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader314: Moving last applied index from -1 to 0
12:00:53,224 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader314: Applying state for log index 0 data zero
12:00:53,224 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader314: applyState called: zero
12:00:53,224 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower315: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:53,224 AM [leader314-writer-143] [DEBUG] JournalWriteTask - leader314: received 1 commands after 515.0 μs
12:00:53,224 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower317 updated: matchIndex: 0, nextIndex: 1
12:00:53,224 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower317: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:53,224 AM [leader314-writer-143] [DEBUG] EntryJournalV1 - leader314: updated meta to JournalMeta[replayFrom=1, applyTo=1]
12:00:53,225 AM [leader314-writer-143] [DEBUG] RaftStorageCompleter - leader314: 1 completion(s) pending
12:00:53,225 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower317 (Follower): Commit index set to 0
12:00:53,225 AM [leader314-writer-143] [DEBUG] JournalWriteTask - leader314: completed 1 commands in 235.0 μs
12:00:53,225 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower317: Lagging 0 entries behind leader leader314 and reached 0 (of expected -1)
12:00:53,225 AM [leader314-writer-143] [DEBUG] JournalWriteTask - leader314: waiting to receive commands
12:00:53,225 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower317 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
12:00:53,225 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - leader314: running 1 completion(s)
12:00:53,225 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower317 (Follower): Setting last applied to 0
12:00:53,225 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower317: Moving last applied index from -1 to 0
12:00:53,225 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower317: Applying state for log index 0 data zero
12:00:53,225 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower317: applyState called: zero
12:00:53,225 AM [follower317-writer-142] [DEBUG] RaftStorageCompleter - follower317: 1 completion(s) pending
12:00:53,225 AM [follower315-writer-140] [DEBUG] RaftStorageCompleter - follower315: 1 completion(s) pending
12:00:53,225 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - follower317: running 1 completion(s)
12:00:53,225 AM [follower317-writer-142] [DEBUG] JournalWriteTask - follower317: completed 1 commands in 4.611 ms
12:00:53,225 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower317: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
12:00:53,225 AM [follower315-writer-140] [DEBUG] JournalWriteTask - follower315: completed 1 commands in 4.805 ms
12:00:53,225 AM [follower317-writer-142] [DEBUG] JournalWriteTask - follower317: received 1 commands after 4.651 μs
12:00:53,225 AM [follower315-writer-140] [DEBUG] JournalWriteTask - follower315: waiting to receive commands
12:00:53,225 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower315 (Follower): Commit index set to 0
12:00:53,225 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower315: Lagging 0 entries behind leader leader314 and reached 0 (of expected -1)
12:00:53,225 AM [follower317-writer-142] [DEBUG] EntryJournalV1 - follower317: updated meta to JournalMeta[replayFrom=1, applyTo=1]
12:00:53,225 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower315 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
12:00:53,225 AM [follower317-writer-142] [DEBUG] RaftStorageCompleter - follower317: 1 completion(s) pending
12:00:53,225 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower315 (Follower): Setting last applied to 0
12:00:53,225 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - follower317: running 1 completion(s)
12:00:53,225 AM [follower317-writer-142] [DEBUG] JournalWriteTask - follower317: completed 1 commands in 154.0 μs
12:00:53,225 AM [follower317-writer-142] [DEBUG] JournalWriteTask - follower317: waiting to receive commands
12:00:53,225 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower315: Moving last applied index from -1 to 0
12:00:53,225 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower315: Applying state for log index 0 data zero
12:00:53,225 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower315: applyState called: zero
12:00:53,225 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - follower315: running 1 completion(s)
12:00:53,225 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower315: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
12:00:53,225 AM [follower315-writer-140] [DEBUG] JournalWriteTask - follower315: received 1 commands after 400.9 μs
12:00:53,225 AM [follower315-writer-140] [DEBUG] EntryJournalV1 - follower315: updated meta to JournalMeta[replayFrom=1, applyTo=1]
12:00:53,225 AM [follower315-writer-140] [DEBUG] RaftStorageCompleter - follower315: 1 completion(s) pending
12:00:53,226 AM [follower315-writer-140] [DEBUG] JournalWriteTask - follower315: completed 1 commands in 148.8 μs
12:00:53,226 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - follower315: running 1 completion(s)
12:00:53,226 AM [follower315-writer-140] [DEBUG] JournalWriteTask - follower315: waiting to receive commands
12:00:53,270 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending
12:00:53,270 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 starting
12:00:53,270 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader314: onShutDown
12:00:53,270 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader314: Initiating leader transfer
12:00:53,270 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower315: onLeaderTransitioning: LeaderTransitioning [leaderId=leader314]
12:00:53,270 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower317: onLeaderTransitioning: LeaderTransitioning [leaderId=leader314]
12:00:53,270 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader314: pauseLeader successfully completed - doing transfer
12:00:53,270 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Leader - leader314 (Leader): Attempting to transfer leadership
12:00:53,271 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower315: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:53,271 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower317: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:53,271 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower317: Lagging 0 entries behind leader leader314 and reached 0 (of expected -1)
12:00:53,271 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower315: Lagging 0 entries behind leader leader314 and reached 0 (of expected -1)
12:00:53,271 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower316: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:53,271 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): sendAppendEntries: 0 is present for follower follower316
12:00:53,271 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Sending AppendEntries to follower follower316: AppendEntries{term=2, leaderId=leader314, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
12:00:53,271 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Leader - leader314 (Leader): tryToCompleteLeadershipTransfer: followerId: follower317, matchIndex: 0, lastIndex: 0, isVoting: false
12:00:53,271 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Leader - leader314 (Leader): tryToCompleteLeadershipTransfer: followerId: follower315, matchIndex: 0, lastIndex: 0, isVoting: true
12:00:53,271 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Leader - leader314 (Leader): Follower's log matches - sending ElectionTimeout
12:00:53,271 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower315: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:53,272 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower315: Lagging 0 entries behind leader leader314 and reached 0 (of expected -1)
12:00:53,272 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower317: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:53,272 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): Checking sendAppendEntries for follower follower316: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:53,272 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader314 (Leader): sendAppendEntries: 0 is present for follower follower316
12:00:53,272 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower317: Lagging 0 entries behind leader leader314 and reached 0 (of expected -1)
12:00:53,272 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
12:00:53,272 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower315 (Follower): Received TimeoutNow - switching to Candidate
12:00:53,272 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower315 (Candidate): Election: Candidate has following voting peers: [follower316, leader314]
12:00:53,272 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Leader - leader314 (Leader): Leader transfer complete
12:00:53,273 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorLeadershipTransferCohort - leader314: leader transfer complete - waiting for new leader
12:00:53,274 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower315: Set currentTerm=3, votedFor=follower315
12:00:53,274 AM [test-pekko.actor.default-dispatcher-18] [INFO] Candidate - follower315 (Candidate): Starting new election term 3
12:00:53,274 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower315 (Candidate): Sending RequestVote{term=3, candidateId=follower315, lastLogIndex=0, lastLogTerm=2} to peer follower316
12:00:53,275 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - follower315 (Candidate): Sending RequestVote{term=3, candidateId=follower315, lastLogIndex=0, lastLogTerm=2} to peer leader314
12:00:53,275 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - follower315 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
12:00:53,275 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower316 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
12:00:53,275 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower316 (Follower): Cluster state: []
12:00:53,275 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower316 (Follower): Candidate in requestVote:RequestVote{term=3, candidateId=follower315, lastLogIndex=0, lastLogTerm=2} with higher term appears reachable, updating term.
12:00:53,275 AM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower316 (Follower): Term 3 in "RequestVote{term=3, candidateId=follower315, lastLogIndex=0, lastLogTerm=2}" message is greater than follower's term 2 - updating term
12:00:53,275 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader314 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
12:00:53,275 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader314 (Leader): Cluster state: []
12:00:53,275 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader314 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower315, lastLogIndex=0, lastLogTerm=2} with higher term appears reachable, updating term.
12:00:53,275 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractLeader - leader314 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower315, lastLogIndex=0, lastLogTerm=2}" message is greater than leader's term 2 - switching to Follower
12:00:53,277 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower316: Set currentTerm=3, votedFor=null
12:00:53,277 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower316 (Follower): In requestVote: RequestVote{term=3, candidateId=follower315, lastLogIndex=0, lastLogTerm=2} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
12:00:53,278 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader314: Set currentTerm=3, votedFor=null
12:00:53,278 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader314 (Leader): Leadership transfer in progress - processing RequestVote
12:00:53,278 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader314 (Leader): In requestVote: RequestVote{term=3, candidateId=follower315, lastLogIndex=0, lastLogTerm=2} - currentTerm: 3, votedFor: null, lastIndex: 0, lastTerm: 2
12:00:53,279 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower316: Set currentTerm=3, votedFor=follower315
12:00:53,279 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower316 (Follower): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
12:00:53,279 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - follower315 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3
12:00:53,279 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - follower315 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1
12:00:53,280 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - follower315 (Leader): Election: Leader has following peers: [follower317, follower316, leader314]
12:00:53,280 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - follower315 (Leader): Checking sendAppendEntries for follower follower317: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:53,280 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - follower315 (Leader): Checking sendAppendEntries for follower follower316: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:53,280 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - follower315 (Leader): Checking sendAppendEntries for follower leader314: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:53,280 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActorBehavior - follower315 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
12:00:53,280 AM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower317 (Follower): Term 3 in "AppendEntries{term=3, leaderId=follower315, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 2 - updating term
12:00:53,280 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader314: Set currentTerm=3, votedFor=follower315
12:00:53,280 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader314 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
12:00:53,280 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader314 (Leader) :- Switching from behavior Leader to Follower, election term: 3
12:00:53,280 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - leader314: Last sync leader does not match current leader follower315, need to catch up to -1
12:00:53,280 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader314: leader changed to follower315
12:00:53,280 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorLeadershipTransferCohort - leader314: Successfully transferred leadership to follower315 in 10.21 ms
12:00:53,280 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader314: leader transfer succeeded - sending PoisonPill
12:00:53,281 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - leader314: terminating thread VirtualThread[#739,leader314-writer-143]/waiting
12:00:53,281 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - follower315 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader314 updated: matchIndex: 0, nextIndex: 1
12:00:53,281 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - follower315 (Leader): Checking sendAppendEntries for follower leader314: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:53,281 AM [leader314-writer-143] [DEBUG] JournalWriteTask - leader314: received 1 commands after 56.11 ms
12:00:53,281 AM [leader314-writer-143] [DEBUG] JournalWriteTask - leader314: completed 1 commands in 13.48 μs
12:00:53,281 AM [leader314-writer-143] [DEBUG] JournalWriteTask - leader314: journal writer stopped
[WARN] [07/02/2025 00:00:53.281] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/leader314] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=leader314, initialSyncDone=false]
12:00:53,281 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader314: journal closed
12:00:53,281 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - leader314: journal closed
12:00:53,281 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader314: stopped executor with 0 remaining tasks
12:00:53,281 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader314: stopped executor with 0 remaining tasks
[WARN] [07/02/2025 00:00:53.281] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/leader314] received dead letter from TestActor[pekko://test/user/follower315]: AppendEntries{term=3, leaderId=follower315, prevLogIndex=0, prevLogTerm=2, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
12:00:53,282 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower317: Set currentTerm=3, votedFor=null
12:00:53,282 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower317: Last sync leader does not match current leader follower315, need to catch up to -1
12:00:53,282 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - follower315 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower317 updated: matchIndex: 0, nextIndex: 1
12:00:53,282 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - follower315 (Leader): Checking sendAppendEntries for follower follower317: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:53.282] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower317] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower317, initialSyncDone=false]
12:00:53,282 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower317: Lagging 0 entries behind leader follower315 and reached 0 (of expected -1)
[WARN] [07/02/2025 00:00:53.282] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower317] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower317, initialSyncDone=true]
12:00:53,792 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower317: Lagging 0 entries behind leader follower315 and reached 0 (of expected -1)
[WARN] [07/02/2025 00:00:53.792] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/leader314] received dead letter from TestActor[pekko://test/user/follower315]: AppendEntries{term=3, leaderId=follower315, prevLogIndex=0, prevLogTerm=2, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
12:00:53,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower316: Last sync leader does not match current leader follower315, need to catch up to -1
12:00:53,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - follower315 (Leader): sendAppendEntries: 0 is present for follower follower316
12:00:53,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - follower315 (Leader): Sending AppendEntries to follower follower316: AppendEntries{term=3, leaderId=follower315, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
[WARN] [07/02/2025 00:00:53.793] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower316] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower316, initialSyncDone=false]
12:00:53,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower316 (Follower): handleAppendEntries: AppendEntries{term=3, leaderId=follower315, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
12:00:53,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower316 (Follower): Number of entries to be appended = 1
12:00:53,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower316 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
12:00:53,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower316 (Follower): Append entry to log zero
12:00:53,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower316: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=false} 
12:00:53,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower316 (Follower): Log size is now 1
12:00:53,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower316 (Follower): Commit index set to 0
12:00:53,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower316 (Follower): handleAppendEntries returning : AppendEntriesReply{term=3, success=true, followerId=follower316, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
12:00:53,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower316: Lagging 0 entries behind leader follower315 and reached 0 (of expected -1)
12:00:53,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower316 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
12:00:53,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower316 (Follower): Setting last applied to 0
12:00:53,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower316: Moving last applied index from -1 to 0
12:00:53,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower316: Applying state for log index 0 data zero
12:00:53,793 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower316: applyState called: zero
12:00:53,793 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - follower315 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower316 updated: matchIndex: 0, nextIndex: 1
12:00:53,793 AM [follower316-writer-141] [DEBUG] JournalWriteTask - follower316: received 1 commands after 995.2 ms
12:00:53,793 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - follower315 (Leader): Checking sendAppendEntries for follower follower316: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:53.794] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower316] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower316, initialSyncDone=true]
12:00:53,824 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower316: onLeaderTransitioning: LeaderTransitioning [leaderId=leader314]
12:00:53,824 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDownToLeaderAndVerifyLeadershipTransferToFollower1 ending
12:00:53,824 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower316 starting
12:00:53,824 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower316: onShutDown
12:00:53,825 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower316: terminating thread VirtualThread[#737,follower316-writer-141]/runnable@ForkJoinPool-53-worker-3
12:00:53,833 AM [follower316-writer-141] [DEBUG] RaftStorageCompleter - follower316: 1 completion(s) pending
12:00:53,833 AM [follower316-writer-141] [DEBUG] JournalWriteTask - follower316: completed 1 commands in 39.85 ms
12:00:53,833 AM [follower316-writer-141] [DEBUG] JournalWriteTask - follower316: received 2 commands after 5.870 μs
12:00:53,833 AM [follower316-writer-141] [DEBUG] EntryJournalV1 - follower316: updated meta to JournalMeta[replayFrom=1, applyTo=1]
12:00:53,834 AM [follower316-writer-141] [DEBUG] RaftStorageCompleter - follower316: 1 more completion(s) pending
12:00:53,834 AM [follower316-writer-141] [DEBUG] JournalWriteTask - follower316: completed 2 commands in 188.8 μs
12:00:53,834 AM [follower316-writer-141] [DEBUG] JournalWriteTask - follower316: journal writer stopped
12:00:53,834 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower316: journal closed
12:00:53,834 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower316: journal closed
12:00:53,834 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower316: stopped executor with 0 remaining tasks
12:00:53,834 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower316: stopped executor with 0 remaining tasks
[WARN] [07/02/2025 00:00:53.835] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower316] received dead letter: ExecuteInSelfMessage[runnable=org.opendaylight.controller.cluster.raft.spi.RaftStorageCompleter$$Lambda/0x00000007c080b068@73453bb4]
12:00:53,835 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/follower316 ending
12:00:53,835 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferOnShutDown ending
12:00:53,835 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower315-notifier318#-1216568307]
12:00:53,847 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower315-collector319#-2069659104]
12:00:53,847 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower315]
12:00:53,847 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower315: terminating thread VirtualThread[#736,follower315-writer-140]/waiting
12:00:53,847 AM [follower315-writer-140] [DEBUG] JournalWriteTask - follower315: received 1 commands after 621.6 ms
12:00:53,847 AM [follower315-writer-140] [DEBUG] JournalWriteTask - follower315: completed 1 commands in 12.29 μs
12:00:53,847 AM [follower315-writer-140] [DEBUG] JournalWriteTask - follower315: journal writer stopped
12:00:53,847 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower315: journal closed
12:00:53,847 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower315: journal closed
12:00:53,848 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower315: stopped executor with 0 remaining tasks
12:00:53,848 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower315: stopped executor with 0 remaining tasks
12:00:53,848 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower316-notifier320#-1086369665]
12:00:53,848 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower316-collector321#-676777812]
12:00:53,848 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower316]
12:00:53,848 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower317-notifier322#1316165546]
12:00:53,849 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower317-collector323#1347618250]
12:00:53,849 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower317]
12:00:53,849 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower317: terminating thread VirtualThread[#738,follower317-writer-142]/waiting
12:00:53,849 AM [follower317-writer-142] [DEBUG] JournalWriteTask - follower317: received 1 commands after 624.0 ms
12:00:53,849 AM [follower317-writer-142] [DEBUG] JournalWriteTask - follower317: completed 1 commands in 6.810 μs
12:00:53,849 AM [follower317-writer-142] [DEBUG] JournalWriteTask - follower317: journal writer stopped
12:00:53,849 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower317: journal closed
12:00:53,849 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower317: journal closed
12:00:53,849 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower317: stopped executor with 0 remaining tasks
12:00:53,849 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower317: stopped executor with 0 remaining tasks
12:00:53,849 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader314-notifier324#754077172]
12:00:53,850 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader314-collector325#686815201]
12:00:53,850 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader314]
12:00:53,853 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers starting
[WARN] [07/02/2025 00:00:53.855] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader326]: org.opendaylight.controller.cluster.common.actor.Monitor@10a1fe2e
12:00:53,856 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - leader326: Starting recovery with journal batch size 1000
12:00:53,856 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader326: started executor
12:00:53,856 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader326: started executor
12:00:53,856 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader326: metadata journal open: replayFrom=1 applyTo=0
12:00:53,857 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader326: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:53,857 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader326: journal open: applyTo=0
12:00:53,857 AM [leader326-writer-144] [DEBUG] JournalWriteTask - leader326: journal writer started
12:00:53,857 AM [leader326-writer-144] [DEBUG] JournalWriteTask - leader326: waiting to receive commands
12:00:53,858 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8682157264276199357/leader326/TermInfo.properties does not exist
12:00:53,858 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader326: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8682157264276199357/leader326/journal-v1-1.log
12:00:53,858 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader326: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest8682157264276199357/leader326/metadata-v1-1.log
12:00:53,858 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader326: no eligible files found
12:00:53,858 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader326: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:53,861 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader326: Set currentTerm=0, votedFor=null
12:00:53,861 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader326: Local TermInfo store seeded with TermInfo{term=0}
12:00:53,861 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader326: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4df0fbc8
12:00:53,861 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader326: Moving last applied index from -1 to -1
12:00:53,861 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - leader326: empty journal: appending 0 entries
12:00:53,861 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader326: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:53,861 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - leader326: journal recovery completedin 346.0 μs with journalIndex=1
12:00:53,862 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
12:00:53,862 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - leader326 (Follower): Received TimeoutNow - switching to Candidate
12:00:53,862 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader326 (Candidate): Election: Candidate has following voting peers: []
12:00:53,868 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader326: Set currentTerm=1, votedFor=leader326
12:00:53,868 AM [test-pekko.actor.default-dispatcher-18] [INFO] Candidate - leader326 (Candidate): Starting new election term 1
12:00:53,868 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader326 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
12:00:53,868 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader326 (Candidate): Received ElectionTimeout
12:00:53,868 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader326 (Leader): Election: Leader has following peers: []
12:00:53,868 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader326 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
12:00:53,868 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader326 starting
12:00:53,869 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader326: onShutDown
12:00:53,869 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - leader326: terminating thread VirtualThread[#740,leader326-writer-144]/waiting
12:00:53,869 AM [leader326-writer-144] [DEBUG] JournalWriteTask - leader326: received 1 commands after 12.24 ms
12:00:53,869 AM [leader326-writer-144] [DEBUG] JournalWriteTask - leader326: completed 1 commands in 11.47 μs
12:00:53,869 AM [leader326-writer-144] [DEBUG] JournalWriteTask - leader326: journal writer stopped
12:00:53,869 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader326: journal closed
12:00:53,869 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader326: journal closed
12:00:53,869 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader326: stopped executor with 0 remaining tasks
12:00:53,869 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader326: stopped executor with 0 remaining tasks
12:00:53,870 AM [main] [INFO] LeadershipTransferIntegrationTest - sendShutDown for pekko://test/user/leader326 ending
12:00:53,870 AM [main] [INFO] LeadershipTransferIntegrationTest - testLeaderTransferSkippedOnShutdownWithNoFollowers ending
12:00:53,870 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader326-collector330#-1588896217]
12:00:53,881 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader326]
12:00:53,882 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging starting
12:00:53,882 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [07/02/2025 00:00:53.884] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower332]: org.opendaylight.controller.cluster.common.actor.Monitor@4906f73d
12:00:53,884 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower332: Starting recovery with journal batch size 1000
12:00:53,884 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower332: started executor
12:00:53,884 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower332: started executor
12:00:53,885 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower332: metadata journal open: replayFrom=1 applyTo=0
12:00:53,885 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower332: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:53,885 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower332: journal open: applyTo=0
12:00:53,885 AM [follower332-writer-145] [DEBUG] JournalWriteTask - follower332: journal writer started
12:00:53,885 AM [follower332-writer-145] [DEBUG] JournalWriteTask - follower332: waiting to receive commands
12:00:53,886 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower332/TermInfo.properties does not exist
12:00:53,886 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower332: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower332/journal-v1-1.log
12:00:53,886 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower332: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower332/metadata-v1-1.log
12:00:53,886 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower332: no eligible files found
12:00:53,886 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower332: SnapshotOffer called.
12:00:53,886 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower332: initializing from snapshot taken at 2025-07-02T00:00:53.882Z
12:00:53,886 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower332: Set currentTerm=1, votedFor=null
12:00:53,886 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PeerInfos - follower332: Updated server config: isVoting: true, peers: [PeerInfo [id=leader331, address=pekko://test/user/leader331, votingState=VOTING], PeerInfo [id=follower333, address=pekko://test/user/follower333, votingState=VOTING], PeerInfo [id=follower334, address=pekko://test/user/follower334, votingState=NON_VOTING]]
12:00:53,886 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - Recovery snapshot applied for follower332 in 62.25 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:53,886 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower332: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:53.882Z
12:00:53,886 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower332: support() called
12:00:53,887 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower332: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower332/snapshot-00000000686476B5-34924080.tmp
12:00:53,888 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower333: Starting recovery with journal batch size 1000
12:00:53,888 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower333: started executor
[WARN] [07/02/2025 00:00:53.888] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower333]: org.opendaylight.controller.cluster.common.actor.Monitor@3300107c
12:00:53,888 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower333: started executor
12:00:53,889 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower333: metadata journal open: replayFrom=1 applyTo=0
12:00:53,889 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower333: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:53,889 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower333: journal open: applyTo=0
12:00:53,890 AM [follower333-writer-146] [DEBUG] JournalWriteTask - follower333: journal writer started
12:00:53,890 AM [follower333-writer-146] [DEBUG] JournalWriteTask - follower333: waiting to receive commands
12:00:53,890 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower333/TermInfo.properties does not exist
12:00:53,890 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower333: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower333/journal-v1-1.log
12:00:53,890 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower333: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower333/metadata-v1-1.log
12:00:53,890 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower333: no eligible files found
12:00:53,890 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower333: SnapshotOffer called.
12:00:53,890 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower333: initializing from snapshot taken at 2025-07-02T00:00:53.882Z
12:00:53,890 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower333: Set currentTerm=1, votedFor=null
12:00:53,890 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PeerInfos - follower333: Updated server config: isVoting: true, peers: [PeerInfo [id=leader331, address=pekko://test/user/leader331, votingState=VOTING], PeerInfo [id=follower332, address=pekko://test/user/follower332, votingState=VOTING], PeerInfo [id=follower334, address=pekko://test/user/follower334, votingState=NON_VOTING]]
12:00:53,890 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - Recovery snapshot applied for follower333 in 58.62 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:53,890 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower333: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:53.882Z
12:00:53,890 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower333: support() called
12:00:53,891 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower333: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower333/snapshot-00000000686476B5-34924080.tmp
12:00:53,891 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower332: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower332/snapshot-00000000686476B5-34924080.v1
12:00:53,891 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower332: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower332/snapshot-00000000686476B5-34924080.v1
12:00:53,891 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower332: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower332/journal-v1-1.log
12:00:53,891 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower332: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower332/metadata-v1-1.log
12:00:53,891 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower332: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:53.882Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower332/snapshot-00000000686476B5-34924080.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:53,891 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower332: local snapshot saved in 4.976 ms, deleting Pekko-persisted snapshots
12:00:53,892 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower332: Recovery completed in 5.737 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:53,892 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower333: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower333/snapshot-00000000686476B5-34924080.v1
12:00:53,892 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower333: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower333/snapshot-00000000686476B5-34924080.v1
12:00:53,892 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower333: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower333/journal-v1-1.log
12:00:53,892 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower333: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower333/metadata-v1-1.log
12:00:53,892 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower333: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:53.882Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower333/snapshot-00000000686476B5-34924080.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:53,892 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower333: local snapshot saved in 1.918 ms, deleting Pekko-persisted snapshots
12:00:53,893 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower333: Recovery completed in 2.448 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [07/02/2025 00:00:53.893] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower334]: org.opendaylight.controller.cluster.common.actor.Monitor@759f0674
12:00:53,894 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower334: Starting recovery with journal batch size 1000
12:00:53,894 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower334: started executor
12:00:53,894 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower334: started executor
12:00:53,894 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower334: metadata journal open: replayFrom=1 applyTo=0
12:00:53,895 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower334: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:53,895 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower334: journal open: applyTo=0
12:00:53,895 AM [follower334-writer-147] [DEBUG] JournalWriteTask - follower334: journal writer started
12:00:53,895 AM [follower334-writer-147] [DEBUG] JournalWriteTask - follower334: waiting to receive commands
12:00:53,895 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower334/TermInfo.properties does not exist
12:00:53,895 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower332: Set currentTerm=1, votedFor=null
12:00:53,895 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower332: Local TermInfo store seeded with TermInfo{term=1}
12:00:53,895 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower334: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower334/journal-v1-1.log
12:00:53,895 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower332: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@45ee2e9a
12:00:53,895 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower334: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower334/metadata-v1-1.log
12:00:53,895 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower332: Moving last applied index from -1 to -1
12:00:53,895 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower334: no eligible files found
12:00:53,895 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower334: SnapshotOffer called.
12:00:53,896 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower334: initializing from snapshot taken at 2025-07-02T00:00:53.882Z
12:00:53,896 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower334: Set currentTerm=1, votedFor=null
12:00:53,896 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - follower332: empty journal: appending 0 entries
12:00:53,896 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - follower334: Updated server config: isVoting: false, peers: [PeerInfo [id=leader331, address=pekko://test/user/leader331, votingState=VOTING], PeerInfo [id=follower333, address=pekko://test/user/follower333, votingState=VOTING], PeerInfo [id=follower332, address=pekko://test/user/follower332, votingState=VOTING]]
12:00:53,896 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower332: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:53,896 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - follower332: journal recovery completedin 301.5 μs with journalIndex=1
12:00:53,896 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - Recovery snapshot applied for follower334 in 87.80 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:53,896 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower334: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:53.882Z
12:00:53,896 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower334: support() called
12:00:53,896 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower333: Set currentTerm=1, votedFor=null
12:00:53,896 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower334: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower334/snapshot-00000000686476B5-34924080.tmp
12:00:53,896 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower333: Local TermInfo store seeded with TermInfo{term=1}
12:00:53,896 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower333: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@6e25a59
12:00:53,896 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower333: Moving last applied index from -1 to -1
12:00:53,896 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower332: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:53,896 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower333: empty journal: appending 0 entries
12:00:53,896 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower333: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:53,896 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower333: journal recovery completedin 244.1 μs with journalIndex=1
12:00:53,897 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower333: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
[WARN] [07/02/2025 00:00:53.897] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader331]: org.opendaylight.controller.cluster.common.actor.Monitor@6d17ded5
12:00:53,898 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower334: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower334/snapshot-00000000686476B5-34924080.v1
12:00:53,898 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - leader331: Starting recovery with journal batch size 1000
12:00:53,898 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower334: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower334/snapshot-00000000686476B5-34924080.v1
12:00:53,898 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader331: started executor
12:00:53,898 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower334: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower334/journal-v1-1.log
12:00:53,898 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader331: started executor
12:00:53,898 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower334: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower334/metadata-v1-1.log
12:00:53,898 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower334: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:53.882Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/follower334/snapshot-00000000686476B5-34924080.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:53,898 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower334: local snapshot saved in 2.265 ms, deleting Pekko-persisted snapshots
12:00:53,898 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader331: metadata journal open: replayFrom=1 applyTo=0
12:00:53,899 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader331: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:53,899 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader331: journal open: applyTo=0
12:00:53,899 AM [leader331-writer-148] [DEBUG] JournalWriteTask - leader331: journal writer started
12:00:53,899 AM [leader331-writer-148] [DEBUG] JournalWriteTask - leader331: waiting to receive commands
12:00:53,899 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower334: Recovery completed in 3.107 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:53,899 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/leader331/TermInfo.properties does not exist
12:00:53,899 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader331: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/leader331/journal-v1-1.log
12:00:53,899 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader331: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/leader331/metadata-v1-1.log
12:00:53,899 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader331: no eligible files found
12:00:53,899 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - leader331: SnapshotOffer called.
12:00:53,899 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - leader331: initializing from snapshot taken at 2025-07-02T00:00:53.882Z
12:00:53,899 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader331: Set currentTerm=1, votedFor=null
12:00:53,899 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PeerInfos - leader331: Updated server config: isVoting: true, peers: [PeerInfo [id=follower333, address=pekko://test/user/follower333, votingState=VOTING], PeerInfo [id=follower332, address=pekko://test/user/follower332, votingState=VOTING], PeerInfo [id=follower334, address=pekko://test/user/follower334, votingState=NON_VOTING]]
12:00:53,899 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - Recovery snapshot applied for leader331 in 49.00 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:53,899 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader331: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:53.882Z
12:00:53,899 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader331: support() called
12:00:53,900 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader331: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/leader331/snapshot-00000000686476B5-34924080.tmp
12:00:53,901 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower334: Set currentTerm=1, votedFor=null
12:00:53,901 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower334: Local TermInfo store seeded with TermInfo{term=1}
12:00:53,901 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower334: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@7b3cb6c1
12:00:53,901 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower334: Moving last applied index from -1 to -1
12:00:53,901 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower334: empty journal: appending 0 entries
12:00:53,901 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower334: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:53,901 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower334: journal recovery completedin 294.8 μs with journalIndex=1
12:00:53,901 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader331: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/leader331/snapshot-00000000686476B5-34924080.v1
12:00:53,901 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader331: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/leader331/snapshot-00000000686476B5-34924080.v1
12:00:53,901 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower334: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:53,901 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader331: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/leader331/journal-v1-1.log
12:00:53,901 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader331: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/leader331/metadata-v1-1.log
12:00:53,901 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader331: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:53.882Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest620301859413563739/leader331/snapshot-00000000686476B5-34924080.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:53,902 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader331: local snapshot saved in 2.240 ms, deleting Pekko-persisted snapshots
12:00:53,902 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader331: Recovery completed in 2.866 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:53,904 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader331: Set currentTerm=1, votedFor=null
12:00:53,904 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader331: Local TermInfo store seeded with TermInfo{term=1}
12:00:53,904 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader331: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@1a7ad40c
12:00:53,904 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader331: Moving last applied index from -1 to -1
12:00:53,904 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader331: empty journal: appending 0 entries
12:00:53,904 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader331: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:53,904 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader331: journal recovery completedin 238.8 μs with journalIndex=1
12:00:53,904 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader331: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:54,283 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
12:00:54,283 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - leader331 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.227:17355, Removed)
12:00:54,283 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - leader331 (Follower): Received ElectionTimeout - switching to Candidate
12:00:54,283 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader331 (Candidate): Election: Candidate has following voting peers: [follower333, follower332]
12:00:54,288 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader331: Set currentTerm=2, votedFor=leader331
12:00:54,288 AM [test-pekko.actor.default-dispatcher-12] [INFO] Candidate - leader331 (Candidate): Starting new election term 2
12:00:54,288 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader331 (Candidate): Sending RequestVote{term=2, candidateId=leader331, lastLogIndex=-1, lastLogTerm=-1} to peer follower333
12:00:54,288 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader331 (Candidate): Sending RequestVote{term=2, candidateId=leader331, lastLogIndex=-1, lastLogTerm=-1} to peer follower332
12:00:54,288 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower333 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
12:00:54,288 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActorBehavior - leader331 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
12:00:54,288 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower332 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
12:00:54,288 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower333 (Follower): Cluster state: []
12:00:54,288 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower333 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader331, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
12:00:54,288 AM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - follower333 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader331, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
12:00:54,288 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower332 (Follower): Cluster state: []
12:00:54,288 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower332 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader331, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
12:00:54,288 AM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - follower332 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader331, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
12:00:54,293 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower332: Set currentTerm=2, votedFor=null
12:00:54,293 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower332 (Follower): In requestVote: RequestVote{term=2, candidateId=leader331, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
12:00:54,294 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower333: Set currentTerm=2, votedFor=null
12:00:54,294 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower333 (Follower): In requestVote: RequestVote{term=2, candidateId=leader331, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
12:00:54,295 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower332: Set currentTerm=2, votedFor=leader331
12:00:54,295 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower332 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
12:00:54,296 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader331 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
12:00:54,296 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader331 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
12:00:54,296 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader331 (Leader): Election: Leader has following peers: [follower333, follower332, follower334]
12:00:54,296 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower333: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:54,296 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower332: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:54,296 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower334: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:54,296 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader331 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
12:00:54,296 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower332: Last sync leader does not match current leader leader331, need to catch up to -1
12:00:54,296 AM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - follower334 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader331, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
12:00:54,296 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader331 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower332 updated: matchIndex: -1, nextIndex: 0
12:00:54,296 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower332: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:54.297] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower332] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower332, initialSyncDone=false]
12:00:54,297 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower333: Set currentTerm=2, votedFor=leader331
12:00:54,297 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower333 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
12:00:54,297 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower333: Last sync leader does not match current leader leader331, need to catch up to -1
12:00:54,297 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower333 updated: matchIndex: -1, nextIndex: 0
12:00:54,297 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower333: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:54.297] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower333] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower333, initialSyncDone=false]
12:00:54,299 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower334: Set currentTerm=2, votedFor=null
12:00:54,299 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower334: Last sync leader does not match current leader leader331, need to catch up to -1
12:00:54,299 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader331 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower334 updated: matchIndex: -1, nextIndex: 0
12:00:54,299 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower334: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:54.300] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower334] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower334, initialSyncDone=false]
12:00:54,307 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
12:00:54,307 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
12:00:54,308 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
12:00:54,308 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging starting
12:00:54,308 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader331: Persist data index=0 term=2 command=zero
12:00:54,308 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader331: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
12:00:54,309 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
12:00:54,309 AM [leader331-writer-148] [DEBUG] JournalWriteTask - leader331: received 1 commands after 410.0 ms
12:00:54,309 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower333: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:54,309 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): sendAppendEntries: 0 is present for follower follower333
12:00:54,309 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): Sending AppendEntries to follower follower333: AppendEntries{term=2, leaderId=leader331, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
12:00:54,309 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower332: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:54,309 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): sendAppendEntries: 0 is present for follower follower332
12:00:54,309 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): Sending AppendEntries to follower follower332: AppendEntries{term=2, leaderId=leader331, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
12:00:54,309 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower334: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:54,309 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): sendAppendEntries: 0 is present for follower follower334
12:00:54,309 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): Sending AppendEntries to follower follower334: AppendEntries{term=2, leaderId=leader331, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
12:00:54,309 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - leader331: awaiting more completions to resolve 1 synchronized callback(s)
12:00:54,309 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower332 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader331, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
12:00:54,309 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower332 (Follower): Number of entries to be appended = 1
12:00:54,309 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower332 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
12:00:54,309 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower332 (Follower): Append entry to log zero
12:00:54,309 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower334 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader331, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=true}]}
12:00:54,309 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower332: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
12:00:54,309 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower334 (Follower): Number of entries to be appended = 1
12:00:54,309 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower334 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
12:00:54,309 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower334 (Follower): Append entry to log zero
12:00:54,309 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower334: Append log entry and persist JournaledLogEntry{index=0, term=2, command=zero, pending=true} 
12:00:54,309 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower332 (Follower): Log size is now 1
12:00:54,309 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower332 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower332, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
12:00:54,310 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower332: Lagging 0 entries behind leader leader331 and reached -1 (of expected -1)
12:00:54,310 AM [follower334-writer-147] [DEBUG] JournalWriteTask - follower334: received 1 commands after 414.7 ms
12:00:54,310 AM [follower332-writer-145] [DEBUG] JournalWriteTask - follower332: received 1 commands after 424.1 ms
[WARN] [07/02/2025 00:00:54.310] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower332] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower332, initialSyncDone=true]
12:00:54,310 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower334 (Follower): Log size is now 1
12:00:54,310 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower334 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower334, logLastIndex=0, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
12:00:54,310 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower334: Lagging 0 entries behind leader leader331 and reached -1 (of expected -1)
[WARN] [07/02/2025 00:00:54.310] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower334] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower334, initialSyncDone=true]
12:00:54,313 AM [leader331-writer-148] [DEBUG] RaftStorageCompleter - leader331: 1 completion(s) pending
12:00:54,313 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - leader331: running 1 completion(s)
12:00:54,313 AM [leader331-writer-148] [DEBUG] JournalWriteTask - leader331: completed 1 commands in 4.718 ms
12:00:54,313 AM [leader331-writer-148] [DEBUG] JournalWriteTask - leader331: waiting to receive commands
12:00:54,314 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader331: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=true}
12:00:54,314 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - leader331: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=0, term=2, command=zero, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e110@718696aa}
12:00:54,314 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower332 updated: matchIndex: 0, nextIndex: 1
12:00:54,314 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
12:00:54,314 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader331 (Leader): Setting last applied to 0
12:00:54,314 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader331: Moving last applied index from -1 to 0
12:00:54,314 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader331: Applying state for log index 0 data zero
12:00:54,314 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader331: applyState called: zero
12:00:54,314 AM [leader331-writer-148] [DEBUG] JournalWriteTask - leader331: received 1 commands after 697.7 μs
12:00:54,314 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower332: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:54,314 AM [follower334-writer-147] [DEBUG] RaftStorageCompleter - follower334: 1 completion(s) pending
12:00:54,314 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower334 updated: matchIndex: 0, nextIndex: 1
12:00:54,314 AM [leader331-writer-148] [DEBUG] EntryJournalV1 - leader331: updated meta to JournalMeta[replayFrom=1, applyTo=1]
12:00:54,314 AM [follower334-writer-147] [DEBUG] JournalWriteTask - follower334: completed 1 commands in 4.824 ms
12:00:54,314 AM [follower334-writer-147] [DEBUG] JournalWriteTask - follower334: waiting to receive commands
12:00:54,314 AM [leader331-writer-148] [DEBUG] RaftStorageCompleter - leader331: 1 completion(s) pending
12:00:54,314 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower334: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:54,314 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower332 (Follower): Commit index set to 0
12:00:54,314 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower332: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
12:00:54,314 AM [leader331-writer-148] [DEBUG] JournalWriteTask - leader331: completed 1 commands in 204.1 μs
12:00:54,314 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower332 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
12:00:54,315 AM [leader331-writer-148] [DEBUG] JournalWriteTask - leader331: waiting to receive commands
12:00:54,315 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower332 (Follower): Setting last applied to 0
12:00:54,315 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - follower334: running 1 completion(s)
12:00:54,315 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower332: Moving last applied index from -1 to 0
12:00:54,315 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - leader331: running 1 completion(s)
12:00:54,315 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower332: Applying state for log index 0 data zero
12:00:54,315 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower332: applyState called: zero
12:00:54,315 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower334: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
12:00:54,315 AM [follower332-writer-145] [DEBUG] RaftStorageCompleter - follower332: 1 completion(s) pending
12:00:54,315 AM [follower332-writer-145] [DEBUG] JournalWriteTask - follower332: completed 1 commands in 4.987 ms
12:00:54,315 AM [follower332-writer-145] [DEBUG] JournalWriteTask - follower332: waiting to receive commands
12:00:54,315 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower334 (Follower): Commit index set to 0
12:00:54,315 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower334: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
12:00:54,315 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower334 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
12:00:54,315 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower334 (Follower): Setting last applied to 0
12:00:54,315 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower334: Moving last applied index from -1 to 0
12:00:54,315 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower334: Applying state for log index 0 data zero
12:00:54,315 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower334: applyState called: zero
12:00:54,315 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - follower332: running 1 completion(s)
12:00:54,315 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower332: persist complete JournaledLogEntry{index=0, term=2, command=zero, pending=false}
12:00:54,315 AM [follower332-writer-145] [DEBUG] JournalWriteTask - follower332: received 1 commands after 143.3 μs
12:00:54,315 AM [follower332-writer-145] [DEBUG] EntryJournalV1 - follower332: updated meta to JournalMeta[replayFrom=1, applyTo=1]
12:00:54,315 AM [follower332-writer-145] [DEBUG] RaftStorageCompleter - follower332: 1 completion(s) pending
12:00:54,315 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - follower332: running 1 completion(s)
12:00:54,315 AM [follower332-writer-145] [DEBUG] JournalWriteTask - follower332: completed 1 commands in 152.2 μs
12:00:54,315 AM [follower332-writer-145] [DEBUG] JournalWriteTask - follower332: waiting to receive commands
12:00:54,315 AM [follower334-writer-147] [DEBUG] JournalWriteTask - follower334: received 1 commands after 609.4 μs
12:00:54,315 AM [follower334-writer-147] [DEBUG] EntryJournalV1 - follower334: updated meta to JournalMeta[replayFrom=1, applyTo=1]
12:00:54,315 AM [follower334-writer-147] [DEBUG] RaftStorageCompleter - follower334: 1 completion(s) pending
12:00:54,315 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - follower334: running 1 completion(s)
12:00:54,315 AM [follower334-writer-147] [DEBUG] JournalWriteTask - follower334: completed 1 commands in 134.0 μs
12:00:54,315 AM [follower334-writer-147] [DEBUG] JournalWriteTask - follower334: waiting to receive commands
12:00:54,359 AM [main] [INFO] LeadershipTransferIntegrationTest - sendPayloadWithFollower2Lagging ending
12:00:54,359 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
12:00:54,359 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
12:00:54,359 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader331: onRequestLeadership RequestLeadership [requestedFollowerId=follower333, replyTo=Actor[pekko://test/user/$c#-35241042]]
12:00:54,359 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader331: Initiating leader transfer
12:00:54,359 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader331: pauseLeader successfully completed - doing transfer
12:00:54,359 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader331 (Leader): Attempting to transfer leadership
12:00:54,359 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower334: onLeaderTransitioning: LeaderTransitioning [leaderId=leader331]
12:00:54,359 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower332: onLeaderTransitioning: LeaderTransitioning [leaderId=leader331]
12:00:54,359 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower333: onLeaderTransitioning: LeaderTransitioning [leaderId=leader331]
12:00:54,359 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower333: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:54,359 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader331 (Leader): sendAppendEntries: 0 is present for follower follower333
12:00:54,359 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader331 (Leader): Sending AppendEntries to follower follower333: AppendEntries{term=2, leaderId=leader331, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
12:00:54,360 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower332: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:54,360 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader331 (Leader): Checking sendAppendEntries for follower follower334: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
12:00:54,360 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower332: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
12:00:54,360 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower334: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
12:00:54,412 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader331 (Leader): sendAppendEntries: 0 is present for follower follower333
12:00:54,532 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader331 (Leader): sendAppendEntries: 0 is present for follower follower333
12:00:54,532 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader331 (Leader): Sending AppendEntries to follower follower333: AppendEntries{term=2, leaderId=leader331, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=2, command=zero, pending=false}]}
12:00:54,533 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower334: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
12:00:54,533 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower332: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
12:00:54,652 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower332: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
12:00:54,653 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower334: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
12:00:54,772 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorLeadershipTransferCohort - leader331: leader transfer aborted
12:00:54,772 AM [test-pekko.actor.default-dispatcher-11] [WARN] RaftActorLeadershipTransferCohort - leader331: Failed to transfer leadership in 413.4 ms
12:00:54,772 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader331: LeadershipTransfer request from follower333 failed
12:00:54,773 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Leader - leader331 (Leader): Leadership transfer expired
12:00:54,773 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower332: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
12:00:54,773 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower334: Lagging 0 entries behind leader leader331 and reached 0 (of expected -1)
12:00:54,812 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithFollower2Lagging ending
12:00:54,812 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower332-notifier335#648987068]
12:00:54,824 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower332-collector336#-1042138891]
12:00:54,824 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower332]
12:00:54,824 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - follower332: terminating thread VirtualThread[#741,follower332-writer-145]/waiting
12:00:54,824 AM [follower332-writer-145] [DEBUG] JournalWriteTask - follower332: received 1 commands after 509.4 ms
12:00:54,825 AM [follower332-writer-145] [DEBUG] JournalWriteTask - follower332: completed 1 commands in 15.95 μs
12:00:54,825 AM [follower332-writer-145] [DEBUG] JournalWriteTask - follower332: journal writer stopped
12:00:54,825 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower332: journal closed
12:00:54,825 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower332: journal closed
12:00:54,825 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower332: stopped executor with 0 remaining tasks
12:00:54,825 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower332: stopped executor with 0 remaining tasks
12:00:54,825 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower333-notifier337#-1404090314]
12:00:54,825 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower333-collector338#-1928695443]
12:00:54,825 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower333]
12:00:54,826 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - follower333: terminating thread VirtualThread[#742,follower333-writer-146]/waiting
12:00:54,826 AM [follower333-writer-146] [DEBUG] JournalWriteTask - follower333: received 1 commands after 936.1 ms
12:00:54,826 AM [follower333-writer-146] [DEBUG] JournalWriteTask - follower333: completed 1 commands in 9.041 μs
12:00:54,826 AM [follower333-writer-146] [DEBUG] JournalWriteTask - follower333: journal writer stopped
12:00:54,826 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower333: journal closed
12:00:54,826 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower333: journal closed
12:00:54,826 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower333: stopped executor with 0 remaining tasks
12:00:54,826 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower333: stopped executor with 0 remaining tasks
12:00:54,826 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower334-notifier339#52208135]
12:00:54,826 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower334-collector340#-959892382]
12:00:54,826 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower334]
12:00:54,827 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - follower334: terminating thread VirtualThread[#743,follower334-writer-147]/waiting
12:00:54,827 AM [follower334-writer-147] [DEBUG] JournalWriteTask - follower334: received 1 commands after 511.4 ms
12:00:54,827 AM [follower334-writer-147] [DEBUG] JournalWriteTask - follower334: completed 1 commands in 9.010 μs
12:00:54,827 AM [follower334-writer-147] [DEBUG] JournalWriteTask - follower334: journal writer stopped
12:00:54,827 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower334: journal closed
12:00:54,827 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower334: journal closed
12:00:54,827 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower334: stopped executor with 0 remaining tasks
12:00:54,827 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower334: stopped executor with 0 remaining tasks
12:00:54,827 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader331-notifier341#-585521200]
12:00:54,827 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader331-collector342#-1496964499]
12:00:54,827 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader331]
12:00:54,827 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - leader331: terminating thread VirtualThread[#744,leader331-writer-148]/waiting
12:00:54,828 AM [leader331-writer-148] [DEBUG] JournalWriteTask - leader331: received 1 commands after 513.1 ms
12:00:54,828 AM [leader331-writer-148] [DEBUG] JournalWriteTask - leader331: completed 1 commands in 8.920 μs
12:00:54,828 AM [leader331-writer-148] [DEBUG] JournalWriteTask - leader331: journal writer stopped
12:00:54,828 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader331: journal closed
12:00:54,828 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader331: journal closed
12:00:54,828 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader331: stopped executor with 0 remaining tasks
12:00:54,828 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader331: stopped executor with 0 remaining tasks
12:00:54,828 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$c#-35241042]
12:00:54,831 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown starting
12:00:54,831 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
[WARN] [07/02/2025 00:00:54.833] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower344]: org.opendaylight.controller.cluster.common.actor.Monitor@76b4b35e
12:00:54,834 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - follower344: Starting recovery with journal batch size 1000
12:00:54,834 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower344: started executor
12:00:54,835 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower344: started executor
12:00:54,835 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower344: metadata journal open: replayFrom=1 applyTo=0
12:00:54,836 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower344: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:54,836 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower344: journal open: applyTo=0
12:00:54,836 AM [follower344-writer-149] [DEBUG] JournalWriteTask - follower344: journal writer started
12:00:54,836 AM [follower344-writer-149] [DEBUG] JournalWriteTask - follower344: waiting to receive commands
12:00:54,837 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower344/TermInfo.properties does not exist
12:00:54,837 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower344: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower344/journal-v1-1.log
12:00:54,837 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower344: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower344/metadata-v1-1.log
12:00:54,837 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower344: no eligible files found
[WARN] [07/02/2025 00:00:54.839] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower345]: org.opendaylight.controller.cluster.common.actor.Monitor@22e75d5c
12:00:54,839 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - follower344: SnapshotOffer called.
12:00:54,838 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower345: Starting recovery with journal batch size 1000
12:00:54,839 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - follower344: initializing from snapshot taken at 2025-07-02T00:00:54.831Z
12:00:54,839 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower344: Set currentTerm=1, votedFor=null
12:00:54,839 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower345: started executor
12:00:54,839 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PeerInfos - follower344: Updated server config: isVoting: true, peers: [PeerInfo [id=leader343, address=pekko://test/user/leader343, votingState=VOTING], PeerInfo [id=follower346, address=pekko://test/user/follower346, votingState=NON_VOTING], PeerInfo [id=follower345, address=pekko://test/user/follower345, votingState=VOTING]]
12:00:54,839 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower345: started executor
12:00:54,839 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - Recovery snapshot applied for follower344 in 111.5 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:54,839 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower344: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:54.831Z
12:00:54,839 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower344: support() called
12:00:54,839 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower345: metadata journal open: replayFrom=1 applyTo=0
12:00:54,839 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower344: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower344/snapshot-00000000686476B6-31880DC0.tmp
12:00:54,840 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower345: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:54,840 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower345: journal open: applyTo=0
12:00:54,840 AM [follower345-writer-150] [DEBUG] JournalWriteTask - follower345: journal writer started
12:00:54,840 AM [follower345-writer-150] [DEBUG] JournalWriteTask - follower345: waiting to receive commands
12:00:54,841 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower345/TermInfo.properties does not exist
12:00:54,841 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower345: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower345/journal-v1-1.log
12:00:54,841 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower345: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower345/metadata-v1-1.log
12:00:54,841 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower345: no eligible files found
12:00:54,841 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower345: SnapshotOffer called.
12:00:54,841 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower345: initializing from snapshot taken at 2025-07-02T00:00:54.831Z
12:00:54,841 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower345: Set currentTerm=1, votedFor=null
12:00:54,841 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PeerInfos - follower345: Updated server config: isVoting: true, peers: [PeerInfo [id=leader343, address=pekko://test/user/leader343, votingState=VOTING], PeerInfo [id=follower344, address=pekko://test/user/follower344, votingState=VOTING], PeerInfo [id=follower346, address=pekko://test/user/follower346, votingState=NON_VOTING]]
12:00:54,841 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - Recovery snapshot applied for follower345 in 60.82 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:54,841 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower345: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:54.831Z
12:00:54,841 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower345: support() called
12:00:54,842 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower345: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower345/snapshot-00000000686476B6-31880DC0.tmp
[WARN] [07/02/2025 00:00:54.842] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower346]: org.opendaylight.controller.cluster.common.actor.Monitor@5175ecc2
12:00:54,842 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower346: Starting recovery with journal batch size 1000
12:00:54,843 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower346: started executor
12:00:54,843 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower346: started executor
12:00:54,843 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower346: metadata journal open: replayFrom=1 applyTo=0
12:00:54,844 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower346: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:54,844 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower346: journal open: applyTo=0
12:00:54,844 AM [follower346-writer-151] [DEBUG] JournalWriteTask - follower346: journal writer started
12:00:54,844 AM [follower346-writer-151] [DEBUG] JournalWriteTask - follower346: waiting to receive commands
12:00:54,844 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower346/TermInfo.properties does not exist
12:00:54,844 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower346: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower346/journal-v1-1.log
12:00:54,844 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower346: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower346/metadata-v1-1.log
12:00:54,844 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower346: no eligible files found
12:00:54,844 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower346: SnapshotOffer called.
12:00:54,844 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower346: initializing from snapshot taken at 2025-07-02T00:00:54.831Z
12:00:54,844 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower346: Set currentTerm=1, votedFor=null
12:00:54,844 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PeerInfos - follower346: Updated server config: isVoting: false, peers: [PeerInfo [id=leader343, address=pekko://test/user/leader343, votingState=VOTING], PeerInfo [id=follower344, address=pekko://test/user/follower344, votingState=VOTING], PeerInfo [id=follower345, address=pekko://test/user/follower345, votingState=VOTING]]
12:00:54,845 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - Recovery snapshot applied for follower346 in 71.89 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:54,845 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower346: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:54.831Z
12:00:54,845 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower346: support() called
12:00:54,845 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower346: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower346/snapshot-00000000686476B6-31880DC0.tmp
[WARN] [07/02/2025 00:00:54.845] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader343]: org.opendaylight.controller.cluster.common.actor.Monitor@48ed4602
12:00:54,846 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - leader343: Starting recovery with journal batch size 1000
12:00:54,846 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader343: started executor
12:00:54,846 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader343: started executor
12:00:54,847 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader343: metadata journal open: replayFrom=1 applyTo=0
12:00:54,848 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader343: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
12:00:54,848 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - leader343: journal open: applyTo=0
12:00:54,848 AM [leader343-writer-152] [DEBUG] JournalWriteTask - leader343: journal writer started
12:00:54,848 AM [leader343-writer-152] [DEBUG] JournalWriteTask - leader343: waiting to receive commands
12:00:54,848 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/leader343/TermInfo.properties does not exist
12:00:54,848 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader343: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/leader343/journal-v1-1.log
12:00:54,848 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader343: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/leader343/metadata-v1-1.log
12:00:54,848 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader343: no eligible files found
12:00:54,848 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - leader343: SnapshotOffer called.
12:00:54,848 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - leader343: initializing from snapshot taken at 2025-07-02T00:00:54.831Z
12:00:54,849 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader343: Set currentTerm=1, votedFor=null
12:00:54,849 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - leader343: Updated server config: isVoting: true, peers: [PeerInfo [id=follower344, address=pekko://test/user/follower344, votingState=VOTING], PeerInfo [id=follower346, address=pekko://test/user/follower346, votingState=NON_VOTING], PeerInfo [id=follower345, address=pekko://test/user/follower345, votingState=VOTING]]
12:00:54,849 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - Recovery snapshot applied for leader343 in 93.42 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0
12:00:54,849 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader343: migrating from Pekko persistent-snapshot taken at 2025-07-02T00:00:54.831Z
12:00:54,849 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - leader343: support() called
12:00:54,849 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader343: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/leader343/snapshot-00000000686476B6-31880DC0.tmp
12:00:54,867 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower344: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower344/snapshot-00000000686476B6-31880DC0.v1
12:00:54,867 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower344: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower344/journal-v1-1.log
12:00:54,867 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower344: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower344/snapshot-00000000686476B6-31880DC0.v1
12:00:54,867 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower344: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower344/metadata-v1-1.log
12:00:54,868 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower344: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:54.831Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower344/snapshot-00000000686476B6-31880DC0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:54,868 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower344: local snapshot saved in 28.63 ms, deleting Pekko-persisted snapshots
12:00:54,869 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower344: Recovery completed in 30.10 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:54,871 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower345: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower345/snapshot-00000000686476B6-31880DC0.v1
12:00:54,871 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader343: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/leader343/snapshot-00000000686476B6-31880DC0.v1
12:00:54,871 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower346: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower346/snapshot-00000000686476B6-31880DC0.v1
12:00:54,871 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower345: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower345/journal-v1-1.log
12:00:54,871 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower346: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower346/journal-v1-1.log
12:00:54,871 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader343: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/leader343/journal-v1-1.log
12:00:54,871 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower345: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower345/snapshot-00000000686476B6-31880DC0.v1
12:00:54,871 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower346: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower346/snapshot-00000000686476B6-31880DC0.v1
12:00:54,871 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader343: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/leader343/snapshot-00000000686476B6-31880DC0.v1
12:00:54,871 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower346: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower346/metadata-v1-1.log
12:00:54,871 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower345: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower345/metadata-v1-1.log
12:00:54,871 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader343: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/leader343/metadata-v1-1.log
12:00:54,871 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower346: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:54.831Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower346/snapshot-00000000686476B6-31880DC0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:54,871 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower346: local snapshot saved in 26.39 ms, deleting Pekko-persisted snapshots
12:00:54,871 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader343: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:54.831Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/leader343/snapshot-00000000686476B6-31880DC0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:54,871 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower345: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-02T00:00:54.831Z, file=/tmp/org.opendaylight.controller.cluster.raft.LeadershipTransferIntegrationTest1809303746404182723/follower345/snapshot-00000000686476B6-31880DC0.v1, size=275, entryCompress=NONE, stateCompress=NONE}
12:00:54,871 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader343: local snapshot saved in 22.24 ms, deleting Pekko-persisted snapshots
12:00:54,872 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower346: Recovery completed in 27.38 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:54,872 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower344: Set currentTerm=1, votedFor=null
12:00:54,872 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower344: Local TermInfo store seeded with TermInfo{term=1}
12:00:54,872 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower344: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@2c14abf6
12:00:54,872 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower344: Moving last applied index from -1 to -1
12:00:54,871 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower345: local snapshot saved in 29.70 ms, deleting Pekko-persisted snapshots
12:00:54,872 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower344: empty journal: appending 0 entries
12:00:54,872 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower344: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:54,873 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower344: journal recovery completedin 565.9 μs with journalIndex=1
12:00:54,873 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader343: Recovery completed in 24.33 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:54,873 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower345: Recovery completed in 31.68 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
12:00:54,874 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower344: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:54,874 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower346: Set currentTerm=1, votedFor=null
12:00:54,874 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower346: Local TermInfo store seeded with TermInfo{term=1}
12:00:54,874 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower346: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@658a75eb
12:00:54,874 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower346: Moving last applied index from -1 to -1
12:00:54,875 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower346: empty journal: appending 0 entries
12:00:54,875 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower346: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:54,875 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower346: journal recovery completedin 246.3 μs with journalIndex=1
12:00:54,875 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader343: Set currentTerm=1, votedFor=null
12:00:54,875 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower345: Set currentTerm=1, votedFor=null
12:00:54,875 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader343: Local TermInfo store seeded with TermInfo{term=1}
12:00:54,875 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower345: Local TermInfo store seeded with TermInfo{term=1}
12:00:54,875 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader343: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4cbea3a4
12:00:54,875 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower345: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4004f1e4
12:00:54,875 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader343: Moving last applied index from -1 to -1
12:00:54,875 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower345: Moving last applied index from -1 to -1
12:00:54,875 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader343: empty journal: appending 0 entries
12:00:54,875 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower345: empty journal: appending 0 entries
12:00:54,875 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower345: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:54,875 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader343: updated meta to JournalMeta[replayFrom=1, applyTo=0]
12:00:54,875 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower345: journal recovery completedin 208.6 μs with journalIndex=1
12:00:54,875 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader343: journal recovery completedin 218.3 μs with journalIndex=1
12:00:54,876 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader343: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:54,876 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower345: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:54,876 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower346: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0))
12:00:55,242 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
12:00:55,242 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader343 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.227:17355, Removed)
12:00:55,242 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader343 (Follower): Received ElectionTimeout - switching to Candidate
12:00:55,242 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader343 (Candidate): Election: Candidate has following voting peers: [follower344, follower345]
12:00:55,245 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader343: Set currentTerm=2, votedFor=leader343
12:00:55,245 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - leader343 (Candidate): Starting new election term 2
12:00:55,245 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader343 (Candidate): Sending RequestVote{term=2, candidateId=leader343, lastLogIndex=-1, lastLogTerm=-1} to peer follower344
12:00:55,245 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader343 (Candidate): Sending RequestVote{term=2, candidateId=leader343, lastLogIndex=-1, lastLogTerm=-1} to peer follower345
12:00:55,245 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower345 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
12:00:55,245 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower344 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
12:00:55,246 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower345 (Follower): Cluster state: []
12:00:55,246 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower345 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader343, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
12:00:55,246 AM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - follower345 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader343, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
12:00:55,246 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower344 (Follower): Cluster state: []
12:00:55,246 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower344 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader343, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
12:00:55,246 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower344 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader343, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 1 - updating term
12:00:55,246 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader343 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
12:00:55,248 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower345: Set currentTerm=2, votedFor=null
12:00:55,248 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower345 (Follower): In requestVote: RequestVote{term=2, candidateId=leader343, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
12:00:55,249 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower344: Set currentTerm=2, votedFor=null
12:00:55,249 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower344 (Follower): In requestVote: RequestVote{term=2, candidateId=leader343, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 2, votedFor: null, lastIndex: -1, lastTerm: -1
12:00:55,276 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower345: Set currentTerm=2, votedFor=leader343
12:00:55,276 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower345 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
12:00:55,276 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader343 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
12:00:55,276 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader343 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
12:00:55,276 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader343 (Leader): Election: Leader has following peers: [follower344, follower346, follower345]
12:00:55,276 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower344: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:55,276 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower346: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:55,277 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower345: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:55,277 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader343 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
12:00:55,277 AM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - follower346 (Follower): Term 2 in "AppendEntries{term=2, leaderId=leader343, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 1 - updating term
12:00:55,277 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower345: Last sync leader does not match current leader leader343, need to catch up to -1
12:00:55,277 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader343 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower345 updated: matchIndex: -1, nextIndex: 0
[WARN] [07/02/2025 00:00:55.278] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower345] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower345, initialSyncDone=false]
12:00:55,278 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower345: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:55,278 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower344: Set currentTerm=2, votedFor=leader343
12:00:55,278 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower344 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
12:00:55,278 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower344: Last sync leader does not match current leader leader343, need to catch up to -1
12:00:55,278 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader343 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower344 updated: matchIndex: -1, nextIndex: 0
12:00:55,278 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower344: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:55.278] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower344] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower344, initialSyncDone=false]
12:00:55,279 AM [main] [INFO] LeadershipTransferIntegrationTest - createRaftActors starting
12:00:55,279 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor starting
12:00:55,279 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower346: Set currentTerm=2, votedFor=null
12:00:55,279 AM [main] [INFO] LeadershipTransferIntegrationTest - createRequestLeadershipResultCollectorActor ending
12:00:55,279 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader343 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower346 updated: matchIndex: -1, nextIndex: 0
12:00:55,279 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower346: Last sync leader does not match current leader leader343, need to catch up to -1
12:00:55,280 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower346: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:55,280 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower344]
[WARN] [07/02/2025 00:00:55.280] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower346] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower346, initialSyncDone=false]
12:00:55,280 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - follower344: terminating thread VirtualThread[#745,follower344-writer-149]/waiting
12:00:55,281 AM [follower344-writer-149] [DEBUG] JournalWriteTask - follower344: received 1 commands after 444.6 ms
12:00:55,281 AM [follower344-writer-149] [DEBUG] JournalWriteTask - follower344: completed 1 commands in 14.07 μs
12:00:55,281 AM [follower344-writer-149] [DEBUG] JournalWriteTask - follower344: journal writer stopped
12:00:55,281 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower344: journal closed
12:00:55,281 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower344: journal closed
12:00:55,281 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower344: stopped executor with 0 remaining tasks
12:00:55,281 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower344: stopped executor with 0 remaining tasks
12:00:55,281 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower346]
12:00:55,282 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - follower346: terminating thread VirtualThread[#747,follower346-writer-151]/waiting
12:00:55,282 AM [follower346-writer-151] [DEBUG] JournalWriteTask - follower346: received 1 commands after 438.2 ms
12:00:55,282 AM [follower346-writer-151] [DEBUG] JournalWriteTask - follower346: completed 1 commands in 5.980 μs
12:00:55,282 AM [follower346-writer-151] [DEBUG] JournalWriteTask - follower346: journal writer stopped
12:00:55,282 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower346: journal closed
12:00:55,282 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower346: journal closed
12:00:55,282 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower346: stopped executor with 0 remaining tasks
12:00:55,282 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower346: stopped executor with 0 remaining tasks
12:00:55,282 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader starting
12:00:55,282 AM [main] [INFO] LeadershipTransferIntegrationTest - sendFollower2RequestLeadershipTransferToLeader ending
12:00:55,282 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader343: onRequestLeadership RequestLeadership [requestedFollowerId=follower345, replyTo=Actor[pekko://test/user/$d#1919633105]]
12:00:55,282 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader343: Initiating leader transfer
[WARN] [07/02/2025 00:00:55.283] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower344] received dead letter from TestActor[pekko://test/user/leader343]: LeaderTransitioning [leaderId=leader343]
[WARN] [07/02/2025 00:00:55.283] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower346] received dead letter from TestActor[pekko://test/user/leader343]: LeaderTransitioning [leaderId=leader343]
12:00:55,283 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower345: onLeaderTransitioning: LeaderTransitioning [leaderId=leader343]
12:00:55,283 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader343: pauseLeader successfully completed - doing transfer
12:00:55,283 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader343 (Leader): Attempting to transfer leadership
12:00:55,283 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower344: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:55,283 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower346: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:55.283] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower344] received dead letter from TestActor[pekko://test/user/leader343]: AppendEntries{term=2, leaderId=leader343, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
[WARN] [07/02/2025 00:00:55.284] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower346] received dead letter from TestActor[pekko://test/user/leader343]: AppendEntries{term=2, leaderId=leader343, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
12:00:55,284 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower345: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:55,284 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower345: Lagging 0 entries behind leader leader343 and reached -1 (of expected -1)
[WARN] [07/02/2025 00:00:55.284] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower345] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower345, initialSyncDone=true]
12:00:55,284 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader343 (Leader): tryToCompleteLeadershipTransfer: followerId: follower345, matchIndex: -1, lastIndex: -1, isVoting: true
12:00:55,284 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader343 (Leader): Follower's log matches - sending ElectionTimeout
12:00:55,284 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower344: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:55,284 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower346: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:55.284] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower344] received dead letter from TestActor[pekko://test/user/leader343]: AppendEntries{term=2, leaderId=leader343, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
12:00:55,284 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader343 (Leader): Checking sendAppendEntries for follower follower345: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:55.284] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower346] received dead letter from TestActor[pekko://test/user/leader343]: AppendEntries{term=2, leaderId=leader343, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}
12:00:55,284 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower345: Lagging 0 entries behind leader leader343 and reached -1 (of expected -1)
12:00:55,284 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Leader - leader343 (Leader): Leader transfer complete
12:00:55,284 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorLeadershipTransferCohort - leader343: leader transfer complete - waiting for new leader
12:00:55,284 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
12:00:55,284 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower345 (Follower): Received TimeoutNow - switching to Candidate
12:00:55,284 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - follower345 (Candidate): Election: Candidate has following voting peers: [leader343, follower344]
12:00:55,286 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower345: Set currentTerm=3, votedFor=follower345
12:00:55,286 AM [test-pekko.actor.default-dispatcher-12] [INFO] Candidate - follower345 (Candidate): Starting new election term 3
12:00:55,286 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - follower345 (Candidate): Sending RequestVote{term=3, candidateId=follower345, lastLogIndex=-1, lastLogTerm=-1} to peer leader343
12:00:55,287 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - follower345 (Candidate): Sending RequestVote{term=3, candidateId=follower345, lastLogIndex=-1, lastLogTerm=-1} to peer follower344
12:00:55,287 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActorBehavior - follower345 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
12:00:55,287 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - leader343 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
12:00:55,287 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - leader343 (Leader): Cluster state: []
12:00:55,287 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - leader343 (Leader): Candidate in requestVote:RequestVote{term=3, candidateId=follower345, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
12:00:55,287 AM [test-pekko.actor.default-dispatcher-12] [INFO] AbstractLeader - leader343 (Leader): Term 3 in "RequestVote{term=3, candidateId=follower345, lastLogIndex=-1, lastLogTerm=-1}" message is greater than leader's term 2 - switching to Follower
[WARN] [07/02/2025 00:00:55.287] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower344] received dead letter from TestActor[pekko://test/user/follower345]: RequestVote{term=3, candidateId=follower345, lastLogIndex=-1, lastLogTerm=-1}
12:00:55,290 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader343: Set currentTerm=3, votedFor=null
12:00:55,290 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader343 (Leader): Leadership transfer in progress - processing RequestVote
12:00:55,290 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - leader343 (Leader): In requestVote: RequestVote{term=3, candidateId=follower345, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 3, votedFor: null, lastIndex: -1, lastTerm: -1
12:00:55,291 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader343: Set currentTerm=3, votedFor=follower345
12:00:55,291 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - leader343 (Leader): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
12:00:55,292 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - follower345 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3
12:00:55,292 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - follower345 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1
12:00:55,292 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActorBehavior - leader343 (Leader) :- Switching from behavior Leader to Follower, election term: 3
12:00:55,292 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - follower345 (Leader): Election: Leader has following peers: [leader343, follower344, follower346]
12:00:55,292 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - follower345 (Leader): Checking sendAppendEntries for follower leader343: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:55,292 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - follower345 (Leader): Checking sendAppendEntries for follower follower344: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:55,292 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - follower345 (Leader): Checking sendAppendEntries for follower follower346: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
12:00:55,292 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - leader343: Last sync leader does not match current leader follower345, need to catch up to -1
12:00:55,292 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - follower345 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
[WARN] [07/02/2025 00:00:55.292] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower344] received dead letter from TestActor[pekko://test/user/follower345]: AppendEntries{term=3, leaderId=follower345, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
12:00:55,292 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorLeadershipTransferCohort - leader343: leader changed to follower345
[WARN] [07/02/2025 00:00:55.292] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower346] received dead letter from TestActor[pekko://test/user/follower345]: AppendEntries{term=3, leaderId=follower345, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
12:00:55,292 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorLeadershipTransferCohort - leader343: Successfully transferred leadership to follower345 in 9.508 ms
12:00:55,292 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader343: Leadership transferred successfully to follower345
12:00:55,292 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - follower345 (Leader): handleAppendEntriesReply - FollowerLogInformation for leader343 updated: matchIndex: -1, nextIndex: 0
12:00:55,292 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - follower345 (Leader): Checking sendAppendEntries for follower leader343: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/02/2025 00:00:55.292] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/leader343] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=leader343, initialSyncDone=false]
12:00:55,333 AM [main] [INFO] LeadershipTransferIntegrationTest - testRequestLeadershipTransferToFollower2WithOtherFollowersDown ending
12:00:55,334 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower344-notifier347#-1688111562]
12:00:55,335 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower344-collector348#-2049631593]
12:00:55,335 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower345-notifier349#1395077222]
12:00:55,335 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower345-collector350#-621003991]
12:00:55,335 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower345]
12:00:55,335 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRaftStorage - follower345: terminating thread VirtualThread[#746,follower345-writer-150]/waiting
12:00:55,335 AM [follower345-writer-150] [DEBUG] JournalWriteTask - follower345: received 1 commands after 495.3 ms
12:00:55,336 AM [follower345-writer-150] [DEBUG] JournalWriteTask - follower345: completed 1 commands in 11.70 μs
12:00:55,336 AM [follower345-writer-150] [DEBUG] JournalWriteTask - follower345: journal writer stopped
12:00:55,336 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower345: journal closed
12:00:55,336 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower345: journal closed
12:00:55,336 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower345: stopped executor with 0 remaining tasks
12:00:55,336 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower345: stopped executor with 0 remaining tasks
12:00:55,336 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower346-notifier351#-1098132083]
12:00:55,336 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower346-collector352#1105587122]
12:00:55,336 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader343-notifier353#2108587773]
12:00:55,337 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader343-collector354#1447420043]
12:00:55,337 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader343]
12:00:55,337 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRaftStorage - leader343: terminating thread VirtualThread[#748,leader343-writer-152]/waiting
12:00:55,337 AM [leader343-writer-152] [DEBUG] JournalWriteTask - leader343: received 1 commands after 489.2 ms
12:00:55,337 AM [leader343-writer-152] [DEBUG] JournalWriteTask - leader343: completed 1 commands in 11.34 μs
12:00:55,337 AM [leader343-writer-152] [DEBUG] JournalWriteTask - leader343: journal writer stopped
12:00:55,337 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader343: journal closed
12:00:55,337 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - leader343: journal closed
12:00:55,337 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader343: stopped executor with 0 remaining tasks
12:00:55,337 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader343: stopped executor with 0 remaining tasks
12:00:55,337 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$d#1919633105]
[INFO] [07/02/2025 00:00:55.340] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
12:00:55,340 AM [test-pekko.actor.default-dispatcher-12] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
[WARN] [07/02/2025 00:00:55.341] [test-pekko.actor.default-dispatcher-17] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.171.227:17355)
[INFO] [07/02/2025 00:00:55.342] [test-pekko.actor.internal-dispatcher-10] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.227:17355] - Exiting completed
12:00:55,342 AM [test-pekko.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.227:17355] - Exiting completed
[INFO] [07/02/2025 00:00:55.342] [test-pekko.actor.internal-dispatcher-10] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.227:17355] - Shutting down...
12:00:55,342 AM [test-pekko.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.227:17355] - Shutting down...
[INFO] [07/02/2025 00:00:55.342] [test-pekko.actor.internal-dispatcher-10] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.227:17355] - Successfully shut down
12:00:55,344 AM [test-pekko.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.227:17355] - Successfully shut down
[INFO] [07/02/2025 00:00:55.345] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.171.227:17355/system/remoting-terminator] Shutting down remote daemon.
[INFO] [07/02/2025 00:00:55.345] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.171.227:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports.
12:00:55,345 AM [test-pekko.actor.default-dispatcher-15] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
12:00:55,345 AM [test-pekko.actor.default-dispatcher-15] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.