[DEBUG] [07/01/2025 21:31:24.235] [main] [EventStream(pekko://test)] logger log1-TestEventListener started
09:31:24,235 PM [test-pekko.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started
[DEBUG] [07/01/2025 21:31:24.235] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started
[DEBUG] [07/01/2025 21:31:24.236] [main] [EventStream(pekko://test)] Default Loggers started
[INFO] [07/01/2025 21:31:24.248] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.43:17355] with UID [3993982746612844685]
09:31:24,249 PM [test-pekko.actor.default-dispatcher-7] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.43:17355] with UID [3993982746612844685]
[INFO] [07/01/2025 21:31:24.248] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.43:17355] - Starting up, Pekko version [1.0.3] ...
09:31:24,249 PM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.43:17355] - Starting up, Pekko version [1.0.3] ...
[INFO] [07/01/2025 21:31:24.253] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.43:17355] - Registered cluster JMX MBean [pekko:type=Cluster]
[INFO] [07/01/2025 21:31:24.253] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.43:17355] - Started up successfully
09:31:24,254 PM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.43:17355] - Registered cluster JMX MBean [pekko:type=Cluster]
09:31:24,254 PM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.43:17355] - Started up successfully
[INFO] [07/01/2025 21:31:24.254] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.43:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing
[INFO] [07/01/2025 21:31:24.254] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.43:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining
09:31:24,255 PM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.43:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing
09:31:24,255 PM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.43:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining
09:31:24,268 PM [test-pekko.actor.default-dispatcher-7] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower223] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[WARN] [07/01/2025 21:31:24.268] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower223]: org.opendaylight.controller.cluster.common.actor.Monitor@1bd5b03f
[INFO] [pekkoDeadLetter][07/01/2025 21:31:24.267] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower223] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:31:24,271 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower223: Starting recovery with journal batch size 1000
09:31:24,271 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower223: started executor
09:31:24,271 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower223: started executor
09:31:24,273 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower223: metadata journal open: replayFrom=1 applyTo=0
09:31:24,274 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower223: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:31:24,274 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower223: journal open: applyTo=0
09:31:24,274 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: journal writer started
09:31:24,274 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: waiting to receive commands
09:31:24,276 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/follower223/TermInfo.properties does not exist
09:31:24,276 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower223: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/follower223/journal-v1-1.log
09:31:24,276 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower223: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/follower223/metadata-v1-1.log
09:31:24,276 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower223: no eligible files found
09:31:24,276 PM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower223: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [07/01/2025 21:31:24.276] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader222]: org.opendaylight.controller.cluster.common.actor.Monitor@308009e6
[INFO] [pekkoDeadLetter][07/01/2025 21:31:24.276] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:31:24,277 PM [test-pekko.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:31:24,277 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - leader222: Starting recovery with journal batch size 1000
09:31:24,279 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=0, votedFor=null
09:31:24,279 PM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower223: Local TermInfo store seeded with TermInfo{term=0}
09:31:24,279 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower223: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@167e59
09:31:24,279 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from -1 to -1
09:31:24,279 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader222: started executor
09:31:24,279 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - follower223: empty journal: appending 0 entries
09:31:24,279 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader222: started executor
09:31:24,280 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower223: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:31:24,280 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - follower223: journal recovery completedin 533.0 μs with journalIndex=1
09:31:24,280 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader222: metadata journal open: replayFrom=1 applyTo=0
09:31:24,281 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader222: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:31:24,281 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader222: journal open: applyTo=0
09:31:24,281 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: journal writer started
09:31:24,281 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
09:31:24,282 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/TermInfo.properties does not exist
09:31:24,283 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/journal-v1-1.log
09:31:24,283 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/metadata-v1-1.log
09:31:24,283 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: no eligible files found
09:31:24,283 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader222: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:31:24,286 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=0, votedFor=null
09:31:24,286 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader222: Local TermInfo store seeded with TermInfo{term=0}
09:31:24,286 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4c84ef24
09:31:24,286 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to -1
09:31:24,286 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader222: empty journal: appending 0 entries
09:31:24,287 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader222: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:31:24,287 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader222: journal recovery completedin 568.4 μs with journalIndex=1
09:31:24,772 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:31:24,772 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader222 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.43:17355, Removed)
09:31:24,772 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader222 (Follower): Received ElectionTimeout - switching to Candidate
09:31:24,772 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader222 (Candidate): Election: Candidate has following voting peers: [follower223, follower224]
09:31:24,774 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222
09:31:24,774 PM [test-pekko.actor.default-dispatcher-6] [INFO] Candidate - leader222 (Candidate): Starting new election term 1
09:31:24,775 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} to peer follower223
09:31:24,775 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} to peer follower224
09:31:24,775 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader222 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
[WARN] [07/01/2025 21:31:24.775] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1}
[INFO] [pekkoDeadLetter][07/01/2025 21:31:24.775] [test-pekko.actor.default-dispatcher-7] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:31:24,775 PM [test-pekko.actor.default-dispatcher-7] [INFO] LocalActorRefProvider$$anon$2 -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:31:24,775 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower223 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:31:24,775 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower223 (Follower): Cluster state: []
09:31:24,775 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower223 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:31:24,776 PM [test-pekko.actor.default-dispatcher-11] [INFO] Follower - follower223 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term
09:31:24,787 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=1, votedFor=null
09:31:24,787 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower223 (Follower): In requestVote: RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1
09:31:24,790 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=1, votedFor=leader222
09:31:24,790 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower223 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true}
09:31:24,790 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader222 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1
09:31:24,790 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader222 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1
09:31:24,790 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Election: Leader has following peers: [follower223, follower224]
09:31:24,790 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:31:24,790 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:31:24,790 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Last sync leader does not match current leader leader222, need to catch up to -1
[WARN] [07/01/2025 21:31:24.790] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:24,790 PM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader222 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
[INFO] [pekkoDeadLetter][07/01/2025 21:31:24.790] [test-pekko.actor.default-dispatcher-15] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:31:24,791 PM [test-pekko.actor.default-dispatcher-7] [INFO] LocalActorRefProvider$$anon$2 -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[WARN] [07/01/2025 21:31:24.791] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower223] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower223, initialSyncDone=false]
[INFO] [pekkoDeadLetter][07/01/2025 21:31:24.791] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower223] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:31:24,791 PM [test-pekko.actor.default-dispatcher-15] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:31:24,791 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: -1, nextIndex: 0
09:31:24,791 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:31:24,830 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader222: Persist data index=0 term=1 command=zero
09:31:24,830 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 
09:31:24,830 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
09:31:24,830 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:31:24,830 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 0 is present for follower follower223
09:31:24,830 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 549.1 ms
09:31:24,830 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]}
09:31:24,830 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:31:24,831 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
09:31:24,831 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]}
09:31:24,831 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1
09:31:24,831 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:31:24,831 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): Append entry to log zero
09:31:24,831 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 
[WARN] [07/01/2025 21:31:24.831] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:24,831 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): Log size is now 1
09:31:24,831 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:31:24,831 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached -1 (of expected -1)
09:31:24,831 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 556.6 ms
[WARN] [07/01/2025 21:31:24.831] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower223] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower223, initialSyncDone=true]
[INFO] [pekkoDeadLetter][07/01/2025 21:31:24.831] [test-pekko.actor.default-dispatcher-11] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:31:24,831 PM [test-pekko.actor.default-dispatcher-7] [INFO] LocalActorRefProvider$$anon$2 -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[INFO] [pekkoDeadLetter][07/01/2025 21:31:24.832] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower223] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:31:24,832 PM [test-pekko.actor.default-dispatcher-11] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:31:24,834 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
09:31:24,834 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 3.995 ms
09:31:24,834 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
09:31:24,834 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
09:31:24,834 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true}
09:31:24,835 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@23c78572}
09:31:24,835 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 0, nextIndex: 1
09:31:24,835 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
09:31:24,835 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 0
09:31:24,835 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to 0
09:31:24,835 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader222: Applying state for log index 0 data zero
09:31:24,835 PM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader222: applyState called: zero
09:31:24,835 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:31:24,835 PM [follower223-writer-87] [DEBUG] RaftStorageCompleter - follower223: 1 completion(s) pending
09:31:24,835 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 4.112 ms
09:31:24,835 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - follower223: running 1 completion(s)
09:31:24,835 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: waiting to receive commands
09:31:24,835 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false}
09:31:24,835 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 738.3 μs
09:31:24,835 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): Commit index set to 0
09:31:24,835 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 0 (of expected -1)
09:31:24,835 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:31:24,835 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 0
09:31:24,835 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from -1 to 0
09:31:24,835 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower223: Applying state for log index 0 data zero
09:31:24,835 PM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower223: applyState called: zero
09:31:24,835 PM [leader222-writer-88] [DEBUG] EntryJournalV1 - leader222: updated meta to JournalMeta[replayFrom=1, applyTo=1]
09:31:24,835 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
09:31:24,835 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 292.6 μs
09:31:24,835 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 260.7 μs
09:31:24,836 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
09:31:24,836 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
09:31:24,836 PM [follower223-writer-87] [DEBUG] EntryJournalV1 - follower223: updated meta to JournalMeta[replayFrom=1, applyTo=1]
09:31:24,836 PM [follower223-writer-87] [DEBUG] RaftStorageCompleter - follower223: 1 completion(s) pending
09:31:24,836 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 310.1 μs
09:31:24,836 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: waiting to receive commands
09:31:24,836 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - follower223: running 1 completion(s)
09:31:24,902 PM [test-pekko.actor.default-dispatcher-16] [INFO] LocalActorRefProvider$$anon$2 -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[WARN] [07/01/2025 21:31:24.902] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
[INFO] [pekkoDeadLetter][07/01/2025 21:31:24.902] [test-pekko.actor.default-dispatcher-16] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:31:24,931 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader222: Persist data index=1 term=1 command=one
09:31:24,931 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 
09:31:24,931 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true
09:31:24,931 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:31:24,931 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 1 is present for follower follower223
09:31:24,931 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]}
09:31:24,931 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 95.96 ms
09:31:24,932 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:31:24,932 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 21:31:24.932] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:24,932 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]}
09:31:24,932 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1
09:31:24,932 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
09:31:24,932 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Append entry to log one
09:31:24,932 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 
[INFO] [pekkoDeadLetter][07/01/2025 21:31:24.932] [test-pekko.actor.default-dispatcher-15] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:31:24,932 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Log size is now 2
09:31:24,932 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:31:24,932 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 0 (of expected -1)
09:31:24,932 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 96.40 ms
09:31:24,933 PM [test-pekko.actor.default-dispatcher-16] [INFO] LocalActorRefProvider$$anon$2 -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:31:24,934 PM [follower223-writer-87] [DEBUG] RaftStorageCompleter - follower223: 1 completion(s) pending
09:31:24,934 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
09:31:24,934 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 1.862 ms
09:31:24,934 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: waiting to receive commands
09:31:24,934 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 2.680 ms
09:31:24,934 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
09:31:24,934 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
09:31:24,934 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true}
09:31:24,934 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=1, term=1, command=one, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@3ab61837}
09:31:24,934 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower223: running 1 completion(s)
09:31:24,934 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false}
09:31:24,935 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 1, nextIndex: 2
09:31:24,935 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0
09:31:24,935 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 1
09:31:24,935 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 0 to 1
09:31:24,935 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader222: Applying state for log index 1 data one
09:31:24,935 PM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - leader222: applyState called: one
09:31:24,935 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:31:24,935 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 573.7 μs
09:31:24,935 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): Commit index set to 1
09:31:24,935 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 1 (of expected -1)
09:31:24,935 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
09:31:24,935 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 1
09:31:24,935 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 0 to 1
09:31:24,935 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower223: Applying state for log index 1 data one
09:31:24,935 PM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower223: applyState called: one
09:31:24,935 PM [leader222-writer-88] [DEBUG] EntryJournalV1 - leader222: updated meta to JournalMeta[replayFrom=1, applyTo=2]
09:31:24,935 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
09:31:24,935 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 214.8 μs
09:31:24,935 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
09:31:24,935 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
09:31:24,935 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 1.033 ms
09:31:24,935 PM [follower223-writer-87] [DEBUG] EntryJournalV1 - follower223: updated meta to JournalMeta[replayFrom=1, applyTo=2]
09:31:24,935 PM [follower223-writer-87] [DEBUG] RaftStorageCompleter - follower223: 1 completion(s) pending
09:31:24,935 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 155.1 μs
09:31:24,936 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: waiting to receive commands
09:31:24,936 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower223: running 1 completion(s)
[WARN] [07/01/2025 21:31:25.022] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:25,22 PM [test-pekko.actor.default-dispatcher-11] [INFO] LocalActorRefProvider$$anon$2 -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[INFO] [pekkoDeadLetter][07/01/2025 21:31:25.022] [test-pekko.actor.default-dispatcher-15] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
09:31:25,33 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader222: Persist data index=2 term=1 command=two
09:31:25,33 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 
09:31:25,33 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true
09:31:25,33 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1
09:31:25,33 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 2 is present for follower follower223
09:31:25,33 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]}
09:31:25,33 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 97.49 ms
09:31:25,33 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1
09:31:25,33 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
09:31:25,33 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]}
09:31:25,33 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1
[WARN] [07/01/2025 21:31:25.033] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:25,33 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0
09:31:25,33 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Append entry to log two
09:31:25,33 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 
09:31:25,33 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Log size is now 3
09:31:25,33 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:31:25,33 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 1 (of expected -1)
09:31:25,33 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 97.79 ms
09:31:25,35 PM [follower223-writer-87] [DEBUG] RaftStorageCompleter - follower223: 1 completion(s) pending
09:31:25,35 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
09:31:25,35 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 1.988 ms
09:31:25,35 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: waiting to receive commands
09:31:25,35 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 2.565 ms
09:31:25,35 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
09:31:25,35 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
09:31:25,35 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true}
09:31:25,36 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=2, term=1, command=two, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@475f0b3b}
09:31:25,36 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower223: running 1 completion(s)
09:31:25,36 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false}
09:31:25,36 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 2, nextIndex: 3
09:31:25,36 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1
09:31:25,36 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 2
09:31:25,36 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 1 to 2
09:31:25,36 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader222: Applying state for log index 2 data two
09:31:25,36 PM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - leader222: applyState called: two
09:31:25,36 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: -1
09:31:25,36 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 541.8 μs
09:31:25,36 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader222: Persist data index=3 term=1 command=three
09:31:25,36 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 
09:31:25,36 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true
09:31:25,36 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 3, leaderLastIndex: 3, leaderSnapShotIndex: -1
09:31:25,36 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 3 is present for follower follower223
09:31:25,36 PM [leader222-writer-88] [DEBUG] EntryJournalV1 - leader222: updated meta to JournalMeta[replayFrom=1, applyTo=3]
09:31:25,36 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
09:31:25,36 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=2, prevLogTerm=1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=three, pending=true}]}
09:31:25,36 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1
09:31:25,36 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 211.9 μs
09:31:25,36 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
09:31:25,36 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 6.530 μs
09:31:25,36 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
09:31:25,37 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Commit index set to 2
09:31:25,37 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 2 (of expected -1)
09:31:25,37 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): 1, lastIndex(): 2
[WARN] [07/01/2025 21:31:25.037] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:25,37 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 2
09:31:25,37 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 1 to 2
09:31:25,37 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower223: Applying state for log index 2 data two
09:31:25,37 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower223: applyState called: two
09:31:25,37 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=2, prevLogTerm=1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=three, pending=true}]}
09:31:25,37 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 1.816 ms
09:31:25,37 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1
09:31:25,37 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 2, entries to be added from: 0
09:31:25,37 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Append entry to log three
09:31:25,37 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 
09:31:25,37 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Log size is now 4
09:31:25,37 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=3, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:31:25,37 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 2 (of expected -1)
09:31:25,37 PM [follower223-writer-87] [DEBUG] EntryJournalV1 - follower223: updated meta to JournalMeta[replayFrom=1, applyTo=3]
09:31:25,38 PM [follower223-writer-87] [DEBUG] RaftStorageCompleter - follower223: 1 completion(s) pending
09:31:25,38 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - follower223: running 1 completion(s)
09:31:25,38 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 260.6 μs
09:31:25,38 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 6.910 μs
09:31:25,38 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
09:31:25,38 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
09:31:25,38 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 1.954 ms
09:31:25,38 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true}
09:31:25,38 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
09:31:25,38 PM [test-pekko.actor.default-dispatcher-11] [INFO] SnapshotManager - leader222: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=2, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false]
09:31:25,38 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SnapshotManager - leader222: captured snapshot at lastSequenceNumber: 3
09:31:25,38 PM [test-pekko.actor.default-dispatcher-11] [INFO] SnapshotManager - leader222: Persising snapshot at EntryInfo[index=2, term=1]/EntryInfo[index=3, term=1]
09:31:25,38 PM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - leader222: support() called
09:31:25,39 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SnapshotManager - leader222: log size 4 exceeds the snapshot batch count 4 - doing snapshotPreCommit with index 2
09:31:25,39 PM [leader222-%d737613] [DEBUG] RaftStorage - leader222: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/snapshot-00000000686453AD-0258EF6E.tmp
09:31:25,39 PM [test-pekko.actor.default-dispatcher-11] [INFO] SnapshotManager - leader222: Removed in-memory snapshotted entries, adjusted snaphsotIndex: 2 and term: 1
09:31:25,39 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=3, term=1, command=three, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@5522240}
09:31:25,39 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 3 is present for follower follower223
09:31:25,39 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 3, nextIndex: 4
09:31:25,39 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 3, lastAppliedIndex: 2
09:31:25,39 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 3
09:31:25,39 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 2 to 3
09:31:25,39 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader222: Applying state for log index 3 data three
09:31:25,39 PM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - leader222: applyState called: three
09:31:25,39 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 3, leaderSnapShotIndex: 2
09:31:25,40 PM [follower223-writer-87] [DEBUG] RaftStorageCompleter - follower223: 1 completion(s) pending
09:31:25,40 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 1.996 ms
09:31:25,40 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: waiting to receive commands
09:31:25,40 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Commit index set to 3
09:31:25,40 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 3 (of expected -1)
09:31:25,40 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 1.280 ms
09:31:25,40 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 3, context.getLastApplied(): 2, lastIndex(): 3
09:31:25,40 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 3
09:31:25,40 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 2 to 3
09:31:25,40 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower223: Applying state for log index 3 data three
09:31:25,40 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower223: applyState called: three
09:31:25,40 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - follower223: running 1 completion(s)
09:31:25,40 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=false}
09:31:25,40 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 251.6 μs
09:31:25,40 PM [leader222-writer-88] [DEBUG] EntryJournalV1 - leader222: updated meta to JournalMeta[replayFrom=1, applyTo=4]
09:31:25,40 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
09:31:25,40 PM [follower223-writer-87] [DEBUG] EntryJournalV1 - follower223: updated meta to JournalMeta[replayFrom=1, applyTo=4]
09:31:25,40 PM [follower223-writer-87] [DEBUG] RaftStorageCompleter - follower223: 1 completion(s) pending
09:31:25,40 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
09:31:25,40 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 123.5 μs
09:31:25,40 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - follower223: running 1 completion(s)
09:31:25,40 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: waiting to receive commands
09:31:25,40 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 346.6 μs
09:31:25,40 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
09:31:25,41 PM [leader222-%d737613] [DEBUG] RaftStorage - leader222: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/snapshot-00000000686453AD-0258EF6E.v1
09:31:25,42 PM [leader222-%d737613] [DEBUG] RaftStorage - leader222: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/snapshot-00000000686453AD-0258EF6E.v1
09:31:25,42 PM [leader222-%d737613] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/TermInfo.properties
09:31:25,42 PM [leader222-%d737613] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/journal-v1-1.log
09:31:25,42 PM [leader222-%d737613] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/metadata-v1-1.log
09:31:25,42 PM [leader222-%d737613] [DEBUG] RaftStorage - leader222: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=2, term=1], timestamp=2025-07-01T21:31:25.039382894Z, file=/tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/snapshot-00000000686453AD-0258EF6E.v1, size=374, entryCompress=NONE, stateCompress=NONE}
09:31:25,42 PM [leader222-%d737613] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
09:31:25,42 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
09:31:25,42 PM [test-pekko.actor.default-dispatcher-6] [INFO] SnapshotManager - leader222: snapshot is durable as of 2025-07-01T21:31:25.039382894Z
09:31:25,42 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotManager - leader222: Snapshot success with first journal index 4
09:31:25,42 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorSnapshotMessageSupport - leader222: SnapshotComplete received
09:31:25,42 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 2.159 ms
09:31:25,42 PM [leader222-writer-88] [DEBUG] EntryJournalV1 - leader222: updated meta to JournalMeta[replayFrom=4, applyTo=4]
09:31:25,43 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
09:31:25,43 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 189.1 μs
09:31:25,43 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
09:31:25,43 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
09:31:25,134 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/snapshot-00000000686453AD-0258EF6E.v1
09:31:25,134 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/TermInfo.properties
09:31:25,134 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/journal-v1-1.log
09:31:25,134 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/metadata-v1-1.log
09:31:25,134 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: picked SnapshotFileV1{lastIncluded=EntryInfo[index=2, term=1], timestamp=2025-07-01T21:31:25.039382894Z, file=/tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/snapshot-00000000686453AD-0258EF6E.v1, size=374, entryCompress=NONE, stateCompress=NONE} as the latest file
[WARN] [07/01/2025 21:31:25.142] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:25,142 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 3 (of expected -1)
09:31:25,248 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - follower223: terminating thread VirtualThread[#610,follower223-writer-87]/waiting
09:31:25,248 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 207.8 ms
09:31:25,248 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 39.54 μs
09:31:25,248 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: journal writer stopped
09:31:25,248 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower223: journal closed
09:31:25,248 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower223: journal closed
09:31:25,248 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower223: stopped executor with 0 remaining tasks
09:31:25,249 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower223: stopped executor with 0 remaining tasks
09:31:25,251 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader222: Persist data index=4 term=1 command=four
09:31:25,251 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=4, term=1, command=four, pending=true} 
09:31:25,251 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 4, isSendImmediate: true
09:31:25,252 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 4, leaderSnapShotIndex: 2
09:31:25,252 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 4 is present for follower follower223
09:31:25,251 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 208.9 ms
09:31:25,252 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=3, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=1, command=four, pending=true}]}
09:31:25,252 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: 2
09:31:25,252 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 21:31:25.252] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower223] received dead letter from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=3, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=1, command=four, pending=true}]}
[WARN] [07/01/2025 21:31:25.252] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:25,254 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
09:31:25,254 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
09:31:25,254 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=4, term=1, command=four, pending=true}
09:31:25,254 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 2.619 ms
09:31:25,254 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
09:31:25,254 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=4, term=1, command=four, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@2d7760cf}
09:31:25,254 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader222: Persist data index=5 term=1 command=five
09:31:25,254 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=5, term=1, command=five, pending=true} 
09:31:25,254 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=five}, logIndex: 5, isSendImmediate: true
09:31:25,254 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 5, leaderSnapShotIndex: 2
09:31:25,255 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 4 is present for follower follower223
09:31:25,254 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 215.8 μs
09:31:25,255 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: 2
09:31:25,255 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 21:31:25.255] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:25,256 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
09:31:25,256 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
09:31:25,256 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=5, term=1, command=five, pending=true}
09:31:25,256 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 1.263 ms
09:31:25,256 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
09:31:25,256 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=5, term=1, command=five, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@201436d5}
09:31:25,261 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 4 is present for follower follower223
[WARN] [07/01/2025 21:31:25.261] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:25,302 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 46.34 ms
09:31:25,303 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
09:31:25,303 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
09:31:25,303 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
09:31:25,303 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 754.6 μs
09:31:25,303 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback UncheckNoopCallback{}
09:31:25,303 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
09:31:25,303 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Persist data index=4 term=1 command=newFour
09:31:25,303 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=4, term=1, command=newFour, pending=true} 
09:31:25,303 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=newFour}, logIndex: 4, isSendImmediate: true
09:31:25,303 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 4, leaderSnapShotIndex: 2
09:31:25,303 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 4 is present for follower follower223
09:31:25,303 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: 2
09:31:25,303 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 178.5 μs
09:31:25,303 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 21:31:25.304] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:25,306 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
09:31:25,306 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
09:31:25,306 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 2.413 ms
09:31:25,306 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=4, term=1, command=newFour, pending=true}
09:31:25,306 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
09:31:25,306 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=4, term=1, command=newFour, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@4ebe742e}
09:31:25,382 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 4 is present for follower follower223
09:31:25,382 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=3, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=1, command=newFour, pending=false}]}
[WARN] [07/01/2025 21:31:25.382] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower223] received dead letter from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=3, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=1, command=newFour, pending=false}]}
[WARN] [07/01/2025 21:31:25.382] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:25,404 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader222: Persist data index=5 term=1 command=newFive
09:31:25,404 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=5, term=1, command=newFive, pending=true} 
09:31:25,404 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=newFive}, logIndex: 5, isSendImmediate: true
09:31:25,404 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 5, leaderSnapShotIndex: 2
09:31:25,404 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 4 is present for follower follower223
09:31:25,404 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: 2
09:31:25,404 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
09:31:25,405 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 98.66 ms
[WARN] [07/01/2025 21:31:25.405] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:25,407 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
09:31:25,407 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
09:31:25,407 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=5, term=1, command=newFive, pending=true}
09:31:25,407 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 2.329 ms
09:31:25,407 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
09:31:25,407 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=5, term=1, command=newFive, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@157a094c}
09:31:25,502 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 4 is present for follower follower223
09:31:25,502 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=3, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=1, command=newFour, pending=false}, JournaledLogEntry{index=5, term=1, command=newFive, pending=false}]}
[WARN] [07/01/2025 21:31:25.502] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower223] received dead letter from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=3, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=1, command=newFour, pending=false}, JournaledLogEntry{index=5, term=1, command=newFive, pending=false}]}
[WARN] [07/01/2025 21:31:25.503] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:25,517 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader222: terminating thread VirtualThread[#613,leader222-writer-88]/waiting
09:31:25,518 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 110.5 ms
09:31:25,518 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 32.80 μs
09:31:25,518 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: journal writer stopped
09:31:25,518 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader222: journal closed
09:31:25,518 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader222: journal closed
09:31:25,518 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks
09:31:25,518 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks
[WARN] [07/01/2025 21:31:25.520] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader222]: org.opendaylight.controller.cluster.common.actor.Monitor@2ff0bc30
09:31:25,521 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader222: Starting recovery with journal batch size 1000
09:31:25,521 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader222: started executor
09:31:25,521 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader222: started executor
09:31:25,522 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader222: metadata journal open: replayFrom=4 applyTo=4
09:31:25,524 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader222: journal open: firstIndex=1 lastIndex=6 replayFrom=4 fileEntries=0
09:31:25,524 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader222: journal open: applyTo=4
09:31:25,524 PM [leader222-writer-89] [DEBUG] JournalWriteTask - leader222: journal writer started
09:31:25,524 PM [leader222-writer-89] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
09:31:25,525 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222
09:31:25,525 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/snapshot-00000000686453AD-0258EF6E.v1
09:31:25,525 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/TermInfo.properties
09:31:25,526 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/journal-v1-1.log
09:31:25,526 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/metadata-v1-1.log
09:31:25,526 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: picked SnapshotFileV1{lastIncluded=EntryInfo[index=2, term=1], timestamp=2025-07-01T21:31:25.039382894Z, file=/tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest18208099884947257204/leader222/snapshot-00000000686453AD-0258EF6E.v1, size=374, entryCompress=NONE, stateCompress=NONE} as the latest file
09:31:25,526 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader222: support() called
09:31:25,527 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader222: initializing from snapshot taken at 2025-07-01T21:31:25.039382894Z
09:31:25,527 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222
09:31:25,527 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for leader222 in 93.80 μs: snapshotIndex=2, snapshotTerm=1, journal-size=0
09:31:25,527 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader222: Recovery completed in 229.3 μs - Switching actor to Follower - last log index = 2, last log term = 1, snapshot index = 2, snapshot term = 1, journal size = 0
09:31:25,527 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader222: restoring local TermInfo{term=1, votedFor=leader222}
09:31:25,527 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222
09:31:25,527 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@11d692d0
09:31:25,527 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to 2
09:31:25,528 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader222: applying entries up to 4
09:31:25,528 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=3, term=1, command=three]
09:31:25,529 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=4, term=1, command=newFour]
09:31:25,529 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=5, term=1, command=newFive]
09:31:25,530 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 2 to 3
09:31:25,530 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader222: journal recovery completedin 2.250 ms with journalIndex=4
09:31:25,530 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower223-collector225#1424069665]
09:31:25,530 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader222 (Follower): Received TimeoutNow - switching to Candidate
09:31:25,530 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader222 (Candidate): Election: Candidate has following voting peers: []
09:31:25,532 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=2, votedFor=leader222
09:31:25,532 PM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader222 (Candidate): Starting new election term 2
09:31:25,532 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader222 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:31:25,532 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader222 (Candidate): Received ElectionTimeout
09:31:25,532 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Election: Leader has following peers: []
09:31:25,532 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader222 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
09:31:25,540 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower223]
09:31:25,541 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader222-collector226#29100414]
09:31:25,541 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader222]
09:31:25,541 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader222-collector227#1186323392]
09:31:25,541 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader222]
09:31:25,542 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - leader222: terminating thread VirtualThread[#622,leader222-writer-89]/waiting
09:31:25,542 PM [leader222-writer-89] [DEBUG] JournalWriteTask - leader222: received 1 commands after 17.69 ms
09:31:25,542 PM [leader222-writer-89] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 29.89 μs
09:31:25,542 PM [leader222-writer-89] [DEBUG] JournalWriteTask - leader222: journal writer stopped
09:31:25,542 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader222: journal closed
09:31:25,542 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader222: journal closed
09:31:25,542 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks
09:31:25,542 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks
[WARN] [07/01/2025 21:31:25.545] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower229]: org.opendaylight.controller.cluster.common.actor.Monitor@5c7955eb
09:31:25,546 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower229: Starting recovery with journal batch size 1000
09:31:25,546 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower229: started executor
09:31:25,546 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower229: started executor
09:31:25,547 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower229: metadata journal open: replayFrom=1 applyTo=0
09:31:25,548 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower229: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:31:25,548 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower229: journal open: applyTo=0
09:31:25,548 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: journal writer started
09:31:25,548 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: waiting to receive commands
09:31:25,549 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/follower229/TermInfo.properties does not exist
09:31:25,549 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower229: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/follower229/journal-v1-1.log
09:31:25,549 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower229: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/follower229/metadata-v1-1.log
09:31:25,549 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower229: no eligible files found
09:31:25,549 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower229: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [07/01/2025 21:31:25.550] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader228]: org.opendaylight.controller.cluster.common.actor.Monitor@214fb8f4
09:31:25,551 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader228: Starting recovery with journal batch size 1000
09:31:25,551 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader228: started executor
09:31:25,551 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader228: started executor
09:31:25,551 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader228: metadata journal open: replayFrom=1 applyTo=0
09:31:25,552 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower229: Set currentTerm=0, votedFor=null
09:31:25,552 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower229: Local TermInfo store seeded with TermInfo{term=0}
09:31:25,552 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower229: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@5e895e51
09:31:25,552 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower229: Moving last applied index from -1 to -1
09:31:25,552 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower229: empty journal: appending 0 entries
09:31:25,552 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower229: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:31:25,552 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower229: journal recovery completedin 357.2 μs with journalIndex=1
09:31:25,553 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader228: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:31:25,553 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader228: journal open: applyTo=0
09:31:25,553 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: journal writer started
09:31:25,553 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
09:31:25,554 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/TermInfo.properties does not exist
09:31:25,554 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/journal-v1-1.log
09:31:25,554 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/metadata-v1-1.log
09:31:25,554 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader228: no eligible files found
09:31:25,554 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader228: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:31:25,558 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader228: Set currentTerm=0, votedFor=null
09:31:25,558 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader228: Local TermInfo store seeded with TermInfo{term=0}
09:31:25,558 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader228: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@378f773b
09:31:25,558 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader228: Moving last applied index from -1 to -1
09:31:25,558 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader228: empty journal: appending 0 entries
09:31:25,558 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader228: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:31:25,558 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader228: journal recovery completedin 357.4 μs with journalIndex=1
09:31:26,62 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:31:26,62 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader228 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.43:17355, Removed)
09:31:26,62 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader228 (Follower): Received ElectionTimeout - switching to Candidate
09:31:26,62 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader228 (Candidate): Election: Candidate has following voting peers: [follower229, follower230]
09:31:26,64 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader228: Set currentTerm=1, votedFor=leader228
09:31:26,64 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader228 (Candidate): Starting new election term 1
09:31:26,64 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader228 (Candidate): Sending RequestVote{term=1, candidateId=leader228, lastLogIndex=-1, lastLogTerm=-1} to peer follower229
09:31:26,64 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader228 (Candidate): Sending RequestVote{term=1, candidateId=leader228, lastLogIndex=-1, lastLogTerm=-1} to peer follower230
09:31:26,64 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader228 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
09:31:26,64 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower229 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
[WARN] [07/01/2025 21:31:26.064] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: RequestVote{term=1, candidateId=leader228, lastLogIndex=-1, lastLogTerm=-1}
09:31:26,64 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower229 (Follower): Cluster state: []
09:31:26,64 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower229 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader228, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:31:26,64 PM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower229 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader228, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term
09:31:26,67 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower229: Set currentTerm=1, votedFor=null
09:31:26,67 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower229 (Follower): In requestVote: RequestVote{term=1, candidateId=leader228, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1
09:31:26,68 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower229: Set currentTerm=1, votedFor=leader228
09:31:26,68 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower229 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true}
09:31:26,68 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader228 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1
09:31:26,68 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader228 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1
09:31:26,68 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader228 (Leader): Election: Leader has following peers: [follower229, follower230]
09:31:26,68 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:31:26,68 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower230: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:31:26,68 PM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader228 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
[WARN] [07/01/2025 21:31:26.068] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:26,68 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower229: Last sync leader does not match current leader leader228, need to catch up to -1
09:31:26,68 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader228 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower229 updated: matchIndex: -1, nextIndex: 0
09:31:26,69 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/01/2025 21:31:26.069] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower229] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower229, initialSyncDone=false]
09:31:26,102 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader228: Persist data index=0 term=1 command=zero
09:31:26,102 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader228: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 
09:31:26,102 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
09:31:26,102 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 549.2 ms
09:31:26,102 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:31:26,102 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): sendAppendEntries: 0 is present for follower follower229
09:31:26,102 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): Sending AppendEntries to follower follower229: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]}
09:31:26,103 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower229 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]}
09:31:26,103 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower229 (Follower): Number of entries to be appended = 1
09:31:26,103 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower229 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:31:26,103 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower229 (Follower): Append entry to log zero
09:31:26,103 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower229: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 
09:31:26,103 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower229 (Follower): Log size is now 1
09:31:26,103 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower229 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower229, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:31:26,103 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower229: Lagging 0 entries behind leader leader228 and reached -1 (of expected -1)
09:31:26,103 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower230: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:31:26,103 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: received 1 commands after 555.2 ms
09:31:26,103 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader228: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 21:31:26.103] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower229] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower229, initialSyncDone=true]
[WARN] [07/01/2025 21:31:26.103] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:26,107 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
09:31:26,107 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
09:31:26,107 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 4.602 ms
09:31:26,107 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
09:31:26,107 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader228: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true}
09:31:26,107 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader228: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@2a837c09}
09:31:26,107 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower229 updated: matchIndex: 0, nextIndex: 1
09:31:26,107 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
09:31:26,107 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader228 (Leader): Setting last applied to 0
09:31:26,107 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader228: Moving last applied index from -1 to 0
09:31:26,107 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader228: Applying state for log index 0 data zero
09:31:26,107 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader228: applyState called: zero
09:31:26,107 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:31:26,107 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 585.6 μs
09:31:26,108 PM [follower229-writer-90] [DEBUG] RaftStorageCompleter - follower229: 1 completion(s) pending
09:31:26,108 PM [leader228-writer-91] [DEBUG] EntryJournalV1 - leader228: updated meta to JournalMeta[replayFrom=1, applyTo=1]
09:31:26,108 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: completed 1 commands in 4.324 ms
09:31:26,108 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: waiting to receive commands
09:31:26,108 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
09:31:26,108 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 261.2 μs
09:31:26,108 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
09:31:26,108 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
09:31:26,108 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower229 (Follower): Commit index set to 0
09:31:26,108 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower229: Lagging 0 entries behind leader leader228 and reached 0 (of expected -1)
09:31:26,108 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower229 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:31:26,108 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower229 (Follower): Setting last applied to 0
09:31:26,108 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower229: Moving last applied index from -1 to 0
09:31:26,108 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower229: Applying state for log index 0 data zero
09:31:26,108 PM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower229: applyState called: zero
09:31:26,108 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - follower229: running 1 completion(s)
09:31:26,108 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower229: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false}
09:31:26,108 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: received 1 commands after 341.3 μs
09:31:26,108 PM [follower229-writer-90] [DEBUG] EntryJournalV1 - follower229: updated meta to JournalMeta[replayFrom=1, applyTo=1]
09:31:26,108 PM [follower229-writer-90] [DEBUG] RaftStorageCompleter - follower229: 1 completion(s) pending
09:31:26,108 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: completed 1 commands in 196.6 μs
09:31:26,108 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower229: running 1 completion(s)
09:31:26,108 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: waiting to receive commands
[WARN] [07/01/2025 21:31:26.182] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:26,203 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader228: Persist data index=1 term=1 command=one
09:31:26,203 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader228: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 
09:31:26,203 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true
09:31:26,203 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:31:26,203 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 95.43 ms
09:31:26,203 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): sendAppendEntries: 1 is present for follower follower229
09:31:26,203 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): Sending AppendEntries to follower follower229: AppendEntries{term=1, leaderId=leader228, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]}
09:31:26,203 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower230: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:31:26,203 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader228: awaiting more completions to resolve 1 synchronized callback(s)
09:31:26,203 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower229 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader228, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]}
09:31:26,203 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower229 (Follower): Number of entries to be appended = 1
09:31:26,203 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower229 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
09:31:26,203 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower229 (Follower): Append entry to log one
09:31:26,204 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower229: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 
[WARN] [07/01/2025 21:31:26.204] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:26,204 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower229 (Follower): Log size is now 2
09:31:26,204 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower229 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower229, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:31:26,204 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower229: Lagging 0 entries behind leader leader228 and reached 0 (of expected -1)
09:31:26,204 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: received 1 commands after 95.42 ms
09:31:26,205 PM [follower229-writer-90] [DEBUG] RaftStorageCompleter - follower229: 1 completion(s) pending
09:31:26,205 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
09:31:26,205 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: completed 1 commands in 1.435 ms
09:31:26,205 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: waiting to receive commands
09:31:26,205 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 1.985 ms
09:31:26,205 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - follower229: running 1 completion(s)
09:31:26,205 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
09:31:26,205 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower229: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false}
09:31:26,205 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
09:31:26,205 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader228: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true}
09:31:26,205 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader228: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=1, term=1, command=one, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@770b55da}
09:31:26,206 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower229 updated: matchIndex: 1, nextIndex: 2
09:31:26,206 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0
09:31:26,206 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader228 (Leader): Setting last applied to 1
09:31:26,206 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader228: Moving last applied index from 0 to 1
09:31:26,206 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader228: Applying state for log index 1 data one
09:31:26,206 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader228: applyState called: one
09:31:26,206 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 565.9 μs
09:31:26,206 PM [leader228-writer-91] [DEBUG] EntryJournalV1 - leader228: updated meta to JournalMeta[replayFrom=1, applyTo=2]
09:31:26,206 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
09:31:26,206 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 179.6 μs
09:31:26,206 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
09:31:26,206 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:31:26,206 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
09:31:26,206 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower229 (Follower): Commit index set to 1
09:31:26,206 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower229: Lagging 0 entries behind leader leader228 and reached 1 (of expected -1)
09:31:26,207 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower229 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
09:31:26,207 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower229 (Follower): Setting last applied to 1
09:31:26,207 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower229: Moving last applied index from 0 to 1
09:31:26,207 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower229: Applying state for log index 1 data one
09:31:26,207 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower229: applyState called: one
09:31:26,207 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: received 1 commands after 1.829 ms
09:31:26,207 PM [follower229-writer-90] [DEBUG] EntryJournalV1 - follower229: updated meta to JournalMeta[replayFrom=1, applyTo=2]
09:31:26,207 PM [follower229-writer-90] [DEBUG] RaftStorageCompleter - follower229: 1 completion(s) pending
09:31:26,207 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: completed 1 commands in 187.5 μs
09:31:26,207 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: waiting to receive commands
09:31:26,207 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - follower229: running 1 completion(s)
[WARN] [07/01/2025 21:31:26.302] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:26,304 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader228: Persist data index=2 term=1 command=two
09:31:26,304 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader228: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 
09:31:26,305 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader228 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true
09:31:26,305 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1
09:31:26,305 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader228 (Leader): sendAppendEntries: 2 is present for follower follower229
09:31:26,305 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 98.74 ms
09:31:26,305 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader228 (Leader): Sending AppendEntries to follower follower229: AppendEntries{term=1, leaderId=leader228, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]}
09:31:26,305 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower230: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1
09:31:26,305 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader228: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 21:31:26.305] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:26,307 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
09:31:26,307 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
09:31:26,307 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 2.242 ms
09:31:26,307 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
09:31:26,307 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader228: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true}
09:31:26,307 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader228: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=2, term=1, command=two, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@3ed030d1}
09:31:26,307 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader228: Persist data index=3 term=1 command=three
09:31:26,307 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader228: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 
09:31:26,307 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader228 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true
09:31:26,307 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 303.3 μs
09:31:26,307 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1
09:31:26,307 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader228 (Leader): sendAppendEntries: 2 is present for follower follower229
09:31:26,307 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower230: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1
09:31:26,308 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader228: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 21:31:26.308] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:26,309 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
09:31:26,309 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
09:31:26,309 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 1.992 ms
09:31:26,309 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
09:31:26,309 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader228: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true}
09:31:26,310 PM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader228: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=2, mandatoryTrim=false]
09:31:26,310 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - leader228: captured snapshot at lastSequenceNumber: 2
09:31:26,310 PM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader228: Persising snapshot at EntryInfo[index=1, term=1]/EntryInfo[index=3, term=1]
09:31:26,310 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader228: support() called
09:31:26,310 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - leader228: log size 4 exceeds the snapshot batch count 4 - doing snapshotPreCommit with index 1
09:31:26,310 PM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader228: Removed in-memory snapshotted entries, adjusted snaphsotIndex: 1 and term: 1
09:31:26,310 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader228: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=3, term=1, command=three, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@2d60857c}
09:31:26,310 PM [leader228-%d258238] [DEBUG] RaftStorage - leader228: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/snapshot-00000000686453AE-12831A38.tmp
09:31:26,310 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader228: Persist data index=4 term=1 command=four
09:31:26,310 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader228: Append log entry and persist JournaledLogEntry{index=4, term=1, command=four, pending=true} 
09:31:26,310 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader228 (Leader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 4, isSendImmediate: true
09:31:26,310 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 2, leaderLastIndex: 4, leaderSnapShotIndex: 1
09:31:26,310 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader228 (Leader): sendAppendEntries: 2 is present for follower follower229
09:31:26,310 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 939.4 μs
09:31:26,310 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower230: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: 1
09:31:26,310 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader228: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 21:31:26.311] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:26,311 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
09:31:26,311 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
09:31:26,311 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader228: persist complete JournaledLogEntry{index=4, term=1, command=four, pending=true}
09:31:26,311 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 945.1 μs
09:31:26,311 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader228: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=4, term=1, command=four, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@32ee3eae}
09:31:26,311 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
09:31:26,313 PM [leader228-%d258238] [DEBUG] RaftStorage - leader228: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/snapshot-00000000686453AE-12831A38.v1
09:31:26,313 PM [leader228-%d258238] [DEBUG] RaftStorage - leader228: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/snapshot-00000000686453AE-12831A38.v1
09:31:26,313 PM [leader228-%d258238] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/TermInfo.properties
09:31:26,313 PM [leader228-%d258238] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/journal-v1-1.log
09:31:26,313 PM [leader228-%d258238] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/metadata-v1-1.log
09:31:26,313 PM [leader228-%d258238] [DEBUG] RaftStorage - leader228: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=1, term=1], timestamp=2025-07-01T21:31:26.310581816Z, file=/tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/snapshot-00000000686453AE-12831A38.v1, size=358, entryCompress=NONE, stateCompress=NONE}
09:31:26,313 PM [leader228-%d258238] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
09:31:26,314 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
09:31:26,314 PM [test-pekko.actor.default-dispatcher-11] [INFO] SnapshotManager - leader228: snapshot is durable as of 2025-07-01T21:31:26.310581816Z
09:31:26,314 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SnapshotManager - leader228: Snapshot success with first journal index 3
09:31:26,314 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorSnapshotMessageSupport - leader228: SnapshotComplete received
09:31:26,314 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 2.265 ms
09:31:26,314 PM [leader228-writer-91] [DEBUG] EntryJournalV1 - leader228: updated meta to JournalMeta[replayFrom=3, applyTo=2]
09:31:26,314 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
09:31:26,314 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 186.5 μs
09:31:26,314 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
09:31:26,314 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
09:31:26,422 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader228 (Leader): sendAppendEntries: 2 is present for follower follower229
09:31:26,422 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader228 (Leader): Sending AppendEntries to follower follower229: AppendEntries{term=1, leaderId=leader228, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=1, command=four, pending=false}]}
[WARN] [07/01/2025 21:31:26.422] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:26,542 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader228 (Leader): sendAppendEntries: 2 is present for follower follower229
09:31:26,542 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader228 (Leader): Sending AppendEntries to follower follower229: AppendEntries{term=1, leaderId=leader228, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=1, command=four, pending=false}]}
[WARN] [07/01/2025 21:31:26.542] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:26,657 PM [awaitility-thread] [DEBUG] RaftStorage - leader228: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/snapshot-00000000686453AE-12831A38.v1
09:31:26,657 PM [awaitility-thread] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/TermInfo.properties
09:31:26,657 PM [awaitility-thread] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/journal-v1-1.log
09:31:26,657 PM [awaitility-thread] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/metadata-v1-1.log
09:31:26,657 PM [awaitility-thread] [DEBUG] RaftStorage - leader228: picked SnapshotFileV1{lastIncluded=EntryInfo[index=1, term=1], timestamp=2025-07-01T21:31:26.310581816Z, file=/tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/snapshot-00000000686453AE-12831A38.v1, size=358, entryCompress=NONE, stateCompress=NONE} as the latest file
09:31:26,661 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower229: Lagging -2 entries behind leader leader228 and reached 1 (of expected -1)
[WARN] [07/01/2025 21:31:26.661] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:26,661 PM [test-pekko.actor.default-dispatcher-15] [WARN] AbstractLeader - leader228 (Leader) : handleAppendEntriesReply delayed beyond election timeout, appendEntriesReply : AppendEntriesReply{term=1, success=true, followerId=follower229, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}, timeSinceLastActivity : 454, lastApplied : 1, commitIndex : 1
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): sendAppendEntries: 2 is present for follower follower229
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Sending AppendEntries to follower follower229: AppendEntries{term=1, leaderId=leader228, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=1, command=four, pending=false}]}
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower229 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader228, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=1, command=four, pending=false}]}
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower229 (Follower): Number of entries to be appended = 3
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower229 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower229 (Follower): Append entry to log two
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower229: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=false} 
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower229 (Follower): Append entry to log three
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower229: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=false} 
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower229 (Follower): Append entry to log four
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower229: Append log entry and persist JournaledLogEntry{index=4, term=1, command=four, pending=false} 
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower229 (Follower): Log size is now 5
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower229 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower229, logLastIndex=4, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower229: Lagging 0 entries behind leader leader228 and reached 1 (of expected -1)
09:31:26,662 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: received 3 commands after 454.9 ms
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower229 updated: matchIndex: 4, nextIndex: 5
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Applying to log - commitIndex: 4, lastAppliedIndex: 1
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader228 (Leader): Setting last applied to 2
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader228: Moving last applied index from 1 to 2
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader228: Applying state for log index 2 data two
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader228: applyState called: two
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader228 (Leader): Setting last applied to 3
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader228: Moving last applied index from 2 to 3
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader228: Applying state for log index 3 data three
09:31:26,662 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader228: applyState called: three
09:31:26,663 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader228 (Leader): Setting last applied to 4
09:31:26,663 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader228: Moving last applied index from 3 to 4
09:31:26,663 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader228: Applying state for log index 4 data four
09:31:26,663 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader228: applyState called: four
09:31:26,663 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 5, leaderLastIndex: 4, leaderSnapShotIndex: 1
09:31:26,663 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 348.7 ms
09:31:26,663 PM [leader228-writer-91] [DEBUG] EntryJournalV1 - leader228: updated meta to JournalMeta[replayFrom=3, applyTo=5]
09:31:26,663 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower229 (Follower): Commit index set to 4
09:31:26,663 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
09:31:26,663 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower229: Lagging 0 entries behind leader leader228 and reached 4 (of expected -1)
09:31:26,663 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower229 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 4, context.getLastApplied(): 1, lastIndex(): 4
09:31:26,663 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower229 (Follower): Setting last applied to 2
09:31:26,663 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower229: Moving last applied index from 1 to 2
09:31:26,663 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 207.0 μs
09:31:26,663 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
09:31:26,663 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower229: Applying state for log index 2 data two
09:31:26,663 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
09:31:26,663 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower229: applyState called: two
09:31:26,663 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower229 (Follower): Setting last applied to 3
09:31:26,663 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower229: Moving last applied index from 2 to 3
09:31:26,663 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower229: Applying state for log index 3 data three
09:31:26,663 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower229: applyState called: three
09:31:26,663 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower229 (Follower): Setting last applied to 4
09:31:26,663 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower229: Moving last applied index from 3 to 4
09:31:26,663 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower229: Applying state for log index 4 data four
09:31:26,663 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower229: applyState called: four
09:31:26,690 PM [follower229-writer-90] [DEBUG] RaftStorageCompleter - follower229: 3 completion(s) pending
09:31:26,690 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: completed 3 commands in 27.38 ms
09:31:26,690 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower229: running 3 completion(s)
09:31:26,690 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower229: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false}
09:31:26,690 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower229: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=false}
09:31:26,690 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower229: persist complete JournaledLogEntry{index=4, term=1, command=four, pending=false}
09:31:26,690 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: received 1 commands after 9.510 μs
09:31:26,690 PM [follower229-writer-90] [DEBUG] EntryJournalV1 - follower229: updated meta to JournalMeta[replayFrom=1, applyTo=5]
09:31:26,690 PM [follower229-writer-90] [DEBUG] RaftStorageCompleter - follower229: 1 completion(s) pending
09:31:26,690 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: completed 1 commands in 215.2 μs
09:31:26,690 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: waiting to receive commands
09:31:26,691 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower229: running 1 completion(s)
09:31:26,770 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - leader228: terminating thread VirtualThread[#624,leader228-writer-91]/waiting
09:31:26,770 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 107.0 ms
09:31:26,770 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 58.60 μs
09:31:26,770 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: journal writer stopped
09:31:26,770 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader228: journal closed
09:31:26,770 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader228: journal closed
09:31:26,770 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader228: stopped executor with 0 remaining tasks
09:31:26,770 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader228: stopped executor with 0 remaining tasks
[WARN] [07/01/2025 21:31:26.772] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader228]: org.opendaylight.controller.cluster.common.actor.Monitor@40842852
09:31:26,773 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - leader228: Starting recovery with journal batch size 1000
09:31:26,773 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader228: started executor
09:31:26,773 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader228: started executor
09:31:26,774 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader228: metadata journal open: replayFrom=3 applyTo=5
09:31:26,776 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader228: journal open: firstIndex=1 lastIndex=5 replayFrom=3 fileEntries=0
09:31:26,776 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader228: journal open: applyTo=5
09:31:26,776 PM [leader228-writer-92] [DEBUG] JournalWriteTask - leader228: journal writer started
09:31:26,776 PM [leader228-writer-92] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
09:31:26,778 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader228: Set currentTerm=1, votedFor=leader228
09:31:26,778 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader228: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/snapshot-00000000686453AE-12831A38.v1
09:31:26,778 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/TermInfo.properties
09:31:26,778 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/journal-v1-1.log
09:31:26,778 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/metadata-v1-1.log
09:31:26,778 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader228: picked SnapshotFileV1{lastIncluded=EntryInfo[index=1, term=1], timestamp=2025-07-01T21:31:26.310581816Z, file=/tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10762637059510943887/leader228/snapshot-00000000686453AE-12831A38.v1, size=358, entryCompress=NONE, stateCompress=NONE} as the latest file
09:31:26,778 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader228: support() called
09:31:26,779 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader228: initializing from snapshot taken at 2025-07-01T21:31:26.310581816Z
09:31:26,779 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader228: Set currentTerm=1, votedFor=leader228
09:31:26,779 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - Recovery snapshot applied for leader228 in 71.36 μs: snapshotIndex=1, snapshotTerm=1, journal-size=0
09:31:26,779 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader228: Recovery completed in 174.9 μs - Switching actor to Follower - last log index = 1, last log term = 1, snapshot index = 1, snapshot term = 1, journal size = 0
09:31:26,779 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader228: restoring local TermInfo{term=1, votedFor=leader228}
09:31:26,779 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader228: Set currentTerm=1, votedFor=leader228
09:31:26,779 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader228: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@7a2c7ea6
09:31:26,779 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader228: Moving last applied index from -1 to 1
09:31:26,780 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader228: applying entries up to 5
09:31:26,780 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader228: recovered journal DefaultLogEntry[index=2, term=1, command=two]
09:31:26,780 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader228: recovered journal DefaultLogEntry[index=3, term=1, command=three]
09:31:26,790 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader228: recovered journal DefaultLogEntry[index=4, term=1, command=four]
09:31:26,791 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader228: Moving last applied index from 1 to 4
09:31:26,791 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader228: journal recovery completedin 11.45 ms with journalIndex=3
09:31:26,791 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader228 (Follower): Received TimeoutNow - switching to Candidate
09:31:26,791 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader228 (Candidate): Election: Candidate has following voting peers: []
09:31:26,801 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader228: Set currentTerm=2, votedFor=leader228
09:31:26,801 PM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader228 (Candidate): Starting new election term 2
09:31:26,801 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader228 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:31:26,801 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader228 (Candidate): Received ElectionTimeout
09:31:26,801 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): Election: Leader has following peers: []
09:31:26,801 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader228 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
09:31:26,876 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower229-collector231#-1105431179]
09:31:26,877 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower229]
09:31:26,877 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - follower229: terminating thread VirtualThread[#623,follower229-writer-90]/waiting
09:31:26,877 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: received 1 commands after 187.5 ms
09:31:26,878 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: completed 1 commands in 29.49 μs
09:31:26,878 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: journal writer stopped
09:31:26,878 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower229: journal closed
09:31:26,878 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower229: journal closed
09:31:26,878 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower229: stopped executor with 0 remaining tasks
09:31:26,878 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower229: stopped executor with 0 remaining tasks
09:31:26,878 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader228-collector232#-2138247424]
09:31:26,878 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader228]
09:31:26,878 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader228-collector233#-703504794]
09:31:26,879 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader228]
09:31:26,879 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - leader228: terminating thread VirtualThread[#630,leader228-writer-92]/waiting
09:31:26,879 PM [leader228-writer-92] [DEBUG] JournalWriteTask - leader228: received 1 commands after 102.7 ms
09:31:26,879 PM [leader228-writer-92] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 19.45 μs
09:31:26,879 PM [leader228-writer-92] [DEBUG] JournalWriteTask - leader228: journal writer stopped
09:31:26,879 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader228: journal closed
09:31:26,879 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader228: journal closed
09:31:26,879 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader228: stopped executor with 0 remaining tasks
09:31:26,879 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader228: stopped executor with 0 remaining tasks
[WARN] [07/01/2025 21:31:26.883] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower235]: org.opendaylight.controller.cluster.common.actor.Monitor@63b4687
09:31:26,884 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - follower235: Starting recovery with journal batch size 1000
09:31:26,884 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower235: started executor
09:31:26,884 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower235: started executor
09:31:26,884 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower235: metadata journal open: replayFrom=1 applyTo=0
09:31:26,885 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower235: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:31:26,885 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower235: journal open: applyTo=0
09:31:26,885 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: journal writer started
09:31:26,885 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: waiting to receive commands
09:31:26,886 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest16748294763175961560/follower235/TermInfo.properties does not exist
09:31:26,886 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower235: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest16748294763175961560/follower235/journal-v1-1.log
09:31:26,886 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower235: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest16748294763175961560/follower235/metadata-v1-1.log
09:31:26,886 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower235: no eligible files found
09:31:26,886 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower235: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [07/01/2025 21:31:26.887] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader234]: org.opendaylight.controller.cluster.common.actor.Monitor@1d6fbf9
09:31:26,887 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader234: Starting recovery with journal batch size 1000
09:31:26,887 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader234: started executor
09:31:26,887 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader234: started executor
09:31:26,888 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader234: metadata journal open: replayFrom=1 applyTo=0
09:31:26,888 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader234: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:31:26,888 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader234: journal open: applyTo=0
09:31:26,888 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: journal writer started
09:31:26,888 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: waiting to receive commands
09:31:26,889 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest16748294763175961560/leader234/TermInfo.properties does not exist
09:31:26,889 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest16748294763175961560/leader234/journal-v1-1.log
09:31:26,889 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest16748294763175961560/leader234/metadata-v1-1.log
09:31:26,889 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader234: no eligible files found
09:31:26,889 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader234: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:31:26,901 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader234: Set currentTerm=0, votedFor=null
09:31:26,901 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader234: Local TermInfo store seeded with TermInfo{term=0}
09:31:26,901 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader234: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@23f1b455
09:31:26,901 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader234: Moving last applied index from -1 to -1
09:31:26,901 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower235: Set currentTerm=0, votedFor=null
09:31:26,901 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower235: Local TermInfo store seeded with TermInfo{term=0}
09:31:26,901 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower235: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@7549e31d
09:31:26,901 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower235: Moving last applied index from -1 to -1
09:31:26,901 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader234: empty journal: appending 0 entries
09:31:26,901 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader234: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:31:26,901 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader234: journal recovery completedin 322.3 μs with journalIndex=1
09:31:26,901 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower235: empty journal: appending 0 entries
09:31:26,901 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower235: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:31:26,901 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower235: journal recovery completedin 554.2 μs with journalIndex=1
09:31:27,402 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:31:27,402 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader234 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.43:17355, Removed)
09:31:27,402 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader234 (Follower): Received ElectionTimeout - switching to Candidate
09:31:27,402 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader234 (Candidate): Election: Candidate has following voting peers: [follower236, follower235]
09:31:27,406 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader234: Set currentTerm=1, votedFor=leader234
09:31:27,406 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader234 (Candidate): Starting new election term 1
09:31:27,406 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader234 (Candidate): Sending RequestVote{term=1, candidateId=leader234, lastLogIndex=-1, lastLogTerm=-1} to peer follower236
09:31:27,406 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader234 (Candidate): Sending RequestVote{term=1, candidateId=leader234, lastLogIndex=-1, lastLogTerm=-1} to peer follower235
09:31:27,406 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader234 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
09:31:27,406 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower235 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:31:27,407 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower235 (Follower): Cluster state: []
09:31:27,407 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower235 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader234, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:31:27,407 PM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower235 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader234, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term
[WARN] [07/01/2025 21:31:27.406] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader234]: RequestVote{term=1, candidateId=leader234, lastLogIndex=-1, lastLogTerm=-1}
09:31:27,409 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower235: Set currentTerm=1, votedFor=null
09:31:27,409 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower235 (Follower): In requestVote: RequestVote{term=1, candidateId=leader234, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1
09:31:27,411 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower235: Set currentTerm=1, votedFor=leader234
09:31:27,411 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower235 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true}
09:31:27,411 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader234 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1
09:31:27,411 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader234 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1
09:31:27,412 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader234 (Leader): Election: Leader has following peers: [follower236, follower235]
09:31:27,412 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower236: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:31:27,412 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower235: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:31:27,412 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader234 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
09:31:27,412 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower235: Last sync leader does not match current leader leader234, need to catch up to -1
[WARN] [07/01/2025 21:31:27.412] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader234]: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:27,412 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader234 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower235 updated: matchIndex: -1, nextIndex: 0
09:31:27,412 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower235: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/01/2025 21:31:27.412] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower235] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower235, initialSyncDone=false]
09:31:27,457 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader234: Persist data index=0 term=1 command=zero
09:31:27,457 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader234: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 
09:31:27,457 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: received 1 commands after 569.0 ms
09:31:27,458 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
09:31:27,458 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower236: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:31:27,458 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower235: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:31:27,458 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): sendAppendEntries: 0 is present for follower follower235
[WARN] [07/01/2025 21:31:27.458] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader234]: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:27,458 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Sending AppendEntries to follower follower235: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]}
09:31:27,458 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower235 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]}
09:31:27,459 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower235 (Follower): Number of entries to be appended = 1
09:31:27,459 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower235 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:31:27,459 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower235 (Follower): Append entry to log zero
09:31:27,459 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower235: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 
09:31:27,459 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower235 (Follower): Log size is now 1
09:31:27,459 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower235 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower235, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:31:27,459 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: received 1 commands after 573.6 ms
09:31:27,459 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached -1 (of expected -1)
[WARN] [07/01/2025 21:31:27.459] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower235] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower235, initialSyncDone=true]
09:31:27,459 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader234: awaiting more completions to resolve 1 synchronized callback(s)
09:31:27,463 PM [leader234-writer-94] [DEBUG] RaftStorageCompleter - leader234: 1 completion(s) pending
09:31:27,463 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader234: running 1 completion(s)
09:31:27,463 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: completed 1 commands in 5.902 ms
09:31:27,463 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: waiting to receive commands
09:31:27,463 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader234: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true}
09:31:27,463 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader234: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@568cd68}
09:31:27,464 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower235 updated: matchIndex: 0, nextIndex: 1
09:31:27,464 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
09:31:27,464 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader234 (Leader): Setting last applied to 0
09:31:27,464 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader234: Moving last applied index from -1 to 0
09:31:27,464 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader234: Applying state for log index 0 data zero
09:31:27,464 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader234: applyState called: zero
09:31:27,464 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: received 1 commands after 728.5 μs
09:31:27,464 PM [follower235-writer-93] [DEBUG] RaftStorageCompleter - follower235: 1 completion(s) pending
09:31:27,464 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: completed 1 commands in 5.161 ms
09:31:27,464 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - follower235: running 1 completion(s)
09:31:27,464 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: waiting to receive commands
09:31:27,464 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower235: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false}
09:31:27,464 PM [leader234-writer-94] [DEBUG] EntryJournalV1 - leader234: updated meta to JournalMeta[replayFrom=1, applyTo=1]
09:31:27,464 PM [leader234-writer-94] [DEBUG] RaftStorageCompleter - leader234: 1 completion(s) pending
09:31:27,464 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: completed 1 commands in 250.0 μs
09:31:27,464 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: waiting to receive commands
09:31:27,464 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower235: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:31:27,464 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader234: running 1 completion(s)
09:31:27,465 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): Commit index set to 0
09:31:27,465 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 0 (of expected -1)
09:31:27,465 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:31:27,465 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower235 (Follower): Setting last applied to 0
09:31:27,465 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower235: Moving last applied index from -1 to 0
09:31:27,465 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower235: Applying state for log index 0 data zero
09:31:27,465 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower235: applyState called: zero
09:31:27,465 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: received 1 commands after 758.1 μs
09:31:27,465 PM [follower235-writer-93] [DEBUG] EntryJournalV1 - follower235: updated meta to JournalMeta[replayFrom=1, applyTo=1]
09:31:27,465 PM [follower235-writer-93] [DEBUG] RaftStorageCompleter - follower235: 1 completion(s) pending
09:31:27,465 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: completed 1 commands in 216.9 μs
09:31:27,465 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: waiting to receive commands
09:31:27,465 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - follower235: running 1 completion(s)
[WARN] [07/01/2025 21:31:27.522] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader234]: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:27,558 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader234: Persist data index=1 term=1 command=one
09:31:27,558 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader234: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 
09:31:27,558 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader234 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true
09:31:27,558 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower236: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:31:27,559 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: received 1 commands after 94.19 ms
09:31:27,559 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower235: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:31:27,559 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader234 (Leader): sendAppendEntries: 1 is present for follower follower235
09:31:27,559 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader234 (Leader): Sending AppendEntries to follower follower235: AppendEntries{term=1, leaderId=leader234, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]}
09:31:27,559 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader234: awaiting more completions to resolve 1 synchronized callback(s)
09:31:27,559 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower235 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader234, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]}
09:31:27,559 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower235 (Follower): Number of entries to be appended = 1
09:31:27,559 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower235 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
09:31:27,559 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower235 (Follower): Append entry to log one
09:31:27,559 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower235: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 
09:31:27,559 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower235 (Follower): Log size is now 2
09:31:27,559 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: received 1 commands after 93.93 ms
09:31:27,559 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower235 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower235, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:31:27,559 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 0 (of expected -1)
[WARN] [07/01/2025 21:31:27.560] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader234]: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:27,561 PM [follower235-writer-93] [DEBUG] RaftStorageCompleter - follower235: 1 completion(s) pending
09:31:27,561 PM [leader234-writer-94] [DEBUG] RaftStorageCompleter - leader234: 1 completion(s) pending
09:31:27,561 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: completed 1 commands in 1.856 ms
09:31:27,561 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: completed 1 commands in 2.509 ms
09:31:27,561 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader234: running 1 completion(s)
09:31:27,561 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader234: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true}
09:31:27,561 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: waiting to receive commands
09:31:27,561 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: waiting to receive commands
09:31:27,561 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader234: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=1, term=1, command=one, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@47220e3}
09:31:27,561 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower235: running 1 completion(s)
09:31:27,561 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower235: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false}
09:31:27,561 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader234 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower235 updated: matchIndex: 1, nextIndex: 2
09:31:27,561 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader234 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0
09:31:27,561 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader234 (Leader): Setting last applied to 1
09:31:27,561 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader234: Moving last applied index from 0 to 1
09:31:27,561 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader234: Applying state for log index 1 data one
09:31:27,561 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader234: applyState called: one
09:31:27,562 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower235: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:31:27,562 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: received 1 commands after 647.0 μs
09:31:27,562 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): Commit index set to 1
09:31:27,562 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 1 (of expected -1)
09:31:27,562 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
09:31:27,562 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower235 (Follower): Setting last applied to 1
09:31:27,562 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower235: Moving last applied index from 0 to 1
09:31:27,562 PM [leader234-writer-94] [DEBUG] EntryJournalV1 - leader234: updated meta to JournalMeta[replayFrom=1, applyTo=2]
09:31:27,562 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower235: Applying state for log index 1 data one
09:31:27,562 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower235: applyState called: one
09:31:27,562 PM [leader234-writer-94] [DEBUG] RaftStorageCompleter - leader234: 1 completion(s) pending
09:31:27,562 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: completed 1 commands in 197.3 μs
09:31:27,562 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: waiting to receive commands
09:31:27,562 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader234: running 1 completion(s)
09:31:27,562 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: received 1 commands after 1.073 ms
09:31:27,562 PM [follower235-writer-93] [DEBUG] EntryJournalV1 - follower235: updated meta to JournalMeta[replayFrom=1, applyTo=2]
09:31:27,562 PM [follower235-writer-93] [DEBUG] RaftStorageCompleter - follower235: 1 completion(s) pending
09:31:27,562 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: completed 1 commands in 155.5 μs
09:31:27,562 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: waiting to receive commands
09:31:27,562 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - follower235: running 1 completion(s)
[WARN] [07/01/2025 21:31:27.642] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader234]: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
[WARN] [07/01/2025 21:31:27.661] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower236]: org.opendaylight.controller.cluster.common.actor.Monitor@25eb9550
09:31:27,662 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower236: Starting recovery with journal batch size 1000
09:31:27,662 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower236: started executor
09:31:27,662 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower236: started executor
09:31:27,663 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower236: metadata journal open: replayFrom=1 applyTo=0
09:31:27,664 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower236: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:31:27,664 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower236: journal open: applyTo=0
09:31:27,664 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: journal writer started
09:31:27,664 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: waiting to receive commands
09:31:27,665 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest16748294763175961560/follower236/TermInfo.properties does not exist
09:31:27,665 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower236: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest16748294763175961560/follower236/journal-v1-1.log
09:31:27,665 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower236: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest16748294763175961560/follower236/metadata-v1-1.log
09:31:27,665 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower236: no eligible files found
09:31:27,665 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower236: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:31:27,669 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower236: Set currentTerm=0, votedFor=null
09:31:27,669 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower236: Local TermInfo store seeded with TermInfo{term=0}
09:31:27,669 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower236: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@3bde66b6
09:31:27,670 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower236: Moving last applied index from -1 to -1
09:31:27,670 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower236: empty journal: appending 0 entries
09:31:27,670 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower236: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:31:27,670 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower236: journal recovery completedin 463.0 μs with journalIndex=1
09:31:27,762 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 1 (of expected -1)
[WARN] [07/01/2025 21:31:27.762] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader234]: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:27,762 PM [test-pekko.actor.default-dispatcher-16] [INFO] PeerInfos - leader234: Peer address for peer follower236 set to pekko://test/user/follower236
09:31:27,762 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader234: Persist data index=2 term=1 command=two
09:31:27,762 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader234: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 
09:31:27,762 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true
09:31:27,763 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower236: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1
09:31:27,763 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower235: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1
09:31:27,763 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): sendAppendEntries: 2 is present for follower follower235
09:31:27,763 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: received 1 commands after 200.5 ms
09:31:27,763 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Sending AppendEntries to follower follower235: AppendEntries{term=1, leaderId=leader234, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]}
09:31:27,763 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader234: awaiting more completions to resolve 1 synchronized callback(s)
09:31:27,763 PM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower236 (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term
09:31:27,763 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower235 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader234, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]}
09:31:27,763 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower235 (Follower): Number of entries to be appended = 1
09:31:27,763 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower235 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0
09:31:27,763 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower235 (Follower): Append entry to log two
09:31:27,763 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower235: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 
09:31:27,763 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: received 1 commands after 200.5 ms
09:31:27,763 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower235 (Follower): Log size is now 3
09:31:27,763 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower235 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower235, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:31:27,763 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 1 (of expected -1)
09:31:27,765 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower236: Set currentTerm=1, votedFor=null
09:31:27,765 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower236: Last sync leader does not match current leader leader234, need to catch up to -1
09:31:27,765 PM [follower235-writer-93] [DEBUG] RaftStorageCompleter - follower235: 1 completion(s) pending
09:31:27,765 PM [leader234-writer-94] [DEBUG] RaftStorageCompleter - leader234: 1 completion(s) pending
09:31:27,766 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - follower235: running 1 completion(s)
09:31:27,766 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: completed 1 commands in 2.897 ms
09:31:27,766 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: completed 1 commands in 2.526 ms
09:31:27,766 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower235: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false}
09:31:27,766 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: waiting to receive commands
09:31:27,766 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: waiting to receive commands
[WARN] [07/01/2025 21:31:27.766] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower236] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower236, initialSyncDone=false]
09:31:27,766 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader234: running 1 completion(s)
09:31:27,766 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader234: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true}
09:31:27,766 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader234: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=2, term=1, command=two, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@77d20ff8}
09:31:27,766 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower235 updated: matchIndex: 2, nextIndex: 3
09:31:27,766 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1
09:31:27,766 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader234 (Leader): Setting last applied to 2
09:31:27,766 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader234: Moving last applied index from 1 to 2
09:31:27,766 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader234: Applying state for log index 2 data two
09:31:27,766 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader234: applyState called: two
09:31:27,766 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower235: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: -1
09:31:27,766 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: received 1 commands after 794.0 μs
09:31:27,767 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower236 updated: matchIndex: -1, nextIndex: 0
09:31:27,767 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower236: active: true, followerNextIndex: 0, leaderLastIndex: 2, leaderSnapShotIndex: -1
09:31:27,767 PM [leader234-writer-94] [DEBUG] EntryJournalV1 - leader234: updated meta to JournalMeta[replayFrom=1, applyTo=3]
09:31:27,767 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower235 (Follower): Commit index set to 2
09:31:27,767 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:27,767 PM [leader234-writer-94] [DEBUG] RaftStorageCompleter - leader234: 1 completion(s) pending
09:31:27,767 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower235 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): 1, lastIndex(): 2
09:31:27,767 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower235 (Follower): Setting last applied to 2
09:31:27,767 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower235: Moving last applied index from 1 to 2
09:31:27,767 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower235: Applying state for log index 2 data two
09:31:27,767 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: completed 1 commands in 379.2 μs
09:31:27,767 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower235: applyState called: two
09:31:27,767 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: waiting to receive commands
09:31:27,767 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: received 1 commands after 1.461 ms
09:31:27,767 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): sendAppendEntries: 0 is present for follower follower236
09:31:27,767 PM [follower235-writer-93] [DEBUG] EntryJournalV1 - follower235: updated meta to JournalMeta[replayFrom=1, applyTo=3]
09:31:27,767 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Sending AppendEntries to follower follower236: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=false}, JournaledLogEntry{index=1, term=1, command=one, pending=false}, JournaledLogEntry{index=2, term=1, command=two, pending=false}]}
09:31:27,767 PM [follower235-writer-93] [DEBUG] RaftStorageCompleter - follower235: 1 completion(s) pending
09:31:27,767 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - follower235: running 1 completion(s)
09:31:27,767 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: completed 1 commands in 214.7 μs
09:31:27,767 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: waiting to receive commands
09:31:27,767 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader234: running 1 completion(s)
09:31:27,767 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower236 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=false}, JournaledLogEntry{index=1, term=1, command=one, pending=false}, JournaledLogEntry{index=2, term=1, command=two, pending=false}]}
09:31:27,767 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower236 (Follower): Number of entries to be appended = 3
09:31:27,767 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower236 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:31:27,767 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower236 (Follower): Append entry to log zero
09:31:27,767 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower236: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=false} 
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower236 (Follower): Append entry to log one
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower236: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=false} 
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower236 (Follower): Append entry to log two
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower236: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=false} 
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower236 (Follower): Log size is now 3
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower236 (Follower): Commit index set to 2
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower236 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower236, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower236 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): -1, lastIndex(): 2
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower236 (Follower): Setting last applied to 0
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower236: Moving last applied index from -1 to 0
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower236: Applying state for log index 0 data zero
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower236: applyState called: zero
09:31:27,768 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: received 3 commands after 103.9 ms
09:31:27,768 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower236 updated: matchIndex: 2, nextIndex: 3
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower236 (Follower): Setting last applied to 1
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower236: Moving last applied index from 0 to 1
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower236: Applying state for log index 1 data one
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower236: applyState called: one
09:31:27,768 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - leader234: fakeSnapshot purging log to 1 for term 1
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower236 (Follower): Setting last applied to 2
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower236: Moving last applied index from 1 to 2
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower236: Applying state for log index 2 data two
09:31:27,768 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower236: applyState called: two
09:31:27,768 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower236: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: 1
[WARN] [07/01/2025 21:31:27.768] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower236] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower236, initialSyncDone=true]
09:31:27,774 PM [follower236-writer-95] [DEBUG] RaftStorageCompleter - follower236: 3 completion(s) pending
09:31:27,774 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: completed 3 commands in 6.022 ms
09:31:27,774 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: received 1 commands after 4.400 μs
09:31:27,774 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - follower236: running 3 completion(s)
09:31:27,774 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower236: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false}
09:31:27,774 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower236: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false}
09:31:27,774 PM [follower236-writer-95] [DEBUG] EntryJournalV1 - follower236: updated meta to JournalMeta[replayFrom=1, applyTo=3]
09:31:27,774 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower236: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false}
09:31:27,774 PM [follower236-writer-95] [DEBUG] RaftStorageCompleter - follower236: 1 completion(s) pending
09:31:27,774 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - follower236: running 1 completion(s)
09:31:27,774 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: completed 1 commands in 96.36 μs
09:31:27,774 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: waiting to receive commands
09:31:27,882 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:27,882 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:27,882 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - follower236: fakeSnapshot purging log to 1 for term 1
09:31:27,882 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - follower235: fakeSnapshot purging log to 1 for term 1
09:31:27,965 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower236: terminating thread VirtualThread[#635,follower236-writer-95]/waiting
09:31:27,966 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: received 1 commands after 191.6 ms
09:31:27,966 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: completed 1 commands in 76.25 μs
09:31:27,966 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: journal writer stopped
09:31:27,966 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower236: journal closed
09:31:27,966 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower236: journal closed
09:31:27,966 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower236: stopped executor with 0 remaining tasks
09:31:27,966 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower236: stopped executor with 0 remaining tasks
[WARN] [07/01/2025 21:31:27.969] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower236]: org.opendaylight.controller.cluster.common.actor.Monitor@2a39c4d9
09:31:27,970 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower236: Starting recovery with journal batch size 1000
09:31:27,970 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower236: started executor
09:31:27,971 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower236: started executor
09:31:27,972 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower236: metadata journal open: replayFrom=1 applyTo=3
09:31:27,973 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower236: journal open: firstIndex=1 lastIndex=3 replayFrom=1 fileEntries=0
09:31:27,973 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower236: journal open: applyTo=3
09:31:27,973 PM [follower236-writer-96] [DEBUG] JournalWriteTask - follower236: journal writer started
09:31:27,973 PM [follower236-writer-96] [DEBUG] JournalWriteTask - follower236: waiting to receive commands
09:31:27,973 PM [test-pekko.actor.default-dispatcher-12] [INFO] PeerInfos - leader234: Peer address for peer follower236 set to pekko://test/user/follower236
09:31:27,974 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower236: Set currentTerm=1, votedFor=null
09:31:27,974 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower236: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest16748294763175961560/follower236/TermInfo.properties
09:31:27,974 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower236: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest16748294763175961560/follower236/journal-v1-1.log
09:31:27,974 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower236: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest16748294763175961560/follower236/metadata-v1-1.log
09:31:27,974 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower236: no eligible files found
09:31:27,974 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower236: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:31:27,974 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - follower236: restoring local TermInfo{term=1}
09:31:27,975 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower236: Set currentTerm=1, votedFor=null
09:31:27,975 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower236: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@3f3d0ff3
09:31:27,975 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower236: Moving last applied index from -1 to -1
09:31:27,975 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower236: applying entries up to 3
09:31:27,975 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower236: recovered journal DefaultLogEntry[index=0, term=1, command=zero]
09:31:27,976 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower236: recovered journal DefaultLogEntry[index=1, term=1, command=one]
09:31:27,976 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower236: recovered journal DefaultLogEntry[index=2, term=1, command=two]
09:31:27,976 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower236: Moving last applied index from -1 to 2
09:31:27,977 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower236: journal recovery completedin 1.926 ms with journalIndex=1
09:31:28,2 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower236: Last sync leader does not match current leader leader234, need to catch up to 2
09:31:28,2 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:28,2 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotManager - follower236: fakeSnapshot purging log to 1 for term 1
[WARN] [07/01/2025 21:31:28.003] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower236] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower236, initialSyncDone=false]
09:31:28,121 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:28,121 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
[WARN] [07/01/2025 21:31:28.122] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower236] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower236, initialSyncDone=true]
09:31:28,242 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:28,242 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:28,361 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:28,362 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:28,482 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:28,482 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:28,602 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:28,602 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:28,722 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:28,722 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:28,841 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:28,841 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:28,961 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:28,961 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:29,82 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:29,82 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:29,202 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:29,202 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:29,322 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:29,322 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:29,442 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:29,442 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:29,562 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:29,562 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:29,682 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:29,682 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:29,802 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:29,802 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:29,922 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:29,922 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:30,42 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:30,42 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:30,162 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:30,162 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:30,281 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:30,282 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:30,402 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:30,402 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:30,522 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:30,522 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:30,642 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:30,642 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:30,762 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:30,762 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:30,881 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:30,881 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:31,2 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:31,2 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:31,122 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:31,122 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:31,242 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:31,242 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:31,362 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:31,362 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:31,482 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:31,482 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:31,601 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:31,601 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:31,722 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:31,722 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:31,842 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:31,842 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:31,961 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:31,961 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:32,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:32,82 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:32,202 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:32,202 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:32,322 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:32,322 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:32,442 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:32,442 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:32,562 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:32,562 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:32,682 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:32,682 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:32,802 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:32,802 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:32,922 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
09:31:32,922 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
09:31:33,2 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower235-collector237#284773426]
09:31:33,14 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower235]
09:31:33,14 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower235: terminating thread VirtualThread[#631,follower235-writer-93]/waiting
09:31:33,14 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: received 1 commands after 5.247 s
09:31:33,14 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: completed 1 commands in 18.82 μs
09:31:33,14 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: journal writer stopped
09:31:33,14 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower235: journal closed
09:31:33,14 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower235: journal closed
09:31:33,14 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower235: stopped executor with 0 remaining tasks
09:31:33,14 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower235: stopped executor with 0 remaining tasks
09:31:33,15 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader234-collector238#-647496071]
09:31:33,15 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader234]
09:31:33,15 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - leader234: terminating thread VirtualThread[#632,leader234-writer-94]/waiting
09:31:33,15 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: received 1 commands after 5.248 s
09:31:33,15 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: completed 1 commands in 9.901 μs
09:31:33,15 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: journal writer stopped
09:31:33,15 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader234: journal closed
09:31:33,15 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader234: journal closed
09:31:33,15 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader234: stopped executor with 0 remaining tasks
09:31:33,15 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader234: stopped executor with 0 remaining tasks
09:31:33,15 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower236-collector239#2019515338]
09:31:33,16 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower236]
09:31:33,16 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower236-collector240#1151244297]
09:31:33,16 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower236]
09:31:33,16 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower236: terminating thread VirtualThread[#638,follower236-writer-96]/waiting
09:31:33,16 PM [follower236-writer-96] [DEBUG] JournalWriteTask - follower236: received 1 commands after 5.043 s
09:31:33,16 PM [follower236-writer-96] [DEBUG] JournalWriteTask - follower236: completed 1 commands in 10.11 μs
09:31:33,16 PM [follower236-writer-96] [DEBUG] JournalWriteTask - follower236: journal writer stopped
09:31:33,16 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower236: journal closed
09:31:33,16 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower236: journal closed
09:31:33,16 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower236: stopped executor with 0 remaining tasks
09:31:33,16 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower236: stopped executor with 0 remaining tasks
[WARN] [07/01/2025 21:31:33.023] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower242]: org.opendaylight.controller.cluster.common.actor.Monitor@39cd0815
09:31:33,23 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower242: Starting recovery with journal batch size 1000
09:31:33,24 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower242: started executor
09:31:33,24 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower242: started executor
09:31:33,24 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower242: metadata journal open: replayFrom=1 applyTo=0
09:31:33,24 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower242: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:31:33,24 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower242: journal open: applyTo=0
09:31:33,25 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: journal writer started
09:31:33,25 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: waiting to receive commands
09:31:33,26 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/follower242/TermInfo.properties does not exist
09:31:33,26 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower242: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/follower242/journal-v1-1.log
09:31:33,26 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower242: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/follower242/metadata-v1-1.log
09:31:33,26 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower242: no eligible files found
09:31:33,26 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower242: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [07/01/2025 21:31:33.026] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader241]: org.opendaylight.controller.cluster.common.actor.Monitor@3af1045e
09:31:33,27 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - leader241: Starting recovery with journal batch size 1000
09:31:33,27 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader241: started executor
09:31:33,27 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader241: started executor
09:31:33,28 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader241: metadata journal open: replayFrom=1 applyTo=0
09:31:33,28 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader241: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
09:31:33,28 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader241: journal open: applyTo=0
09:31:33,29 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: journal writer started
09:31:33,29 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
09:31:33,29 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/leader241/TermInfo.properties does not exist
09:31:33,29 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader241: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/leader241/journal-v1-1.log
09:31:33,29 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader241: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/leader241/metadata-v1-1.log
09:31:33,29 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader241: no eligible files found
09:31:33,29 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader241: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
09:31:33,30 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower242: Set currentTerm=0, votedFor=null
09:31:33,30 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower242: Local TermInfo store seeded with TermInfo{term=0}
09:31:33,30 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower242: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@18cc8059
09:31:33,30 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower242: Moving last applied index from -1 to -1
09:31:33,30 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower242: empty journal: appending 0 entries
09:31:33,30 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower242: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:31:33,30 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower242: journal recovery completedin 223.2 μs with journalIndex=1
09:31:33,33 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader241: Set currentTerm=0, votedFor=null
09:31:33,33 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader241: Local TermInfo store seeded with TermInfo{term=0}
09:31:33,33 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader241: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@2d6252db
09:31:33,33 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader241: Moving last applied index from -1 to -1
09:31:33,33 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader241: empty journal: appending 0 entries
09:31:33,33 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader241: updated meta to JournalMeta[replayFrom=1, applyTo=0]
09:31:33,33 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader241: journal recovery completedin 385.3 μs with journalIndex=1
09:31:33,472 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
09:31:33,472 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader241 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.43:17355, Removed)
09:31:33,472 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader241 (Follower): Received ElectionTimeout - switching to Candidate
09:31:33,472 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader241 (Candidate): Election: Candidate has following voting peers: [follower243, follower242]
09:31:33,475 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader241: Set currentTerm=1, votedFor=leader241
09:31:33,475 PM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader241 (Candidate): Starting new election term 1
09:31:33,475 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader241 (Candidate): Sending RequestVote{term=1, candidateId=leader241, lastLogIndex=-1, lastLogTerm=-1} to peer follower243
09:31:33,475 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader241 (Candidate): Sending RequestVote{term=1, candidateId=leader241, lastLogIndex=-1, lastLogTerm=-1} to peer follower242
09:31:33,475 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader241 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
09:31:33,475 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower242 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
09:31:33,476 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower242 (Follower): Cluster state: []
09:31:33,476 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower242 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader241, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
09:31:33,476 PM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower242 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader241, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term
[WARN] [07/01/2025 21:31:33.476] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: RequestVote{term=1, candidateId=leader241, lastLogIndex=-1, lastLogTerm=-1}
09:31:33,479 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower242: Set currentTerm=1, votedFor=null
09:31:33,479 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower242 (Follower): In requestVote: RequestVote{term=1, candidateId=leader241, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1
09:31:33,481 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower242: Set currentTerm=1, votedFor=leader241
09:31:33,481 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower242 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true}
09:31:33,481 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader241 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1
09:31:33,481 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader241 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1
09:31:33,481 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Election: Leader has following peers: [follower243, follower242]
09:31:33,482 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower243: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:31:33,482 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/01/2025 21:31:33.482] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:33,482 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower242: Last sync leader does not match current leader leader241, need to catch up to -1
[WARN] [07/01/2025 21:31:33.482] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower242] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower242, initialSyncDone=false]
09:31:33,482 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader241 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
09:31:33,482 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower242 updated: matchIndex: -1, nextIndex: 0
09:31:33,483 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
09:31:33,529 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader241: Persist data index=0 term=1 command=zero
09:31:33,529 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader241: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 
09:31:33,529 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
09:31:33,530 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower243: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:31:33,530 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:31:33,530 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): sendAppendEntries: 0 is present for follower follower242
09:31:33,530 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 501.1 ms
09:31:33,530 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Sending AppendEntries to follower follower242: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]}
09:31:33,530 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower242 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]}
09:31:33,530 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower242 (Follower): Number of entries to be appended = 1
09:31:33,530 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower242 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
09:31:33,530 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower242 (Follower): Append entry to log zero
09:31:33,530 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower242: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 
09:31:33,530 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower242 (Follower): Log size is now 1
09:31:33,530 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower242 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower242, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:31:33,530 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower242: Lagging 0 entries behind leader leader241 and reached -1 (of expected -1)
09:31:33,530 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: received 1 commands after 505.4 ms
[WARN] [07/01/2025 21:31:33.530] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower242] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower242, initialSyncDone=true]
[WARN] [07/01/2025 21:31:33.530] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:33,530 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader241: awaiting more completions to resolve 1 synchronized callback(s)
09:31:33,534 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
09:31:33,534 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 3.994 ms
09:31:33,534 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
09:31:33,534 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
09:31:33,534 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader241: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true}
09:31:33,534 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader241: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@6a7edc8c}
09:31:33,534 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower242 updated: matchIndex: 0, nextIndex: 1
09:31:33,534 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
09:31:33,534 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader241 (Leader): Setting last applied to 0
09:31:33,534 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader241: Moving last applied index from -1 to 0
09:31:33,534 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader241: Applying state for log index 0 data zero
09:31:33,534 PM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader241: applyState called: zero
09:31:33,534 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
09:31:33,534 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 534.7 μs
09:31:33,534 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower242 (Follower): Commit index set to 0
09:31:33,534 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower242: Lagging 0 entries behind leader leader241 and reached 0 (of expected -1)
09:31:33,534 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower242 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
09:31:33,534 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower242 (Follower): Setting last applied to 0
09:31:33,534 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower242: Moving last applied index from -1 to 0
09:31:33,534 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower242: Applying state for log index 0 data zero
09:31:33,534 PM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower242: applyState called: zero
09:31:33,534 PM [leader241-writer-98] [DEBUG] EntryJournalV1 - leader241: updated meta to JournalMeta[replayFrom=1, applyTo=1]
09:31:33,534 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
09:31:33,534 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 202.0 μs
09:31:33,535 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
09:31:33,535 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
09:31:33,535 PM [follower242-writer-97] [DEBUG] RaftStorageCompleter - follower242: 1 completion(s) pending
09:31:33,535 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - follower242: running 1 completion(s)
09:31:33,535 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: completed 1 commands in 4.516 ms
09:31:33,535 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower242: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false}
09:31:33,535 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: received 1 commands after 6.520 μs
09:31:33,535 PM [follower242-writer-97] [DEBUG] EntryJournalV1 - follower242: updated meta to JournalMeta[replayFrom=1, applyTo=1]
09:31:33,535 PM [follower242-writer-97] [DEBUG] RaftStorageCompleter - follower242: 1 completion(s) pending
09:31:33,535 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: completed 1 commands in 197.1 μs
09:31:33,535 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: waiting to receive commands
09:31:33,535 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - follower242: running 1 completion(s)
[WARN] [07/01/2025 21:31:33.602] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:33,631 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader241: Persist data index=1 term=1 command=one
09:31:33,631 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader241: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 
09:31:33,631 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true
09:31:33,631 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower243: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:31:33,631 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 96.27 ms
09:31:33,631 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:31:33,631 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): sendAppendEntries: 1 is present for follower follower242
09:31:33,631 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Sending AppendEntries to follower follower242: AppendEntries{term=1, leaderId=leader241, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]}
09:31:33,631 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower242 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader241, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]}
09:31:33,631 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower242 (Follower): Number of entries to be appended = 1
09:31:33,631 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower242 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
09:31:33,631 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower242 (Follower): Append entry to log one
09:31:33,631 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower242: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 
09:31:33,631 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower242 (Follower): Log size is now 2
09:31:33,631 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower242 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower242, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:31:33,631 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower242: Lagging 0 entries behind leader leader241 and reached 0 (of expected -1)
09:31:33,631 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: received 1 commands after 96.30 ms
09:31:33,631 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader241: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 21:31:33.631] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:33,633 PM [follower242-writer-97] [DEBUG] RaftStorageCompleter - follower242: 1 completion(s) pending
09:31:33,633 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
09:31:33,633 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: completed 1 commands in 1.487 ms
09:31:33,633 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: waiting to receive commands
09:31:33,633 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 1.969 ms
09:31:33,633 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
09:31:33,633 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
09:31:33,633 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader241: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true}
09:31:33,633 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower242: running 1 completion(s)
09:31:33,633 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader241: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=1, term=1, command=one, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@7d3aa983}
09:31:33,633 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower242: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false}
09:31:33,633 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower242 updated: matchIndex: 1, nextIndex: 2
09:31:33,633 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0
09:31:33,633 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader241 (Leader): Setting last applied to 1
09:31:33,633 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader241: Moving last applied index from 0 to 1
09:31:33,633 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader241: Applying state for log index 1 data one
09:31:33,633 PM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader241: applyState called: one
09:31:33,633 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1
09:31:33,633 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 520.7 μs
09:31:33,633 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower242 (Follower): Commit index set to 1
09:31:33,633 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower242: Lagging 0 entries behind leader leader241 and reached 1 (of expected -1)
09:31:33,633 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower242 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
09:31:33,634 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower242 (Follower): Setting last applied to 1
09:31:33,634 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower242: Moving last applied index from 0 to 1
09:31:33,634 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower242: Applying state for log index 1 data one
09:31:33,634 PM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower242: applyState called: one
09:31:33,634 PM [leader241-writer-98] [DEBUG] EntryJournalV1 - leader241: updated meta to JournalMeta[replayFrom=1, applyTo=2]
09:31:33,634 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
09:31:33,634 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
09:31:33,634 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 260.3 μs
09:31:33,634 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
09:31:33,634 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: received 1 commands after 1.086 ms
09:31:33,634 PM [follower242-writer-97] [DEBUG] EntryJournalV1 - follower242: updated meta to JournalMeta[replayFrom=1, applyTo=2]
09:31:33,634 PM [follower242-writer-97] [DEBUG] RaftStorageCompleter - follower242: 1 completion(s) pending
09:31:33,634 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: completed 1 commands in 144.1 μs
09:31:33,634 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: waiting to receive commands
09:31:33,634 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - follower242: running 1 completion(s)
[WARN] [07/01/2025 21:31:33.722] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:33,732 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader241: Persist data index=2 term=1 command=two
09:31:33,732 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader241: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 
09:31:33,732 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true
09:31:33,732 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower243: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1
09:31:33,732 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 98.54 ms
09:31:33,732 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1
09:31:33,732 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): sendAppendEntries: 2 is present for follower follower242
09:31:33,732 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Sending AppendEntries to follower follower242: AppendEntries{term=1, leaderId=leader241, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]}
09:31:33,732 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader241: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 21:31:33.733] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:33,735 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
09:31:33,735 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
09:31:33,735 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 2.393 ms
09:31:33,735 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
09:31:33,735 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader241: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true}
09:31:33,735 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader241: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=2, term=1, command=two, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@64255cbf}
09:31:33,735 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader241: Persist data index=3 term=1 command=three
09:31:33,735 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader241: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 
09:31:33,735 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true
09:31:33,735 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower243: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1
09:31:33,735 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 326.7 μs
09:31:33,735 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1
09:31:33,735 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): sendAppendEntries: 2 is present for follower follower242
09:31:33,735 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader241: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 21:31:33.735] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:33,736 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
09:31:33,736 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
09:31:33,736 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 1.243 ms
09:31:33,736 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader241: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true}
09:31:33,736 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
09:31:33,736 PM [test-pekko.actor.default-dispatcher-6] [INFO] SnapshotManager - leader241: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=2, mandatoryTrim=false]
09:31:33,737 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotManager - leader241: captured snapshot at lastSequenceNumber: 2
09:31:33,737 PM [test-pekko.actor.default-dispatcher-6] [INFO] SnapshotManager - leader241: Persising snapshot at EntryInfo[index=1, term=1]/EntryInfo[index=3, term=1]
09:31:33,737 PM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader241: support() called
09:31:33,737 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotManager - leader241: log size 4 exceeds the snapshot batch count 4 - doing snapshotPreCommit with index 1
09:31:33,738 PM [test-pekko.actor.default-dispatcher-6] [INFO] SnapshotManager - leader241: Removed in-memory snapshotted entries, adjusted snaphsotIndex: 1 and term: 1
09:31:33,738 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader241: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=3, term=1, command=three, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@4a1d5730}
09:31:33,738 PM [leader241-%d369929] [DEBUG] RaftStorage - leader241: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/leader241/snapshot-00000000686453B5-2BFB00F7.tmp
09:31:33,740 PM [leader241-%d369929] [DEBUG] RaftStorage - leader241: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/leader241/snapshot-00000000686453B5-2BFB00F7.v1
09:31:33,740 PM [leader241-%d369929] [DEBUG] RaftStorage - leader241: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/leader241/snapshot-00000000686453B5-2BFB00F7.v1
09:31:33,741 PM [leader241-%d369929] [DEBUG] RaftStorage - leader241: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/leader241/TermInfo.properties
09:31:33,741 PM [leader241-%d369929] [DEBUG] RaftStorage - leader241: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/leader241/journal-v1-1.log
09:31:33,741 PM [leader241-%d369929] [DEBUG] RaftStorage - leader241: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/leader241/metadata-v1-1.log
09:31:33,741 PM [leader241-%d369929] [DEBUG] RaftStorage - leader241: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=1, term=1], timestamp=2025-07-01T21:31:33.737870071Z, file=/tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/leader241/snapshot-00000000686453B5-2BFB00F7.v1, size=358, entryCompress=NONE, stateCompress=NONE}
09:31:33,741 PM [leader241-%d369929] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
09:31:33,741 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
09:31:33,842 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): sendAppendEntries: 2 is present for follower follower242
09:31:33,842 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Sending AppendEntries to follower follower242: AppendEntries{term=1, leaderId=leader241, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}]}
[WARN] [07/01/2025 21:31:33.842] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
[WARN] [07/01/2025 21:31:33.962] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:33,962 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): sendAppendEntries: 2 is present for follower follower242
09:31:33,962 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Sending AppendEntries to follower follower242: AppendEntries{term=1, leaderId=leader241, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}]}
09:31:33,984 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader241: Persist data index=4 term=1 command=four
09:31:33,984 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader241: Append log entry and persist JournaledLogEntry{index=4, term=1, command=four, pending=true} 
09:31:33,984 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader241 (Leader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 4, isSendImmediate: true
09:31:33,984 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower243: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: 1
09:31:33,984 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: true, followerNextIndex: 2, leaderLastIndex: 4, leaderSnapShotIndex: 1
09:31:33,985 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader241 (Leader): sendAppendEntries: 2 is present for follower follower242
09:31:33,985 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader241: awaiting more completions to resolve 1 synchronized callback(s)
09:31:33,984 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 248.1 ms
[WARN] [07/01/2025 21:31:33.985] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:33,987 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
09:31:33,987 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
09:31:33,987 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader241: persist complete JournaledLogEntry{index=4, term=1, command=four, pending=true}
09:31:33,987 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 2.871 ms
09:31:33,987 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
09:31:33,987 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader241: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=4, term=1, command=four, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087a420@5f2fc94b}
09:31:34,81 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower242: Lagging -2 entries behind leader leader241 and reached 1 (of expected -1)
09:31:34,81 PM [test-pekko.actor.default-dispatcher-16] [WARN] AbstractLeader - leader241 (Leader) : handleAppendEntriesReply delayed beyond election timeout, appendEntriesReply : AppendEntriesReply{term=1, success=true, followerId=follower242, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}, timeSinceLastActivity : 447, lastApplied : 1, commitIndex : 1
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader241 (Leader): sendAppendEntries: 2 is present for follower follower242
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader241 (Leader): Sending AppendEntries to follower follower242: AppendEntries{term=1, leaderId=leader241, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=1, command=four, pending=false}]}
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower242 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader241, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=1, command=four, pending=false}]}
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower242 (Follower): Number of entries to be appended = 3
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower242 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower242 (Follower): Append entry to log two
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower242: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=false} 
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower242 (Follower): Append entry to log three
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower242: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=false} 
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower242 (Follower): Append entry to log four
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower242: Append log entry and persist JournaledLogEntry{index=4, term=1, command=four, pending=false} 
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower242 (Follower): Log size is now 5
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower242 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower242, logLastIndex=4, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower242: Lagging 0 entries behind leader leader241 and reached 1 (of expected -1)
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader241 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower242 updated: matchIndex: 4, nextIndex: 5
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader241 (Leader): Applying to log - commitIndex: 4, lastAppliedIndex: 1
09:31:34,82 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: received 3 commands after 448.0 ms
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader241 (Leader): Setting last applied to 2
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader241: Moving last applied index from 1 to 2
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader241: Applying state for log index 2 data two
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader241: applyState called: two
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader241 (Leader): Setting last applied to 3
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader241: Moving last applied index from 2 to 3
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader241: Applying state for log index 3 data three
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader241: applyState called: three
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader241 (Leader): Setting last applied to 4
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader241: Moving last applied index from 3 to 4
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader241: Applying state for log index 4 data four
09:31:34,82 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader241: applyState called: four
09:31:34,83 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: true, followerNextIndex: 5, leaderLastIndex: 4, leaderSnapShotIndex: 1
09:31:34,83 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 95.05 ms
09:31:34,83 PM [leader241-writer-98] [DEBUG] EntryJournalV1 - leader241: updated meta to JournalMeta[replayFrom=1, applyTo=5]
09:31:34,83 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower242 (Follower): Commit index set to 4
09:31:34,83 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
09:31:34,83 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 178.8 μs
09:31:34,83 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
09:31:34,83 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
[WARN] [07/01/2025 21:31:34.083] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
09:31:34,83 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower242: Lagging 0 entries behind leader leader241 and reached 4 (of expected -1)
09:31:34,83 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower242 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 4, context.getLastApplied(): 1, lastIndex(): 4
09:31:34,83 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower242 (Follower): Setting last applied to 2
09:31:34,83 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower242: Moving last applied index from 1 to 2
09:31:34,83 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower242: Applying state for log index 2 data two
09:31:34,83 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower242: applyState called: two
09:31:34,83 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower242 (Follower): Setting last applied to 3
09:31:34,83 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower242: Moving last applied index from 2 to 3
09:31:34,83 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower242: Applying state for log index 3 data three
09:31:34,83 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower242: applyState called: three
09:31:34,83 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower242 (Follower): Setting last applied to 4
09:31:34,83 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower242: Moving last applied index from 3 to 4
09:31:34,83 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower242: Applying state for log index 4 data four
09:31:34,83 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower242: applyState called: four
09:31:34,87 PM [follower242-writer-97] [DEBUG] RaftStorageCompleter - follower242: 3 completion(s) pending
09:31:34,87 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: completed 3 commands in 5.217 ms
09:31:34,87 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: received 1 commands after 6.440 μs
09:31:34,88 PM [follower242-writer-97] [DEBUG] EntryJournalV1 - follower242: updated meta to JournalMeta[replayFrom=1, applyTo=5]
09:31:34,88 PM [follower242-writer-97] [DEBUG] RaftStorageCompleter - follower242: 1 completion(s) pending
09:31:34,88 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower242: running 3 completion(s)
09:31:34,88 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: completed 1 commands in 237.6 μs
09:31:34,88 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower242: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false}
09:31:34,88 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: waiting to receive commands
09:31:34,88 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower242: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=false}
09:31:34,88 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower242: persist complete JournaledLogEntry{index=4, term=1, command=four, pending=false}
09:31:34,88 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower242: running 1 completion(s)
09:31:34,187 PM [main] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
09:31:34,187 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
09:31:34,187 PM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader241: snapshot is durable as of 2025-07-01T21:31:33.737870071Z
09:31:34,187 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - leader241: Snapshot success with first journal index 3
09:31:34,188 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - leader241: SnapshotComplete received
09:31:34,188 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 104.8 ms
09:31:34,188 PM [leader241-writer-98] [DEBUG] EntryJournalV1 - leader241: updated meta to JournalMeta[replayFrom=3, applyTo=5]
09:31:34,188 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
09:31:34,188 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 592.7 μs
09:31:34,188 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
09:31:34,188 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
09:31:34,199 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - leader241: terminating thread VirtualThread[#640,leader241-writer-98]/waiting
09:31:34,200 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 11.27 ms
09:31:34,200 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 13.20 μs
09:31:34,200 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: journal writer stopped
09:31:34,200 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader241: journal closed
09:31:34,200 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader241: journal closed
09:31:34,200 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader241: stopped executor with 0 remaining tasks
09:31:34,200 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader241: stopped executor with 0 remaining tasks
[WARN] [07/01/2025 21:31:34.202] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader241]: org.opendaylight.controller.cluster.common.actor.Monitor@603f47a9
09:31:34,203 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - leader241: Starting recovery with journal batch size 1000
09:31:34,203 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader241: started executor
09:31:34,203 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader241: started executor
09:31:34,204 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader241: metadata journal open: replayFrom=3 applyTo=5
09:31:34,205 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader241: journal open: firstIndex=1 lastIndex=5 replayFrom=3 fileEntries=0
09:31:34,205 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader241: journal open: applyTo=5
09:31:34,206 PM [leader241-writer-99] [DEBUG] JournalWriteTask - leader241: journal writer started
09:31:34,206 PM [leader241-writer-99] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
09:31:34,207 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader241: Set currentTerm=1, votedFor=leader241
09:31:34,207 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader241: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/leader241/snapshot-00000000686453B5-2BFB00F7.v1
09:31:34,207 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader241: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/leader241/TermInfo.properties
09:31:34,207 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader241: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/leader241/journal-v1-1.log
09:31:34,207 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader241: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/leader241/metadata-v1-1.log
09:31:34,207 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader241: picked SnapshotFileV1{lastIncluded=EntryInfo[index=1, term=1], timestamp=2025-07-01T21:31:33.737870071Z, file=/tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11604172936522734663/leader241/snapshot-00000000686453B5-2BFB00F7.v1, size=358, entryCompress=NONE, stateCompress=NONE} as the latest file
09:31:34,207 PM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader241: support() called
09:31:34,208 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - leader241: initializing from snapshot taken at 2025-07-01T21:31:33.737870071Z
09:31:34,208 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader241: Set currentTerm=1, votedFor=leader241
09:31:34,208 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - Recovery snapshot applied for leader241 in 59.66 μs: snapshotIndex=1, snapshotTerm=1, journal-size=0
09:31:34,208 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader241: Recovery completed in 148.3 μs - Switching actor to Follower - last log index = 1, last log term = 1, snapshot index = 1, snapshot term = 1, journal size = 0
09:31:34,208 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - leader241: restoring local TermInfo{term=1, votedFor=leader241}
09:31:34,208 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader241: Set currentTerm=1, votedFor=leader241
09:31:34,208 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader241: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@42d20d99
09:31:34,208 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader241: Moving last applied index from -1 to 1
09:31:34,208 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader241: applying entries up to 5
09:31:34,208 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader241: recovered journal DefaultLogEntry[index=2, term=1, command=two]
09:31:34,209 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader241: recovered journal DefaultLogEntry[index=3, term=1, command=three]
09:31:34,209 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader241: recovered journal DefaultLogEntry[index=4, term=1, command=four]
09:31:34,209 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader241: Moving last applied index from 1 to 4
09:31:34,209 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader241: journal recovery completedin 1.069 ms with journalIndex=3
09:31:34,209 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower242-collector244#-652236956]
09:31:34,209 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader241 (Follower): Received TimeoutNow - switching to Candidate
09:31:34,209 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader241 (Candidate): Election: Candidate has following voting peers: []
09:31:34,212 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader241: Set currentTerm=2, votedFor=leader241
09:31:34,212 PM [test-pekko.actor.default-dispatcher-6] [INFO] Candidate - leader241 (Candidate): Starting new election term 2
09:31:34,212 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader241 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
09:31:34,212 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader241 (Candidate): Received ElectionTimeout
09:31:34,212 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader241 (Leader): Election: Leader has following peers: []
09:31:34,213 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader241 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
09:31:34,220 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower242]
09:31:34,220 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower242: terminating thread VirtualThread[#639,follower242-writer-97]/waiting
09:31:34,220 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: received 1 commands after 132.8 ms
09:31:34,221 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: completed 1 commands in 14.73 μs
09:31:34,221 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: journal writer stopped
09:31:34,221 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower242: journal closed
09:31:34,221 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower242: journal closed
09:31:34,221 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower242: stopped executor with 0 remaining tasks
09:31:34,221 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower242: stopped executor with 0 remaining tasks
09:31:34,221 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader241-collector245#-65338614]
09:31:34,221 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader241]
09:31:34,221 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader241-collector246#-439618707]
09:31:34,221 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader241]
09:31:34,222 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - leader241: terminating thread VirtualThread[#646,leader241-writer-99]/waiting
09:31:34,222 PM [leader241-writer-99] [DEBUG] JournalWriteTask - leader241: received 1 commands after 16.05 ms
09:31:34,222 PM [leader241-writer-99] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 9.831 μs
09:31:34,222 PM [leader241-writer-99] [DEBUG] JournalWriteTask - leader241: journal writer stopped
09:31:34,222 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader241: journal closed
09:31:34,222 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader241: journal closed
09:31:34,222 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader241: stopped executor with 0 remaining tasks
09:31:34,222 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader241: stopped executor with 0 remaining tasks
09:31:34,224 PM [test-pekko.actor.default-dispatcher-16] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
[INFO] [07/01/2025 21:31:34.223] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
[WARN] [07/01/2025 21:31:34.224] [test-pekko.actor.default-dispatcher-6] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.170.43:17355)
09:31:34,225 PM [test-pekko.actor.default-dispatcher-16] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.43:17355] - Exiting completed
09:31:34,225 PM [test-pekko.actor.default-dispatcher-16] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.43:17355] - Shutting down...
[INFO] [07/01/2025 21:31:34.225] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.43:17355] - Exiting completed
[INFO] [07/01/2025 21:31:34.225] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.43:17355] - Shutting down...
[INFO] [07/01/2025 21:31:34.225] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.43:17355] - Successfully shut down
09:31:34,226 PM [test-pekko.actor.default-dispatcher-16] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.43:17355] - Successfully shut down
09:31:34,226 PM [test-pekko.actor.default-dispatcher-16] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
[INFO] [07/01/2025 21:31:34.226] [test-pekko.remote.default-remote-dispatcher-9] [pekko://test@10.30.170.43:17355/system/remoting-terminator] Shutting down remote daemon.
[INFO] [07/01/2025 21:31:34.226] [test-pekko.remote.default-remote-dispatcher-9] [pekko://test@10.30.170.43:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports.
09:31:34,226 PM [test-pekko.actor.default-dispatcher-16] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
[INFO] [07/01/2025 21:31:34.229] [test-pekko.remote.default-remote-dispatcher-8] [pekko://test@10.30.170.43:17355/system/remoting-terminator] Remoting shut down.
09:31:34,229 PM [test-pekko.actor.default-dispatcher-17] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[DEBUG] [07/01/2025 21:31:34.229] [test-pekko.actor.internal-dispatcher-4] [EventStream] shutting down: StandardOutLogger