[DEBUG] [07/01/2025 19:49:25.923] [main] [EventStream(pekko://test)] logger log1-TestEventListener started
07:49:25,923 PM [test-pekko.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started
[DEBUG] [07/01/2025 19:49:25.923] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started
[DEBUG] [07/01/2025 19:49:25.923] [main] [EventStream(pekko://test)] Default Loggers started
07:49:25,936 PM [test-pekko.actor.default-dispatcher-7] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.142:17355] with UID [-2886426838407637879]
[INFO] [07/01/2025 19:49:25.936] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.142:17355] with UID [-2886426838407637879]
07:49:25,937 PM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.142:17355] - Starting up, Pekko version [1.0.3] ...
[INFO] [07/01/2025 19:49:25.937] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.142:17355] - Starting up, Pekko version [1.0.3] ...
07:49:25,939 PM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.142:17355] - Registered cluster JMX MBean [pekko:type=Cluster]
07:49:25,939 PM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.142:17355] - Started up successfully
07:49:25,941 PM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.142:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing
07:49:25,941 PM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.142:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining
[INFO] [07/01/2025 19:49:25.939] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.142:17355] - Registered cluster JMX MBean [pekko:type=Cluster]
[INFO] [07/01/2025 19:49:25.939] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.142:17355] - Started up successfully
[INFO] [07/01/2025 19:49:25.940] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.142:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing
[INFO] [07/01/2025 19:49:25.941] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.142:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining
[WARN] [07/01/2025 19:49:25.953] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower223]: org.opendaylight.controller.cluster.common.actor.Monitor@23fb529d
[INFO] [pekkoDeadLetter][07/01/2025 19:49:25.954] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower223] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:25,954 PM [test-pekko.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower223] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:25,958 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower223: Starting recovery with journal batch size 1000
07:49:25,959 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower223: started executor
07:49:25,959 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower223: started executor
07:49:25,959 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower223: metadata journal open: replayFrom=1 applyTo=0
07:49:25,960 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower223: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
07:49:25,960 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower223: journal open: applyTo=0
07:49:25,960 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: journal writer started
07:49:25,960 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: waiting to receive commands
07:49:25,961 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/follower223/TermInfo.properties does not exist
[WARN] [07/01/2025 19:49:25.961] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader222]: org.opendaylight.controller.cluster.common.actor.Monitor@42c106af
07:49:25,962 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower223: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/follower223/journal-v1-1.log
07:49:25,962 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower223: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/follower223/metadata-v1-1.log
07:49:25,962 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower223: no eligible files found
07:49:25,962 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower223: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
07:49:25,968 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=0, votedFor=null
07:49:25,968 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower223: Local TermInfo store seeded with TermInfo{term=0}
07:49:25,968 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower223: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4e1f6700
07:49:25,968 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from -1 to -1
07:49:25,968 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower223: empty journal: appending 0 entries
07:49:25,968 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower223: updated meta to JournalMeta[replayFrom=1, applyTo=0]
07:49:25,969 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower223: journal recovery completedin 515.1 μs with journalIndex=1
[INFO] [pekkoDeadLetter][07/01/2025 19:49:25.962] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:25,977 PM [test-pekko.actor.default-dispatcher-7] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:25,977 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - leader222: Starting recovery with journal batch size 1000
07:49:25,978 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader222: started executor
07:49:25,978 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader222: started executor
07:49:25,978 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader222: metadata journal open: replayFrom=1 applyTo=0
07:49:25,979 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader222: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
07:49:25,979 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader222: journal open: applyTo=0
07:49:25,979 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: journal writer started
07:49:25,980 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
07:49:25,981 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/TermInfo.properties does not exist
07:49:25,981 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/journal-v1-1.log
07:49:25,981 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/metadata-v1-1.log
07:49:25,981 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader222: no eligible files found
07:49:25,981 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader222: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
07:49:25,987 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=0, votedFor=null
07:49:25,987 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader222: Local TermInfo store seeded with TermInfo{term=0}
07:49:25,987 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader222: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@652f8ccf
07:49:25,987 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to -1
07:49:25,987 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader222: empty journal: appending 0 entries
07:49:25,988 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader222: updated meta to JournalMeta[replayFrom=1, applyTo=0]
07:49:25,988 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader222: journal recovery completedin 1.174 ms with journalIndex=1
07:49:26,495 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
07:49:26,495 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader222 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.142:17355, Removed)
07:49:26,495 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader222 (Follower): Received ElectionTimeout - switching to Candidate
07:49:26,495 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader222 (Candidate): Election: Candidate has following voting peers: [follower223, follower224]
07:49:26,499 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222
07:49:26,499 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader222 (Candidate): Starting new election term 1
07:49:26,500 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} to peer follower223
07:49:26,500 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} to peer follower224
07:49:26,500 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader222 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
07:49:26,500 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
07:49:26,500 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): Cluster state: []
07:49:26,500 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
07:49:26,500 PM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - follower223 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term
[WARN] [07/01/2025 19:49:26.500] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1}
[INFO] [pekkoDeadLetter][07/01/2025 19:49:26.500] [test-pekko.actor.default-dispatcher-16] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:26,501 PM [test-pekko.actor.default-dispatcher-16] [INFO] LocalActorRefProvider$$anon$2 -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:26,503 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=1, votedFor=null
07:49:26,503 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): In requestVote: RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1
07:49:26,508 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=1, votedFor=leader222
07:49:26,508 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true}
07:49:26,508 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader222 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1
07:49:26,508 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader222 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1
07:49:26,508 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Election: Leader has following peers: [follower223, follower224]
07:49:26,508 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
07:49:26,508 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
07:49:26,508 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader222 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
07:49:26,508 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Last sync leader does not match current leader leader222, need to catch up to -1
[WARN] [07/01/2025 19:49:26.509] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:26,509 PM [test-pekko.actor.default-dispatcher-17] [INFO] LocalActorRefProvider$$anon$2 -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[INFO] [pekkoDeadLetter][07/01/2025 19:49:26.509] [test-pekko.actor.default-dispatcher-17] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[WARN] [07/01/2025 19:49:26.509] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower223] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower223, initialSyncDone=false]
[INFO] [pekkoDeadLetter][07/01/2025 19:49:26.509] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower223] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:26,509 PM [test-pekko.actor.default-dispatcher-7] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:26,509 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: -1, nextIndex: 0
07:49:26,509 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
07:49:26,543 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader222: Persist data index=0 term=1 command=zero
07:49:26,543 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 
07:49:26,543 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
07:49:26,543 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
07:49:26,543 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 0 is present for follower follower223
07:49:26,543 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 563.4 ms
07:49:26,543 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]}
07:49:26,543 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
[WARN] [07/01/2025 19:49:26.543] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
[INFO] [pekkoDeadLetter][07/01/2025 19:49:26.543] [test-pekko.actor.default-dispatcher-7] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:26,544 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
07:49:26,544 PM [test-pekko.actor.default-dispatcher-11] [INFO] LocalActorRefProvider$$anon$2 -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:26,544 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]}
07:49:26,544 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1
07:49:26,544 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
07:49:26,544 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Append entry to log zero
07:49:26,544 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 
07:49:26,544 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 583.5 ms
07:49:26,544 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Log size is now 1
07:49:26,544 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
07:49:26,544 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached -1 (of expected -1)
[WARN] [07/01/2025 19:49:26.544] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower223] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower223, initialSyncDone=true]
[INFO] [pekkoDeadLetter][07/01/2025 19:49:26.545] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower223] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:26,545 PM [test-pekko.actor.default-dispatcher-16] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:26,548 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
07:49:26,548 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 4.888 ms
07:49:26,548 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
07:49:26,548 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
07:49:26,548 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true}
07:49:26,548 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@1eb5159a}
07:49:26,548 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 0, nextIndex: 1
07:49:26,548 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
07:49:26,548 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 0
07:49:26,548 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to 0
07:49:26,548 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader222: Applying state for log index 0 data zero
07:49:26,548 PM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader222: applyState called: zero
07:49:26,548 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
07:49:26,548 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 510.2 μs
07:49:26,549 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): Commit index set to 0
07:49:26,549 PM [leader222-writer-88] [DEBUG] EntryJournalV1 - leader222: updated meta to JournalMeta[replayFrom=1, applyTo=1]
07:49:26,549 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 0 (of expected -1)
07:49:26,549 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
07:49:26,549 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
07:49:26,549 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 0
07:49:26,549 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from -1 to 0
07:49:26,549 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower223: Applying state for log index 0 data zero
07:49:26,549 PM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower223: applyState called: zero
07:49:26,549 PM [follower223-writer-87] [DEBUG] RaftStorageCompleter - follower223: 1 completion(s) pending
07:49:26,549 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 178.9 μs
07:49:26,549 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
07:49:26,549 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 4.788 ms
07:49:26,549 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
07:49:26,549 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - follower223: running 1 completion(s)
07:49:26,549 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 17.18 μs
07:49:26,549 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false}
07:49:26,549 PM [follower223-writer-87] [DEBUG] EntryJournalV1 - follower223: updated meta to JournalMeta[replayFrom=1, applyTo=1]
07:49:26,549 PM [follower223-writer-87] [DEBUG] RaftStorageCompleter - follower223: 1 completion(s) pending
07:49:26,549 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - follower223: running 1 completion(s)
07:49:26,549 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 248.6 μs
07:49:26,549 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: waiting to receive commands
[WARN] [07/01/2025 19:49:26.625] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
[INFO] [pekkoDeadLetter][07/01/2025 19:49:26.625] [test-pekko.actor.default-dispatcher-15] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:26,625 PM [test-pekko.actor.default-dispatcher-15] [INFO] LocalActorRefProvider$$anon$2 -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:26,644 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader222: Persist data index=1 term=1 command=one
07:49:26,644 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 
07:49:26,645 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true
07:49:26,645 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
07:49:26,645 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 1 is present for follower follower223
07:49:26,645 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]}
07:49:26,645 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1
07:49:26,645 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 96.03 ms
07:49:26,645 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
07:49:26,645 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]}
07:49:26,645 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1
07:49:26,645 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
07:49:26,645 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Append entry to log one
07:49:26,645 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 
[WARN] [07/01/2025 19:49:26.645] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:26,645 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 96.19 ms
[INFO] [pekkoDeadLetter][07/01/2025 19:49:26.645] [test-pekko.actor.default-dispatcher-6] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:26,646 PM [test-pekko.actor.default-dispatcher-14] [INFO] LocalActorRefProvider$$anon$2 -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:26,646 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Log size is now 2
07:49:26,646 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
07:49:26,646 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 0 (of expected -1)
07:49:26,648 PM [follower223-writer-87] [DEBUG] RaftStorageCompleter - follower223: 1 completion(s) pending
07:49:26,648 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
07:49:26,648 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 2.720 ms
07:49:26,648 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: waiting to receive commands
07:49:26,648 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 3.261 ms
07:49:26,648 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - follower223: running 1 completion(s)
07:49:26,648 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
07:49:26,648 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
07:49:26,648 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true}
07:49:26,648 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false}
07:49:26,648 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=1, term=1, command=one, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@554394ae}
07:49:26,648 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 1, nextIndex: 2
07:49:26,648 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0
07:49:26,648 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 1
07:49:26,648 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 0 to 1
07:49:26,648 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader222: Applying state for log index 1 data one
07:49:26,648 PM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - leader222: applyState called: one
07:49:26,649 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1
07:49:26,649 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 491.7 μs
07:49:26,649 PM [leader222-writer-88] [DEBUG] EntryJournalV1 - leader222: updated meta to JournalMeta[replayFrom=1, applyTo=2]
07:49:26,649 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower223 (Follower): Commit index set to 1
07:49:26,649 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
07:49:26,649 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 1 (of expected -1)
07:49:26,649 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
07:49:26,649 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
07:49:26,649 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 261.2 μs
07:49:26,649 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 1
07:49:26,649 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
07:49:26,649 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 0 to 1
07:49:26,649 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower223: Applying state for log index 1 data one
07:49:26,649 PM [test-pekko.actor.default-dispatcher-14] [INFO] MockRaftActor - follower223: applyState called: one
07:49:26,650 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 1.816 ms
07:49:26,650 PM [follower223-writer-87] [DEBUG] EntryJournalV1 - follower223: updated meta to JournalMeta[replayFrom=1, applyTo=2]
07:49:26,650 PM [follower223-writer-87] [DEBUG] RaftStorageCompleter - follower223: 1 completion(s) pending
07:49:26,650 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 196.8 μs
07:49:26,650 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: waiting to receive commands
07:49:26,650 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - follower223: running 1 completion(s)
[WARN] [07/01/2025 19:49:26.745] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
[INFO] [pekkoDeadLetter][07/01/2025 19:49:26.745] [test-pekko.actor.default-dispatcher-15] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:26,746 PM [test-pekko.actor.default-dispatcher-15] [INFO] LocalActorRefProvider$$anon$2 -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
07:49:26,746 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Persist data index=2 term=1 command=two
07:49:26,746 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 
07:49:26,747 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true
07:49:26,747 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1
07:49:26,747 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 2 is present for follower follower223
07:49:26,747 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]}
07:49:26,747 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1
07:49:26,747 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
07:49:26,747 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]}
07:49:26,747 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1
07:49:26,747 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0
07:49:26,747 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Append entry to log two
07:49:26,747 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 
07:49:26,747 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 98.03 ms
07:49:26,748 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Log size is now 3
07:49:26,748 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
07:49:26,748 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 1 (of expected -1)
07:49:26,748 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 97.40 ms
[WARN] [07/01/2025 19:49:26.748] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:26,751 PM [follower223-writer-87] [DEBUG] RaftStorageCompleter - follower223: 1 completion(s) pending
07:49:26,751 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
07:49:26,751 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 3.548 ms
07:49:26,751 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: waiting to receive commands
07:49:26,751 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 3.868 ms
07:49:26,751 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
07:49:26,751 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - follower223: running 1 completion(s)
07:49:26,751 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false}
07:49:26,751 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
07:49:26,752 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true}
07:49:26,752 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=2, term=1, command=two, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@77945a63}
07:49:26,752 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 2, nextIndex: 3
07:49:26,752 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1
07:49:26,752 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 2
07:49:26,752 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 1 to 2
07:49:26,752 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Applying state for log index 2 data two
07:49:26,752 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader222: applyState called: two
07:49:26,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: -1
07:49:26,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Persist data index=3 term=1 command=three
07:49:26,753 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): Commit index set to 2
07:49:26,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 
07:49:26,753 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 2 (of expected -1)
07:49:26,753 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): 1, lastIndex(): 2
07:49:26,753 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 2
07:49:26,753 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 1 to 2
07:49:26,753 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower223: Applying state for log index 2 data two
07:49:26,753 PM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower223: applyState called: two
07:49:26,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true
07:49:26,753 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 1.706 ms
07:49:26,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 3, leaderLastIndex: 3, leaderSnapShotIndex: -1
07:49:26,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 3 is present for follower follower223
07:49:26,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=2, prevLogTerm=1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=three, pending=true}]}
07:49:26,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1
07:49:26,753 PM [leader222-writer-88] [DEBUG] EntryJournalV1 - leader222: updated meta to JournalMeta[replayFrom=1, applyTo=3]
07:49:26,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
07:49:26,754 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
07:49:26,754 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=2, prevLogTerm=1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=three, pending=true}]}
07:49:26,754 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1
07:49:26,754 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 2, entries to be added from: 0
07:49:26,754 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): Append entry to log three
07:49:26,754 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 405.6 μs
07:49:26,754 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 
07:49:26,754 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 2.268 ms
07:49:26,754 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 10.01 μs
07:49:26,754 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): Log size is now 4
07:49:26,754 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=3, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
07:49:26,754 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 2 (of expected -1)
[WARN] [07/01/2025 19:49:26.754] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:26,754 PM [follower223-writer-87] [DEBUG] EntryJournalV1 - follower223: updated meta to JournalMeta[replayFrom=1, applyTo=3]
07:49:26,754 PM [follower223-writer-87] [DEBUG] RaftStorageCompleter - follower223: 1 completion(s) pending
07:49:26,754 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - follower223: running 1 completion(s)
07:49:26,754 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 300.7 μs
07:49:26,754 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 10.78 μs
07:49:26,755 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
07:49:26,755 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
07:49:26,756 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
07:49:26,756 PM [follower223-writer-87] [DEBUG] RaftStorageCompleter - follower223: 1 completion(s) pending
07:49:26,756 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 1.979 ms
07:49:26,756 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
07:49:26,756 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 1.635 ms
07:49:26,756 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - follower223: running 1 completion(s)
07:49:26,756 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: waiting to receive commands
07:49:26,756 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=false}
07:49:26,756 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
07:49:26,756 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true}
07:49:26,756 PM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader222: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=2, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false]
07:49:26,756 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - leader222: captured snapshot at lastSequenceNumber: 3
07:49:26,756 PM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader222: Persising snapshot at EntryInfo[index=2, term=1]/EntryInfo[index=3, term=1]
07:49:26,756 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader222: support() called
07:49:26,757 PM [leader222-%d407743] [DEBUG] RaftStorage - leader222: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/snapshot-0000000068643BC6-2D1DF2D9.tmp
07:49:26,757 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - leader222: log size 4 exceeds the snapshot batch count 4 - doing snapshotPreCommit with index 2
07:49:26,757 PM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader222: Removed in-memory snapshotted entries, adjusted snaphsotIndex: 2 and term: 1
07:49:26,757 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=3, term=1, command=three, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@17bba52c}
07:49:26,757 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 3 is present for follower follower223
07:49:26,758 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 3, nextIndex: 4
07:49:26,758 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 3, lastAppliedIndex: 2
07:49:26,758 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 3
07:49:26,758 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 2 to 3
07:49:26,758 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Applying state for log index 3 data three
07:49:26,758 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader222: applyState called: three
07:49:26,758 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 2.140 ms
07:49:26,758 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 3, leaderSnapShotIndex: 2
07:49:26,758 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower223 (Follower): Commit index set to 3
07:49:26,758 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 3 (of expected -1)
07:49:26,758 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 3, context.getLastApplied(): 2, lastIndex(): 3
07:49:26,758 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 3
07:49:26,758 PM [leader222-writer-88] [DEBUG] EntryJournalV1 - leader222: updated meta to JournalMeta[replayFrom=1, applyTo=4]
07:49:26,758 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 2 to 3
07:49:26,758 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
07:49:26,758 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower223: Applying state for log index 3 data three
07:49:26,758 PM [test-pekko.actor.default-dispatcher-14] [INFO] MockRaftActor - follower223: applyState called: three
07:49:26,758 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 285.4 μs
07:49:26,758 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
07:49:26,758 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
07:49:26,758 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 2.589 ms
07:49:26,758 PM [follower223-writer-87] [DEBUG] EntryJournalV1 - follower223: updated meta to JournalMeta[replayFrom=1, applyTo=4]
07:49:26,758 PM [follower223-writer-87] [DEBUG] RaftStorageCompleter - follower223: 1 completion(s) pending
07:49:26,759 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 141.8 μs
07:49:26,759 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: waiting to receive commands
07:49:26,759 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - follower223: running 1 completion(s)
07:49:26,759 PM [leader222-%d407743] [DEBUG] RaftStorage - leader222: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/snapshot-0000000068643BC6-2D1DF2D9.v1
07:49:26,759 PM [leader222-%d407743] [DEBUG] RaftStorage - leader222: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/snapshot-0000000068643BC6-2D1DF2D9.v1
07:49:26,759 PM [leader222-%d407743] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/TermInfo.properties
07:49:26,759 PM [leader222-%d407743] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/journal-v1-1.log
07:49:26,759 PM [leader222-%d407743] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/metadata-v1-1.log
07:49:26,759 PM [leader222-%d407743] [DEBUG] RaftStorage - leader222: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=2, term=1], timestamp=2025-07-01T19:49:26.756937433Z, file=/tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/snapshot-0000000068643BC6-2D1DF2D9.v1, size=374, entryCompress=NONE, stateCompress=NONE}
07:49:26,759 PM [leader222-%d407743] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
07:49:26,759 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
07:49:26,759 PM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader222: snapshot is durable as of 2025-07-01T19:49:26.756937433Z
07:49:26,759 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader222: Snapshot success with first journal index 4
07:49:26,759 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorSnapshotMessageSupport - leader222: SnapshotComplete received
07:49:26,759 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 1.274 ms
07:49:26,760 PM [leader222-writer-88] [DEBUG] EntryJournalV1 - leader222: updated meta to JournalMeta[replayFrom=4, applyTo=4]
07:49:26,760 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
07:49:26,760 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 180.9 μs
07:49:26,760 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
07:49:26,760 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
07:49:26,848 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/snapshot-0000000068643BC6-2D1DF2D9.v1
07:49:26,848 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/TermInfo.properties
07:49:26,848 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/journal-v1-1.log
07:49:26,848 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/metadata-v1-1.log
07:49:26,848 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: picked SnapshotFileV1{lastIncluded=EntryInfo[index=2, term=1], timestamp=2025-07-01T19:49:26.756937433Z, file=/tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/snapshot-0000000068643BC6-2D1DF2D9.v1, size=374, entryCompress=NONE, stateCompress=NONE} as the latest file
[WARN] [07/01/2025 19:49:26.865] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:26,865 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 3 (of expected -1)
07:49:26,962 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRaftStorage - follower223: terminating thread VirtualThread[#612,follower223-writer-87]/waiting
07:49:26,963 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: received 1 commands after 204.2 ms
07:49:26,963 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 63.29 μs
07:49:26,963 PM [follower223-writer-87] [DEBUG] JournalWriteTask - follower223: journal writer stopped
07:49:26,963 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower223: journal closed
07:49:26,963 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - follower223: journal closed
07:49:26,963 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower223: stopped executor with 0 remaining tasks
07:49:26,963 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower223: stopped executor with 0 remaining tasks
07:49:26,964 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader222: Persist data index=4 term=1 command=four
07:49:26,964 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=4, term=1, command=four, pending=true} 
07:49:26,964 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 4, isSendImmediate: true
07:49:26,964 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 204.6 ms
07:49:26,964 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 4, leaderSnapShotIndex: 2
07:49:26,964 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 4 is present for follower follower223
07:49:26,964 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=3, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=1, command=four, pending=true}]}
07:49:26,965 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: 2
07:49:26,965 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 19:49:26.965] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower223] received dead letter from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=3, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=1, command=four, pending=true}]}
[WARN] [07/01/2025 19:49:26.965] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:26,967 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
07:49:26,967 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
07:49:26,967 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 2.523 ms
07:49:26,967 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=4, term=1, command=four, pending=true}
07:49:26,967 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
07:49:26,967 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=4, term=1, command=four, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@39d16ad8}
07:49:26,969 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader222: Persist data index=5 term=1 command=five
07:49:26,969 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=5, term=1, command=five, pending=true} 
07:49:26,969 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=five}, logIndex: 5, isSendImmediate: true
07:49:26,969 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 5, leaderSnapShotIndex: 2
07:49:26,969 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 4 is present for follower follower223
07:49:26,969 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: 2
07:49:26,969 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
07:49:26,969 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 2.197 ms
[WARN] [07/01/2025 19:49:26.969] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:26,971 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
07:49:26,971 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
07:49:26,971 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=5, term=1, command=five, pending=true}
07:49:26,971 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 2.211 ms
07:49:26,971 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
07:49:26,971 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=5, term=1, command=five, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@ff08c20}
07:49:26,984 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 4 is present for follower follower223
[WARN] [07/01/2025 19:49:26.984] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:27,20 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 48.71 ms
07:49:27,21 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
07:49:27,21 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
07:49:27,21 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
07:49:27,21 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 957.7 μs
07:49:27,21 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
07:49:27,21 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback org.opendaylight.controller.cluster.raft.spi.JournalWriteTask$$Lambda/0x00000007c080ab90@52a1379a
07:49:27,21 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader222: Persist data index=4 term=1 command=newFour
07:49:27,21 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=4, term=1, command=newFour, pending=true} 
07:49:27,22 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=newFour}, logIndex: 4, isSendImmediate: true
07:49:27,22 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 256.2 μs
07:49:27,22 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 4, leaderSnapShotIndex: 2
07:49:27,22 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 4 is present for follower follower223
07:49:27,22 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: 2
07:49:27,22 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 19:49:27.022] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:27,24 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
07:49:27,24 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 2.371 ms
07:49:27,24 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
07:49:27,24 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
07:49:27,24 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=4, term=1, command=newFour, pending=true}
07:49:27,24 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=4, term=1, command=newFour, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@41d01926}
07:49:27,105 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 4 is present for follower follower223
07:49:27,105 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=3, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=1, command=newFour, pending=false}]}
[WARN] [07/01/2025 19:49:27.105] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower223] received dead letter from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=3, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=1, command=newFour, pending=false}]}
[WARN] [07/01/2025 19:49:27.105] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:27,123 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Persist data index=5 term=1 command=newFive
07:49:27,123 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=5, term=1, command=newFive, pending=true} 
07:49:27,123 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=newFive}, logIndex: 5, isSendImmediate: true
07:49:27,123 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 5, leaderSnapShotIndex: 2
07:49:27,123 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 4 is present for follower follower223
07:49:27,123 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 99.01 ms
07:49:27,123 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: 2
07:49:27,123 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 19:49:27.124] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:27,126 PM [leader222-writer-88] [DEBUG] RaftStorageCompleter - leader222: 1 completion(s) pending
07:49:27,126 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: running 1 completion(s)
07:49:27,126 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 2.913 ms
07:49:27,126 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
07:49:27,126 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=5, term=1, command=newFive, pending=true}
07:49:27,126 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader222: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=5, term=1, command=newFive, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@592d02f2}
07:49:27,225 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 4 is present for follower follower223
07:49:27,225 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=3, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=1, command=newFour, pending=false}, JournaledLogEntry{index=5, term=1, command=newFive, pending=false}]}
[WARN] [07/01/2025 19:49:27.225] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower223] received dead letter from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=3, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=1, command=newFour, pending=false}, JournaledLogEntry{index=5, term=1, command=newFive, pending=false}]}
[WARN] [07/01/2025 19:49:27.226] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:27,237 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRaftStorage - leader222: terminating thread VirtualThread[#617,leader222-writer-88]/waiting
07:49:27,238 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: received 1 commands after 111.5 ms
07:49:27,238 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 28.08 μs
07:49:27,238 PM [leader222-writer-88] [DEBUG] JournalWriteTask - leader222: journal writer stopped
07:49:27,238 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader222: journal closed
07:49:27,238 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - leader222: journal closed
07:49:27,238 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks
07:49:27,238 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks
[WARN] [07/01/2025 19:49:27.240] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader222]: org.opendaylight.controller.cluster.common.actor.Monitor@12127539
07:49:27,241 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - leader222: Starting recovery with journal batch size 1000
07:49:27,241 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader222: started executor
07:49:27,241 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader222: started executor
07:49:27,242 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader222: metadata journal open: replayFrom=4 applyTo=4
07:49:27,244 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader222: journal open: firstIndex=1 lastIndex=6 replayFrom=4 fileEntries=0
07:49:27,244 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - leader222: journal open: applyTo=4
07:49:27,245 PM [leader222-writer-89] [DEBUG] JournalWriteTask - leader222: journal writer started
07:49:27,245 PM [leader222-writer-89] [DEBUG] JournalWriteTask - leader222: waiting to receive commands
07:49:27,246 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222
07:49:27,247 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader222: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/snapshot-0000000068643BC6-2D1DF2D9.v1
07:49:27,247 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/TermInfo.properties
07:49:27,247 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/journal-v1-1.log
07:49:27,247 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/metadata-v1-1.log
07:49:27,247 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader222: picked SnapshotFileV1{lastIncluded=EntryInfo[index=2, term=1], timestamp=2025-07-01T19:49:26.756937433Z, file=/tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2643102024120493513/leader222/snapshot-0000000068643BC6-2D1DF2D9.v1, size=374, entryCompress=NONE, stateCompress=NONE} as the latest file
07:49:27,247 PM [test-pekko.actor.default-dispatcher-14] [INFO] MockRaftActor - leader222: support() called
07:49:27,248 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRecovery - leader222: initializing from snapshot taken at 2025-07-01T19:49:26.756937433Z
07:49:27,248 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222
07:49:27,248 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - Recovery snapshot applied for leader222 in 93.44 μs: snapshotIndex=2, snapshotTerm=1, journal-size=0
07:49:27,249 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader222: Recovery completed in 295.8 μs - Switching actor to Follower - last log index = 2, last log term = 1, snapshot index = 2, snapshot term = 1, journal size = 0
07:49:27,249 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRecovery - leader222: restoring local TermInfo{term=1, votedFor=leader222}
07:49:27,249 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222
07:49:27,249 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader222: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@ae89d4c
07:49:27,249 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to 2
07:49:27,249 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - leader222: applying entries up to 4
07:49:27,250 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=3, term=1, command=three]
07:49:27,250 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=4, term=1, command=newFour]
07:49:27,251 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=5, term=1, command=newFive]
07:49:27,251 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 2 to 3
07:49:27,251 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - leader222: journal recovery completedin 2.053 ms with journalIndex=4
07:49:27,251 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - leader222 (Follower): Received TimeoutNow - switching to Candidate
07:49:27,251 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower223-collector225#758979811]
07:49:27,252 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader222 (Candidate): Election: Candidate has following voting peers: []
07:49:27,253 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower223]
07:49:27,253 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader222-collector226#-1134941448]
07:49:27,253 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader222]
07:49:27,254 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader222-collector227#1852432453]
07:49:27,254 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader222]
07:49:27,256 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=2, votedFor=leader222
07:49:27,256 PM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - leader222 (Candidate): Starting new election term 2
07:49:27,256 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader222 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
07:49:27,256 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader222 (Candidate): Received ElectionTimeout
[WARN] [07/01/2025 19:49:27.256] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/leader222-collector227] received dead letter: org.opendaylight.controller.cluster.raft.base.messages.TimeoutNow@1894593a
07:49:27,257 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Election: Leader has following peers: []
07:49:27,257 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader222 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
[WARN] [07/01/2025 19:49:27.257] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/leader222-collector227] received dead letter: org.opendaylight.controller.cluster.raft.base.messages.ElectionTimeout@9ea2f79
07:49:27,257 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRaftStorage - leader222: terminating thread VirtualThread[#625,leader222-writer-89]/waiting
07:49:27,257 PM [leader222-writer-89] [DEBUG] JournalWriteTask - leader222: received 1 commands after 12.16 ms
07:49:27,257 PM [leader222-writer-89] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 27.97 μs
07:49:27,257 PM [leader222-writer-89] [DEBUG] JournalWriteTask - leader222: journal writer stopped
07:49:27,257 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader222: journal closed
07:49:27,257 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - leader222: journal closed
07:49:27,257 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks
07:49:27,257 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks
[WARN] [07/01/2025 19:49:27.261] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower229]: org.opendaylight.controller.cluster.common.actor.Monitor@8d038c0
07:49:27,262 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - follower229: Starting recovery with journal batch size 1000
07:49:27,262 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower229: started executor
07:49:27,262 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower229: started executor
07:49:27,262 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower229: metadata journal open: replayFrom=1 applyTo=0
07:49:27,263 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower229: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
07:49:27,263 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - follower229: journal open: applyTo=0
07:49:27,263 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: journal writer started
07:49:27,263 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: waiting to receive commands
07:49:27,265 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/follower229/TermInfo.properties does not exist
07:49:27,265 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower229: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/follower229/journal-v1-1.log
07:49:27,265 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower229: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/follower229/metadata-v1-1.log
07:49:27,265 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower229: no eligible files found
07:49:27,265 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - follower229: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [07/01/2025 19:49:27.265] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader228]: org.opendaylight.controller.cluster.common.actor.Monitor@13f55e3e
07:49:27,266 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - leader228: Starting recovery with journal batch size 1000
07:49:27,266 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader228: started executor
07:49:27,267 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader228: started executor
07:49:27,267 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower229: Set currentTerm=0, votedFor=null
07:49:27,267 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - follower229: Local TermInfo store seeded with TermInfo{term=0}
07:49:27,267 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower229: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@327e2798
07:49:27,267 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - follower229: Moving last applied index from -1 to -1
07:49:27,267 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader228: metadata journal open: replayFrom=1 applyTo=0
07:49:27,267 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - follower229: empty journal: appending 0 entries
07:49:27,268 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower229: updated meta to JournalMeta[replayFrom=1, applyTo=0]
07:49:27,268 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - follower229: journal recovery completedin 323.7 μs with journalIndex=1
07:49:27,268 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader228: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
07:49:27,268 PM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader228: journal open: applyTo=0
07:49:27,269 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: journal writer started
07:49:27,269 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
07:49:27,270 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/TermInfo.properties does not exist
07:49:27,270 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/journal-v1-1.log
07:49:27,270 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/metadata-v1-1.log
07:49:27,270 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader228: no eligible files found
07:49:27,270 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader228: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
07:49:27,274 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader228: Set currentTerm=0, votedFor=null
07:49:27,274 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader228: Local TermInfo store seeded with TermInfo{term=0}
07:49:27,274 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader228: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@254b6646
07:49:27,274 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader228: Moving last applied index from -1 to -1
07:49:27,274 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader228: empty journal: appending 0 entries
07:49:27,275 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader228: updated meta to JournalMeta[replayFrom=1, applyTo=0]
07:49:27,275 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader228: journal recovery completedin 527.8 μs with journalIndex=1
07:49:27,725 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
07:49:27,725 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader228 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.142:17355, Removed)
07:49:27,725 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader228 (Follower): Received ElectionTimeout - switching to Candidate
07:49:27,725 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader228 (Candidate): Election: Candidate has following voting peers: [follower229, follower230]
07:49:27,729 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader228: Set currentTerm=1, votedFor=leader228
07:49:27,729 PM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader228 (Candidate): Starting new election term 1
07:49:27,729 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader228 (Candidate): Sending RequestVote{term=1, candidateId=leader228, lastLogIndex=-1, lastLogTerm=-1} to peer follower229
07:49:27,730 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader228 (Candidate): Sending RequestVote{term=1, candidateId=leader228, lastLogIndex=-1, lastLogTerm=-1} to peer follower230
07:49:27,730 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader228 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
07:49:27,730 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower229 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
07:49:27,730 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower229 (Follower): Cluster state: []
07:49:27,730 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower229 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader228, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
07:49:27,730 PM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - follower229 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader228, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term
[WARN] [07/01/2025 19:49:27.730] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: RequestVote{term=1, candidateId=leader228, lastLogIndex=-1, lastLogTerm=-1}
07:49:27,733 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower229: Set currentTerm=1, votedFor=null
07:49:27,733 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower229 (Follower): In requestVote: RequestVote{term=1, candidateId=leader228, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1
07:49:27,736 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower229: Set currentTerm=1, votedFor=leader228
07:49:27,736 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower229 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true}
07:49:27,736 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader228 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1
07:49:27,736 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader228 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1
07:49:27,736 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader228 (Leader): Election: Leader has following peers: [follower229, follower230]
07:49:27,736 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
07:49:27,736 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower230: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
07:49:27,736 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader228 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
07:49:27,736 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower229: Last sync leader does not match current leader leader228, need to catch up to -1
[WARN] [07/01/2025 19:49:27.737] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
[WARN] [07/01/2025 19:49:27.737] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower229] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower229, initialSyncDone=false]
07:49:27,737 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader228 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower229 updated: matchIndex: -1, nextIndex: 0
07:49:27,737 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
07:49:27,781 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader228: Persist data index=0 term=1 command=zero
07:49:27,781 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader228: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 
07:49:27,781 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 512.2 ms
07:49:27,781 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader228 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
07:49:27,782 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
07:49:27,782 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader228 (Leader): sendAppendEntries: 0 is present for follower follower229
07:49:27,782 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader228 (Leader): Sending AppendEntries to follower follower229: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]}
07:49:27,782 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower230: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
07:49:27,782 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader228: awaiting more completions to resolve 1 synchronized callback(s)
07:49:27,782 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower229 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]}
[WARN] [07/01/2025 19:49:27.782] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:27,782 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower229 (Follower): Number of entries to be appended = 1
07:49:27,782 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower229 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
07:49:27,782 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower229 (Follower): Append entry to log zero
07:49:27,782 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - follower229: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 
07:49:27,783 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower229 (Follower): Log size is now 1
07:49:27,783 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower229 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower229, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
07:49:27,783 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower229: Lagging 0 entries behind leader leader228 and reached -1 (of expected -1)
07:49:27,783 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: received 1 commands after 519.5 ms
[WARN] [07/01/2025 19:49:27.783] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower229] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower229, initialSyncDone=true]
07:49:27,787 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
07:49:27,788 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
07:49:27,788 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 6.656 ms
07:49:27,788 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
07:49:27,788 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader228: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true}
07:49:27,788 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader228: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@2ac1662e}
07:49:27,788 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader228 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower229 updated: matchIndex: 0, nextIndex: 1
07:49:27,788 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader228 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
07:49:27,788 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - leader228 (Leader): Setting last applied to 0
07:49:27,788 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - leader228: Moving last applied index from -1 to 0
07:49:27,788 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader228: Applying state for log index 0 data zero
07:49:27,788 PM [test-pekko.actor.default-dispatcher-14] [INFO] MockRaftActor - leader228: applyState called: zero
07:49:27,788 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
07:49:27,788 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 707.3 μs
07:49:27,789 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower229 (Follower): Commit index set to 0
07:49:27,789 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower229: Lagging 0 entries behind leader leader228 and reached 0 (of expected -1)
07:49:27,789 PM [leader228-writer-91] [DEBUG] EntryJournalV1 - leader228: updated meta to JournalMeta[replayFrom=1, applyTo=1]
07:49:27,789 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower229 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
07:49:27,789 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower229 (Follower): Setting last applied to 0
07:49:27,789 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
07:49:27,789 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - follower229: Moving last applied index from -1 to 0
07:49:27,789 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower229: Applying state for log index 0 data zero
07:49:27,789 PM [test-pekko.actor.default-dispatcher-14] [INFO] MockRaftActor - follower229: applyState called: zero
07:49:27,789 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 329.3 μs
07:49:27,789 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
07:49:27,789 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
07:49:27,789 PM [follower229-writer-90] [DEBUG] RaftStorageCompleter - follower229: 1 completion(s) pending
07:49:27,789 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - follower229: running 1 completion(s)
07:49:27,789 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: completed 1 commands in 6.293 ms
07:49:27,789 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - follower229: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false}
07:49:27,789 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: received 1 commands after 9.840 μs
07:49:27,789 PM [follower229-writer-90] [DEBUG] EntryJournalV1 - follower229: updated meta to JournalMeta[replayFrom=1, applyTo=1]
07:49:27,789 PM [follower229-writer-90] [DEBUG] RaftStorageCompleter - follower229: 1 completion(s) pending
07:49:27,789 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: completed 1 commands in 255.3 μs
07:49:27,789 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - follower229: running 1 completion(s)
07:49:27,789 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: waiting to receive commands
[WARN] [07/01/2025 19:49:27.855] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:27,883 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader228: Persist data index=1 term=1 command=one
07:49:27,883 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader228: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 
07:49:27,883 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true
07:49:27,883 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
07:49:27,883 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): sendAppendEntries: 1 is present for follower follower229
07:49:27,883 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Sending AppendEntries to follower follower229: AppendEntries{term=1, leaderId=leader228, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]}
07:49:27,884 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower230: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1
07:49:27,884 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader228: awaiting more completions to resolve 1 synchronized callback(s)
07:49:27,884 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 94.93 ms
07:49:27,884 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower229 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader228, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]}
[WARN] [07/01/2025 19:49:27.884] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:27,885 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower229 (Follower): Number of entries to be appended = 1
07:49:27,885 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower229 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
07:49:27,885 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower229 (Follower): Append entry to log one
07:49:27,885 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - follower229: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 
07:49:27,885 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower229 (Follower): Log size is now 2
07:49:27,885 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower229 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower229, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
07:49:27,885 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower229: Lagging 0 entries behind leader leader228 and reached 0 (of expected -1)
07:49:27,885 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: received 1 commands after 95.51 ms
07:49:27,887 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
07:49:27,887 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 2.904 ms
07:49:27,887 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
07:49:27,887 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
07:49:27,887 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader228: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true}
07:49:27,887 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader228: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=1, term=1, command=one, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@4713dbff}
07:49:27,887 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower229 updated: matchIndex: 1, nextIndex: 2
07:49:27,887 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0
07:49:27,887 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader228 (Leader): Setting last applied to 1
07:49:27,887 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader228: Moving last applied index from 0 to 1
07:49:27,887 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader228: Applying state for log index 1 data one
07:49:27,887 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader228: applyState called: one
07:49:27,887 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1
07:49:27,887 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower229 (Follower): Commit index set to 1
07:49:27,888 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower229: Lagging 0 entries behind leader leader228 and reached 1 (of expected -1)
07:49:27,888 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower229 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
07:49:27,888 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower229 (Follower): Setting last applied to 1
07:49:27,888 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower229: Moving last applied index from 0 to 1
07:49:27,888 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower229: Applying state for log index 1 data one
07:49:27,888 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower229: applyState called: one
07:49:27,888 PM [follower229-writer-90] [DEBUG] RaftStorageCompleter - follower229: 1 completion(s) pending
07:49:27,888 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: completed 1 commands in 2.892 ms
07:49:27,888 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: received 1 commands after 10.59 μs
07:49:27,888 PM [follower229-writer-90] [DEBUG] EntryJournalV1 - follower229: updated meta to JournalMeta[replayFrom=1, applyTo=2]
07:49:27,888 PM [follower229-writer-90] [DEBUG] RaftStorageCompleter - follower229: 1 more completion(s) pending
07:49:27,888 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: completed 1 commands in 242.4 μs
07:49:27,888 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: waiting to receive commands
07:49:27,888 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 1.707 ms
07:49:27,889 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorageCompleter - follower229: running 2 completion(s)
07:49:27,889 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower229: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false}
07:49:27,889 PM [leader228-writer-91] [DEBUG] EntryJournalV1 - leader228: updated meta to JournalMeta[replayFrom=1, applyTo=2]
07:49:27,889 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
07:49:27,889 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
07:49:27,889 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 276.0 μs
07:49:27,889 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
[WARN] [07/01/2025 19:49:27.975] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:27,984 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader228: Persist data index=2 term=1 command=two
07:49:27,984 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader228: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 
07:49:27,984 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true
07:49:27,984 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1
07:49:27,984 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): sendAppendEntries: 2 is present for follower follower229
07:49:27,984 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Sending AppendEntries to follower follower229: AppendEntries{term=1, leaderId=leader228, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]}
07:49:27,984 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 95.47 ms
07:49:27,984 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower230: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1
07:49:27,984 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader228: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 19:49:27.985] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:27,987 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
07:49:27,987 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
07:49:27,988 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader228: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true}
07:49:27,987 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 3.172 ms
07:49:27,988 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
07:49:27,988 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader228: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=2, term=1, command=two, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@176660f5}
07:49:27,988 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader228: Persist data index=3 term=1 command=three
07:49:27,988 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader228: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 
07:49:27,988 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true
07:49:27,988 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1
07:49:27,988 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): sendAppendEntries: 2 is present for follower follower229
07:49:27,988 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 211.7 μs
07:49:27,988 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower230: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1
07:49:27,988 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader228: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 19:49:27.988] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:27,989 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
07:49:27,989 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
07:49:27,989 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader228: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true}
07:49:27,989 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 1.179 ms
07:49:27,989 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
07:49:27,989 PM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader228: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=2, mandatoryTrim=false]
07:49:27,989 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader228: captured snapshot at lastSequenceNumber: 2
07:49:27,989 PM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader228: Persising snapshot at EntryInfo[index=1, term=1]/EntryInfo[index=3, term=1]
07:49:27,989 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader228: support() called
07:49:27,990 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader228: log size 4 exceeds the snapshot batch count 4 - doing snapshotPreCommit with index 1
07:49:27,990 PM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader228: Removed in-memory snapshotted entries, adjusted snaphsotIndex: 1 and term: 1
07:49:27,990 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader228: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=3, term=1, command=three, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@49f82cc0}
07:49:27,990 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader228: Persist data index=4 term=1 command=four
07:49:27,990 PM [leader228-%d854115] [DEBUG] RaftStorage - leader228: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/snapshot-0000000068643BC7-3B03BA63.tmp
07:49:27,990 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader228: Append log entry and persist JournaledLogEntry{index=4, term=1, command=four, pending=true} 
07:49:27,990 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 4, isSendImmediate: true
07:49:27,990 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 2, leaderLastIndex: 4, leaderSnapShotIndex: 1
07:49:27,990 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): sendAppendEntries: 2 is present for follower follower229
07:49:27,990 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 899.3 μs
07:49:27,990 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower230: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: 1
07:49:27,990 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader228: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 19:49:27.991] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:27,992 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
07:49:27,992 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
07:49:27,992 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 2.105 ms
07:49:27,992 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
07:49:27,992 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader228: persist complete JournaledLogEntry{index=4, term=1, command=four, pending=true}
07:49:27,992 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader228: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=4, term=1, command=four, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@9f6e84}
07:49:27,994 PM [leader228-%d854115] [DEBUG] RaftStorage - leader228: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/snapshot-0000000068643BC7-3B03BA63.v1
07:49:27,994 PM [leader228-%d854115] [DEBUG] RaftStorage - leader228: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/snapshot-0000000068643BC7-3B03BA63.v1
07:49:27,994 PM [leader228-%d854115] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/TermInfo.properties
07:49:27,994 PM [leader228-%d854115] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/journal-v1-1.log
07:49:27,994 PM [leader228-%d854115] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/metadata-v1-1.log
07:49:27,994 PM [leader228-%d854115] [DEBUG] RaftStorage - leader228: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=1, term=1], timestamp=2025-07-01T19:49:27.990100067Z, file=/tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/snapshot-0000000068643BC7-3B03BA63.v1, size=358, entryCompress=NONE, stateCompress=NONE}
07:49:27,994 PM [leader228-%d854115] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
07:49:27,994 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
07:49:27,994 PM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader228: snapshot is durable as of 2025-07-01T19:49:27.990100067Z
07:49:27,994 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader228: Snapshot success with first journal index 3
07:49:27,994 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorSnapshotMessageSupport - leader228: SnapshotComplete received
07:49:27,994 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 2.246 ms
07:49:27,994 PM [leader228-writer-91] [DEBUG] EntryJournalV1 - leader228: updated meta to JournalMeta[replayFrom=3, applyTo=2]
07:49:27,994 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
07:49:27,994 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
07:49:27,994 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 156.2 μs
07:49:27,994 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
07:49:28,95 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader228 (Leader): sendAppendEntries: 2 is present for follower follower229
07:49:28,95 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader228 (Leader): Sending AppendEntries to follower follower229: AppendEntries{term=1, leaderId=leader228, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=1, command=four, pending=false}]}
[WARN] [07/01/2025 19:49:28.095] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:28,215 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader228 (Leader): sendAppendEntries: 2 is present for follower follower229
07:49:28,215 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader228 (Leader): Sending AppendEntries to follower follower229: AppendEntries{term=1, leaderId=leader228, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=1, command=four, pending=false}]}
[WARN] [07/01/2025 19:49:28.215] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
[WARN] [07/01/2025 19:49:28.335] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:28,337 PM [awaitility-thread] [DEBUG] RaftStorage - leader228: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/snapshot-0000000068643BC7-3B03BA63.v1
07:49:28,337 PM [awaitility-thread] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/TermInfo.properties
07:49:28,337 PM [awaitility-thread] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/journal-v1-1.log
07:49:28,337 PM [awaitility-thread] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/metadata-v1-1.log
07:49:28,337 PM [awaitility-thread] [DEBUG] RaftStorage - leader228: picked SnapshotFileV1{lastIncluded=EntryInfo[index=1, term=1], timestamp=2025-07-01T19:49:27.990100067Z, file=/tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/snapshot-0000000068643BC7-3B03BA63.v1, size=358, entryCompress=NONE, stateCompress=NONE} as the latest file
07:49:28,455 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower229: Lagging -2 entries behind leader leader228 and reached 1 (of expected -1)
07:49:28,455 PM [test-pekko.actor.default-dispatcher-7] [WARN] AbstractLeader - leader228 (Leader) : handleAppendEntriesReply delayed beyond election timeout, appendEntriesReply : AppendEntriesReply{term=1, success=true, followerId=follower229, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}, timeSinceLastActivity : 567, lastApplied : 1, commitIndex : 1
07:49:28,455 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader228 (Leader): sendAppendEntries: 2 is present for follower follower229
[WARN] [07/01/2025 19:49:28.455] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader228]: AppendEntries{term=1, leaderId=leader228, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:28,455 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader228 (Leader): Sending AppendEntries to follower follower229: AppendEntries{term=1, leaderId=leader228, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=1, command=four, pending=false}]}
07:49:28,455 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower229 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader228, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=1, command=four, pending=false}]}
07:49:28,456 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower229 (Follower): Number of entries to be appended = 3
07:49:28,456 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower229 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0
07:49:28,456 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower229 (Follower): Append entry to log two
07:49:28,456 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - follower229: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=false} 
07:49:28,456 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower229 (Follower): Append entry to log three
07:49:28,456 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - follower229: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=false} 
07:49:28,456 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower229 (Follower): Append entry to log four
07:49:28,456 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - follower229: Append log entry and persist JournaledLogEntry{index=4, term=1, command=four, pending=false} 
07:49:28,456 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower229 (Follower): Log size is now 5
07:49:28,456 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower229 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower229, logLastIndex=4, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
07:49:28,456 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower229: Lagging 0 entries behind leader leader228 and reached 1 (of expected -1)
07:49:28,456 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower229 updated: matchIndex: 4, nextIndex: 5
07:49:28,456 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): Applying to log - commitIndex: 4, lastAppliedIndex: 1
07:49:28,456 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader228 (Leader): Setting last applied to 2
07:49:28,456 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader228: Moving last applied index from 1 to 2
07:49:28,456 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader228: Applying state for log index 2 data two
07:49:28,456 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader228: applyState called: two
07:49:28,456 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: received 3 commands after 567.9 ms
07:49:28,457 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader228 (Leader): Setting last applied to 3
07:49:28,457 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader228: Moving last applied index from 2 to 3
07:49:28,457 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader228: Applying state for log index 3 data three
07:49:28,457 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader228: applyState called: three
07:49:28,457 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader228 (Leader): Setting last applied to 4
07:49:28,457 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader228: Moving last applied index from 3 to 4
07:49:28,457 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader228: Applying state for log index 4 data four
07:49:28,457 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader228: applyState called: four
07:49:28,457 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader228 (Leader): Checking sendAppendEntries for follower follower229: active: true, followerNextIndex: 5, leaderLastIndex: 4, leaderSnapShotIndex: 1
07:49:28,457 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 462.6 ms
07:49:28,457 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower229 (Follower): Commit index set to 4
07:49:28,457 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower229: Lagging 0 entries behind leader leader228 and reached 4 (of expected -1)
07:49:28,457 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower229 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 4, context.getLastApplied(): 1, lastIndex(): 4
07:49:28,457 PM [leader228-writer-91] [DEBUG] EntryJournalV1 - leader228: updated meta to JournalMeta[replayFrom=3, applyTo=5]
07:49:28,457 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower229 (Follower): Setting last applied to 2
07:49:28,457 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower229: Moving last applied index from 1 to 2
07:49:28,457 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower229: Applying state for log index 2 data two
07:49:28,457 PM [leader228-writer-91] [DEBUG] RaftStorageCompleter - leader228: 1 completion(s) pending
07:49:28,457 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower229: applyState called: two
07:49:28,457 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 241.4 μs
07:49:28,457 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
07:49:28,458 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower229 (Follower): Setting last applied to 3
07:49:28,458 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower229: Moving last applied index from 2 to 3
07:49:28,458 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower229: Applying state for log index 3 data three
07:49:28,458 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower229: applyState called: three
07:49:28,458 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower229 (Follower): Setting last applied to 4
07:49:28,458 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower229: Moving last applied index from 3 to 4
07:49:28,458 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower229: Applying state for log index 4 data four
07:49:28,458 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower229: applyState called: four
07:49:28,458 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader228: running 1 completion(s)
07:49:28,462 PM [follower229-writer-90] [DEBUG] RaftStorageCompleter - follower229: 3 completion(s) pending
07:49:28,462 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: completed 3 commands in 6.146 ms
07:49:28,463 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: received 1 commands after 5.360 μs
07:49:28,463 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - follower229: running 3 completion(s)
07:49:28,463 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower229: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false}
07:49:28,463 PM [follower229-writer-90] [DEBUG] EntryJournalV1 - follower229: updated meta to JournalMeta[replayFrom=1, applyTo=5]
07:49:28,463 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower229: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=false}
07:49:28,463 PM [follower229-writer-90] [DEBUG] RaftStorageCompleter - follower229: 1 completion(s) pending
07:49:28,463 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower229: persist complete JournaledLogEntry{index=4, term=1, command=four, pending=false}
07:49:28,463 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: completed 1 commands in 126.9 μs
07:49:28,463 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: waiting to receive commands
07:49:28,463 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - follower229: running 1 completion(s)
07:49:28,551 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader228: terminating thread VirtualThread[#627,leader228-writer-91]/waiting
07:49:28,551 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: received 1 commands after 93.92 ms
07:49:28,552 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 27.86 μs
07:49:28,552 PM [leader228-writer-91] [DEBUG] JournalWriteTask - leader228: journal writer stopped
07:49:28,552 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader228: journal closed
07:49:28,552 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader228: journal closed
07:49:28,552 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader228: stopped executor with 0 remaining tasks
07:49:28,552 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader228: stopped executor with 0 remaining tasks
07:49:28,555 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader228: Starting recovery with journal batch size 1000
07:49:28,555 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader228: started executor
07:49:28,555 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader228: started executor
07:49:28,556 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader228: metadata journal open: replayFrom=3 applyTo=5
[WARN] [07/01/2025 19:49:28.556] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader228]: org.opendaylight.controller.cluster.common.actor.Monitor@114f2ea3
07:49:28,557 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader228: journal open: firstIndex=1 lastIndex=5 replayFrom=3 fileEntries=0
07:49:28,557 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader228: journal open: applyTo=5
07:49:28,557 PM [leader228-writer-92] [DEBUG] JournalWriteTask - leader228: journal writer started
07:49:28,557 PM [leader228-writer-92] [DEBUG] JournalWriteTask - leader228: waiting to receive commands
07:49:28,558 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader228: Set currentTerm=1, votedFor=leader228
07:49:28,558 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader228: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/snapshot-0000000068643BC7-3B03BA63.v1
07:49:28,559 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/TermInfo.properties
07:49:28,559 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/journal-v1-1.log
07:49:28,559 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/metadata-v1-1.log
07:49:28,559 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader228: picked SnapshotFileV1{lastIncluded=EntryInfo[index=1, term=1], timestamp=2025-07-01T19:49:27.990100067Z, file=/tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest5570986635134180465/leader228/snapshot-0000000068643BC7-3B03BA63.v1, size=358, entryCompress=NONE, stateCompress=NONE} as the latest file
07:49:28,559 PM [test-pekko.actor.default-dispatcher-14] [INFO] MockRaftActor - leader228: support() called
07:49:28,559 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRecovery - leader228: initializing from snapshot taken at 2025-07-01T19:49:27.990100067Z
07:49:28,560 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader228: Set currentTerm=1, votedFor=leader228
07:49:28,560 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - Recovery snapshot applied for leader228 in 59.84 μs: snapshotIndex=1, snapshotTerm=1, journal-size=0
07:49:28,560 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader228: Recovery completed in 170.2 μs - Switching actor to Follower - last log index = 1, last log term = 1, snapshot index = 1, snapshot term = 1, journal size = 0
07:49:28,560 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRecovery - leader228: restoring local TermInfo{term=1, votedFor=leader228}
07:49:28,560 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader228: Set currentTerm=1, votedFor=leader228
07:49:28,560 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader228: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@72a7b5fa
07:49:28,560 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - leader228: Moving last applied index from -1 to 1
07:49:28,560 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - leader228: applying entries up to 5
07:49:28,560 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - leader228: recovered journal DefaultLogEntry[index=2, term=1, command=two]
07:49:28,561 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - leader228: recovered journal DefaultLogEntry[index=3, term=1, command=three]
07:49:28,561 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - leader228: recovered journal DefaultLogEntry[index=4, term=1, command=four]
07:49:28,561 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - leader228: Moving last applied index from 1 to 4
07:49:28,561 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - leader228: journal recovery completedin 1.242 ms with journalIndex=3
07:49:28,561 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - leader228 (Follower): Received TimeoutNow - switching to Candidate
07:49:28,561 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader228 (Candidate): Election: Candidate has following voting peers: []
07:49:28,564 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader228: Set currentTerm=2, votedFor=leader228
07:49:28,564 PM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - leader228 (Candidate): Starting new election term 2
07:49:28,564 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader228 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
07:49:28,564 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader228 (Candidate): Received ElectionTimeout
07:49:28,564 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader228 (Leader): Election: Leader has following peers: []
07:49:28,564 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader228 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
07:49:28,654 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower229-collector231#-162713759]
07:49:28,666 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower229]
07:49:28,666 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - follower229: terminating thread VirtualThread[#626,follower229-writer-90]/waiting
07:49:28,666 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: received 1 commands after 203.5 ms
07:49:28,667 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: completed 1 commands in 59.04 μs
07:49:28,667 PM [follower229-writer-90] [DEBUG] JournalWriteTask - follower229: journal writer stopped
07:49:28,667 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower229: journal closed
07:49:28,667 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower229: journal closed
07:49:28,667 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower229: stopped executor with 0 remaining tasks
07:49:28,667 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower229: stopped executor with 0 remaining tasks
07:49:28,668 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader228-collector232#-1095361110]
07:49:28,668 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader228]
07:49:28,668 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader228-collector233#-284328877]
07:49:28,668 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader228]
07:49:28,669 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader228: terminating thread VirtualThread[#633,leader228-writer-92]/waiting
07:49:28,669 PM [leader228-writer-92] [DEBUG] JournalWriteTask - leader228: received 1 commands after 111.4 ms
07:49:28,669 PM [leader228-writer-92] [DEBUG] JournalWriteTask - leader228: completed 1 commands in 20.86 μs
07:49:28,669 PM [leader228-writer-92] [DEBUG] JournalWriteTask - leader228: journal writer stopped
07:49:28,669 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader228: journal closed
07:49:28,669 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader228: journal closed
07:49:28,669 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader228: stopped executor with 0 remaining tasks
07:49:28,669 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader228: stopped executor with 0 remaining tasks
[WARN] [07/01/2025 19:49:28.678] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower235]: org.opendaylight.controller.cluster.common.actor.Monitor@7ac242ad
07:49:28,679 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower235: Starting recovery with journal batch size 1000
07:49:28,679 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower235: started executor
07:49:28,679 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower235: started executor
07:49:28,680 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower235: metadata journal open: replayFrom=1 applyTo=0
07:49:28,681 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower235: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
07:49:28,681 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower235: journal open: applyTo=0
07:49:28,681 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: journal writer started
07:49:28,681 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: waiting to receive commands
[WARN] [07/01/2025 19:49:28.683] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader234]: org.opendaylight.controller.cluster.common.actor.Monitor@1ebfdbe1
07:49:28,683 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - leader234: Starting recovery with journal batch size 1000
07:49:28,684 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader234: started executor
07:49:28,684 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader234: started executor
07:49:28,684 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader234: metadata journal open: replayFrom=1 applyTo=0
07:49:28,684 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader234: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
07:49:28,684 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - leader234: journal open: applyTo=0
07:49:28,684 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: journal writer started
07:49:28,685 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: waiting to receive commands
07:49:28,686 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10517959941631667503/leader234/TermInfo.properties does not exist
07:49:28,686 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10517959941631667503/leader234/journal-v1-1.log
07:49:28,687 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10517959941631667503/leader234/metadata-v1-1.log
07:49:28,687 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader234: no eligible files found
07:49:28,687 PM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader234: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
07:49:28,687 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10517959941631667503/follower235/TermInfo.properties does not exist
07:49:28,687 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower235: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10517959941631667503/follower235/journal-v1-1.log
07:49:28,687 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower235: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10517959941631667503/follower235/metadata-v1-1.log
07:49:28,687 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower235: no eligible files found
07:49:28,687 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower235: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
07:49:28,690 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader234: Set currentTerm=0, votedFor=null
07:49:28,690 PM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader234: Local TermInfo store seeded with TermInfo{term=0}
07:49:28,690 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader234: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@e0f7814
07:49:28,690 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - leader234: Moving last applied index from -1 to -1
07:49:28,690 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - leader234: empty journal: appending 0 entries
07:49:28,690 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader234: updated meta to JournalMeta[replayFrom=1, applyTo=0]
07:49:28,691 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - leader234: journal recovery completedin 553.6 μs with journalIndex=1
07:49:28,692 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower235: Set currentTerm=0, votedFor=null
07:49:28,692 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower235: Local TermInfo store seeded with TermInfo{term=0}
07:49:28,692 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower235: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@1952196e
07:49:28,692 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower235: Moving last applied index from -1 to -1
07:49:28,693 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower235: empty journal: appending 0 entries
07:49:28,693 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower235: updated meta to JournalMeta[replayFrom=1, applyTo=0]
07:49:28,693 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower235: journal recovery completedin 336.9 μs with journalIndex=1
07:49:29,194 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
07:49:29,194 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader234 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.142:17355, Removed)
07:49:29,194 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader234 (Follower): Received ElectionTimeout - switching to Candidate
07:49:29,194 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader234 (Candidate): Election: Candidate has following voting peers: [follower236, follower235]
07:49:29,197 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader234: Set currentTerm=1, votedFor=leader234
07:49:29,197 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader234 (Candidate): Starting new election term 1
07:49:29,197 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader234 (Candidate): Sending RequestVote{term=1, candidateId=leader234, lastLogIndex=-1, lastLogTerm=-1} to peer follower236
07:49:29,197 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader234 (Candidate): Sending RequestVote{term=1, candidateId=leader234, lastLogIndex=-1, lastLogTerm=-1} to peer follower235
07:49:29,197 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader234 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
07:49:29,197 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower235 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
07:49:29,197 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower235 (Follower): Cluster state: []
07:49:29,197 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower235 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader234, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
07:49:29,197 PM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - follower235 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader234, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term
[WARN] [07/01/2025 19:49:29.197] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader234]: RequestVote{term=1, candidateId=leader234, lastLogIndex=-1, lastLogTerm=-1}
07:49:29,199 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower235: Set currentTerm=1, votedFor=null
07:49:29,200 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower235 (Follower): In requestVote: RequestVote{term=1, candidateId=leader234, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1
07:49:29,205 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower235: Set currentTerm=1, votedFor=leader234
07:49:29,205 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower235 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true}
07:49:29,205 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader234 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1
07:49:29,205 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader234 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1
07:49:29,206 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Election: Leader has following peers: [follower236, follower235]
07:49:29,206 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower236: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
07:49:29,206 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower235: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
07:49:29,206 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader234 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
[WARN] [07/01/2025 19:49:29.206] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader234]: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:29,206 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower235: Last sync leader does not match current leader leader234, need to catch up to -1
07:49:29,207 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower235 updated: matchIndex: -1, nextIndex: 0
[WARN] [07/01/2025 19:49:29.207] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/follower235] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower235, initialSyncDone=false]
07:49:29,207 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower235: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
07:49:29,249 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader234: Persist data index=0 term=1 command=zero
07:49:29,249 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader234: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 
07:49:29,249 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: received 1 commands after 564.6 ms
07:49:29,250 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader234 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
07:49:29,250 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower236: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
07:49:29,250 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower235: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
07:49:29,250 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader234 (Leader): sendAppendEntries: 0 is present for follower follower235
07:49:29,250 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader234 (Leader): Sending AppendEntries to follower follower235: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]}
07:49:29,250 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader234: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 19:49:29.250] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader234]: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:29,250 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]}
07:49:29,250 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): Number of entries to be appended = 1
07:49:29,250 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
07:49:29,250 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): Append entry to log zero
07:49:29,250 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower235: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 
07:49:29,251 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): Log size is now 1
07:49:29,251 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower235, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
07:49:29,251 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached -1 (of expected -1)
07:49:29,251 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: received 1 commands after 570.0 ms
[WARN] [07/01/2025 19:49:29.251] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower235] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower235, initialSyncDone=true]
07:49:29,255 PM [leader234-writer-94] [DEBUG] RaftStorageCompleter - leader234: 1 completion(s) pending
07:49:29,255 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader234: running 1 completion(s)
07:49:29,255 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: completed 1 commands in 5.852 ms
07:49:29,255 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: waiting to receive commands
07:49:29,255 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader234: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true}
07:49:29,255 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader234: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@5263d3f4}
07:49:29,255 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader234 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower235 updated: matchIndex: 0, nextIndex: 1
07:49:29,255 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader234 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
07:49:29,255 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader234 (Leader): Setting last applied to 0
07:49:29,255 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader234: Moving last applied index from -1 to 0
07:49:29,255 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader234: Applying state for log index 0 data zero
07:49:29,255 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader234: applyState called: zero
07:49:29,256 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: received 1 commands after 479.5 μs
07:49:29,256 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower235: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
07:49:29,256 PM [leader234-writer-94] [DEBUG] EntryJournalV1 - leader234: updated meta to JournalMeta[replayFrom=1, applyTo=1]
07:49:29,256 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): Commit index set to 0
07:49:29,256 PM [leader234-writer-94] [DEBUG] RaftStorageCompleter - leader234: 1 completion(s) pending
07:49:29,256 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 0 (of expected -1)
07:49:29,256 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
07:49:29,256 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader234: running 1 completion(s)
07:49:29,256 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: completed 1 commands in 247.9 μs
07:49:29,256 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower235 (Follower): Setting last applied to 0
07:49:29,256 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: waiting to receive commands
07:49:29,256 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower235: Moving last applied index from -1 to 0
07:49:29,256 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower235: Applying state for log index 0 data zero
07:49:29,256 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower235: applyState called: zero
07:49:29,256 PM [follower235-writer-93] [DEBUG] RaftStorageCompleter - follower235: 1 completion(s) pending
07:49:29,256 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: completed 1 commands in 5.213 ms
07:49:29,256 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: received 1 commands after 7.790 μs
07:49:29,256 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower235: running 1 completion(s)
07:49:29,256 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower235: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false}
07:49:29,256 PM [follower235-writer-93] [DEBUG] EntryJournalV1 - follower235: updated meta to JournalMeta[replayFrom=1, applyTo=1]
07:49:29,256 PM [follower235-writer-93] [DEBUG] RaftStorageCompleter - follower235: 1 completion(s) pending
07:49:29,256 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: completed 1 commands in 154.5 μs
07:49:29,256 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower235: running 1 completion(s)
07:49:29,256 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: waiting to receive commands
[WARN] [07/01/2025 19:49:29.324] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader234]: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:29,350 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader234: Persist data index=1 term=1 command=one
07:49:29,350 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader234: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 
07:49:29,350 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true
07:49:29,350 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower236: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1
07:49:29,350 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: received 1 commands after 94.21 ms
07:49:29,350 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower235: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
07:49:29,350 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): sendAppendEntries: 1 is present for follower follower235
07:49:29,350 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Sending AppendEntries to follower follower235: AppendEntries{term=1, leaderId=leader234, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]}
07:49:29,350 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader234: awaiting more completions to resolve 1 synchronized callback(s)
07:49:29,350 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower235 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader234, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]}
07:49:29,351 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower235 (Follower): Number of entries to be appended = 1
07:49:29,351 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower235 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
07:49:29,351 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower235 (Follower): Append entry to log one
07:49:29,351 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - follower235: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 
07:49:29,351 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower235 (Follower): Log size is now 2
07:49:29,351 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower235 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower235, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
07:49:29,351 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: received 1 commands after 94.49 ms
07:49:29,351 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 0 (of expected -1)
[WARN] [07/01/2025 19:49:29.351] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader234]: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:29,352 PM [leader234-writer-94] [DEBUG] RaftStorageCompleter - leader234: 1 completion(s) pending
07:49:29,352 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader234: running 1 completion(s)
07:49:29,353 PM [follower235-writer-93] [DEBUG] RaftStorageCompleter - follower235: 1 completion(s) pending
07:49:29,353 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader234: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true}
07:49:29,353 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: completed 1 commands in 1.727 ms
07:49:29,353 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - follower235: running 1 completion(s)
07:49:29,353 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader234: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=1, term=1, command=one, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@17f14600}
07:49:29,353 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower235: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false}
07:49:29,353 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: waiting to receive commands
07:49:29,352 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: completed 1 commands in 2.282 ms
07:49:29,353 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: waiting to receive commands
07:49:29,353 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower235 updated: matchIndex: 1, nextIndex: 2
07:49:29,353 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0
07:49:29,353 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader234 (Leader): Setting last applied to 1
07:49:29,353 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader234: Moving last applied index from 0 to 1
07:49:29,353 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader234: Applying state for log index 1 data one
07:49:29,353 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader234: applyState called: one
07:49:29,353 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower235: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1
07:49:29,353 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: received 1 commands after 331.2 μs
07:49:29,353 PM [leader234-writer-94] [DEBUG] EntryJournalV1 - leader234: updated meta to JournalMeta[replayFrom=1, applyTo=2]
07:49:29,353 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): Commit index set to 1
07:49:29,353 PM [leader234-writer-94] [DEBUG] RaftStorageCompleter - leader234: 1 completion(s) pending
07:49:29,353 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 1 (of expected -1)
07:49:29,353 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
07:49:29,353 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: completed 1 commands in 190.9 μs
07:49:29,353 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower235 (Follower): Setting last applied to 1
07:49:29,353 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: waiting to receive commands
07:49:29,353 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower235: Moving last applied index from 0 to 1
07:49:29,353 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower235: Applying state for log index 1 data one
07:49:29,353 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower235: applyState called: one
07:49:29,353 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: received 1 commands after 866.5 μs
07:49:29,354 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader234: running 1 completion(s)
07:49:29,354 PM [follower235-writer-93] [DEBUG] EntryJournalV1 - follower235: updated meta to JournalMeta[replayFrom=1, applyTo=2]
07:49:29,354 PM [follower235-writer-93] [DEBUG] RaftStorageCompleter - follower235: 1 completion(s) pending
07:49:29,354 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower235: running 1 completion(s)
07:49:29,354 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: completed 1 commands in 154.4 μs
07:49:29,354 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: waiting to receive commands
[WARN] [07/01/2025 19:49:29.445] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader234]: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:29,456 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower236: Starting recovery with journal batch size 1000
07:49:29,456 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower236: started executor
07:49:29,456 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower236: started executor
07:49:29,456 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower236: metadata journal open: replayFrom=1 applyTo=0
07:49:29,457 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower236: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
07:49:29,457 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower236: journal open: applyTo=0
07:49:29,457 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: journal writer started
[WARN] [07/01/2025 19:49:29.457] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower236]: org.opendaylight.controller.cluster.common.actor.Monitor@3ab3459d
07:49:29,457 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: waiting to receive commands
07:49:29,461 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10517959941631667503/follower236/TermInfo.properties does not exist
07:49:29,461 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower236: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10517959941631667503/follower236/journal-v1-1.log
07:49:29,461 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower236: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10517959941631667503/follower236/metadata-v1-1.log
07:49:29,461 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower236: no eligible files found
07:49:29,461 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower236: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
07:49:29,463 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower236: Set currentTerm=0, votedFor=null
07:49:29,463 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower236: Local TermInfo store seeded with TermInfo{term=0}
07:49:29,463 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower236: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@5e7b78b
07:49:29,463 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower236: Moving last applied index from -1 to -1
07:49:29,463 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower236: empty journal: appending 0 entries
07:49:29,463 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower236: updated meta to JournalMeta[replayFrom=1, applyTo=0]
07:49:29,463 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower236: journal recovery completedin 233.4 μs with journalIndex=1
07:49:29,556 PM [test-pekko.actor.default-dispatcher-14] [INFO] PeerInfos - leader234: Peer address for peer follower236 set to pekko://test/user/follower236
07:49:29,556 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader234: Persist data index=2 term=1 command=two
07:49:29,556 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader234: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 
07:49:29,557 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader234 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true
07:49:29,557 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower236: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1
07:49:29,557 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: received 1 commands after 203.4 ms
07:49:29,557 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower235: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1
07:49:29,557 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader234 (Leader): sendAppendEntries: 2 is present for follower follower235
07:49:29,557 PM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower236 (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term
07:49:29,557 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader234 (Leader): Sending AppendEntries to follower follower235: AppendEntries{term=1, leaderId=leader234, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]}
07:49:29,557 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader234: awaiting more completions to resolve 1 synchronized callback(s)
07:49:29,557 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader234, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]}
07:49:29,557 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): Number of entries to be appended = 1
07:49:29,557 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0
07:49:29,557 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): Append entry to log two
07:49:29,557 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower235: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 
07:49:29,557 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): Log size is now 3
07:49:29,557 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower235 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower235, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
07:49:29,557 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 1 (of expected -1)
07:49:29,557 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: received 1 commands after 203.7 ms
07:49:29,559 PM [leader234-writer-94] [DEBUG] RaftStorageCompleter - leader234: 1 completion(s) pending
07:49:29,559 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader234: running 1 completion(s)
07:49:29,559 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: completed 1 commands in 2.284 ms
07:49:29,559 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader234: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true}
07:49:29,559 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: waiting to receive commands
07:49:29,559 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - leader234: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=2, term=1, command=two, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@23c48635}
07:49:29,559 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader234 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower235 updated: matchIndex: 2, nextIndex: 3
07:49:29,559 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader234 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1
07:49:29,559 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - leader234 (Leader): Setting last applied to 2
07:49:29,559 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - leader234: Moving last applied index from 1 to 2
07:49:29,559 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader234: Applying state for log index 2 data two
07:49:29,559 PM [test-pekko.actor.default-dispatcher-14] [INFO] MockRaftActor - leader234: applyState called: two
07:49:29,560 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower235: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: -1
07:49:29,560 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: received 1 commands after 593.7 μs
07:49:29,560 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower235 (Follower): Commit index set to 2
07:49:29,560 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:29,560 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower235 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): 1, lastIndex(): 2
07:49:29,560 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower235 (Follower): Setting last applied to 2
07:49:29,560 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - follower235: Moving last applied index from 1 to 2
07:49:29,560 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower235: Applying state for log index 2 data two
07:49:29,560 PM [test-pekko.actor.default-dispatcher-14] [INFO] MockRaftActor - follower235: applyState called: two
07:49:29,560 PM [leader234-writer-94] [DEBUG] EntryJournalV1 - leader234: updated meta to JournalMeta[replayFrom=1, applyTo=3]
07:49:29,560 PM [leader234-writer-94] [DEBUG] RaftStorageCompleter - leader234: 1 completion(s) pending
07:49:29,560 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader234: running 1 completion(s)
07:49:29,560 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: completed 1 commands in 238.3 μs
07:49:29,560 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: waiting to receive commands
07:49:29,560 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower236: Set currentTerm=1, votedFor=null
07:49:29,560 PM [follower235-writer-93] [DEBUG] RaftStorageCompleter - follower235: 1 completion(s) pending
07:49:29,560 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower236: Last sync leader does not match current leader leader234, need to catch up to -1
07:49:29,560 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: completed 1 commands in 2.611 ms
07:49:29,560 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: received 1 commands after 4.550 μs
07:49:29,560 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader234 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower236 updated: matchIndex: -1, nextIndex: 0
07:49:29,560 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower236: active: true, followerNextIndex: 0, leaderLastIndex: 2, leaderSnapShotIndex: -1
07:49:29,560 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader234 (Leader): sendAppendEntries: 0 is present for follower follower236
07:49:29,560 PM [follower235-writer-93] [DEBUG] EntryJournalV1 - follower235: updated meta to JournalMeta[replayFrom=1, applyTo=3]
07:49:29,560 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader234 (Leader): Sending AppendEntries to follower follower236: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=false}, JournaledLogEntry{index=1, term=1, command=one, pending=false}, JournaledLogEntry{index=2, term=1, command=two, pending=false}]}
07:49:29,560 PM [follower235-writer-93] [DEBUG] RaftStorageCompleter - follower235: 1 more completion(s) pending
07:49:29,560 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: completed 1 commands in 148.4 μs
07:49:29,560 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: waiting to receive commands
[WARN] [07/01/2025 19:49:29.560] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower236] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower236, initialSyncDone=false]
07:49:29,561 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - follower235: running 2 completion(s)
07:49:29,561 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - follower235: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false}
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower236 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader234, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=false}, JournaledLogEntry{index=1, term=1, command=one, pending=false}, JournaledLogEntry{index=2, term=1, command=two, pending=false}]}
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower236 (Follower): Number of entries to be appended = 3
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower236 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower236 (Follower): Append entry to log zero
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower236: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=false} 
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower236 (Follower): Append entry to log one
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower236: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=false} 
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower236 (Follower): Append entry to log two
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower236: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=false} 
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower236 (Follower): Log size is now 3
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower236 (Follower): Commit index set to 2
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower236 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower236, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower236 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): -1, lastIndex(): 2
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower236 (Follower): Setting last applied to 0
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower236: Moving last applied index from -1 to 0
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower236: Applying state for log index 0 data zero
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower236: applyState called: zero
07:49:29,561 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: received 3 commands after 103.7 ms
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower236 (Follower): Setting last applied to 1
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower236: Moving last applied index from 0 to 1
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower236: Applying state for log index 1 data one
07:49:29,561 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader234 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower236 updated: matchIndex: 2, nextIndex: 3
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower236: applyState called: one
07:49:29,561 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SnapshotManager - leader234: fakeSnapshot purging log to 1 for term 1
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower236 (Follower): Setting last applied to 2
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower236: Moving last applied index from 1 to 2
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower236: Applying state for log index 2 data two
07:49:29,561 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower236: applyState called: two
07:49:29,561 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader234 (Leader): Checking sendAppendEntries for follower follower236: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: 1
[WARN] [07/01/2025 19:49:29.561] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/follower236] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower236, initialSyncDone=true]
07:49:29,567 PM [follower236-writer-95] [DEBUG] RaftStorageCompleter - follower236: 3 completion(s) pending
07:49:29,567 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: completed 3 commands in 5.779 ms
07:49:29,567 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - follower236: running 3 completion(s)
07:49:29,567 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: received 1 commands after 3.410 μs
07:49:29,567 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - follower236: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false}
07:49:29,567 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - follower236: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false}
07:49:29,567 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - follower236: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false}
07:49:29,567 PM [follower236-writer-95] [DEBUG] EntryJournalV1 - follower236: updated meta to JournalMeta[replayFrom=1, applyTo=3]
07:49:29,567 PM [follower236-writer-95] [DEBUG] RaftStorageCompleter - follower236: 1 completion(s) pending
07:49:29,567 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: completed 1 commands in 168.1 μs
07:49:29,567 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorageCompleter - follower236: running 1 completion(s)
07:49:29,567 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: waiting to receive commands
07:49:29,685 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:29,685 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SnapshotManager - follower235: fakeSnapshot purging log to 1 for term 1
07:49:29,685 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:29,685 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - follower236: fakeSnapshot purging log to 1 for term 1
07:49:29,770 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - follower236: terminating thread VirtualThread[#638,follower236-writer-95]/waiting
07:49:29,773 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: received 1 commands after 205.7 ms
07:49:29,773 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: completed 1 commands in 50.25 μs
07:49:29,773 PM [follower236-writer-95] [DEBUG] JournalWriteTask - follower236: journal writer stopped
07:49:29,773 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower236: journal closed
07:49:29,773 PM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - follower236: journal closed
07:49:29,773 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower236: stopped executor with 0 remaining tasks
07:49:29,773 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower236: stopped executor with 0 remaining tasks
[WARN] [07/01/2025 19:49:29.776] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower236]: org.opendaylight.controller.cluster.common.actor.Monitor@1db14512
07:49:29,777 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - follower236: Starting recovery with journal batch size 1000
07:49:29,777 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower236: started executor
07:49:29,777 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower236: started executor
07:49:29,778 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower236: metadata journal open: replayFrom=1 applyTo=3
07:49:29,779 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower236: journal open: firstIndex=1 lastIndex=3 replayFrom=1 fileEntries=0
07:49:29,780 PM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - follower236: journal open: applyTo=3
07:49:29,780 PM [follower236-writer-96] [DEBUG] JournalWriteTask - follower236: journal writer started
07:49:29,780 PM [follower236-writer-96] [DEBUG] JournalWriteTask - follower236: waiting to receive commands
07:49:29,784 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower236: Set currentTerm=1, votedFor=null
07:49:29,784 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower236: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10517959941631667503/follower236/TermInfo.properties
07:49:29,784 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower236: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10517959941631667503/follower236/journal-v1-1.log
07:49:29,784 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower236: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10517959941631667503/follower236/metadata-v1-1.log
07:49:29,784 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower236: no eligible files found
07:49:29,784 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower236: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
07:49:29,784 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - follower236: restoring local TermInfo{term=1}
07:49:29,784 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower236: Set currentTerm=1, votedFor=null
07:49:29,784 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower236: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@55f95896
07:49:29,784 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower236: Moving last applied index from -1 to -1
07:49:29,785 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower236: applying entries up to 3
07:49:29,785 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower236: recovered journal DefaultLogEntry[index=0, term=1, command=zero]
07:49:29,785 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower236: recovered journal DefaultLogEntry[index=1, term=1, command=one]
07:49:29,785 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower236: recovered journal DefaultLogEntry[index=2, term=1, command=two]
07:49:29,785 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower236: Moving last applied index from -1 to 2
07:49:29,786 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower236: journal recovery completedin 1.179 ms with journalIndex=1
07:49:29,805 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:29,805 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower236: Last sync leader does not match current leader leader234, need to catch up to 2
07:49:29,805 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - follower236: fakeSnapshot purging log to 1 for term 1
[WARN] [07/01/2025 19:49:29.806] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/follower236] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower236, initialSyncDone=false]
07:49:29,876 PM [test-pekko.actor.default-dispatcher-14] [INFO] PeerInfos - leader234: Peer address for peer follower236 set to pekko://test/user/follower236
07:49:29,925 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:29,925 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
[WARN] [07/01/2025 19:49:29.925] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower236] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower236, initialSyncDone=true]
07:49:30,45 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:30,45 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:30,165 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:30,165 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:30,285 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:30,285 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:30,405 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:30,405 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:30,525 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:30,525 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:30,645 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:30,645 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:30,765 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:30,765 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:30,885 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:30,885 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:31,5 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:31,5 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:31,125 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:31,125 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:31,245 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:31,245 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:31,365 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:31,365 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:31,485 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:31,485 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:31,595 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:31,595 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:31,715 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:31,715 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:31,836 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:31,836 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:31,954 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:31,954 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:32,65 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:32,66 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:32,185 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:32,186 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:32,305 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:32,305 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:32,425 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:32,425 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:32,544 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:32,544 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:32,665 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:32,665 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:32,785 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:32,785 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:32,905 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:32,905 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:33,25 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:33,25 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:33,144 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:33,144 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:33,265 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:33,265 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:33,385 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:33,385 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:33,505 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:33,505 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:33,625 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:33,625 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:33,745 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:33,745 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:33,865 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:33,866 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:33,985 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:33,985 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:34,105 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:34,105 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:34,225 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:34,225 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:34,346 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:34,346 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:34,465 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:34,465 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:34,575 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:34,575 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:34,695 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:34,696 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:34,815 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower235: Lagging 0 entries behind leader leader234 and reached 2 (of expected -1)
07:49:34,815 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower236: Lagging 0 entries behind leader leader234 and reached 2 (of expected 2)
07:49:34,911 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower235-collector237#-164283882]
07:49:34,914 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower235]
07:49:34,914 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - follower235: terminating thread VirtualThread[#634,follower235-writer-93]/waiting
07:49:34,914 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: received 1 commands after 5.354 s
07:49:34,914 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: completed 1 commands in 62.36 μs
07:49:34,914 PM [follower235-writer-93] [DEBUG] JournalWriteTask - follower235: journal writer stopped
07:49:34,915 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower235: journal closed
07:49:34,915 PM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - follower235: journal closed
07:49:34,915 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower235: stopped executor with 0 remaining tasks
07:49:34,915 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower235: stopped executor with 0 remaining tasks
07:49:34,915 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader234-collector238#-2023499104]
07:49:34,915 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader234]
07:49:34,915 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - leader234: terminating thread VirtualThread[#635,leader234-writer-94]/waiting
07:49:34,916 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: received 1 commands after 5.356 s
07:49:34,916 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: completed 1 commands in 20.96 μs
07:49:34,916 PM [leader234-writer-94] [DEBUG] JournalWriteTask - leader234: journal writer stopped
07:49:34,916 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader234: journal closed
07:49:34,916 PM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader234: journal closed
07:49:34,916 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader234: stopped executor with 0 remaining tasks
07:49:34,916 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader234: stopped executor with 0 remaining tasks
07:49:34,916 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower236-collector239#1882499294]
07:49:34,917 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower236]
07:49:34,917 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower236-collector240#1507599193]
07:49:34,917 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower236]
07:49:34,917 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - follower236: terminating thread VirtualThread[#642,follower236-writer-96]/waiting
07:49:34,917 PM [follower236-writer-96] [DEBUG] JournalWriteTask - follower236: received 1 commands after 5.137 s
07:49:34,917 PM [follower236-writer-96] [DEBUG] JournalWriteTask - follower236: completed 1 commands in 20.45 μs
07:49:34,917 PM [follower236-writer-96] [DEBUG] JournalWriteTask - follower236: journal writer stopped
07:49:34,918 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower236: journal closed
07:49:34,918 PM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - follower236: journal closed
07:49:34,918 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower236: stopped executor with 0 remaining tasks
07:49:34,918 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower236: stopped executor with 0 remaining tasks
[WARN] [07/01/2025 19:49:34.927] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower242]: org.opendaylight.controller.cluster.common.actor.Monitor@1376a8d4
07:49:34,928 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - follower242: Starting recovery with journal batch size 1000
07:49:34,928 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower242: started executor
07:49:34,928 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower242: started executor
07:49:34,929 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower242: metadata journal open: replayFrom=1 applyTo=0
07:49:34,929 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower242: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
07:49:34,929 PM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - follower242: journal open: applyTo=0
07:49:34,929 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: journal writer started
07:49:34,929 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: waiting to receive commands
07:49:34,931 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/follower242/TermInfo.properties does not exist
07:49:34,931 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower242: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/follower242/journal-v1-1.log
07:49:34,931 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower242: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/follower242/metadata-v1-1.log
07:49:34,931 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower242: no eligible files found
07:49:34,931 PM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower242: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [07/01/2025 19:49:34.932] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader241]: org.opendaylight.controller.cluster.common.actor.Monitor@501ec49d
07:49:34,933 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - leader241: Starting recovery with journal batch size 1000
07:49:34,933 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader241: started executor
07:49:34,933 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader241: started executor
07:49:34,933 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader241: metadata journal open: replayFrom=1 applyTo=0
07:49:34,934 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader241: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
07:49:34,934 PM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader241: journal open: applyTo=0
07:49:34,934 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: journal writer started
07:49:34,934 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
07:49:34,935 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/leader241/TermInfo.properties does not exist
07:49:34,935 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader241: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/leader241/journal-v1-1.log
07:49:34,935 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader241: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/leader241/metadata-v1-1.log
07:49:34,935 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader241: no eligible files found
07:49:34,935 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader241: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
07:49:34,936 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower242: Set currentTerm=0, votedFor=null
07:49:34,936 PM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower242: Local TermInfo store seeded with TermInfo{term=0}
07:49:34,936 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower242: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@524ba2ef
07:49:34,936 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower242: Moving last applied index from -1 to -1
07:49:34,936 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - follower242: empty journal: appending 0 entries
07:49:34,937 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower242: updated meta to JournalMeta[replayFrom=1, applyTo=0]
07:49:34,937 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - follower242: journal recovery completedin 872.2 μs with journalIndex=1
07:49:34,939 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader241: Set currentTerm=0, votedFor=null
07:49:34,939 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader241: Local TermInfo store seeded with TermInfo{term=0}
07:49:34,939 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader241: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@74513aab
07:49:34,939 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - leader241: Moving last applied index from -1 to -1
07:49:34,939 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - leader241: empty journal: appending 0 entries
07:49:34,939 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader241: updated meta to JournalMeta[replayFrom=1, applyTo=0]
07:49:34,939 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - leader241: journal recovery completedin 411.4 μs with journalIndex=1
07:49:35,424 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
07:49:35,425 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - leader241 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.142:17355, Removed)
07:49:35,425 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - leader241 (Follower): Received ElectionTimeout - switching to Candidate
07:49:35,425 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader241 (Candidate): Election: Candidate has following voting peers: [follower243, follower242]
07:49:35,430 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader241: Set currentTerm=1, votedFor=leader241
07:49:35,430 PM [test-pekko.actor.default-dispatcher-18] [INFO] Candidate - leader241 (Candidate): Starting new election term 1
07:49:35,430 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader241 (Candidate): Sending RequestVote{term=1, candidateId=leader241, lastLogIndex=-1, lastLogTerm=-1} to peer follower243
07:49:35,430 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader241 (Candidate): Sending RequestVote{term=1, candidateId=leader241, lastLogIndex=-1, lastLogTerm=-1} to peer follower242
07:49:35,430 PM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader241 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
[WARN] [07/01/2025 19:49:35.431] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: RequestVote{term=1, candidateId=leader241, lastLogIndex=-1, lastLogTerm=-1}
07:49:35,431 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower242 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
07:49:35,431 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower242 (Follower): Cluster state: []
07:49:35,431 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower242 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader241, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term.
07:49:35,431 PM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - follower242 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader241, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term
07:49:35,434 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower242: Set currentTerm=1, votedFor=null
07:49:35,435 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower242 (Follower): In requestVote: RequestVote{term=1, candidateId=leader241, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1
07:49:35,437 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower242: Set currentTerm=1, votedFor=leader241
07:49:35,437 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower242 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true}
07:49:35,437 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader241 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1
07:49:35,437 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader241 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1
07:49:35,437 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader241 (Leader): Election: Leader has following peers: [follower243, follower242]
07:49:35,438 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower243: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
07:49:35,438 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
07:49:35,438 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader241 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
07:49:35,438 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower242: Last sync leader does not match current leader leader241, need to catch up to -1
[WARN] [07/01/2025 19:49:35.438] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:35,438 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader241 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower242 updated: matchIndex: -1, nextIndex: 0
[WARN] [07/01/2025 19:49:35.438] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower242] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower242, initialSyncDone=false]
07:49:35,438 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
07:49:35,444 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader241: Persist data index=0 term=1 command=zero
07:49:35,444 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader241: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 
07:49:35,444 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader241 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true
07:49:35,444 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower243: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
07:49:35,444 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 510.7 ms
07:49:35,445 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
07:49:35,445 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader241 (Leader): sendAppendEntries: 0 is present for follower follower242
07:49:35,445 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader241 (Leader): Sending AppendEntries to follower follower242: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]}
07:49:35,445 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - leader241: awaiting more completions to resolve 1 synchronized callback(s)
07:49:35,445 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower242 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]}
07:49:35,445 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower242 (Follower): Number of entries to be appended = 1
07:49:35,445 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower242 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
07:49:35,445 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower242 (Follower): Append entry to log zero
07:49:35,445 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower242: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 
07:49:35,445 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower242 (Follower): Log size is now 1
07:49:35,445 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower242 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower242, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
07:49:35,445 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower242: Lagging 0 entries behind leader leader241 and reached -1 (of expected -1)
[WARN] [07/01/2025 19:49:35.445] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:35,445 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: received 1 commands after 515.9 ms
[WARN] [07/01/2025 19:49:35.445] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower242] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower242, initialSyncDone=true]
07:49:35,451 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
07:49:35,451 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
07:49:35,451 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 6.682 ms
07:49:35,451 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader241: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true}
07:49:35,451 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
07:49:35,451 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - leader241: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@1f7cf0a8}
07:49:35,451 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader241 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower242 updated: matchIndex: 0, nextIndex: 1
07:49:35,451 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader241 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
07:49:35,451 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader241 (Leader): Setting last applied to 0
07:49:35,451 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader241: Moving last applied index from -1 to 0
07:49:35,452 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader241: Applying state for log index 0 data zero
07:49:35,452 PM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader241: applyState called: zero
07:49:35,452 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
07:49:35,452 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 483.2 μs
07:49:35,452 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower242 (Follower): Commit index set to 0
07:49:35,452 PM [leader241-writer-98] [DEBUG] EntryJournalV1 - leader241: updated meta to JournalMeta[replayFrom=1, applyTo=1]
07:49:35,452 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
07:49:35,452 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 336.2 μs
07:49:35,452 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
07:49:35,452 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
07:49:35,452 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower242: Lagging 0 entries behind leader leader241 and reached 0 (of expected -1)
07:49:35,452 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower242 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
07:49:35,452 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower242 (Follower): Setting last applied to 0
07:49:35,452 PM [follower242-writer-97] [DEBUG] RaftStorageCompleter - follower242: 1 completion(s) pending
07:49:35,452 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - follower242: Moving last applied index from -1 to 0
07:49:35,452 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower242: Applying state for log index 0 data zero
07:49:35,452 PM [test-pekko.actor.default-dispatcher-7] [INFO] MockRaftActor - follower242: applyState called: zero
07:49:35,452 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: completed 1 commands in 6.976 ms
07:49:35,452 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: waiting to receive commands
07:49:35,453 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: received 1 commands after 271.5 μs
07:49:35,453 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - follower242: running 1 completion(s)
07:49:35,453 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - follower242: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false}
07:49:35,453 PM [follower242-writer-97] [DEBUG] EntryJournalV1 - follower242: updated meta to JournalMeta[replayFrom=1, applyTo=1]
07:49:35,453 PM [follower242-writer-97] [DEBUG] RaftStorageCompleter - follower242: 1 completion(s) pending
07:49:35,453 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: completed 1 commands in 183.5 μs
07:49:35,453 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: waiting to receive commands
07:49:35,453 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - follower242: running 1 completion(s)
07:49:35,546 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader241: Persist data index=1 term=1 command=one
07:49:35,546 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader241: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 
07:49:35,546 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader241 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true
07:49:35,547 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 94.36 ms
07:49:35,547 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower243: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1
[WARN] [07/01/2025 19:49:35.547] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:35,547 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
07:49:35,547 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader241 (Leader): sendAppendEntries: 1 is present for follower follower242
07:49:35,547 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader241 (Leader): Sending AppendEntries to follower follower242: AppendEntries{term=1, leaderId=leader241, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]}
07:49:35,547 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower242 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader241, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]}
07:49:35,547 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower242 (Follower): Number of entries to be appended = 1
07:49:35,547 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower242 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
07:49:35,547 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower242 (Follower): Append entry to log one
07:49:35,547 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower242: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 
07:49:35,548 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower242 (Follower): Log size is now 2
07:49:35,548 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower242 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower242, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
07:49:35,548 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower242: Lagging 0 entries behind leader leader241 and reached 0 (of expected -1)
07:49:35,548 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: received 1 commands after 94.74 ms
07:49:35,548 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader241: awaiting more completions to resolve 1 synchronized callback(s)
07:49:35,549 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
07:49:35,549 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
07:49:35,549 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 2.039 ms
07:49:35,549 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
07:49:35,549 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader241: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true}
07:49:35,549 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader241: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=1, term=1, command=one, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@13f333df}
07:49:35,549 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader241 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower242 updated: matchIndex: 1, nextIndex: 2
07:49:35,549 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader241 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0
07:49:35,549 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - leader241 (Leader): Setting last applied to 1
07:49:35,549 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - leader241: Moving last applied index from 0 to 1
07:49:35,549 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader241: Applying state for log index 1 data one
07:49:35,549 PM [test-pekko.actor.default-dispatcher-7] [INFO] MockRaftActor - leader241: applyState called: one
07:49:35,549 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1
07:49:35,549 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 475.1 μs
07:49:35,549 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower242 (Follower): Commit index set to 1
07:49:35,549 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower242: Lagging 0 entries behind leader leader241 and reached 1 (of expected -1)
07:49:35,549 PM [leader241-writer-98] [DEBUG] EntryJournalV1 - leader241: updated meta to JournalMeta[replayFrom=1, applyTo=2]
07:49:35,549 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower242 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
07:49:35,549 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower242 (Follower): Setting last applied to 1
07:49:35,549 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
07:49:35,549 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - follower242: Moving last applied index from 0 to 1
07:49:35,549 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower242: Applying state for log index 1 data one
07:49:35,549 PM [test-pekko.actor.default-dispatcher-7] [INFO] MockRaftActor - follower242: applyState called: one
07:49:35,549 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 282.3 μs
07:49:35,550 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
07:49:35,550 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
07:49:35,550 PM [follower242-writer-97] [DEBUG] RaftStorageCompleter - follower242: 1 completion(s) pending
07:49:35,550 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - follower242: running 1 completion(s)
07:49:35,550 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - follower242: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false}
07:49:35,550 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: completed 1 commands in 2.003 ms
07:49:35,550 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: received 1 commands after 6.110 μs
07:49:35,550 PM [follower242-writer-97] [DEBUG] EntryJournalV1 - follower242: updated meta to JournalMeta[replayFrom=1, applyTo=2]
07:49:35,550 PM [follower242-writer-97] [DEBUG] RaftStorageCompleter - follower242: 1 completion(s) pending
07:49:35,550 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: completed 1 commands in 361.2 μs
07:49:35,550 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: waiting to receive commands
07:49:35,552 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - follower242: running 1 completion(s)
[WARN] [07/01/2025 19:49:35.554] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:35,649 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader241: Persist data index=2 term=1 command=two
07:49:35,649 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader241: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 
07:49:35,649 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader241 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true
07:49:35,649 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 99.26 ms
07:49:35,649 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower243: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1
07:49:35,649 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1
07:49:35,649 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader241 (Leader): sendAppendEntries: 2 is present for follower follower242
07:49:35,649 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader241 (Leader): Sending AppendEntries to follower follower242: AppendEntries{term=1, leaderId=leader241, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]}
07:49:35,649 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader241: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 19:49:35.649] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:35,652 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
07:49:35,652 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
07:49:35,652 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 2.884 ms
07:49:35,652 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
07:49:35,652 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader241: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true}
07:49:35,652 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader241: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=2, term=1, command=two, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@70a535b0}
07:49:35,652 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader241: Persist data index=3 term=1 command=three
07:49:35,652 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader241: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 
07:49:35,652 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader241 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true
07:49:35,652 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower243: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1
07:49:35,652 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 248.2 μs
07:49:35,652 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1
07:49:35,652 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader241 (Leader): sendAppendEntries: 2 is present for follower follower242
07:49:35,652 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader241: awaiting more completions to resolve 1 synchronized callback(s)
[WARN] [07/01/2025 19:49:35.652] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:35,653 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
07:49:35,653 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 1.244 ms
07:49:35,653 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
07:49:35,653 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
07:49:35,653 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader241: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true}
07:49:35,653 PM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader241: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=2, mandatoryTrim=false]
07:49:35,654 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - leader241: captured snapshot at lastSequenceNumber: 2
07:49:35,654 PM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader241: Persising snapshot at EntryInfo[index=1, term=1]/EntryInfo[index=3, term=1]
07:49:35,654 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader241: support() called
07:49:35,654 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - leader241: log size 4 exceeds the snapshot batch count 4 - doing snapshotPreCommit with index 1
07:49:35,654 PM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader241: Removed in-memory snapshotted entries, adjusted snaphsotIndex: 1 and term: 1
07:49:35,654 PM [leader241-%d227534] [DEBUG] RaftStorage - leader241: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/leader241/snapshot-0000000068643BCF-2705D3E6.tmp
07:49:35,654 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader241: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=3, term=1, command=three, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@4e5bca56}
07:49:35,656 PM [leader241-%d227534] [DEBUG] RaftStorage - leader241: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/leader241/snapshot-0000000068643BCF-2705D3E6.v1
07:49:35,657 PM [leader241-%d227534] [DEBUG] RaftStorage - leader241: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/leader241/snapshot-0000000068643BCF-2705D3E6.v1
07:49:35,657 PM [leader241-%d227534] [DEBUG] RaftStorage - leader241: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/leader241/TermInfo.properties
07:49:35,657 PM [leader241-%d227534] [DEBUG] RaftStorage - leader241: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/leader241/journal-v1-1.log
07:49:35,657 PM [leader241-%d227534] [DEBUG] RaftStorage - leader241: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/leader241/metadata-v1-1.log
07:49:35,657 PM [leader241-%d227534] [DEBUG] RaftStorage - leader241: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=1, term=1], timestamp=2025-07-01T19:49:35.654693350Z, file=/tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/leader241/snapshot-0000000068643BCF-2705D3E6.v1, size=358, entryCompress=NONE, stateCompress=NONE}
07:49:35,657 PM [leader241-%d227534] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
07:49:35,657 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
07:49:35,675 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader241 (Leader): sendAppendEntries: 2 is present for follower follower242
[WARN] [07/01/2025 19:49:35.675] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:35,795 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader241 (Leader): sendAppendEntries: 2 is present for follower follower242
07:49:35,795 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader241 (Leader): Sending AppendEntries to follower follower242: AppendEntries{term=1, leaderId=leader241, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}]}
[WARN] [07/01/2025 19:49:35.796] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:35,915 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader241 (Leader): sendAppendEntries: 2 is present for follower follower242
07:49:35,915 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader241 (Leader): Sending AppendEntries to follower follower242: AppendEntries{term=1, leaderId=leader241, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}]}
[WARN] [07/01/2025 19:49:35.915] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:35,951 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader241: Persist data index=4 term=1 command=four
07:49:35,951 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader241: Append log entry and persist JournaledLogEntry{index=4, term=1, command=four, pending=true} 
07:49:35,951 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 297.6 ms
07:49:35,951 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader241 (Leader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 4, isSendImmediate: true
07:49:35,952 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower243: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: 1
[WARN] [07/01/2025 19:49:35.952] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:35,952 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: false, followerNextIndex: 2, leaderLastIndex: 4, leaderSnapShotIndex: 1
07:49:35,952 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower242: Lagging -2 entries behind leader leader241 and reached 1 (of expected -1)
07:49:35,952 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader241: awaiting more completions to resolve 1 synchronized callback(s)
07:49:35,955 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
07:49:35,955 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
07:49:35,955 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 4.066 ms
07:49:35,955 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
07:49:35,955 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader241: persist complete JournaledLogEntry{index=4, term=1, command=four, pending=true}
07:49:35,955 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader241: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=4, term=1, command=four, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c087e6f8@687324c2}
07:49:35,955 PM [test-pekko.actor.default-dispatcher-7] [WARN] AbstractLeader - leader241 (Leader) : handleAppendEntriesReply delayed beyond election timeout, appendEntriesReply : AppendEntriesReply{term=1, success=true, followerId=follower242, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}, timeSinceLastActivity : 405, lastApplied : 1, commitIndex : 1
07:49:35,955 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader241 (Leader): sendAppendEntries: 2 is present for follower follower242
07:49:35,955 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader241 (Leader): Sending AppendEntries to follower follower242: AppendEntries{term=1, leaderId=leader241, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=1, command=four, pending=false}]}
07:49:35,956 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower242 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader241, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=1, command=four, pending=false}]}
07:49:35,956 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower242 (Follower): Number of entries to be appended = 3
07:49:35,956 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower242 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0
07:49:35,956 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower242 (Follower): Append entry to log two
07:49:35,956 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower242: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=false} 
07:49:35,957 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower242 (Follower): Append entry to log three
07:49:35,957 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower242: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=false} 
07:49:35,957 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower242 (Follower): Append entry to log four
07:49:35,957 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower242: Append log entry and persist JournaledLogEntry{index=4, term=1, command=four, pending=false} 
07:49:35,957 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: received 1 commands after 406.4 ms
07:49:35,957 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower242 (Follower): Log size is now 5
07:49:35,957 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower242 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower242, logLastIndex=4, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
07:49:35,957 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower242: Lagging 0 entries behind leader leader241 and reached 1 (of expected -1)
07:49:35,957 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader241 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower242 updated: matchIndex: 4, nextIndex: 5
07:49:35,957 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader241 (Leader): Applying to log - commitIndex: 4, lastAppliedIndex: 1
07:49:35,957 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - leader241 (Leader): Setting last applied to 2
07:49:35,958 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - leader241: Moving last applied index from 1 to 2
07:49:35,958 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader241: Applying state for log index 2 data two
07:49:35,958 PM [test-pekko.actor.default-dispatcher-7] [INFO] MockRaftActor - leader241: applyState called: two
07:49:35,958 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - leader241 (Leader): Setting last applied to 3
07:49:35,958 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - leader241: Moving last applied index from 2 to 3
07:49:35,958 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader241: Applying state for log index 3 data three
07:49:35,958 PM [test-pekko.actor.default-dispatcher-7] [INFO] MockRaftActor - leader241: applyState called: three
07:49:35,959 PM [follower242-writer-97] [DEBUG] RaftStorageCompleter - follower242: 1 completion(s) pending
07:49:35,959 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: completed 1 commands in 1.965 ms
07:49:35,959 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - follower242: running 1 completion(s)
07:49:35,959 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: received 2 commands after 6.930 μs
07:49:35,959 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower242: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false}
07:49:35,959 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - leader241 (Leader): Setting last applied to 4
07:49:35,960 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - leader241: Moving last applied index from 3 to 4
07:49:35,960 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader241: Applying state for log index 4 data four
07:49:35,960 PM [test-pekko.actor.default-dispatcher-7] [INFO] MockRaftActor - leader241: applyState called: four
07:49:35,960 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 5.296 ms
07:49:35,961 PM [follower242-writer-97] [DEBUG] RaftStorageCompleter - follower242: 2 completion(s) pending
07:49:35,961 PM [leader241-writer-98] [DEBUG] EntryJournalV1 - leader241: updated meta to JournalMeta[replayFrom=1, applyTo=5]
07:49:35,961 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: completed 2 commands in 1.990 ms
07:49:35,961 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - follower242: running 2 completion(s)
07:49:35,961 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: waiting to receive commands
07:49:35,961 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
07:49:35,961 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower242: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=false}
07:49:35,961 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower242: persist complete JournaledLogEntry{index=4, term=1, command=four, pending=false}
07:49:35,961 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 413.1 μs
07:49:35,961 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
07:49:35,961 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader241 (Leader): Checking sendAppendEntries for follower follower242: active: true, followerNextIndex: 5, leaderLastIndex: 4, leaderSnapShotIndex: 1
07:49:35,961 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower242 (Follower): Commit index set to 4
07:49:35,961 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower242: Lagging 0 entries behind leader leader241 and reached 4 (of expected -1)
07:49:35,961 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower242 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 4, context.getLastApplied(): 1, lastIndex(): 4
07:49:35,961 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower242 (Follower): Setting last applied to 2
07:49:35,961 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower242: Moving last applied index from 1 to 2
07:49:35,961 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower242: Applying state for log index 2 data two
07:49:35,961 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower242: applyState called: two
07:49:35,962 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower242 (Follower): Setting last applied to 3
07:49:35,962 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower242: Moving last applied index from 2 to 3
07:49:35,962 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower242: Applying state for log index 3 data three
07:49:35,962 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower242: applyState called: three
07:49:35,962 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower242 (Follower): Setting last applied to 4
07:49:35,962 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower242: Moving last applied index from 3 to 4
07:49:35,962 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower242: Applying state for log index 4 data four
07:49:35,962 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower242: applyState called: four
07:49:35,962 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: received 1 commands after 1.069 ms
07:49:35,962 PM [follower242-writer-97] [DEBUG] EntryJournalV1 - follower242: updated meta to JournalMeta[replayFrom=1, applyTo=5]
07:49:35,962 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
07:49:35,962 PM [follower242-writer-97] [DEBUG] RaftStorageCompleter - follower242: 1 completion(s) pending
07:49:35,962 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: completed 1 commands in 179.9 μs
07:49:35,962 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: waiting to receive commands
07:49:35,962 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - follower242: running 1 completion(s)
[WARN] [07/01/2025 19:49:36.034] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:36,154 PM [main] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
07:49:36,154 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
07:49:36,154 PM [test-pekko.actor.default-dispatcher-18] [INFO] SnapshotManager - leader241: snapshot is durable as of 2025-07-01T19:49:35.654693350Z
07:49:36,154 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - leader241: Snapshot success with first journal index 3
07:49:36,154 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 193.5 ms
07:49:36,155 PM [leader241-writer-98] [DEBUG] EntryJournalV1 - leader241: updated meta to JournalMeta[replayFrom=3, applyTo=5]
07:49:36,155 PM [leader241-writer-98] [DEBUG] RaftStorageCompleter - leader241: 1 completion(s) pending
07:49:36,155 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 385.7 μs
07:49:36,155 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
07:49:36,155 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - leader241: running 1 completion(s)
07:49:36,156 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorSnapshotMessageSupport - leader241: SnapshotComplete received
07:49:36,156 PM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower242: Lagging 0 entries behind leader leader241 and reached 4 (of expected -1)
[WARN] [07/01/2025 19:49:36.156] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader241]: AppendEntries{term=1, leaderId=leader241, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
07:49:36,157 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRaftStorage - leader241: terminating thread VirtualThread[#644,leader241-writer-98]/waiting
07:49:36,157 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: received 1 commands after 1.978 ms
07:49:36,157 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 23.56 μs
07:49:36,157 PM [leader241-writer-98] [DEBUG] JournalWriteTask - leader241: journal writer stopped
07:49:36,157 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader241: journal closed
07:49:36,157 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - leader241: journal closed
07:49:36,157 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader241: stopped executor with 0 remaining tasks
07:49:36,157 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader241: stopped executor with 0 remaining tasks
07:49:36,160 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - leader241: Starting recovery with journal batch size 1000
07:49:36,160 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader241: started executor
07:49:36,160 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader241: started executor
[WARN] [07/01/2025 19:49:36.161] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader241]: org.opendaylight.controller.cluster.common.actor.Monitor@2fc5279f
07:49:36,161 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader241: metadata journal open: replayFrom=3 applyTo=5
07:49:36,162 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader241: journal open: firstIndex=1 lastIndex=5 replayFrom=3 fileEntries=0
07:49:36,162 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - leader241: journal open: applyTo=5
07:49:36,163 PM [leader241-writer-99] [DEBUG] JournalWriteTask - leader241: journal writer started
07:49:36,163 PM [leader241-writer-99] [DEBUG] JournalWriteTask - leader241: waiting to receive commands
07:49:36,164 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader241: Set currentTerm=1, votedFor=leader241
07:49:36,164 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader241: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/leader241/snapshot-0000000068643BCF-2705D3E6.v1
07:49:36,164 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader241: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/leader241/TermInfo.properties
07:49:36,164 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader241: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/leader241/journal-v1-1.log
07:49:36,164 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader241: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/leader241/metadata-v1-1.log
07:49:36,165 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader241: picked SnapshotFileV1{lastIncluded=EntryInfo[index=1, term=1], timestamp=2025-07-01T19:49:35.654693350Z, file=/tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8445231922700960503/leader241/snapshot-0000000068643BCF-2705D3E6.v1, size=358, entryCompress=NONE, stateCompress=NONE} as the latest file
07:49:36,165 PM [test-pekko.actor.default-dispatcher-7] [INFO] MockRaftActor - leader241: support() called
07:49:36,166 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRecovery - leader241: initializing from snapshot taken at 2025-07-01T19:49:35.654693350Z
07:49:36,166 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader241: Set currentTerm=1, votedFor=leader241
07:49:36,166 PM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - Recovery snapshot applied for leader241 in 92.07 μs: snapshotIndex=1, snapshotTerm=1, journal-size=0
07:49:36,166 PM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader241: Recovery completed in 255.7 μs - Switching actor to Follower - last log index = 1, last log term = 1, snapshot index = 1, snapshot term = 1, journal size = 0
07:49:36,166 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRecovery - leader241: restoring local TermInfo{term=1, votedFor=leader241}
07:49:36,166 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader241: Set currentTerm=1, votedFor=leader241
07:49:36,166 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader241: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@5e615391
07:49:36,167 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - leader241: Moving last applied index from -1 to 1
07:49:36,167 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - leader241: applying entries up to 5
07:49:36,167 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - leader241: recovered journal DefaultLogEntry[index=2, term=1, command=two]
07:49:36,168 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - leader241: recovered journal DefaultLogEntry[index=3, term=1, command=three]
07:49:36,168 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - leader241: recovered journal DefaultLogEntry[index=4, term=1, command=four]
07:49:36,168 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - leader241: Moving last applied index from 1 to 4
07:49:36,168 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - leader241: journal recovery completedin 1.772 ms with journalIndex=3
07:49:36,169 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - leader241 (Follower): Received TimeoutNow - switching to Candidate
07:49:36,169 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader241 (Candidate): Election: Candidate has following voting peers: []
07:49:36,170 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower242-collector244#-1907986053]
07:49:36,171 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower242]
07:49:36,171 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRaftStorage - follower242: terminating thread VirtualThread[#643,follower242-writer-97]/waiting
07:49:36,171 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: received 1 commands after 209.3 ms
07:49:36,172 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: completed 1 commands in 15.82 μs
07:49:36,172 PM [follower242-writer-97] [DEBUG] JournalWriteTask - follower242: journal writer stopped
07:49:36,172 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower242: journal closed
07:49:36,172 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - follower242: journal closed
07:49:36,172 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower242: stopped executor with 0 remaining tasks
07:49:36,172 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower242: stopped executor with 0 remaining tasks
07:49:36,172 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader241: Set currentTerm=2, votedFor=leader241
07:49:36,172 PM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - leader241 (Candidate): Starting new election term 2
07:49:36,172 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - leader241 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
07:49:36,172 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader241 (Candidate): Received ElectionTimeout
07:49:36,172 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader241 (Leader): Election: Leader has following peers: []
07:49:36,172 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - leader241 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
07:49:36,172 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader241-collector245#354334245]
07:49:36,173 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader241]
07:49:36,173 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader241-collector246#1545417330]
07:49:36,173 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader241]
07:49:36,173 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - leader241: terminating thread VirtualThread[#650,leader241-writer-99]/waiting
07:49:36,174 PM [leader241-writer-99] [DEBUG] JournalWriteTask - leader241: received 1 commands after 11.01 ms
07:49:36,174 PM [leader241-writer-99] [DEBUG] JournalWriteTask - leader241: completed 1 commands in 14.87 μs
07:49:36,174 PM [leader241-writer-99] [DEBUG] JournalWriteTask - leader241: journal writer stopped
07:49:36,174 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader241: journal closed
07:49:36,174 PM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader241: journal closed
07:49:36,174 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader241: stopped executor with 0 remaining tasks
07:49:36,174 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader241: stopped executor with 0 remaining tasks
[INFO] [07/01/2025 19:49:36.175] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
07:49:36,175 PM [test-pekko.actor.default-dispatcher-7] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
[WARN] [07/01/2025 19:49:36.176] [test-pekko.actor.default-dispatcher-7] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.170.142:17355)
[INFO] [07/01/2025 19:49:36.177] [test-pekko.actor.internal-dispatcher-4] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.142:17355] - Exiting completed
07:49:36,177 PM [test-pekko.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.142:17355] - Exiting completed
07:49:36,177 PM [test-pekko.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.142:17355] - Shutting down...
07:49:36,178 PM [test-pekko.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.142:17355] - Successfully shut down
[INFO] [07/01/2025 19:49:36.177] [test-pekko.actor.internal-dispatcher-4] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.142:17355] - Shutting down...
07:49:36,179 PM [test-pekko.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
[INFO] [07/01/2025 19:49:36.177] [test-pekko.actor.internal-dispatcher-4] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.142:17355] - Successfully shut down
[INFO] [07/01/2025 19:49:36.179] [test-pekko.remote.default-remote-dispatcher-9] [pekko://test@10.30.170.142:17355/system/remoting-terminator] Shutting down remote daemon.
[INFO] [07/01/2025 19:49:36.179] [test-pekko.remote.default-remote-dispatcher-9] [pekko://test@10.30.170.142:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports.
07:49:36,179 PM [test-pekko.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
[INFO] [07/01/2025 19:49:36.181] [test-pekko.remote.default-remote-dispatcher-9] [pekko://test@10.30.170.142:17355/system/remoting-terminator] Remoting shut down.
07:49:36,181 PM [test-pekko.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[DEBUG] [07/01/2025 19:49:36.181] [test-pekko.actor.internal-dispatcher-2] [EventStream] shutting down: StandardOutLogger