[DEBUG] [06/30/2025 09:08:25.199] [main] [EventStream(pekko://test)] logger log1-TestEventListener started 09:08:25,200 AM [test-pekko.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [06/30/2025 09:08:25.200] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started [DEBUG] [06/30/2025 09:08:25.200] [main] [EventStream(pekko://test)] Default Loggers started 09:08:25,209 AM [test-pekko.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.168:17355] with UID [2300776697296122068] [INFO] [06/30/2025 09:08:25.208] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.168:17355] with UID [2300776697296122068] 09:08:25,209 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Starting up, Pekko version [1.0.3] ... [INFO] [06/30/2025 09:08:25.209] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Starting up, Pekko version [1.0.3] ... [INFO] [06/30/2025 09:08:25.211] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Registered cluster JMX MBean [pekko:type=Cluster] 09:08:25,211 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Registered cluster JMX MBean [pekko:type=Cluster] [INFO] [06/30/2025 09:08:25.211] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Started up successfully 09:08:25,211 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Started up successfully [INFO] [06/30/2025 09:08:25.212] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing [INFO] [06/30/2025 09:08:25.212] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 09:08:25,212 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing 09:08:25,212 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining [WARN] [06/30/2025 09:08:25.224] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower223]: org.opendaylight.controller.cluster.common.actor.Monitor@219ad43b [INFO] [pekkoDeadLetter][06/30/2025 09:08:25.225] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower223] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:08:25,225 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower223] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:08:25,228 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower223: Starting recovery with journal batch size 1000 09:08:25,229 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower223: started executor 09:08:25,229 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower223: started executor 09:08:25,229 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower223: metadata journal open: replayFrom=1 applyTo=0 09:08:25,230 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower223: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:08:25,230 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower223: journal open: applyTo=0 09:08:25,230 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: journal writer started 09:08:25,230 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting to receive commands [WARN] [06/30/2025 09:08:25.232] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader222]: org.opendaylight.controller.cluster.common.actor.Monitor@6bcdb887 [INFO] [pekkoDeadLetter][06/30/2025 09:08:25.232] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:08:25,232 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:08:25,233 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/follower223/TermInfo.properties does not exist 09:08:25,233 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower223: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/follower223/journal-v1-1.log 09:08:25,233 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower223: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/follower223/metadata-v1-1.log 09:08:25,233 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower223: no eligible files found 09:08:25,233 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower223: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:08:25,234 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - leader222: Starting recovery with journal batch size 1000 09:08:25,235 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader222: started executor 09:08:25,235 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader222: started executor 09:08:25,235 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader222: metadata journal open: replayFrom=1 applyTo=0 09:08:25,235 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader222: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:08:25,235 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - leader222: journal open: applyTo=0 09:08:25,236 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: journal writer started 09:08:25,236 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:08:25,236 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties does not exist 09:08:25,236 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:25,236 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:25,236 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:25,236 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader222: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:08:25,238 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=0, votedFor=null 09:08:25,238 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower223: Local TermInfo store seeded with TermInfo{term=0} 09:08:25,238 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower223: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4c000807 09:08:25,238 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from -1 to -1 09:08:25,238 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower223: journal recovery completedin 250.0 μs with journalIndex=1 09:08:25,240 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=0, votedFor=null 09:08:25,240 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader222: Local TermInfo store seeded with TermInfo{term=0} 09:08:25,240 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader222: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@345151bb 09:08:25,240 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to -1 09:08:25,240 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader222: journal recovery completedin 170.5 μs with journalIndex=1 09:08:25,656 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 09:08:25,656 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader222 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed) 09:08:25,656 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader222 (Follower): Received ElectionTimeout - switching to Candidate 09:08:25,656 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader222 (Candidate): Election: Candidate has following voting peers: [follower223, follower224] 09:08:25,661 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222 09:08:25,661 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - leader222 (Candidate): Starting new election term 1 09:08:25,661 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} to peer follower223 09:08:25,661 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} to peer follower224 09:08:25,661 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 09:08:25,661 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): Cluster state: [] 09:08:25,661 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 09:08:25,661 AM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - follower223 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 09:08:25,661 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader222 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 [WARN] [06/30/2025 09:08:25.662] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} [INFO] [pekkoDeadLetter][06/30/2025 09:08:25.662] [test-pekko.actor.default-dispatcher-16] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:08:25,662 AM [test-pekko.actor.default-dispatcher-16] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:08:25,664 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=1, votedFor=null 09:08:25,664 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): In requestVote: RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 09:08:25,666 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=1, votedFor=leader222 09:08:25,666 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 09:08:25,666 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader222 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 09:08:25,666 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader222 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 09:08:25,666 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Election: Leader has following peers: [follower223, follower224] 09:08:25,666 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:08:25,666 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:08:25,666 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader222 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 09:08:25,666 AM [test-pekko.actor.default-dispatcher-5] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [06/30/2025 09:08:25.667] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [INFO] [pekkoDeadLetter][06/30/2025 09:08:25.666] [test-pekko.actor.default-dispatcher-5] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:08:25,667 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Last sync leader does not match current leader leader222, need to catch up to -1 [WARN] [06/30/2025 09:08:25.667] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower223] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower223, initialSyncDone=false] [INFO] [pekkoDeadLetter][06/30/2025 09:08:25.667] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower223] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:08:25,667 AM [test-pekko.actor.default-dispatcher-15] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:08:25,667 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: -1, nextIndex: 0 09:08:25,667 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:08:25,693 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Persist data index=0 term=1 command=zero 09:08:25,693 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:08:25,693 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 09:08:25,693 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:08:25,693 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 0 is present for follower follower223 09:08:25,693 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 commands after 457.8 ms 09:08:25,693 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 09:08:25,694 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:08:25,694 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 09:08:25,694 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 09:08:25,694 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 09:08:25,694 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): Append entry to log zero 09:08:25,694 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:08:25,694 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 463.5 ms 09:08:25,694 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): Log size is now 1 09:08:25,694 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:08:25,694 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached -1 (of expected -1) [WARN] [06/30/2025 09:08:25.694] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:25,694 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) [INFO] [pekkoDeadLetter][06/30/2025 09:08:25.694] [test-pekko.actor.default-dispatcher-6] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:08:25,695 AM [test-pekko.actor.default-dispatcher-6] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:08:25,695 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 0, nextIndex: 1 09:08:25,696 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:08:25,698 AM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 09:08:25,698 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 4.458 ms 09:08:25,698 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 09:08:25,698 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:08:25,698 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:08:25,698 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 09:08:25,698 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 0 09:08:25,698 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to 0 09:08:25,698 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 0 data zero 09:08:25,698 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader222: applyState called: zero 09:08:25,698 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 commands after 406.7 μs 09:08:25,699 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 164.7 μs 09:08:25,699 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:08:25,699 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 09:08:25,699 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 5.117 ms 09:08:25,699 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting to receive commands 09:08:25,699 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 09:08:25,699 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 09:08:25,699 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@3e47f186 [WARN] [06/30/2025 09:08:25.699] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower223] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower223, initialSyncDone=true] 09:08:25,699 AM [test-pekko.actor.default-dispatcher-18] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][06/30/2025 09:08:25.699] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower223] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [06/30/2025 09:08:25.777] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [INFO] [pekkoDeadLetter][06/30/2025 09:08:25.777] [test-pekko.actor.default-dispatcher-18] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:08:25,777 AM [test-pekko.actor.default-dispatcher-16] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:08:25,794 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Persist data index=1 term=1 command=one 09:08:25,794 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:08:25,794 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 09:08:25,794 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 commands after 95.67 ms 09:08:25,794 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:08:25,794 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 1 is present for follower follower223 09:08:25,794 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 09:08:25,795 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 [WARN] [06/30/2025 09:08:25.795] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:25,795 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 09:08:25,795 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 09:08:25,795 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 09:08:25,795 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Append entry to log one 09:08:25,795 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} [INFO] [pekkoDeadLetter][06/30/2025 09:08:25.795] [test-pekko.actor.default-dispatcher-16] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:08:25,795 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Log size is now 2 09:08:25,795 AM [test-pekko.actor.default-dispatcher-16] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:08:25,795 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Commit index set to 0 09:08:25,795 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:08:25,795 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 0 (of expected -1) 09:08:25,795 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 96.05 ms 09:08:25,795 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 09:08:25,795 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 0 09:08:25,795 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from -1 to 0 09:08:25,795 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower223: Applying state for log index 0 data zero 09:08:25,795 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower223: applyState called: zero 09:08:25,796 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 09:08:25,797 AM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 09:08:25,797 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 2.643 ms 09:08:25,797 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:08:25,797 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 09:08:25,797 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 1.958 ms 09:08:25,797 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 7.460 μs 09:08:25,797 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 135.9 μs 09:08:25,797 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting to receive commands 09:08:25,798 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 09:08:25,798 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 09:08:25,798 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@683e91f3 09:08:25,798 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 1, nextIndex: 2 09:08:25,798 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:08:25,798 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 09:08:25,798 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:08:25,798 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 09:08:25,798 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 1 09:08:25,798 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 0 to 1 09:08:25,798 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 1 data one 09:08:25,798 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader222: applyState called: one 09:08:25,798 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 commands after 1.241 ms 09:08:25,799 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 148.6 μs 09:08:25,799 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:08:25,896 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader222: Persist data index=2 term=1 command=two 09:08:25,896 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:08:25,896 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 09:08:25,896 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:08:25,896 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 2 is present for follower follower223 09:08:25,896 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 commands after 97.57 ms 09:08:25,896 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 09:08:25,896 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 [WARN] [06/30/2025 09:08:25.896] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:25,897 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 09:08:25,897 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 09:08:25,897 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 09:08:25,897 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): Append entry to log two 09:08:25,897 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} [INFO] [pekkoDeadLetter][06/30/2025 09:08:25.897] [test-pekko.actor.default-dispatcher-17] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:08:25,897 AM [test-pekko.actor.default-dispatcher-17] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:08:25,897 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): Log size is now 3 09:08:25,897 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): Commit index set to 1 09:08:25,897 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:08:25,897 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 1 (of expected -1) 09:08:25,897 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 99.49 ms 09:08:25,897 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 2 09:08:25,897 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 1 09:08:25,897 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 2 is present for follower follower223 09:08:25,897 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 0 to 1 09:08:25,897 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower223: Applying state for log index 1 data one 09:08:25,897 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower223: applyState called: one [WARN] [06/30/2025 09:08:25.897] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:25,897 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 09:08:25,897 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 2, nextIndex: 3 09:08:25,897 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:08:25,897 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader222: Persist data index=3 term=1 command=three 09:08:25,897 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 09:08:25,897 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true 09:08:25,897 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 3, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:08:25,897 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 3 is present for follower follower223 09:08:25,897 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=2, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=three, pending=true}]} 09:08:25,897 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 [WARN] [06/30/2025 09:08:25.898] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:25,898 AM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 09:08:25,898 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 1.845 ms 09:08:25,898 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 commands after 4.880 μs 09:08:25,898 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 09:08:25,898 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 1.361 ms 09:08:25,898 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 09:08:25,898 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 4.440 μs 09:08:25,898 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 09:08:25,899 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 137.4 μs 09:08:25,899 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting to receive commands 09:08:25,899 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 09:08:25,899 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:08:25,899 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1 09:08:25,899 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 2 09:08:25,899 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 1 to 2 09:08:25,899 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Applying state for log index 2 data two 09:08:25,899 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader222: applyState called: two 09:08:25,899 AM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 09:08:25,898 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@36393072 09:08:25,899 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 1.238 ms 09:08:25,899 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 09:08:25,899 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 commands after 5.170 μs 09:08:25,899 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true} 09:08:25,899 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=2, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=three, pending=false}]} 09:08:25,900 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 09:08:25,899 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader222: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=2, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 09:08:25,900 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 2, entries to be added from: 0 09:08:25,900 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 88.83 μs 09:08:25,900 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): Append entry to log three 09:08:25,900 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:08:25,900 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=false} 09:08:25,900 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): Log size is now 4 09:08:25,900 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=3, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:08:25,900 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 1 (of expected -1) 09:08:25,900 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 09:08:25,900 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 1.158 ms 09:08:25,900 AM [test-pekko.actor.default-dispatcher-16] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:349) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) [ERROR] [06/30/2025 09:08:25.900] [test-pekko.actor.internal-dispatcher-2] [pekko://test/user/leader222] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:349) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 09:08:25,900 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader222: terminating thread VirtualThread[#609,leader222-writer-91]/waiting 09:08:25,900 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 commands after 900.3 μs 09:08:25,901 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 31.30 μs 09:08:25,901 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: journal writer stopped 09:08:25,901 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader222: journal closed 09:08:25,901 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader222: journal closed 09:08:25,901 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks 09:08:25,901 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks 09:08:25,901 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 09:08:25,901 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 09:08:25,901 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 1.334 ms 09:08:25,901 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting to receive commands 09:08:25,901 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=false} 09:08:25,901 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@77043a49 [WARN] [06/30/2025 09:08:25.901] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader222]: org.opendaylight.controller.cluster.common.actor.Monitor@397cb395 09:08:25,902 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader222: Starting recovery with journal batch size 1000 09:08:25,902 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader222: started executor 09:08:25,902 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader222: started executor 09:08:25,903 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader222: metadata journal open: replayFrom=1 applyTo=2 09:08:25,904 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader222: journal open: firstIndex=1 lastIndex=4 replayFrom=1 fileEntries=0 09:08:25,904 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader222: journal open: applyTo=2 09:08:25,905 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: journal writer started 09:08:25,905 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:08:25,905 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222 09:08:25,905 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:25,905 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:25,905 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:25,905 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:25,905 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader222: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:08:25,905 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - leader222: restoring local TermInfo{term=1, votedFor=leader222} 09:08:25,905 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222 09:08:25,905 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader222: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@44dee37 09:08:25,905 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to -1 09:08:25,906 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 09:08:25,906 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=1, term=1, command=one] 09:08:25,906 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=2, term=1, command=two] 09:08:25,907 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=3, term=1, command=three] 09:08:25,907 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader222: journal recovery completedin 1.553 ms with journalIndex=1 09:08:25,997 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:25,997 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:25,997 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:25,997 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:26,98 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:26,98 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:26,98 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:26,98 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:26,198 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:26,198 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:26,198 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:26,198 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:26,299 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:26,299 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:26,299 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:26,299 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:26,399 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:26,399 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:26,399 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:26,399 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:26,406 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - leader222 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed) 09:08:26,406 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - leader222 (Follower): Received ElectionTimeout - switching to Candidate 09:08:26,406 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader222 (Candidate): Election: Candidate has following voting peers: [follower223, follower224] 09:08:26,412 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=2, votedFor=leader222 09:08:26,412 AM [test-pekko.actor.default-dispatcher-17] [INFO] Candidate - leader222 (Candidate): Starting new election term 2 09:08:26,412 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} to peer follower223 09:08:26,412 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} to peer follower224 09:08:26,412 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader222 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 09:08:26,412 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower223 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 09:08:26,412 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower223 (Follower): Cluster state: [] 09:08:26,412 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower223 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} with higher term appears reachable, updating term. 09:08:26,412 AM [test-pekko.actor.default-dispatcher-18] [INFO] Follower - follower223 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1}" message is greater than follower's term 1 - updating term [WARN] [06/30/2025 09:08:26.412] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} 09:08:26,416 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=2, votedFor=null 09:08:26,416 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower223 (Follower): In requestVote: RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} - currentTerm: 2, votedFor: null, lastIndex: 3, lastTerm: 1 09:08:26,418 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=2, votedFor=leader222 09:08:26,418 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower223 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 09:08:26,418 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader222 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 09:08:26,418 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader222 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 09:08:26,418 AM [test-pekko.actor.default-dispatcher-18] [INFO] Candidate - leader222 (Candidate): LastApplied index -1 is behind last index 3 - switching to PreLeader 09:08:26,418 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Election: Leader has following peers: [follower223, follower224] 09:08:26,418 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:08:26,418 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:08:26,419 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader222 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 2 09:08:26,419 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging -2 entries behind leader leader222 and reached 1 (of expected -1) 09:08:26,419 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Persist data index=4 term=2 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b 09:08:26,419 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b, pending=true} [WARN] [06/30/2025 09:08:26.419] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:26,419 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Replicate message: identifier: null, logIndex: 4, isSendImmediate: true 09:08:26,419 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:08:26,419 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:08:26,419 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: received 1 commands after 513.9 ms 09:08:26,419 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 3, nextIndex: 4 [WARN] [06/30/2025 09:08:26.419] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:26,419 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging -2 entries behind leader leader222 and reached 1 (of expected -1) 09:08:26,420 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 09:08:26,420 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 09:08:26,420 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 09:08:26,420 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 09:08:26,420 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:08:26,420 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): sendAppendEntries: 4 is present for follower follower223 09:08:26,420 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Sending AppendEntries to follower follower223: AppendEntries{term=2, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b, pending=true}]} 09:08:26,420 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b, pending=true}]} 09:08:26,420 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 09:08:26,420 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 3, entries to be added from: 0 09:08:26,420 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): Append entry to log org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b 09:08:26,420 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b, pending=true} 09:08:26,420 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): Log size is now 5 09:08:26,420 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower223, logLastIndex=4, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:08:26,420 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging -2 entries behind leader leader222 and reached 1 (of expected -1) 09:08:26,420 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 09:08:26,420 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 519.1 ms 09:08:26,420 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 09:08:26,420 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 09:08:26,420 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 09:08:26,420 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 09:08:26,420 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): sendAppendEntries: 4 is present for follower follower223 09:08:26,420 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 4, nextIndex: 5 09:08:26,420 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 09:08:26,420 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 09:08:26,420 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 09:08:26,420 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 5, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:08:26,421 AM [leader222-writer-92] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 09:08:26,421 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 1.871 ms 09:08:26,421 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b, pending=true} 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Applying to log - commitIndex: 4, lastAppliedIndex: -1 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 0 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to 0 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 0 data zero 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader222: applyState called: zero 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 1 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 0 to 1 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 1 data one 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader222: applyState called: one 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 2 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 1 to 2 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 2 data two 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader222: applyState called: two 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 3 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 2 to 3 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 3 data three 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader222: applyState called: three 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 4 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 3 to 4 09:08:26,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b 09:08:26,421 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: received 1 commands after 477.2 μs 09:08:26,421 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 101.6 μs 09:08:26,421 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:08:26,422 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PreLeader - leader222 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}] - lastApplied: 4, lastIndex: 4 09:08:26,422 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): Election: Leader has following peers: [follower223, follower224] 09:08:26,422 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 5, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:08:26,422 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:08:26,422 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 09:08:26,422 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 09:08:26,422 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b, pending=false} 09:08:26,422 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@7f7afbbd 09:08:26,422 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 1.523 ms 09:08:26,422 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting to receive commands 09:08:26,422 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): Commit index set to 4 [WARN] [06/30/2025 09:08:26.422] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:26,422 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:08:26,422 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 4, context.getLastApplied(): 1, lastIndex(): 4 09:08:26,422 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 2 09:08:26,422 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 1 to 2 09:08:26,422 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower223: Applying state for log index 2 data two 09:08:26,422 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower223: applyState called: two 09:08:26,422 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 3 09:08:26,422 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 2 to 3 09:08:26,422 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower223: Applying state for log index 3 data three 09:08:26,422 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower223: applyState called: three 09:08:26,422 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 4 09:08:26,422 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 3 to 4 09:08:26,422 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower223: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b 09:08:26,422 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 276.7 μs 09:08:26,422 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader222 (PreLeader) :- Switching from behavior PreLeader to Leader, election term: 2 09:08:26,422 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 189.6 μs 09:08:26,422 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting to receive commands 09:08:26,499 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:26,500 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:26,500 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:26,500 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:08:26.537] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:26,537 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:08:26,600 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:26,600 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:26,600 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:26,600 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:26,657 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:26.657] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:26,700 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:26,700 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:26,700 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:26,700 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:26,777 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:26.777] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:26,801 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:26,801 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:26,801 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:26,801 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:26,897 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:26.897] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:26,901 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:26,901 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:26,901 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:26,901 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:27,2 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:27,2 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:27,2 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:27,2 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:08:27.017] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:27,17 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:08:27,103 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:27,103 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:27,103 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:27,103 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:27,137 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:27.137] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:27,204 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:27,204 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:27,204 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:27,204 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:27,257 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:27.257] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:27,305 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:27,305 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:27,305 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:27,305 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:08:27.376] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:27,376 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:08:27,406 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:27,406 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:27,406 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:27,406 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:27,497 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:27.497] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:27,507 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:27,507 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:27,507 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:27,507 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:27,607 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:27,608 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:27,608 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:27,608 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:27,617 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:27.617] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:27,708 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:27,709 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:27,709 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:27,709 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:27,736 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:27.736] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:27,809 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:27,809 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:27,809 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:27,809 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:08:27.857] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:27,857 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:08:27,910 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:27,910 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:27,910 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:27,910 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:27,977 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:27.977] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:28,11 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:28,11 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:28,11 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:28,11 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:28,97 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:28.097] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:28,112 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:28,112 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:28,112 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:28,112 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:28,213 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:28,213 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:28,213 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:28,213 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:28,217 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:28.217] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:28,314 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:28,314 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:28,314 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:28,314 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:28,337 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:28.337] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:28,415 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:28,415 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:28,415 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:28,415 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:28,456 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:28.456] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:28,515 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:28,515 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:28,515 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:28,515 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:28,576 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:28.577] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:28,616 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:28,616 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:28,616 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:28,616 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:08:28.697] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:28,697 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:08:28,716 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:28,716 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:28,716 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:28,716 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:28,816 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:28.816] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:28,817 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:28,817 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:28,817 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:28,817 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:28,917 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:28,917 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:28,917 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:28,917 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:28,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:28.937] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:29,18 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:29,18 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:29,18 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:29,18 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:29,57 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:29.057] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:29,118 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:29,119 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:29,119 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:29,119 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:29,177 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:29.177] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:29,219 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:29,219 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:29,219 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:29,220 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:29,297 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:29.297] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:29,320 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:29,320 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:29,320 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:29,320 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:29,417 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:29.417] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:29,421 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:29,421 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:29,421 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:29,421 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:29,521 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:29,521 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:29,522 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:29,522 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:29,537 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:29.537] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:29,622 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:29,622 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:29,622 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:29,622 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:29,657 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:29.657] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:29,723 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:29,723 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:29,723 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:29,723 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:29,777 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:29.777] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:29,823 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:29,823 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:29,823 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:29,823 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:29,897 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:29.897] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:29,924 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:29,924 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:29,924 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:29,924 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:08:30.018] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:30,35 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:30,35 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:30,35 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:30,35 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:30,35 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:08:30,135 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:30,135 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:30,135 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:30,135 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:30,137 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:30.137] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:30,236 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:30,236 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:30,236 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:30,236 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:30,257 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:08:30.257] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:30,337 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:30,337 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:30,337 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:30,337 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:08:30.377] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:30,377 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:08:30,438 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:30,438 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:30,438 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:30,438 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:08:30.496] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:30,496 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:08:30,538 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:30,538 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:30,538 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:30,538 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:08:30.617] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:30,617 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:08:30,639 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:30,639 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:30,639 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:30,639 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:08:30.737] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:30,737 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:08:30,739 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:30,739 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:30,739 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:30,739 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:08:30,840 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/TermInfo.properties 09:08:30,840 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/journal-v1-1.log 09:08:30,840 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11209092945265392933/leader222/metadata-v1-1.log 09:08:30,840 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:08:30.856] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:30,856 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:08:30,941 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower223-collector225#-1107468910] 09:08:30,953 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower223] 09:08:30,953 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - follower223: terminating thread VirtualThread[#604,follower223-writer-90]/waiting 09:08:30,954 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 4.531 s 09:08:30,954 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 43.75 μs 09:08:30,954 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: journal writer stopped 09:08:30,954 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower223: journal closed 09:08:30,954 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower223: journal closed 09:08:30,954 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower223: stopped executor with 0 remaining tasks 09:08:30,954 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower223: stopped executor with 0 remaining tasks 09:08:30,954 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader222-collector226#301186940] 09:08:30,954 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader222] 09:08:30,954 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader222: terminating thread VirtualThread[#613,leader222-writer-92]/waiting 09:08:30,954 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: received 1 commands after 4.533 s 09:08:30,955 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 16.32 μs 09:08:30,955 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: journal writer stopped 09:08:30,955 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader222: journal closed 09:08:30,955 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader222: journal closed 09:08:30,955 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks 09:08:30,955 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks [WARN] [06/30/2025 09:08:30.959] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower228]: org.opendaylight.controller.cluster.common.actor.Monitor@1365be94 09:08:30,960 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower228: Starting recovery with journal batch size 1000 09:08:30,960 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower228: started executor 09:08:30,960 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower228: started executor 09:08:30,961 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower228: metadata journal open: replayFrom=1 applyTo=0 09:08:30,961 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower228: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:08:30,961 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower228: journal open: applyTo=0 09:08:30,961 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: journal writer started 09:08:30,961 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: waiting to receive commands 09:08:30,962 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader227: Starting recovery with journal batch size 1000 09:08:30,963 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader227: started executor 09:08:30,963 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader227: started executor 09:08:30,963 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/follower228/TermInfo.properties does not exist 09:08:30,963 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader227: metadata journal open: replayFrom=1 applyTo=0 09:08:30,963 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/follower228/journal-v1-1.log 09:08:30,963 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/follower228/metadata-v1-1.log 09:08:30,963 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower228: no eligible files found 09:08:30,963 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower228: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:08:30,963 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader227: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:08:30,963 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader227: journal open: applyTo=0 09:08:30,963 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: journal writer started 09:08:30,963 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting to receive commands [WARN] [06/30/2025 09:08:30.963] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader227]: org.opendaylight.controller.cluster.common.actor.Monitor@37403f07 09:08:30,964 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties does not exist 09:08:30,964 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:30,964 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:30,964 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader227: no eligible files found 09:08:30,964 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader227: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:08:30,969 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=0, votedFor=null 09:08:30,969 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower228: Local TermInfo store seeded with TermInfo{term=0} 09:08:30,969 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower228: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@1672c5e8 09:08:30,969 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower228: Moving last applied index from -1 to -1 09:08:30,970 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower228: journal recovery completedin 490.1 μs with journalIndex=1 09:08:30,972 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=0, votedFor=null 09:08:30,972 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader227: Local TermInfo store seeded with TermInfo{term=0} 09:08:30,973 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader227: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@398660fa 09:08:30,973 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from -1 to -1 09:08:30,973 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader227: journal recovery completedin 251.2 μs with journalIndex=1 09:08:31,396 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 09:08:31,396 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader227 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed) 09:08:31,396 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader227 (Follower): Received ElectionTimeout - switching to Candidate 09:08:31,396 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader227 (Candidate): Election: Candidate has following voting peers: [follower229, follower228] 09:08:31,400 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=1, votedFor=leader227 09:08:31,400 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader227 (Candidate): Starting new election term 1 09:08:31,400 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} to peer follower229 09:08:31,400 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} to peer follower228 [WARN] [06/30/2025 09:08:31.400] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} 09:08:31,400 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower228 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 09:08:31,400 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader227 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 09:08:31,400 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower228 (Follower): Cluster state: [] 09:08:31,400 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower228 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 09:08:31,400 AM [test-pekko.actor.default-dispatcher-18] [INFO] Follower - follower228 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 09:08:31,403 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=1, votedFor=null 09:08:31,403 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower228 (Follower): In requestVote: RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 09:08:31,405 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=1, votedFor=leader227 09:08:31,405 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower228 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 09:08:31,405 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader227 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 09:08:31,405 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader227 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 09:08:31,406 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Election: Leader has following peers: [follower229, follower228] 09:08:31,406 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:08:31,406 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:08:31,406 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader227 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 09:08:31,406 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower228: Last sync leader does not match current leader leader227, need to catch up to -1 [WARN] [06/30/2025 09:08:31.406] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:31,406 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower228 updated: matchIndex: -1, nextIndex: 0 [WARN] [06/30/2025 09:08:31.406] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower228] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower228, initialSyncDone=false] 09:08:31,406 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:08:31,426 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader227: Persist data index=0 term=1 command=zero 09:08:31,426 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:08:31,426 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 commands after 463.0 ms 09:08:31,427 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 09:08:31,427 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:08:31,427 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:08:31,427 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 0 is present for follower follower228 09:08:31,427 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader227 (Leader): Sending AppendEntries to follower follower228: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 09:08:31,427 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower228 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 09:08:31,427 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower228 (Follower): Number of entries to be appended = 1 09:08:31,427 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower228 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 09:08:31,427 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower228 (Follower): Append entry to log zero 09:08:31,427 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower228: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} [WARN] [06/30/2025 09:08:31.427] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:31,427 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 commands after 466.0 ms 09:08:31,427 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower228 (Follower): Log size is now 1 09:08:31,427 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower228 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower228, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:08:31,428 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower228: Lagging 0 entries behind leader leader227 and reached -1 (of expected -1) 09:08:31,428 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower228: awaiting more completions to resolve 1 deferred callback(s) 09:08:31,428 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower228 updated: matchIndex: 0, nextIndex: 1 09:08:31,428 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:08:31,430 AM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 09:08:31,430 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: completed 1 commands in 4.040 ms 09:08:31,430 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 09:08:31,430 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting to receive commands 09:08:31,430 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:08:31,431 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 09:08:31,431 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader227 (Leader): Setting last applied to 0 09:08:31,431 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from -1 to 0 09:08:31,431 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader227: Applying state for log index 0 data zero 09:08:31,431 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader227: applyState called: zero 09:08:31,431 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 commands after 562.8 μs 09:08:31,431 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: completed 1 commands in 163.2 μs 09:08:31,431 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting to receive commands 09:08:31,432 AM [follower228-writer-93] [DEBUG] EntryStoreCompleter - follower228: 1 completion(s) pending 09:08:31,432 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: completed 1 commands in 5.114 ms 09:08:31,432 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: waiting to receive commands 09:08:31,432 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower228: running 1 completion(s) 09:08:31,432 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower228: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 09:08:31,432 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower228: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@ad539f2 [WARN] [06/30/2025 09:08:31.433] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower228] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower228, initialSyncDone=true] [WARN] [06/30/2025 09:08:31.517] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:31,527 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader227: Persist data index=1 term=1 command=one 09:08:31,527 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:08:31,527 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 09:08:31,527 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:08:31,527 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 commands after 96.19 ms 09:08:31,527 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:08:31,527 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 1 is present for follower follower228 09:08:31,528 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Sending AppendEntries to follower follower228: AppendEntries{term=1, leaderId=leader227, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 09:08:31,528 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower228 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader227, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 09:08:31,528 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower228 (Follower): Number of entries to be appended = 1 09:08:31,528 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower228 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 09:08:31,528 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower228 (Follower): Append entry to log one 09:08:31,528 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower228: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:08:31,528 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower228 (Follower): Log size is now 2 09:08:31,528 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower228 (Follower): Commit index set to 0 09:08:31,528 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower228 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower228, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:08:31,528 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower228: Lagging 0 entries behind leader leader227 and reached 0 (of expected -1) 09:08:31,528 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower228 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 09:08:31,528 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower228 (Follower): Setting last applied to 0 09:08:31,528 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 commands after 95.55 ms 09:08:31,528 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower228: Moving last applied index from -1 to 0 09:08:31,528 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower228: Applying state for log index 0 data zero 09:08:31,528 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower228: applyState called: zero 09:08:31,528 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower228 updated: matchIndex: 1, nextIndex: 2 09:08:31,528 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower228: awaiting more completions to resolve 1 deferred callback(s) 09:08:31,528 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 [WARN] [06/30/2025 09:08:31.528] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:31,530 AM [follower228-writer-93] [DEBUG] EntryStoreCompleter - follower228: 1 completion(s) pending 09:08:31,530 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower228: running 1 completion(s) 09:08:31,530 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: completed 1 commands in 1.889 ms 09:08:31,530 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower228: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 09:08:31,530 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 commands after 4.750 μs 09:08:31,530 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower228: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@61b7fd21 09:08:31,530 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: completed 1 commands in 122.9 μs 09:08:31,530 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: waiting to receive commands 09:08:31,530 AM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 09:08:31,530 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: completed 1 commands in 2.663 ms 09:08:31,530 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting to receive commands 09:08:31,530 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 09:08:31,530 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:08:31,530 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 09:08:31,530 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader227 (Leader): Setting last applied to 1 09:08:31,530 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from 0 to 1 09:08:31,530 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader227: Applying state for log index 1 data one 09:08:31,530 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader227: applyState called: one 09:08:31,530 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 commands after 200.7 μs 09:08:31,530 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: completed 1 commands in 96.65 μs 09:08:31,530 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting to receive commands 09:08:31,629 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader227: Persist data index=2 term=1 command=two 09:08:31,629 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:08:31,629 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 09:08:31,629 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 commands after 98.93 ms 09:08:31,630 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:08:31,630 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:08:31,630 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 2 is present for follower follower228 09:08:31,630 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Sending AppendEntries to follower follower228: AppendEntries{term=1, leaderId=leader227, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 09:08:31,630 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader227: Persist data index=3 term=1 command=three 09:08:31,630 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 09:08:31,630 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true 09:08:31,630 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 [WARN] [06/30/2025 09:08:31.630] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:31,630 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:08:31,630 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 2 is present for follower follower228 09:08:31,630 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader227: Persist data index=4 term=1 command=four 09:08:31,630 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=4, term=1, command=four, pending=true} 09:08:31,630 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 4, isSendImmediate: true 09:08:31,630 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:08:31,630 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:08:31,630 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 2 is present for follower follower228 [WARN] [06/30/2025 09:08:31.630] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:08:31.631] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:31,632 AM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 09:08:31,632 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: completed 1 commands in 2.527 ms 09:08:31,632 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 2 commands after 5.480 μs 09:08:31,632 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 09:08:31,632 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:08:31,635 AM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 2 completion(s) pending 09:08:31,635 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: completed 2 commands in 2.708 ms 09:08:31,635 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting to receive commands 09:08:31,635 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader227: running 2 completion(s) 09:08:31,635 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true} 09:08:31,635 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader227: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=3, mandatoryTrim=false] [ERROR] [06/30/2025 09:08:31.635] [test-pekko.actor.internal-dispatcher-10] [pekko://test/user/leader227] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:349) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 09:08:31,636 AM [test-pekko.actor.default-dispatcher-16] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:349) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 09:08:31,637 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - leader227: terminating thread VirtualThread[#616,leader227-writer-94]/waiting 09:08:31,638 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 commands after 3.665 ms 09:08:31,639 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: completed 1 commands in 16.37 μs 09:08:31,639 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: journal writer stopped 09:08:31,639 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader227: journal closed 09:08:31,639 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader227: journal closed 09:08:31,639 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks 09:08:31,639 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks 09:08:31,641 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader227: Starting recovery with journal batch size 1000 09:08:31,641 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader227: started executor 09:08:31,641 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader227: started executor 09:08:31,642 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader227: metadata journal open: replayFrom=1 applyTo=1 [WARN] [06/30/2025 09:08:31.642] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader227]: org.opendaylight.controller.cluster.common.actor.Monitor@3303c32c 09:08:31,645 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader227: journal open: firstIndex=1 lastIndex=5 replayFrom=1 fileEntries=0 09:08:31,645 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader227: journal open: applyTo=1 09:08:31,645 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: journal writer started 09:08:31,645 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: waiting to receive commands 09:08:31,649 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=1, votedFor=leader227 09:08:31,649 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:31,649 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:31,649 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:31,649 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader227: no eligible files found 09:08:31,649 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader227: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:08:31,649 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - leader227: restoring local TermInfo{term=1, votedFor=leader227} 09:08:31,649 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=1, votedFor=leader227 09:08:31,649 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader227: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@3ac25284 09:08:31,649 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from -1 to -1 09:08:31,650 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 09:08:31,650 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=1, term=1, command=one] 09:08:31,651 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=2, term=1, command=two] 09:08:31,651 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=3, term=1, command=three] 09:08:31,651 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=4, term=1, command=four] 09:08:31,651 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader227: journal recovery completedin 1.786 ms with journalIndex=1 09:08:32,167 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader227 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed) 09:08:32,167 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader227 (Follower): Received ElectionTimeout - switching to Candidate 09:08:32,167 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader227 (Candidate): Election: Candidate has following voting peers: [follower229, follower228] 09:08:32,172 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=2, votedFor=leader227 09:08:32,172 AM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader227 (Candidate): Starting new election term 2 09:08:32,172 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} to peer follower229 09:08:32,173 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} to peer follower228 09:08:32,173 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower228 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 09:08:32,173 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower228 (Follower): Cluster state: [] [WARN] [06/30/2025 09:08:32.173] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} 09:08:32,173 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower228 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} with higher term appears reachable, updating term. 09:08:32,173 AM [test-pekko.actor.default-dispatcher-14] [INFO] Follower - follower228 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1}" message is greater than follower's term 1 - updating term 09:08:32,173 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader227 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 09:08:32,175 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=2, votedFor=null 09:08:32,175 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower228 (Follower): In requestVote: RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} - currentTerm: 2, votedFor: null, lastIndex: 1, lastTerm: 1 09:08:32,179 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=2, votedFor=leader227 09:08:32,179 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower228 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 09:08:32,180 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader227 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 09:08:32,180 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader227 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 09:08:32,180 AM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - leader227 (Candidate): LastApplied index -1 is behind last index 4 - switching to PreLeader 09:08:32,180 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader227 (PreLeader): Election: Leader has following peers: [follower229, follower228] 09:08:32,180 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:08:32,180 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower228: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:08:32,180 AM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader227 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 2 [WARN] [06/30/2025 09:08:32.180] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:32,180 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader227: Persist data index=5 term=2 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b 09:08:32,180 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=5, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b, pending=true} 09:08:32,180 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader227 (PreLeader): Replicate message: identifier: null, logIndex: 5, isSendImmediate: true 09:08:32,180 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 09:08:32,180 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower228: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 09:08:32,180 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: received 1 commands after 535.5 ms [WARN] [06/30/2025 09:08:32.181] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:32,182 AM [leader227-writer-95] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 09:08:32,182 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 09:08:32,182 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: completed 1 commands in 1.818 ms 09:08:32,182 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=5, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b, pending=true} 09:08:32,182 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: waiting to receive commands 09:08:32,283 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:32,283 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:32,283 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:32,283 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:32.296] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:32,384 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:32,384 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:32,384 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:32,384 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:32.416] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:32,484 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:32,484 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:32,484 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:32,484 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:32.536] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:32,585 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:32,585 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:32,585 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:32,585 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:32.657] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:32,685 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:32,685 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:32,685 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:32,685 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:32.776] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:32,786 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:32,786 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:32,786 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:32,786 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 09:08:32,886 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:32,886 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:32,886 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:32,886 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:32.887] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:32,987 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:32,987 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:32,987 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:32,987 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:33.007] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:33,88 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:33,88 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:33,88 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:33,88 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:33.128] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:33,188 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:33,188 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:33,188 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:33,188 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:33.246] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:33,289 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:33,289 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:33,289 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:33,289 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:33.367] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:33,389 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:33,389 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:33,390 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:33,390 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:33.487] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:33,490 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:33,490 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:33,490 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:33,490 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 09:08:33,591 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:33,591 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:33,591 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:33,591 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:33.607] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:33,691 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:33,691 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:33,691 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:33,691 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:33.727] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:33,792 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:33,792 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:33,792 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:33,792 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:33.846] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:33,892 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:33,892 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:33,892 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:33,892 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:33.967] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:33,993 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:33,993 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:33,993 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:33,993 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:34.087] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:34,93 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:34,93 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:34,93 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:34,93 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 09:08:34,194 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:34,194 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:34,194 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:34,194 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:34.207] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:34,294 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:34,294 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:34,294 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:34,294 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:34.327] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:34,395 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:34,395 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:34,395 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:34,395 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:34.447] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:34,496 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:34,496 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:34,496 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:34,496 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:34.567] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:34,597 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:34,597 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:34,597 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:34,597 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:34.687] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:34,697 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:34,697 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:34,697 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:34,697 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 09:08:34,798 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:34,798 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:34,798 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:34,798 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:34.807] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:34,898 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:34,898 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:34,898 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:34,898 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:34.926] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:34,999 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:34,999 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:34,999 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:34,999 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:35.047] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:35,99 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:35,99 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:35,99 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:35,99 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:35.167] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:35,200 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:35,200 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:35,200 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:35,200 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:35.286] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:35,301 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:35,301 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:35,301 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:35,301 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 09:08:35,401 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:35,401 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:35,401 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:35,401 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:35.407] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:35,502 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:35,502 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:35,502 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:35,502 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:35.527] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:35,602 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:35,602 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:35,602 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:35,602 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:35.647] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:35,703 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:35,703 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:35,703 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:35,703 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:35.767] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:35,803 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:35,803 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:35,803 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:35,803 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:35.887] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:35,904 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:35,904 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:35,904 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:35,904 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:35.996] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:36,5 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:36,5 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:36,5 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:36,5 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 09:08:36,105 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:36,105 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:36,105 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:36,105 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:36.107] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:36,206 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:36,206 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:36,206 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:36,206 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:36.226] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:36,306 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:36,306 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:36,306 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:36,306 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:36.347] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:36,407 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:36,407 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:36,407 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:36,407 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:36.467] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:36,507 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:36,507 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:36,507 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:36,507 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:36.587] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:36,608 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:36,608 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:36,608 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:36,608 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:36.707] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:36,708 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:36,708 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:36,708 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:36,708 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 09:08:36,809 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:36,809 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:36,809 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:36,809 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:36.827] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:36,909 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:36,909 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:36,909 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:36,910 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:36.937] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:37,10 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:37,10 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:37,10 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:37,10 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:37.056] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:37,110 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/TermInfo.properties 09:08:37,111 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/journal-v1-1.log 09:08:37,111 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1154226033197628164/leader227/metadata-v1-1.log 09:08:37,111 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:08:37.166] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:37,212 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower228-collector230#1062120657] 09:08:37,223 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower228] 09:08:37,223 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRaftStorage - follower228: terminating thread VirtualThread[#615,follower228-writer-93]/waiting 09:08:37,224 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 commands after 5.694 s 09:08:37,224 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: completed 1 commands in 43.63 μs 09:08:37,224 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: journal writer stopped 09:08:37,224 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower228: journal closed 09:08:37,224 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - follower228: journal closed 09:08:37,224 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower228: stopped executor with 0 remaining tasks 09:08:37,224 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower228: stopped executor with 0 remaining tasks 09:08:37,224 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader227-collector231#1024160710] 09:08:37,225 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader227] 09:08:37,225 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRaftStorage - leader227: terminating thread VirtualThread[#619,leader227-writer-95]/waiting 09:08:37,225 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: received 1 commands after 5.043 s 09:08:37,225 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: completed 1 commands in 17.38 μs 09:08:37,225 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: journal writer stopped 09:08:37,225 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader227: journal closed 09:08:37,225 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - leader227: journal closed 09:08:37,225 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks 09:08:37,225 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks [WARN] [06/30/2025 09:08:37.231] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower233]: org.opendaylight.controller.cluster.common.actor.Monitor@19e140c5 09:08:37,232 AM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - follower233: Starting recovery with journal batch size 1000 09:08:37,232 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower233: started executor 09:08:37,232 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower233: started executor 09:08:37,233 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower233: metadata journal open: replayFrom=1 applyTo=0 09:08:37,234 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower233: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:08:37,234 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - follower233: journal open: applyTo=0 09:08:37,234 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: journal writer started 09:08:37,234 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting to receive commands 09:08:37,237 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11503863712738248640/follower233/TermInfo.properties does not exist 09:08:37,237 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower233: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11503863712738248640/follower233/journal-v1-1.log 09:08:37,237 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower233: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11503863712738248640/follower233/metadata-v1-1.log 09:08:37,237 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower233: no eligible files found 09:08:37,237 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - follower233: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [06/30/2025 09:08:37.239] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader232]: org.opendaylight.controller.cluster.common.actor.Monitor@390e5cbc 09:08:37,239 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - leader232: Starting recovery with journal batch size 1000 09:08:37,240 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader232: started executor 09:08:37,240 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader232: started executor 09:08:37,241 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader232: metadata journal open: replayFrom=1 applyTo=0 09:08:37,241 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader232: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:08:37,241 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader232: journal open: applyTo=0 09:08:37,241 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: journal writer started 09:08:37,242 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting to receive commands 09:08:37,242 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower233: Set currentTerm=0, votedFor=null 09:08:37,242 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - follower233: Local TermInfo store seeded with TermInfo{term=0} 09:08:37,242 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower233: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@1250080f 09:08:37,242 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from -1 to -1 09:08:37,243 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - follower233: journal recovery completedin 306.9 μs with journalIndex=1 09:08:37,243 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11503863712738248640/leader232/TermInfo.properties does not exist 09:08:37,243 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader232: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11503863712738248640/leader232/journal-v1-1.log 09:08:37,243 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader232: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11503863712738248640/leader232/metadata-v1-1.log 09:08:37,243 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader232: no eligible files found 09:08:37,243 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader232: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:08:37,248 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader232: Set currentTerm=0, votedFor=null 09:08:37,248 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader232: Local TermInfo store seeded with TermInfo{term=0} 09:08:37,248 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader232: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@414f2748 09:08:37,248 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from -1 to -1 09:08:37,248 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader232: journal recovery completedin 380.6 μs with journalIndex=1 09:08:37,737 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 09:08:37,737 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader232 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed) 09:08:37,737 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader232 (Follower): Received ElectionTimeout - switching to Candidate 09:08:37,737 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader232 (Candidate): Election: Candidate has following voting peers: [follower234, follower233] 09:08:37,741 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader232: Set currentTerm=1, votedFor=leader232 09:08:37,741 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - leader232 (Candidate): Starting new election term 1 09:08:37,741 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader232 (Candidate): Sending RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} to peer follower234 09:08:37,741 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader232 (Candidate): Sending RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} to peer follower233 09:08:37,741 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader232 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 09:08:37,741 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower233 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. [WARN] [06/30/2025 09:08:37.741] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} 09:08:37,741 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower233 (Follower): Cluster state: [] 09:08:37,741 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower233 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 09:08:37,741 AM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower233 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 09:08:37,745 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower233: Set currentTerm=1, votedFor=null 09:08:37,746 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower233 (Follower): In requestVote: RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 09:08:37,748 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower233: Set currentTerm=1, votedFor=leader232 09:08:37,748 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower233 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 09:08:37,748 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader232 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 09:08:37,748 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader232 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 09:08:37,749 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): Election: Leader has following peers: [follower234, follower233] 09:08:37,749 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:08:37,749 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:08:37,749 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader232 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 [WARN] [06/30/2025 09:08:37.749] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:37,749 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Last sync leader does not match current leader leader232, need to catch up to -1 09:08:37,749 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: -1, nextIndex: 0 09:08:37,749 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [06/30/2025 09:08:37.750] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower233] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower233, initialSyncDone=false] 09:08:37,754 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader232: Persist data index=0 term=1 command=zero 09:08:37,754 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader232: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:08:37,754 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 09:08:37,754 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:08:37,754 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 commands after 512.6 ms 09:08:37,754 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:08:37,754 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 0 is present for follower follower233 09:08:37,754 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower233: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 09:08:37,755 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 09:08:37,755 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): Number of entries to be appended = 1 09:08:37,755 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 09:08:37,755 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): Append entry to log zero 09:08:37,755 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower233: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:08:37,755 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): Log size is now 1 09:08:37,755 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower233, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:08:37,755 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: 0, nextIndex: 1 09:08:37,755 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 commands after 520.4 ms 09:08:37,755 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:08:37,755 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached -1 (of expected -1) 09:08:37,755 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower233: awaiting more completions to resolve 1 deferred callback(s) [WARN] [06/30/2025 09:08:37.755] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:37,759 AM [leader232-writer-97] [DEBUG] EntryStoreCompleter - leader232: 1 completion(s) pending 09:08:37,759 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: completed 1 commands in 4.291 ms 09:08:37,759 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting to receive commands 09:08:37,759 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - leader232: running 1 completion(s) 09:08:37,759 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader232: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:08:37,759 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader232 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 09:08:37,759 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader232 (Leader): Setting last applied to 0 09:08:37,759 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from -1 to 0 09:08:37,759 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader232: Applying state for log index 0 data zero 09:08:37,759 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader232: applyState called: zero 09:08:37,759 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 commands after 383.1 μs 09:08:37,759 AM [follower233-writer-96] [DEBUG] EntryStoreCompleter - follower233: 1 completion(s) pending 09:08:37,759 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: completed 1 commands in 138.6 μs 09:08:37,759 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: completed 1 commands in 4.125 ms 09:08:37,759 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting to receive commands 09:08:37,759 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting to receive commands 09:08:37,759 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower233: running 1 completion(s) 09:08:37,759 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower233: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 09:08:37,759 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower233: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@1f38310d [WARN] [06/30/2025 09:08:37.759] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower233] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower233, initialSyncDone=true] 09:08:37,855 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader232: Persist data index=1 term=1 command=one 09:08:37,855 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader232: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:08:37,855 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 commands after 95.92 ms 09:08:37,855 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 1 is present for follower follower233 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower233: AppendEntries{term=1, leaderId=leader232, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): Number of entries to be appended = 1 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): Append entry to log one 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower233: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): Log size is now 2 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): Commit index set to 0 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower233, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 0 (of expected -1) 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 [WARN] [06/30/2025 09:08:37.856] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower233 (Follower): Setting last applied to 0 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from -1 to 0 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower233: Applying state for log index 0 data zero 09:08:37,856 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower233: applyState called: zero 09:08:37,857 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower233: awaiting more completions to resolve 1 deferred callback(s) 09:08:37,857 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 commands after 97.31 ms 09:08:37,857 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: 1, nextIndex: 2 09:08:37,857 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:08:37,857 AM [leader232-writer-97] [DEBUG] EntryStoreCompleter - leader232: 1 completion(s) pending 09:08:37,857 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: completed 1 commands in 1.854 ms 09:08:37,857 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting to receive commands 09:08:37,858 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader232: running 1 completion(s) 09:08:37,858 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader232: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:08:37,858 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 09:08:37,858 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader232 (Leader): Setting last applied to 1 09:08:37,858 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from 0 to 1 09:08:37,858 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader232: Applying state for log index 1 data one 09:08:37,858 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader232: applyState called: one 09:08:37,858 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 commands after 1.206 ms 09:08:37,859 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: completed 1 commands in 401.6 μs 09:08:37,859 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting to receive commands 09:08:37,860 AM [follower233-writer-96] [DEBUG] EntryStoreCompleter - follower233: 1 completion(s) pending 09:08:37,860 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower233: running 1 completion(s) 09:08:37,860 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower233: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 09:08:37,860 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower233: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@76d276e0 09:08:37,860 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: completed 1 commands in 2.943 ms 09:08:37,860 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 commands after 10.19 μs 09:08:37,860 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: completed 1 commands in 167.2 μs 09:08:37,860 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting to receive commands [WARN] [06/30/2025 09:08:37.867] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:08:37.959] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower234]: org.opendaylight.controller.cluster.common.actor.Monitor@771d4f23 09:08:37,960 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower234: Starting recovery with journal batch size 1000 09:08:37,960 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower234: started executor 09:08:37,960 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower234: started executor 09:08:37,961 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower234: metadata journal open: replayFrom=1 applyTo=0 09:08:37,961 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower234: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:08:37,961 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower234: journal open: applyTo=0 09:08:37,962 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: journal writer started 09:08:37,962 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: waiting to receive commands 09:08:37,963 AM [test-pekko.actor.default-dispatcher-17] [INFO] PeerInfos - leader232: Peer address for peer follower234 set to pekko://test/user/follower234 09:08:37,963 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader232: Persist data index=2 term=1 command=two 09:08:37,963 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader232: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:08:37,963 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 09:08:37,963 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:08:37,963 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:08:37,963 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 2 is present for follower follower233 09:08:37,963 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower233: AppendEntries{term=1, leaderId=leader232, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 09:08:37,963 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11503863712738248640/follower234/TermInfo.properties does not exist 09:08:37,963 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11503863712738248640/follower234/journal-v1-1.log 09:08:37,963 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 09:08:37,963 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11503863712738248640/follower234/metadata-v1-1.log 09:08:37,963 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): Number of entries to be appended = 1 09:08:37,963 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower234: no eligible files found 09:08:37,963 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 09:08:37,963 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): Append entry to log two 09:08:37,963 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower233: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:08:37,963 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower234: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:08:37,963 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 commands after 104.5 ms 09:08:37,964 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 commands after 103.6 ms 09:08:37,964 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): Log size is now 3 09:08:37,964 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): Commit index set to 1 09:08:37,964 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower233, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:08:37,964 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 1 (of expected -1) 09:08:37,964 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 2 09:08:37,964 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower233 (Follower): Setting last applied to 1 09:08:37,964 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from 0 to 1 09:08:37,964 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: 2, nextIndex: 3 09:08:37,964 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower233: Applying state for log index 1 data one 09:08:37,965 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:08:37,964 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower233: applyState called: one 09:08:37,965 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower233: awaiting more completions to resolve 1 deferred callback(s) 09:08:37,966 AM [leader232-writer-97] [DEBUG] EntryStoreCompleter - leader232: 1 completion(s) pending 09:08:37,966 AM [follower233-writer-96] [DEBUG] EntryStoreCompleter - follower233: 1 completion(s) pending 09:08:37,966 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: completed 1 commands in 2.128 ms 09:08:37,966 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: completed 1 commands in 2.368 ms 09:08:37,966 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryStoreCompleter - leader232: running 1 completion(s) 09:08:37,966 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting to receive commands 09:08:37,966 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 commands after 5.900 μs 09:08:37,966 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader232: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:08:37,966 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader232 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1 09:08:37,966 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - leader232 (Leader): Setting last applied to 2 09:08:37,966 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from 1 to 2 09:08:37,966 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader232: Applying state for log index 2 data two 09:08:37,966 AM [test-pekko.actor.default-dispatcher-14] [INFO] MockRaftActor - leader232: applyState called: two 09:08:37,966 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: completed 1 commands in 174.2 μs 09:08:37,966 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting to receive commands 09:08:37,966 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 commands after 305.8 μs 09:08:37,966 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: completed 1 commands in 103.3 μs 09:08:37,966 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting to receive commands 09:08:37,967 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower233: running 1 completion(s) 09:08:37,967 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower233: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 09:08:37,967 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower233: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@4295d0ef 09:08:37,967 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=0, votedFor=null 09:08:37,967 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower234: Local TermInfo store seeded with TermInfo{term=0} 09:08:37,967 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower234: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@2f1c2739 09:08:37,967 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to -1 09:08:37,967 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower234: journal recovery completedin 217.1 μs with journalIndex=1 09:08:37,968 AM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower234 (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term 09:08:37,969 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=1, votedFor=null 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Last sync leader does not match current leader leader232, need to catch up to -1 09:08:37,970 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower234 updated: matchIndex: -1, nextIndex: 0 09:08:37,970 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: true, followerNextIndex: 0, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:08:37,970 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 0 is present for follower follower234 09:08:37,970 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower234: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=false}, JournaledLogEntry{index=1, term=1, command=one, pending=false}, JournaledLogEntry{index=2, term=1, command=two, pending=false}]} 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower234 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=false}, JournaledLogEntry{index=1, term=1, command=one, pending=false}, JournaledLogEntry{index=2, term=1, command=two, pending=false}]} 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower234 (Follower): Number of entries to be appended = 3 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower234 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower234 (Follower): Append entry to log zero 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower234: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=false} 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower234 (Follower): Append entry to log one 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower234: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=false} 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower234 (Follower): Append entry to log two 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower234: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=false} 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower234 (Follower): Log size is now 3 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower234 (Follower): Commit index set to 2 09:08:37,970 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: received 2 commands after 8.189 ms 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower234 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower234, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower234 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): -1, lastIndex(): 2 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 0 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to 0 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower234: Applying state for log index 0 data zero 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower234: applyState called: zero 09:08:37,970 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower234 updated: matchIndex: 2, nextIndex: 3 09:08:37,970 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - leader232: fakeSnapshot purging log to 1 for term 1 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 1 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 0 to 1 [WARN] [06/30/2025 09:08:37.970] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=false] 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower234: Applying state for log index 1 data one 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower234: applyState called: one 09:08:37,970 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: 1 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 2 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 1 to 2 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower234: Applying state for log index 2 data two 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower234: applyState called: two 09:08:37,970 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower234: awaiting more completions to resolve 3 deferred callback(s) 09:08:37,975 AM [follower234-writer-98] [DEBUG] EntryStoreCompleter - follower234: 2 completion(s) pending 09:08:37,975 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower234: running 2 completion(s) 09:08:37,975 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower234: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 09:08:37,975 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower234: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@398c5538 09:08:37,975 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower234: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 09:08:37,975 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower234: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@78198f02 09:08:37,975 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower234: awaiting more completions to resolve 1 deferred callback(s) 09:08:37,975 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: completed 2 commands in 4.818 ms 09:08:37,975 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: received 2 commands after 9.810 μs 09:08:37,976 AM [follower234-writer-98] [DEBUG] EntryStoreCompleter - follower234: 1 completion(s) pending 09:08:37,976 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower234: running 1 completion(s) 09:08:37,976 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower234: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 09:08:37,976 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower234: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@2005752f 09:08:37,976 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: completed 2 commands in 1.101 ms 09:08:37,976 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: waiting to receive commands [WARN] [06/30/2025 09:08:37.976] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=true] 09:08:38,106 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower233 (Follower): Commit index set to 2 09:08:38,107 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:38,107 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:38,107 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower233 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): 1, lastIndex(): 2 09:08:38,107 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower233 (Follower): Setting last applied to 2 09:08:38,107 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - follower234: fakeSnapshot purging log to 1 for term 1 09:08:38,107 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from 1 to 2 09:08:38,107 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower233: Applying state for log index 2 data two 09:08:38,107 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower233: applyState called: two 09:08:38,107 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - follower233: fakeSnapshot purging log to 1 for term 1 09:08:38,107 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 commands after 140.6 ms 09:08:38,107 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: completed 1 commands in 280.7 μs 09:08:38,107 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting to receive commands 09:08:38,177 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - follower234: terminating thread VirtualThread[#625,follower234-writer-98]/waiting 09:08:38,177 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: received 1 commands after 200.8 ms 09:08:38,177 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: completed 1 commands in 23.26 μs 09:08:38,177 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: journal writer stopped 09:08:38,177 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower234: journal closed 09:08:38,177 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower234: journal closed 09:08:38,177 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks 09:08:38,177 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks [WARN] [06/30/2025 09:08:38.181] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower234]: org.opendaylight.controller.cluster.common.actor.Monitor@2fd6142c 09:08:38,182 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower234: Starting recovery with journal batch size 1000 09:08:38,182 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower234: started executor 09:08:38,182 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower234: started executor 09:08:38,183 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower234: metadata journal open: replayFrom=1 applyTo=2 09:08:38,184 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower234: journal open: firstIndex=1 lastIndex=3 replayFrom=1 fileEntries=0 09:08:38,184 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower234: journal open: applyTo=2 09:08:38,185 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: journal writer started 09:08:38,185 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: waiting to receive commands 09:08:38,185 AM [test-pekko.actor.default-dispatcher-15] [INFO] PeerInfos - leader232: Peer address for peer follower234 set to pekko://test/user/follower234 09:08:38,186 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=1, votedFor=null 09:08:38,187 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11503863712738248640/follower234/TermInfo.properties 09:08:38,187 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11503863712738248640/follower234/journal-v1-1.log 09:08:38,187 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11503863712738248640/follower234/metadata-v1-1.log 09:08:38,187 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower234: no eligible files found 09:08:38,187 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower234: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:08:38,187 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - follower234: restoring local TermInfo{term=1} 09:08:38,187 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=1, votedFor=null 09:08:38,187 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower234: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@74a8b17b 09:08:38,187 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to -1 09:08:38,187 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower234: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 09:08:38,188 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower234: recovered journal DefaultLogEntry[index=1, term=1, command=one] 09:08:38,188 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower234: recovered journal DefaultLogEntry[index=2, term=1, command=two] 09:08:38,188 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower234: journal recovery completedin 1.517 ms with journalIndex=1 09:08:38,227 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower234 (Follower): Commit index set to 2 09:08:38,227 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Last sync leader does not match current leader leader232, need to catch up to 2 09:08:38,227 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower234 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): -1, lastIndex(): 2 09:08:38,227 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 0 09:08:38,227 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to 0 09:08:38,227 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower234: Applying state for log index 0 data zero 09:08:38,227 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower234: applyState called: zero 09:08:38,227 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:38,227 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 1 09:08:38,227 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 0 to 1 09:08:38,227 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower234: Applying state for log index 1 data one 09:08:38,227 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower234: applyState called: one 09:08:38,227 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 2 09:08:38,227 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 1 to 2 09:08:38,227 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower234: Applying state for log index 2 data two 09:08:38,227 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower234: applyState called: two 09:08:38,227 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - follower234: fakeSnapshot purging log to 1 for term 1 09:08:38,227 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: received 1 commands after 42.55 ms [WARN] [06/30/2025 09:08:38.228] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=false] 09:08:38,228 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: completed 1 commands in 371.5 μs 09:08:38,228 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: waiting to receive commands 09:08:38,347 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:38,347 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) [WARN] [06/30/2025 09:08:38.347] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=true] 09:08:38,467 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:38,467 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:38,587 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:38,587 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:38,707 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:38,707 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:38,826 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:38,826 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:38,947 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:38,947 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:39,67 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:39,67 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:39,187 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:39,187 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:39,307 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:39,307 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:39,426 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:39,427 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:39,547 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:39,547 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:39,667 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:39,667 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:39,787 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:39,787 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:39,907 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:39,907 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:40,27 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:40,27 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:40,147 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:40,147 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:40,267 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:40,267 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:40,386 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:40,387 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:40,507 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:40,507 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:40,627 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:40,627 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:40,746 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:40,747 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:40,866 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:40,867 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:40,976 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:40,977 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:41,96 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:41,97 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:41,217 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:41,217 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:41,337 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:41,337 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:41,457 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:41,457 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:41,576 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:41,576 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:41,696 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:41,696 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:41,817 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:41,817 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:41,937 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:41,937 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:42,56 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:42,56 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:42,177 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:42,177 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:42,297 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:42,297 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:42,417 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:42,417 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:42,537 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:42,537 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:42,657 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:42,657 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:42,776 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:42,776 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:42,897 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:42,897 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:43,16 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:43,17 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:43,137 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:08:43,137 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:08:43,217 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower233-collector235#-2083119337] 09:08:43,228 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower233] 09:08:43,229 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRaftStorage - follower233: terminating thread VirtualThread[#621,follower233-writer-96]/waiting 09:08:43,229 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 commands after 5.122 s 09:08:43,229 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: completed 1 commands in 38.74 μs 09:08:43,229 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: journal writer stopped 09:08:43,230 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower233: journal closed 09:08:43,230 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - follower233: journal closed 09:08:43,230 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower233: stopped executor with 0 remaining tasks 09:08:43,230 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower233: stopped executor with 0 remaining tasks 09:08:43,230 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader232-collector236#-1549496016] 09:08:43,230 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader232] 09:08:43,230 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRaftStorage - leader232: terminating thread VirtualThread[#622,leader232-writer-97]/waiting 09:08:43,230 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 commands after 5.264 s 09:08:43,230 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: completed 1 commands in 17.13 μs 09:08:43,230 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: journal writer stopped 09:08:43,231 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader232: journal closed 09:08:43,231 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - leader232: journal closed 09:08:43,231 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader232: stopped executor with 0 remaining tasks 09:08:43,231 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader232: stopped executor with 0 remaining tasks 09:08:43,231 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower234-collector237#-1364217774] 09:08:43,231 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower234] 09:08:43,232 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower234-collector238#-1107820626] 09:08:43,232 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower234] 09:08:43,232 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRaftStorage - follower234: terminating thread VirtualThread[#628,follower234-writer-99]/waiting 09:08:43,232 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: received 1 commands after 5.005 s 09:08:43,232 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: completed 1 commands in 17.23 μs 09:08:43,232 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: journal writer stopped 09:08:43,233 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower234: journal closed 09:08:43,233 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - follower234: journal closed 09:08:43,233 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks 09:08:43,233 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks 09:08:43,243 AM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - follower240: Starting recovery with journal batch size 1000 09:08:43,243 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower240: started executor 09:08:43,243 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower240: started executor 09:08:43,243 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower240: metadata journal open: replayFrom=1 applyTo=0 [WARN] [06/30/2025 09:08:43.244] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower240]: org.opendaylight.controller.cluster.common.actor.Monitor@ff301e0 09:08:43,244 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower240: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:08:43,244 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - follower240: journal open: applyTo=0 09:08:43,244 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: journal writer started 09:08:43,244 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting to receive commands 09:08:43,246 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10169067618624235353/follower240/TermInfo.properties does not exist 09:08:43,246 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower240: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10169067618624235353/follower240/journal-v1-1.log [WARN] [06/30/2025 09:08:43.246] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader239]: org.opendaylight.controller.cluster.common.actor.Monitor@704de656 09:08:43,246 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower240: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10169067618624235353/follower240/metadata-v1-1.log 09:08:43,246 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower240: no eligible files found 09:08:43,246 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower240: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:08:43,246 AM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - leader239: Starting recovery with journal batch size 1000 09:08:43,246 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader239: started executor 09:08:43,246 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader239: started executor 09:08:43,247 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader239: metadata journal open: replayFrom=1 applyTo=0 09:08:43,247 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader239: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:08:43,247 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - leader239: journal open: applyTo=0 09:08:43,247 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: journal writer started 09:08:43,247 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:08:43,248 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10169067618624235353/leader239/TermInfo.properties does not exist 09:08:43,248 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10169067618624235353/leader239/journal-v1-1.log 09:08:43,248 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10169067618624235353/leader239/metadata-v1-1.log 09:08:43,248 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader239: no eligible files found 09:08:43,248 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader239: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:08:43,248 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=0, votedFor=null 09:08:43,248 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower240: Local TermInfo store seeded with TermInfo{term=0} 09:08:43,248 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower240: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@3b6ad890 09:08:43,249 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from -1 to -1 09:08:43,249 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower240: journal recovery completedin 259.3 μs with journalIndex=1 09:08:43,252 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=0, votedFor=null 09:08:43,252 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader239: Local TermInfo store seeded with TermInfo{term=0} 09:08:43,252 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader239: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@5b953291 09:08:43,252 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to -1 09:08:43,253 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader239: journal recovery completedin 562.2 μs with journalIndex=1 09:08:43,686 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 09:08:43,687 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader239 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed) 09:08:43,687 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader239 (Follower): Received ElectionTimeout - switching to Candidate 09:08:43,687 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader239 (Candidate): Election: Candidate has following voting peers: [follower241, follower240] 09:08:43,691 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=1, votedFor=leader239 09:08:43,691 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader239 (Candidate): Starting new election term 1 09:08:43,691 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} to peer follower241 09:08:43,691 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} to peer follower240 09:08:43,691 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader239 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 09:08:43,691 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower240 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 09:08:43,691 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower240 (Follower): Cluster state: [] 09:08:43,691 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower240 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 09:08:43,691 AM [test-pekko.actor.default-dispatcher-14] [INFO] Follower - follower240 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term [WARN] [06/30/2025 09:08:43.691] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} 09:08:43,693 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=1, votedFor=null 09:08:43,693 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower240 (Follower): In requestVote: RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 09:08:43,695 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=1, votedFor=leader239 09:08:43,695 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower240 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 09:08:43,695 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader239 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 09:08:43,695 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader239 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 09:08:43,695 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader239 (Leader): Election: Leader has following peers: [follower241, follower240] 09:08:43,696 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:08:43,696 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:08:43,696 AM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader239 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 [WARN] [06/30/2025 09:08:43.696] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:43,696 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Last sync leader does not match current leader leader239, need to catch up to -1 09:08:43,696 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: -1, nextIndex: 0 09:08:43,696 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [06/30/2025 09:08:43.696] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower240] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower240, initialSyncDone=false] 09:08:43,706 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Persist data index=0 term=1 command=zero 09:08:43,706 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:08:43,707 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 09:08:43,707 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:08:43,707 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:08:43,707 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 0 is present for follower follower240 09:08:43,707 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 commands after 459.7 ms 09:08:43,707 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Sending AppendEntries to follower follower240: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} [WARN] [06/30/2025 09:08:43.707] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:43,707 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 09:08:43,707 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): Number of entries to be appended = 1 09:08:43,707 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 09:08:43,707 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): Append entry to log zero 09:08:43,707 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:08:43,707 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): Log size is now 1 09:08:43,707 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower240, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:08:43,707 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 commands after 463.0 ms 09:08:43,707 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached -1 (of expected -1) 09:08:43,707 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 1 deferred callback(s) 09:08:43,707 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader239 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 0, nextIndex: 1 09:08:43,708 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:08:43,711 AM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 09:08:43,711 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 3.949 ms 09:08:43,711 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 09:08:43,711 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:08:43,711 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:08:43,711 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader239 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 09:08:43,711 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - leader239 (Leader): Setting last applied to 0 09:08:43,711 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to 0 09:08:43,711 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader239: Applying state for log index 0 data zero 09:08:43,711 AM [test-pekko.actor.default-dispatcher-14] [INFO] MockRaftActor - leader239: applyState called: zero 09:08:43,711 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 commands after 344.6 μs 09:08:43,711 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 125.7 μs 09:08:43,711 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:08:43,712 AM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 1 completion(s) pending 09:08:43,712 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: completed 1 commands in 4.334 ms 09:08:43,712 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting to receive commands 09:08:43,712 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower240: running 1 completion(s) 09:08:43,712 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 09:08:43,712 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@65c45b35 [WARN] [06/30/2025 09:08:43.712] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower240] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower240, initialSyncDone=true] [WARN] [06/30/2025 09:08:43.807] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:43,809 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Persist data index=1 term=1 command=one 09:08:43,809 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:08:43,809 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 09:08:43,809 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:08:43,809 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 commands after 97.84 ms 09:08:43,809 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:08:43,809 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 1 is present for follower follower240 09:08:43,809 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Sending AppendEntries to follower follower240: AppendEntries{term=1, leaderId=leader239, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 09:08:43,809 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader239, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 09:08:43,809 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): Number of entries to be appended = 1 09:08:43,809 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 09:08:43,809 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): Append entry to log one 09:08:43,809 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:08:43,810 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): Log size is now 2 09:08:43,810 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): Commit index set to 0 09:08:43,810 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 commands after 97.83 ms 09:08:43,810 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower240, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} [WARN] [06/30/2025 09:08:43.809] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:43,810 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 0 (of expected -1) 09:08:43,810 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 09:08:43,810 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 0 09:08:43,810 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from -1 to 0 09:08:43,810 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower240: Applying state for log index 0 data zero 09:08:43,810 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower240: applyState called: zero 09:08:43,810 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader239 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 1, nextIndex: 2 09:08:43,810 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 1 deferred callback(s) 09:08:43,810 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:08:43,812 AM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 1 completion(s) pending 09:08:43,812 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: completed 1 commands in 2.026 ms 09:08:43,812 AM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 09:08:43,812 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 commands after 24.39 μs 09:08:43,812 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower240: running 1 completion(s) 09:08:43,812 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 2.456 ms 09:08:43,812 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 09:08:43,812 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:08:43,812 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 09:08:43,812 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@11d1d5c8 09:08:43,812 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: completed 1 commands in 65.37 μs 09:08:43,812 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting to receive commands 09:08:43,812 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:08:43,812 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader239 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 09:08:43,812 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader239 (Leader): Setting last applied to 1 09:08:43,812 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 0 to 1 09:08:43,812 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader239: Applying state for log index 1 data one 09:08:43,812 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - leader239: applyState called: one 09:08:43,812 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 commands after 437.7 μs 09:08:43,812 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 125.5 μs 09:08:43,812 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:08:43,912 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Persist data index=2 term=1 command=two 09:08:43,912 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:08:43,912 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 09:08:43,912 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:08:43,913 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:08:43,913 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 2 is present for follower follower240 09:08:43,913 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Sending AppendEntries to follower follower240: AppendEntries{term=1, leaderId=leader239, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 09:08:43,913 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Persist data index=3 term=1 command=three [WARN] [06/30/2025 09:08:43.913] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:43,913 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 09:08:43,913 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true 09:08:43,913 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 commands after 100.3 ms 09:08:43,913 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:08:43,913 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:08:43,913 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 2 is present for follower follower240 [WARN] [06/30/2025 09:08:43.913] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:43,916 AM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 09:08:43,916 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 2.975 ms 09:08:43,916 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 commands after 8.670 μs 09:08:43,916 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 09:08:43,916 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:08:43,918 AM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 09:08:43,918 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 2.520 ms 09:08:43,918 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:08:43,918 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 09:08:43,919 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true} 09:08:43,919 AM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader239: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=2, mandatoryTrim=false] 09:08:43,919 AM [test-pekko.actor.default-dispatcher-11] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:349) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) [ERROR] [06/30/2025 09:08:43.919] [test-pekko.actor.internal-dispatcher-4] [pekko://test/user/leader239] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:349) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 09:08:43,920 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader239: terminating thread VirtualThread[#630,leader239-writer-101]/waiting 09:08:43,920 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 commands after 1.582 ms 09:08:43,920 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 23.02 μs 09:08:43,920 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: journal writer stopped 09:08:43,921 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader239: journal closed 09:08:43,921 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader239: journal closed 09:08:43,921 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks 09:08:43,921 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks [WARN] [06/30/2025 09:08:43.921] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader239]: org.opendaylight.controller.cluster.common.actor.Monitor@7d0977d1 09:08:43,923 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader239: Starting recovery with journal batch size 1000 09:08:43,923 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader239: started executor 09:08:43,923 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader239: started executor 09:08:43,924 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader239: metadata journal open: replayFrom=1 applyTo=1 09:08:43,925 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader239: journal open: firstIndex=1 lastIndex=4 replayFrom=1 fileEntries=0 09:08:43,925 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader239: journal open: applyTo=1 09:08:43,925 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: journal writer started 09:08:43,925 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:08:43,927 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=1, votedFor=leader239 09:08:43,927 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10169067618624235353/leader239/TermInfo.properties 09:08:43,927 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10169067618624235353/leader239/journal-v1-1.log 09:08:43,927 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10169067618624235353/leader239/metadata-v1-1.log 09:08:43,927 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader239: no eligible files found 09:08:43,927 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader239: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:08:43,927 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - leader239: restoring local TermInfo{term=1, votedFor=leader239} 09:08:43,927 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=1, votedFor=leader239 09:08:43,927 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader239: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@36742497 09:08:43,927 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to -1 09:08:43,928 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 09:08:43,928 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=1, term=1, command=one] 09:08:43,928 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=2, term=1, command=two] 09:08:43,928 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=3, term=1, command=three] 09:08:43,928 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader239: journal recovery completedin 1.305 ms with journalIndex=1 09:08:44,427 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader239 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed) 09:08:44,427 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader239 (Follower): Received ElectionTimeout - switching to Candidate 09:08:44,427 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader239 (Candidate): Election: Candidate has following voting peers: [follower241, follower240] 09:08:44,431 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=2, votedFor=leader239 09:08:44,431 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader239 (Candidate): Starting new election term 2 09:08:44,431 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} to peer follower241 09:08:44,432 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} to peer follower240 09:08:44,432 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 09:08:44,432 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): Cluster state: [] 09:08:44,432 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} with higher term appears reachable, updating term. 09:08:44,432 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower240 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1}" message is greater than follower's term 1 - updating term [WARN] [06/30/2025 09:08:44.432] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} 09:08:44,432 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader239 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 09:08:44,434 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=2, votedFor=null 09:08:44,434 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): In requestVote: RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} - currentTerm: 2, votedFor: null, lastIndex: 1, lastTerm: 1 09:08:44,436 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=2, votedFor=leader239 09:08:44,437 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 09:08:44,437 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader239 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 09:08:44,437 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader239 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 09:08:44,437 AM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader239 (Candidate): LastApplied index -1 is behind last index 3 - switching to PreLeader 09:08:44,437 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (PreLeader): Election: Leader has following peers: [follower241, follower240] 09:08:44,437 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:08:44,437 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:08:44,437 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader239 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 2 09:08:44,437 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader239: Persist data index=4 term=2 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b 09:08:44,437 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b, pending=true} 09:08:44,437 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (PreLeader): Replicate message: identifier: null, logIndex: 4, isSendImmediate: true 09:08:44,437 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:08:44,437 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:08:44,437 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 commands after 512.1 ms [WARN] [06/30/2025 09:08:44.438] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:08:44.438] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:44,440 AM [leader239-writer-102] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 09:08:44,440 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 2.301 ms 09:08:44,440 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:08:44,440 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 09:08:44,440 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b, pending=true} 09:08:44,466 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader239: Persist data index=5 term=2 command=four 09:08:44,466 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=5, term=2, command=four, pending=true} 09:08:44,466 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (PreLeader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 5, isSendImmediate: true 09:08:44,466 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 09:08:44,466 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 commands after 25.95 ms 09:08:44,466 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 09:08:44,466 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging -1 entries behind leader leader239 and reached 0 (of expected -1) 09:08:44,466 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader239 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 1, nextIndex: 2 [WARN] [06/30/2025 09:08:44.466] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:44,466 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 09:08:44,466 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 09:08:44,467 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 5, leaderSnapShotIndex: -1 09:08:44,467 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader239 (PreLeader): sendAppendEntries: 2 is present for follower follower240 09:08:44,467 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader239 (PreLeader): Sending AppendEntries to follower follower240: AppendEntries{term=2, leaderId=leader239, prevLogIndex=1, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b, pending=false}, JournaledLogEntry{index=5, term=2, command=four, pending=true}]} 09:08:44,467 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader239, prevLogIndex=1, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b, pending=false}, JournaledLogEntry{index=5, term=2, command=four, pending=true}]} 09:08:44,467 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): Number of entries to be appended = 4 09:08:44,467 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 09:08:44,467 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): Append entry to log two 09:08:44,467 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=false} 09:08:44,467 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 commands after 655.5 ms 09:08:44,468 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): Append entry to log three 09:08:44,468 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=false} 09:08:44,468 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): Append entry to log org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b 09:08:44,468 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b, pending=false} 09:08:44,468 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): Append entry to log four 09:08:44,468 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=5, term=2, command=four, pending=true} 09:08:44,468 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): Log size is now 6 09:08:44,468 AM [leader239-writer-102] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 09:08:44,468 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower240, logLastIndex=5, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:08:44,468 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging -1 entries behind leader leader239 and reached 0 (of expected -1) 09:08:44,468 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 2.330 ms 09:08:44,468 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:08:44,468 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 4 deferred callback(s) 09:08:44,468 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 09:08:44,468 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=5, term=2, command=four, pending=true} 09:08:44,468 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 09:08:44,468 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 09:08:44,468 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 5, nextIndex: 6 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Applying to log - commitIndex: 5, lastAppliedIndex: -1 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 0 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to 0 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Applying state for log index 0 data zero 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader239: applyState called: zero 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 1 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 0 to 1 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Applying state for log index 1 data one 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader239: applyState called: one 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 2 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 1 to 2 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Applying state for log index 2 data two 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader239: applyState called: two 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 3 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 2 to 3 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Applying state for log index 3 data three 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader239: applyState called: three 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 4 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 3 to 4 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 5 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 4 to 5 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Applying state for log index 5 data four 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader239: applyState called: four 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 6, leaderLastIndex: 5, leaderSnapShotIndex: -1 09:08:44,469 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 commands after 812.2 μs 09:08:44,469 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PreLeader - leader239 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}] - lastApplied: 5, lastIndex: 5 09:08:44,469 AM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 1 completion(s) pending 09:08:44,469 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower240: running 1 completion(s) 09:08:44,469 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: completed 1 commands in 2.154 ms 09:08:44,469 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 243.1 μs 09:08:44,469 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 09:08:44,470 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 3 commands after 9.490 μs 09:08:44,470 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:08:44,470 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@7d475566 09:08:44,470 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 3 deferred callback(s) 09:08:44,470 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Election: Leader has following peers: [follower241, follower240] 09:08:44,470 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 09:08:44,470 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 6, leaderLastIndex: 5, leaderSnapShotIndex: -1 09:08:44,470 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader239 (PreLeader) :- Switching from behavior PreLeader to Leader, election term: 2 [WARN] [06/30/2025 09:08:44.470] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:44,473 AM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 3 completion(s) pending 09:08:44,473 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower240: running 3 completion(s) 09:08:44,473 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: completed 3 commands in 3.837 ms 09:08:44,473 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=false} 09:08:44,473 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting to receive commands 09:08:44,473 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@2e5349c0 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b, pending=false} 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@60424b31 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=5, term=2, command=four, pending=false} 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087ad08@7f1dd716 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): Commit index set to 5 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 5, context.getLastApplied(): 0, lastIndex(): 5 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 1 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 0 to 1 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower240: Applying state for log index 1 data one 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower240: applyState called: one 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 2 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 1 to 2 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower240: Applying state for log index 2 data two 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower240: applyState called: two 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 3 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 2 to 3 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower240: Applying state for log index 3 data three 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower240: applyState called: three 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 4 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 3 to 4 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower240: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@2b41bf8b 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 5 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 4 to 5 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower240: Applying state for log index 5 data four 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower240: applyState called: four 09:08:44,474 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 commands after 878.8 μs 09:08:44,474 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:08:44,474 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: completed 1 commands in 119.5 μs 09:08:44,475 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting to receive commands [WARN] [06/30/2025 09:08:44.587] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:44,587 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:08:44,707 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:44.707] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:44,827 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:44.827] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:44,947 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:44.947] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:08:45.067] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:45,67 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:45.186] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:45,187 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:45.307] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:45,307 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:45.427] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:45,427 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:08:45,546 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:45.546] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:45,667 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:45.667] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:45,787 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:45.787] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:45,906 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:45.906] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:46,26 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:46.027] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:08:46.147] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:46,147 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:08:46,267 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:46.267] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:46,387 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:46.387] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:46,507 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:46.507] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:46,626 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:46.626] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:46,747 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:46.747] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:46,867 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:46.867] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:46,987 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:46.987] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:47,107 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:47.107] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:47,226 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:47.226] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:08:47.346] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:47,347 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:08:47,466 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:47.466] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:47,587 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:47.587] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:08:47.707] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:47,707 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:08:47,826 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:47.826] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:47,947 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:47.947] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:48,57 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:48.057] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:48,166 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:48.166] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:48,287 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:48.287] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:48,407 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:48.407] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:08:48.527] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:48,527 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:08:48,647 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:48.647] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:08:48.766] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:48,767 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:08:48,886 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:48.886] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:49,7 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:49.007] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:08:49.127] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:49,127 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:08:49,247 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:49.247] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:49,366 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:49.367] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:49,486 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:08:49.486] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:08:49,489 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower240-collector242#-1521248177] 09:08:49,500 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower240] 09:08:49,500 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - follower240: terminating thread VirtualThread[#629,follower240-writer-100]/waiting 09:08:49,501 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 commands after 5.026 s 09:08:49,501 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: completed 1 commands in 48.54 μs 09:08:49,501 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: journal writer stopped 09:08:49,501 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower240: journal closed 09:08:49,501 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower240: journal closed 09:08:49,501 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower240: stopped executor with 0 remaining tasks 09:08:49,501 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower240: stopped executor with 0 remaining tasks 09:08:49,501 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader239-collector243#-656974236] 09:08:49,502 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader239] 09:08:49,502 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - leader239: terminating thread VirtualThread[#633,leader239-writer-102]/waiting 09:08:49,502 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 commands after 5.032 s 09:08:49,502 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 18.63 μs 09:08:49,502 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: journal writer stopped 09:08:49,502 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader239: journal closed 09:08:49,502 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader239: journal closed 09:08:49,502 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks 09:08:49,502 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks 09:08:49,506 AM [test-pekko.actor.default-dispatcher-14] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [INFO] [06/30/2025 09:08:49.506] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [WARN] [06/30/2025 09:08:49.507] [test-pekko.actor.default-dispatcher-17] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.170.168:17355) 09:08:49,509 AM [test-pekko.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Exiting completed 09:08:49,509 AM [test-pekko.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Shutting down... 09:08:49,509 AM [test-pekko.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Successfully shut down [INFO] [06/30/2025 09:08:49.508] [test-pekko.actor.internal-dispatcher-10] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Exiting completed [INFO] [06/30/2025 09:08:49.508] [test-pekko.actor.internal-dispatcher-10] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Shutting down... [INFO] [06/30/2025 09:08:49.508] [test-pekko.actor.internal-dispatcher-10] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Successfully shut down [INFO] [06/30/2025 09:08:49.510] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.170.168:17355/system/remoting-terminator] Shutting down remote daemon. 09:08:49,510 AM [test-pekko.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. [INFO] [06/30/2025 09:08:49.510] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.170.168:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports. 09:08:49,510 AM [test-pekko.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [INFO] [06/30/2025 09:08:49.512] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.170.168:17355/system/remoting-terminator] Remoting shut down. [DEBUG] [06/30/2025 09:08:49.512] [test-pekko.actor.internal-dispatcher-3] [EventStream] shutting down: StandardOutLogger 09:08:49,512 AM [test-pekko.actor.default-dispatcher-15] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.