[DEBUG] [06/30/2025 09:49:07.104] [main] [EventStream(pekko://test)] logger log1-TestEventListener started 09:49:07,105 AM [test-pekko.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [06/30/2025 09:49:07.105] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started [DEBUG] [06/30/2025 09:49:07.105] [main] [EventStream(pekko://test)] Default Loggers started 09:49:07,116 AM [test-pekko.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.12:17355] with UID [-836350139941543940] 09:49:07,116 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.12:17355] - Starting up, Pekko version [1.0.3] ... [INFO] [06/30/2025 09:49:07.113] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.12:17355] with UID [-836350139941543940] 09:49:07,116 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.12:17355] - Registered cluster JMX MBean [pekko:type=Cluster] 09:49:07,116 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.12:17355] - Started up successfully [INFO] [06/30/2025 09:49:07.114] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.12:17355] - Starting up, Pekko version [1.0.3] ... [INFO] [06/30/2025 09:49:07.116] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.12:17355] - Registered cluster JMX MBean [pekko:type=Cluster] [INFO] [06/30/2025 09:49:07.116] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.12:17355] - Started up successfully [INFO] [06/30/2025 09:49:07.127] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.12:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing [INFO] [06/30/2025 09:49:07.127] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.12:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 09:49:07,129 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.12:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing 09:49:07,129 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.12:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining [WARN] [06/30/2025 09:49:07.130] [test-pekko.actor.default-dispatcher-13] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower223]: org.opendaylight.controller.cluster.common.actor.Monitor@5d23b91c [INFO] [pekkoDeadLetter][06/30/2025 09:49:07.130] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower223] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:49:07,130 AM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower223] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:49:07,132 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower223: Starting recovery with journal batch size 1000 09:49:07,132 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower223: started executor 09:49:07,132 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower223: started executor 09:49:07,134 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower223: metadata journal open: replayFrom=1 applyTo=0 09:49:07,135 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower223: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:49:07,135 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower223: journal open: applyTo=0 09:49:07,135 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: journal writer started 09:49:07,135 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting to receive commands [WARN] [06/30/2025 09:49:07.136] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader222]: org.opendaylight.controller.cluster.common.actor.Monitor@6aa4f3a3 09:49:07,136 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/follower223/TermInfo.properties does not exist 09:49:07,136 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower223: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/follower223/journal-v1-1.log 09:49:07,136 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower223: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/follower223/metadata-v1-1.log [INFO] [pekkoDeadLetter][06/30/2025 09:49:07.136] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:49:07,136 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower223: no eligible files found 09:49:07,136 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower223: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:49:07,137 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - leader222: Starting recovery with journal batch size 1000 09:49:07,137 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader222: started executor 09:49:07,137 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader222: started executor 09:49:07,138 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader222: metadata journal open: replayFrom=1 applyTo=0 09:49:07,138 AM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:49:07,138 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader222: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:49:07,138 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader222: journal open: applyTo=0 09:49:07,139 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: journal writer started 09:49:07,139 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:49:07,139 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=0, votedFor=null 09:49:07,139 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower223: Local TermInfo store seeded with TermInfo{term=0} 09:49:07,139 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower223: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@291bddd7 09:49:07,139 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from -1 to -1 09:49:07,140 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties does not exist 09:49:07,140 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:07,140 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:07,140 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower223: journal recovery completedin 281.9 μs with journalIndex=1 09:49:07,140 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:07,140 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader222: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:49:07,143 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=0, votedFor=null 09:49:07,143 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader222: Local TermInfo store seeded with TermInfo{term=0} 09:49:07,143 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@491085c3 09:49:07,143 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to -1 09:49:07,144 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader222: journal recovery completedin 390.1 μs with journalIndex=1 09:49:07,573 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 09:49:07,573 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader222 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.12:17355, Removed) 09:49:07,573 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader222 (Follower): Received ElectionTimeout - switching to Candidate 09:49:07,573 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader222 (Candidate): Election: Candidate has following voting peers: [follower223, follower224] 09:49:07,608 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222 09:49:07,608 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - leader222 (Candidate): Starting new election term 1 09:49:07,608 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} to peer follower223 09:49:07,608 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} to peer follower224 09:49:07,608 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader222 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 09:49:07,608 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower223 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 09:49:07,608 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower223 (Follower): Cluster state: [] 09:49:07,608 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower223 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 09:49:07,608 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower223 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term [WARN] [06/30/2025 09:49:07.609] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} [INFO] [pekkoDeadLetter][06/30/2025 09:49:07.609] [test-pekko.actor.default-dispatcher-5] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:49:07,609 AM [test-pekko.actor.default-dispatcher-6] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:49:07,611 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=1, votedFor=null 09:49:07,611 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower223 (Follower): In requestVote: RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 09:49:07,614 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=1, votedFor=leader222 09:49:07,614 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower223 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 09:49:07,614 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader222 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 09:49:07,614 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader222 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 09:49:07,615 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Election: Leader has following peers: [follower223, follower224] 09:49:07,615 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:49:07,615 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:49:07,615 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader222 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 09:49:07,615 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Last sync leader does not match current leader leader222, need to catch up to -1 [WARN] [06/30/2025 09:49:07.615] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower223] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower223, initialSyncDone=false] [WARN] [06/30/2025 09:49:07.615] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [INFO] [pekkoDeadLetter][06/30/2025 09:49:07.615] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower223] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][06/30/2025 09:49:07.615] [test-pekko.actor.default-dispatcher-12] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:49:07,615 AM [test-pekko.actor.default-dispatcher-16] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:49:07,615 AM [test-pekko.actor.default-dispatcher-16] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:49:07,616 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: -1, nextIndex: 0 09:49:07,616 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:49:07,659 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader222: Persist data index=0 term=1 command=zero 09:49:07,659 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:49:07,659 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 09:49:07,659 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:49:07,659 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 0 is present for follower follower223 09:49:07,659 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 09:49:07,659 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 commands after 520.8 ms 09:49:07,660 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:49:07,660 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} [WARN] [06/30/2025 09:49:07.660] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:07,660 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 [INFO] [pekkoDeadLetter][06/30/2025 09:49:07.660] [test-pekko.actor.default-dispatcher-12] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:49:07,660 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 09:49:07,660 AM [test-pekko.actor.default-dispatcher-11] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:49:07,660 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): Append entry to log zero 09:49:07,660 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:49:07,660 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 525.6 ms 09:49:07,661 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): Log size is now 1 09:49:07,661 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:49:07,661 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached -1 (of expected -1) 09:49:07,661 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 09:49:07,661 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 0, nextIndex: 1 09:49:07,661 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:49:07,663 AM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 09:49:07,664 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 4.073 ms 09:49:07,664 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 09:49:07,664 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:49:07,664 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:49:07,664 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 09:49:07,664 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 0 09:49:07,664 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to 0 09:49:07,664 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader222: Applying state for log index 0 data zero 09:49:07,664 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader222: applyState called: zero 09:49:07,664 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 commands after 484.6 μs 09:49:07,664 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 09:49:07,664 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 4.104 ms 09:49:07,665 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting to receive commands 09:49:07,664 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 245.0 μs 09:49:07,665 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:49:07,665 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 09:49:07,665 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 09:49:07,665 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@3be6fc53 [WARN] [06/30/2025 09:49:07.665] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower223] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower223, initialSyncDone=true] [INFO] [pekkoDeadLetter][06/30/2025 09:49:07.665] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower223] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:49:07,665 AM [test-pekko.actor.default-dispatcher-6] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [06/30/2025 09:49:07.734] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:07,734 AM [test-pekko.actor.default-dispatcher-16] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][06/30/2025 09:49:07.734] [test-pekko.actor.default-dispatcher-16] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:49:07,760 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader222: Persist data index=1 term=1 command=one 09:49:07,760 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:49:07,760 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 commands after 95.78 ms 09:49:07,761 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 09:49:07,761 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:49:07,761 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 1 is present for follower follower223 09:49:07,761 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 09:49:07,761 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 09:49:07,761 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 09:49:07,761 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 09:49:07,761 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): Append entry to log one 09:49:07,761 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:49:07,761 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): Log size is now 2 09:49:07,761 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): Commit index set to 0 09:49:07,761 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:49:07,761 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 0 (of expected -1) 09:49:07,761 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 09:49:07,761 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 0 09:49:07,762 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from -1 to 0 09:49:07,762 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower223: Applying state for log index 0 data zero 09:49:07,762 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower223: applyState called: zero 09:49:07,762 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 96.98 ms 09:49:07,762 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 09:49:07,762 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:49:07,762 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 1, nextIndex: 2 09:49:07,762 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 [WARN] [06/30/2025 09:49:07.762] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [INFO] [pekkoDeadLetter][06/30/2025 09:49:07.762] [test-pekko.actor.default-dispatcher-13] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:49:07,762 AM [test-pekko.actor.default-dispatcher-5] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:49:07,763 AM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 09:49:07,763 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 2.446 ms 09:49:07,763 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:49:07,763 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 09:49:07,763 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:49:07,763 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 09:49:07,763 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 1 09:49:07,763 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 0 to 1 09:49:07,763 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 1 data one 09:49:07,763 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader222: applyState called: one 09:49:07,764 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 commands after 582.4 μs 09:49:07,764 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 148.9 μs 09:49:07,764 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:49:07,764 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 09:49:07,764 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 09:49:07,764 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 2.187 ms 09:49:07,764 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 09:49:07,764 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 8.100 μs 09:49:07,764 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@226ffb0a 09:49:07,764 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 149.6 μs 09:49:07,764 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting to receive commands [WARN] [06/30/2025 09:49:07.853] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [INFO] [pekkoDeadLetter][06/30/2025 09:49:07.853] [test-pekko.actor.default-dispatcher-16] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:49:07,853 AM [test-pekko.actor.default-dispatcher-16] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:49:07,861 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Persist data index=2 term=1 command=two 09:49:07,861 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:49:07,861 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 09:49:07,861 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:49:07,861 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 2 is present for follower follower223 09:49:07,861 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 09:49:07,861 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 commands after 97.61 ms 09:49:07,862 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:49:07,862 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Persist data index=3 term=1 command=three 09:49:07,862 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 09:49:07,862 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true 09:49:07,862 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 09:49:07,862 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:49:07,862 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 2 is present for follower follower223 09:49:07,862 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 09:49:07,862 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:49:07,862 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 [WARN] [06/30/2025 09:49:07.862] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:07,862 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): Append entry to log two 09:49:07,862 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} [WARN] [06/30/2025 09:49:07.862] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:07,862 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 98.05 ms 09:49:07,863 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): Log size is now 3 09:49:07,863 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): Commit index set to 1 09:49:07,863 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:49:07,863 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 1 (of expected -1) 09:49:07,863 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 2 09:49:07,863 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 1 09:49:07,863 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 0 to 1 09:49:07,863 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower223: Applying state for log index 1 data one 09:49:07,863 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower223: applyState called: one 09:49:07,863 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 2, nextIndex: 3 09:49:07,863 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 3, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:49:07,863 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 3 is present for follower follower223 09:49:07,863 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 09:49:07,863 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=2, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=three, pending=true}]} 09:49:07,864 AM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 09:49:07,864 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 09:49:07,864 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 2.605 ms 09:49:07,864 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 09:49:07,864 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 commands after 7.720 μs 09:49:07,864 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:49:07,864 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 1.962 ms 09:49:07,864 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1 09:49:07,864 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 10.20 μs 09:49:07,864 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 2 09:49:07,864 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 1 to 2 09:49:07,864 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Applying state for log index 2 data two 09:49:07,864 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader222: applyState called: two 09:49:07,865 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 09:49:07,865 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 09:49:07,865 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@2e702c8 09:49:07,865 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 231.4 μs 09:49:07,865 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting to receive commands 09:49:07,865 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=2, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=three, pending=true}]} 09:49:07,865 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 09:49:07,865 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 2, entries to be added from: 0 09:49:07,865 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): Append entry to log three 09:49:07,865 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 09:49:07,865 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): Log size is now 4 09:49:07,865 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=3, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:49:07,865 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 299.7 μs 09:49:07,865 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 3, nextIndex: 4 09:49:07,865 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:49:07,865 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 1 (of expected -1) 09:49:07,865 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 09:49:07,866 AM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 09:49:07,866 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 1.575 ms 09:49:07,866 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 09:49:07,866 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true} 09:49:07,866 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 commands after 7.401 μs 09:49:07,866 AM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - leader222: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=2, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 09:49:07,866 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 164.7 μs 09:49:07,866 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:49:07,866 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 09:49:07,866 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 1.285 ms 09:49:07,866 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting to receive commands 09:49:07,866 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 09:49:07,866 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=false} 09:49:07,866 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@43da08f3 09:49:07,867 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): Commit index set to 2 09:49:07,867 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 2 (of expected -1) 09:49:07,867 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): 1, lastIndex(): 3 09:49:07,867 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 2 09:49:07,867 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 1 to 2 09:49:07,867 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower223: Applying state for log index 2 data two 09:49:07,867 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower223: applyState called: two [ERROR] [06/30/2025 09:49:07.866] [test-pekko.actor.internal-dispatcher-4] [pekko://test/user/leader222] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:139) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:349) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 09:49:07,867 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 620.2 μs 09:49:07,867 AM [test-pekko.actor.default-dispatcher-5] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:139) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:349) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 09:49:07,867 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 162.4 μs 09:49:07,867 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting to receive commands 09:49:07,868 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRaftStorage - leader222: terminating thread VirtualThread[#613,leader222-writer-91]/waiting 09:49:07,868 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 commands after 1.512 ms 09:49:07,868 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 19.86 μs 09:49:07,868 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: journal writer stopped 09:49:07,868 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader222: journal closed 09:49:07,868 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - leader222: journal closed 09:49:07,868 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks 09:49:07,868 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks [WARN] [06/30/2025 09:49:07.869] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader222]: org.opendaylight.controller.cluster.common.actor.Monitor@bdad7ab 09:49:07,869 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - leader222: Starting recovery with journal batch size 1000 09:49:07,869 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader222: started executor 09:49:07,869 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader222: started executor 09:49:07,870 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader222: metadata journal open: replayFrom=1 applyTo=3 09:49:07,872 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader222: journal open: firstIndex=1 lastIndex=4 replayFrom=1 fileEntries=0 09:49:07,872 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - leader222: journal open: applyTo=3 09:49:07,872 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: journal writer started 09:49:07,872 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:49:07,873 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222 09:49:07,873 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:07,873 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:07,873 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:07,873 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:07,873 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader222: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:49:07,873 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRecovery - leader222: restoring local TermInfo{term=1, votedFor=leader222} 09:49:07,873 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222 09:49:07,873 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@752b6e7 09:49:07,873 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to -1 09:49:07,874 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 09:49:07,874 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=1, term=1, command=one] 09:49:07,874 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=2, term=1, command=two] 09:49:07,875 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=3, term=1, command=three] 09:49:07,875 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader222: journal recovery completedin 1.647 ms with journalIndex=1 09:49:07,963 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:07,963 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:07,963 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:07,963 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:08,64 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:08,64 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:08,64 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:08,64 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:08,165 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:08,165 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:08,165 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:08,165 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:08,265 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:08,265 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:08,265 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:08,265 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:08,363 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - leader222 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.12:17355, Removed) 09:49:08,363 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - leader222 (Follower): Received ElectionTimeout - switching to Candidate 09:49:08,364 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader222 (Candidate): Election: Candidate has following voting peers: [follower223, follower224] 09:49:08,366 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties4544559965064357355.tmp 09:49:08,366 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:08,366 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:08,366 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:08,366 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:08,369 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=2, votedFor=leader222 09:49:08,369 AM [test-pekko.actor.default-dispatcher-18] [INFO] Candidate - leader222 (Candidate): Starting new election term 2 09:49:08,369 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} to peer follower223 09:49:08,369 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} to peer follower224 09:49:08,369 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader222 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 09:49:08,369 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower223 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 09:49:08,369 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower223 (Follower): Cluster state: [] 09:49:08,369 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower223 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} with higher term appears reachable, updating term. 09:49:08,369 AM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - follower223 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1}" message is greater than follower's term 1 - updating term [WARN] [06/30/2025 09:49:08.369] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} 09:49:08,372 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=2, votedFor=null 09:49:08,372 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower223 (Follower): In requestVote: RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} - currentTerm: 2, votedFor: null, lastIndex: 3, lastTerm: 1 09:49:08,374 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=2, votedFor=leader222 09:49:08,374 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower223 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 09:49:08,374 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader222 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 09:49:08,374 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader222 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 09:49:08,374 AM [test-pekko.actor.default-dispatcher-18] [INFO] Candidate - leader222 (Candidate): LastApplied index -1 is behind last index 3 - switching to PreLeader 09:49:08,375 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Election: Leader has following peers: [follower223, follower224] 09:49:08,375 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:49:08,375 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:49:08,375 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader222 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 2 09:49:08,375 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging -3 entries behind leader leader222 and reached 2 (of expected -1) [WARN] [06/30/2025 09:49:08.375] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:08,375 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Persist data index=4 term=2 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387 09:49:08,375 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387, pending=true} 09:49:08,375 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: received 1 commands after 503.5 ms 09:49:08,376 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Replicate message: identifier: null, logIndex: 4, isSendImmediate: true 09:49:08,376 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:49:08,376 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging -3 entries behind leader leader222 and reached 2 (of expected -1) 09:49:08,377 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 [WARN] [06/30/2025 09:49:08.377] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:08,377 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 3, nextIndex: 4 09:49:08,377 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 09:49:08,377 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 09:49:08,377 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 09:49:08,377 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 09:49:08,377 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:49:08,377 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): sendAppendEntries: 4 is present for follower follower223 09:49:08,377 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Sending AppendEntries to follower follower223: AppendEntries{term=2, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387, pending=true}]} 09:49:08,377 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387, pending=true}]} 09:49:08,378 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 09:49:08,378 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 3, entries to be added from: 0 09:49:08,378 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 09:49:08,378 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower223 (Follower): Append entry to log org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387 09:49:08,378 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387, pending=true} 09:49:08,378 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 09:49:08,378 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 09:49:08,378 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 09:49:08,378 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 510.5 ms 09:49:08,378 AM [leader222-writer-92] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 09:49:08,378 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower223 (Follower): Log size is now 5 09:49:08,378 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower223, logLastIndex=4, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:49:08,378 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging -3 entries behind leader leader222 and reached 2 (of expected -1) 09:49:08,378 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 09:49:08,378 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 2.505 ms 09:49:08,378 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:49:08,378 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): sendAppendEntries: 4 is present for follower follower223 09:49:08,378 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 09:49:08,378 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387, pending=true} 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 4, nextIndex: 5 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Applying to log - commitIndex: 4, lastAppliedIndex: -1 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 0 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to 0 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 0 data zero 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader222: applyState called: zero 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 1 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 0 to 1 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 1 data one 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader222: applyState called: one 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 2 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 1 to 2 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 2 data two 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader222: applyState called: two 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 3 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 2 to 3 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 3 data three 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader222: applyState called: three 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 4 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 3 to 4 09:49:08,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387 09:49:08,380 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: received 1 commands after 1.388 ms 09:49:08,380 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 09:49:08,380 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 09:49:08,380 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387, pending=false} 09:49:08,380 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@495639cd 09:49:08,380 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 1.837 ms 09:49:08,380 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 218.8 μs 09:49:08,380 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting to receive commands 09:49:08,380 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: waiting to receive commands 09:49:08,380 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 5, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:49:08,380 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower223 (Follower): Commit index set to 4 09:49:08,380 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:49:08,380 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PreLeader - leader222 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}] - lastApplied: 4, lastIndex: 4 09:49:08,380 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 4, context.getLastApplied(): 2, lastIndex(): 4 09:49:08,380 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 3 09:49:08,380 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 2 to 3 09:49:08,380 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower223: Applying state for log index 3 data three 09:49:08,380 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower223: applyState called: three 09:49:08,380 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): Election: Leader has following peers: [follower223, follower224] 09:49:08,380 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 4 09:49:08,380 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 3 to 4 09:49:08,380 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower223: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387 09:49:08,381 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 618.0 μs 09:49:08,381 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 170.9 μs 09:49:08,381 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting to receive commands 09:49:08,380 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 5, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:49:08,381 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:49:08,381 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:49:08,381 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader222 (PreLeader) :- Switching from behavior PreLeader to Leader, election term: 2 [WARN] [06/30/2025 09:49:08.381] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:08,466 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:08,466 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:08,466 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:08,467 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:08,494 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:08.495] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:08,567 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:08,567 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:08,567 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:08,567 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:08,613 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:08.613] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:08,668 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:08,668 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:08,668 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:08,668 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:08,733 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:08.733] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:08,768 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:08,768 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:08,768 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:08,768 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:49:08.854] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:08,854 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:49:08,869 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:08,869 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:08,869 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:08,869 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:08,969 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:08,969 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:08,969 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:08,969 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:08,974 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:08.974] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:09,70 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:09,70 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:09,70 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:09,70 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:09,94 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:09.094] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:09,170 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:09,170 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:09,170 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:09,170 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:09,213 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:09.213] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:09,271 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:09,271 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:09,271 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:09,271 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:09,333 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:09.333] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:09,371 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:09,371 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:09,371 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:09,371 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:49:09.453] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:09,454 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:49:09,472 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:09,472 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:09,472 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:09,472 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:09,572 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:09,572 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:09,573 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:09,573 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:09,573 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:09.574] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:09,673 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:09,673 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:09,673 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:09,673 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:09,694 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:09.694] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:09,773 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:09,773 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:09,773 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:09,773 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:09,813 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:09.813] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:09,874 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:09,874 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:09,874 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:09,874 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:09,933 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:09.933] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:09,975 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:09,975 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:09,975 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:09,975 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:10,54 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:10.054] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:10,75 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:10,75 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:10,75 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:10,75 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:10,173 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:10.173] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:10,176 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:10,176 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:10,176 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:10,176 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:10,276 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:10,276 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:10,276 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:10,276 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:49:10.294] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:10,294 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:49:10,377 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:10,377 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:10,377 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:10,377 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:49:10.413] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:10,413 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:49:10,478 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:10,478 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:10,478 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:10,478 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:10,533 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:10.533] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:10,578 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:10,578 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:10,579 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:10,579 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:10,654 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:10.654] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:10,679 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:10,679 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:10,679 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:10,679 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:49:10.773] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:10,773 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:49:10,780 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:10,780 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:10,780 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:10,780 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:10,880 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:10,880 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:10,880 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:10,880 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:49:10.894] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:10,894 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:49:10,981 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:10,981 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:10,981 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:10,981 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:49:11.013] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:11,13 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:49:11,81 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:11,81 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:11,81 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:11,81 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:49:11.133] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:11,134 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:49:11,182 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:11,182 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:11,182 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:11,182 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:11,253 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:11.253] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:11,283 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:11,283 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:11,283 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:11,283 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:11,373 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:11.373] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:11,383 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:11,383 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:11,383 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:11,383 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:11,484 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:11,484 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:11,484 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:11,484 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:11,494 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:11.494] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:11,584 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:11,585 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:11,585 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:11,585 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:11,613 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:11.613] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:11,685 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:11,685 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:11,685 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:11,685 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:11,723 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:11.723] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:11,786 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:11,786 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:11,786 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:11,786 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:11,843 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:11.843] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:11,886 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:11,886 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:11,886 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:11,886 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:11,964 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:11.964] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:11,987 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:11,987 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:11,987 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:11,987 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:12,73 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:12.074] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:12,87 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:12,87 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:12,87 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:12,87 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:12,188 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:12,188 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:12,188 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:12,188 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:12,193 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:12.193] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:12,288 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:12,288 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:12,288 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:12,288 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:12,313 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:12.313] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:12,389 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:12,389 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:12,389 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:12,389 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:12,434 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:12.434] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:12,489 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:12,489 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:12,489 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:12,489 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:12,553 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/30/2025 09:49:12.553] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:12,590 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:12,590 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:12,590 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:12,590 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:49:12.673] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:12,674 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:49:12,690 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:12,690 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:12,690 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:12,690 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 09:49:12,791 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/TermInfo.properties 09:49:12,791 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/journal-v1-1.log 09:49:12,791 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest8220744163412914592/leader222/metadata-v1-1.log 09:49:12,791 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/30/2025 09:49:12.793] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:12,793 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 09:49:12,892 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower223-collector225#-1817391063] 09:49:12,904 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower223] 09:49:12,904 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - follower223: terminating thread VirtualThread[#611,follower223-writer-90]/waiting 09:49:12,904 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 commands after 4.523 s 09:49:12,904 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: completed 1 commands in 36.70 μs 09:49:12,904 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: journal writer stopped 09:49:12,905 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower223: journal closed 09:49:12,905 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower223: journal closed 09:49:12,905 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower223: stopped executor with 0 remaining tasks 09:49:12,905 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower223: stopped executor with 0 remaining tasks 09:49:12,905 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader222-collector226#1238071585] 09:49:12,905 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader222] 09:49:12,905 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - leader222: terminating thread VirtualThread[#618,leader222-writer-92]/waiting 09:49:12,906 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: received 1 commands after 4.526 s 09:49:12,906 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: completed 1 commands in 16.89 μs 09:49:12,906 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: journal writer stopped 09:49:12,906 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader222: journal closed 09:49:12,906 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - leader222: journal closed 09:49:12,906 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks 09:49:12,906 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks [WARN] [06/30/2025 09:49:12.910] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower228]: org.opendaylight.controller.cluster.common.actor.Monitor@4579ce9b 09:49:12,911 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower228: Starting recovery with journal batch size 1000 09:49:12,911 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower228: started executor 09:49:12,911 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower228: started executor 09:49:12,912 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower228: metadata journal open: replayFrom=1 applyTo=0 09:49:12,913 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower228: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:49:12,913 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower228: journal open: applyTo=0 09:49:12,913 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: journal writer started 09:49:12,913 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: waiting to receive commands 09:49:12,914 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/follower228/TermInfo.properties does not exist 09:49:12,915 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/follower228/journal-v1-1.log 09:49:12,915 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/follower228/metadata-v1-1.log 09:49:12,915 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower228: no eligible files found 09:49:12,915 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower228: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [06/30/2025 09:49:12.915] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader227]: org.opendaylight.controller.cluster.common.actor.Monitor@c47540b 09:49:12,915 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - leader227: Starting recovery with journal batch size 1000 09:49:12,916 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader227: started executor 09:49:12,916 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader227: started executor 09:49:12,916 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader227: metadata journal open: replayFrom=1 applyTo=0 09:49:12,917 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader227: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:49:12,917 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader227: journal open: applyTo=0 09:49:12,917 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: journal writer started 09:49:12,917 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting to receive commands 09:49:12,918 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties does not exist 09:49:12,918 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:12,918 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:12,918 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader227: no eligible files found 09:49:12,918 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader227: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:49:12,922 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=0, votedFor=null 09:49:12,922 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower228: Local TermInfo store seeded with TermInfo{term=0} 09:49:12,922 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower228: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@62e84eaa 09:49:12,922 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower228: Moving last applied index from -1 to -1 09:49:12,922 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower228: journal recovery completedin 232.8 μs with journalIndex=1 09:49:12,924 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=0, votedFor=null 09:49:12,924 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader227: Local TermInfo store seeded with TermInfo{term=0} 09:49:12,924 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader227: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4929527e 09:49:12,924 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from -1 to -1 09:49:12,924 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - leader227: journal recovery completedin 362.7 μs with journalIndex=1 09:49:13,383 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 09:49:13,383 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - leader227 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.12:17355, Removed) 09:49:13,383 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - leader227 (Follower): Received ElectionTimeout - switching to Candidate 09:49:13,384 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader227 (Candidate): Election: Candidate has following voting peers: [follower229, follower228] 09:49:13,388 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=1, votedFor=leader227 09:49:13,388 AM [test-pekko.actor.default-dispatcher-17] [INFO] Candidate - leader227 (Candidate): Starting new election term 1 09:49:13,388 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} to peer follower229 09:49:13,388 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} to peer follower228 09:49:13,388 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader227 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 09:49:13,388 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower228 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 09:49:13,388 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower228 (Follower): Cluster state: [] 09:49:13,388 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower228 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 09:49:13,388 AM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - follower228 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term [WARN] [06/30/2025 09:49:13.388] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} 09:49:13,391 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=1, votedFor=null 09:49:13,391 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower228 (Follower): In requestVote: RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 09:49:13,393 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=1, votedFor=leader227 09:49:13,393 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower228 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 09:49:13,393 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader227 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 09:49:13,393 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader227 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 09:49:13,394 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (Leader): Election: Leader has following peers: [follower229, follower228] 09:49:13,394 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:49:13,394 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:49:13,394 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader227 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 [WARN] [06/30/2025 09:49:13.394] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:13,394 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower228: Last sync leader does not match current leader leader227, need to catch up to -1 09:49:13,394 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower228 updated: matchIndex: -1, nextIndex: 0 09:49:13,394 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [06/30/2025 09:49:13.394] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower228] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower228, initialSyncDone=false] 09:49:13,428 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader227: Persist data index=0 term=1 command=zero 09:49:13,428 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:49:13,428 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 09:49:13,429 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:49:13,429 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:49:13,429 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 0 is present for follower follower228 09:49:13,429 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 commands after 511.4 ms 09:49:13,429 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Sending AppendEntries to follower follower228: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 09:49:13,429 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower228 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 09:49:13,429 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower228 (Follower): Number of entries to be appended = 1 09:49:13,429 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower228 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 [WARN] [06/30/2025 09:49:13.429] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:13,429 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower228 (Follower): Append entry to log zero 09:49:13,429 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower228: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:49:13,429 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower228 (Follower): Log size is now 1 09:49:13,429 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower228 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower228, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:49:13,429 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower228: Lagging 0 entries behind leader leader227 and reached -1 (of expected -1) 09:49:13,429 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 commands after 516.3 ms 09:49:13,429 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower228: awaiting more completions to resolve 1 deferred callback(s) 09:49:13,429 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower228 updated: matchIndex: 0, nextIndex: 1 09:49:13,429 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:49:13,432 AM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 09:49:13,432 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: completed 1 commands in 3.837 ms 09:49:13,433 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting to receive commands 09:49:13,433 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 09:49:13,433 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:49:13,433 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 09:49:13,433 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader227 (Leader): Setting last applied to 0 09:49:13,433 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from -1 to 0 09:49:13,433 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader227: Applying state for log index 0 data zero 09:49:13,433 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader227: applyState called: zero 09:49:13,433 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 commands after 686.6 μs 09:49:13,433 AM [follower228-writer-93] [DEBUG] EntryStoreCompleter - follower228: 1 completion(s) pending 09:49:13,433 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower228: running 1 completion(s) 09:49:13,433 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower228: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 09:49:13,433 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: completed 1 commands in 4.267 ms 09:49:13,433 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower228: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@44cd9603 09:49:13,433 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: waiting to receive commands 09:49:13,434 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: completed 1 commands in 214.2 μs [WARN] [06/30/2025 09:49:13.434] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower228] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower228, initialSyncDone=true] 09:49:13,434 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting to receive commands [WARN] [06/30/2025 09:49:13.513] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:13,530 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader227: Persist data index=1 term=1 command=one 09:49:13,530 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:49:13,530 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 commands after 96.09 ms 09:49:13,530 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 09:49:13,530 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:49:13,530 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:49:13,530 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 1 is present for follower follower228 09:49:13,530 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): Sending AppendEntries to follower follower228: AppendEntries{term=1, leaderId=leader227, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 09:49:13,531 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower228 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader227, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 09:49:13,531 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower228 (Follower): Number of entries to be appended = 1 09:49:13,531 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower228 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 09:49:13,531 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower228 (Follower): Append entry to log one 09:49:13,531 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower228: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:49:13,531 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 commands after 97.25 ms [WARN] [06/30/2025 09:49:13.531] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:13,531 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower228 (Follower): Log size is now 2 09:49:13,531 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower228 (Follower): Commit index set to 0 09:49:13,531 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower228 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower228, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:49:13,531 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower228: Lagging 0 entries behind leader leader227 and reached 0 (of expected -1) 09:49:13,531 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower228 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 09:49:13,531 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower228 (Follower): Setting last applied to 0 09:49:13,531 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower228: Moving last applied index from -1 to 0 09:49:13,531 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower228: Applying state for log index 0 data zero 09:49:13,531 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower228: applyState called: zero 09:49:13,531 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower228 updated: matchIndex: 1, nextIndex: 2 09:49:13,531 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower228: awaiting more completions to resolve 1 deferred callback(s) 09:49:13,532 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:49:13,532 AM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 09:49:13,532 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 09:49:13,532 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: completed 1 commands in 1.895 ms 09:49:13,532 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting to receive commands 09:49:13,532 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:49:13,532 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 09:49:13,532 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader227 (Leader): Setting last applied to 1 09:49:13,532 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from 0 to 1 09:49:13,532 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader227: Applying state for log index 1 data one 09:49:13,532 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader227: applyState called: one 09:49:13,532 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 commands after 621.4 μs 09:49:13,532 AM [follower228-writer-93] [DEBUG] EntryStoreCompleter - follower228: 1 completion(s) pending 09:49:13,533 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: completed 1 commands in 1.749 ms 09:49:13,533 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 commands after 7.940 μs 09:49:13,533 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: completed 1 commands in 216.8 μs 09:49:13,533 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting to receive commands 09:49:13,533 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower228: running 1 completion(s) 09:49:13,533 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower228: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 09:49:13,533 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: completed 1 commands in 122.7 μs 09:49:13,533 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: waiting to receive commands 09:49:13,533 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower228: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@38cd79c6 09:49:13,631 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader227: Persist data index=2 term=1 command=two 09:49:13,631 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:49:13,631 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 09:49:13,631 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:49:13,631 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 commands after 98.33 ms 09:49:13,631 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:49:13,631 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 2 is present for follower follower228 09:49:13,631 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): Sending AppendEntries to follower follower228: AppendEntries{term=1, leaderId=leader227, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 09:49:13,631 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader227: Persist data index=3 term=1 command=three 09:49:13,631 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 09:49:13,631 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true 09:49:13,632 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:49:13,632 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:49:13,632 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 2 is present for follower follower228 [WARN] [06/30/2025 09:49:13.632] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:13,632 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader227: Persist data index=4 term=1 command=four 09:49:13,632 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=4, term=1, command=four, pending=true} [WARN] [06/30/2025 09:49:13.632] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:13,632 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 4, isSendImmediate: true 09:49:13,632 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:49:13,632 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:49:13,632 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 2 is present for follower follower228 [WARN] [06/30/2025 09:49:13.632] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:13,633 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 2 is present for follower follower228 [WARN] [06/30/2025 09:49:13.633] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:13,633 AM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 09:49:13,634 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 09:49:13,634 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: completed 1 commands in 2.460 ms 09:49:13,634 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:49:13,634 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 2 commands after 17.82 μs 09:49:13,637 AM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 2 completion(s) pending 09:49:13,637 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: completed 2 commands in 2.939 ms 09:49:13,637 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - leader227: running 2 completion(s) 09:49:13,637 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting to receive commands 09:49:13,637 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true} 09:49:13,637 AM [test-pekko.actor.default-dispatcher-18] [INFO] SnapshotManager - leader227: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=3, mandatoryTrim=false] 09:49:13,637 AM [test-pekko.actor.default-dispatcher-6] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:139) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) [ERROR] [06/30/2025 09:49:13.637] [test-pekko.actor.internal-dispatcher-4] [pekko://test/user/leader227] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:139) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:349) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:349) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 09:49:13,638 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - leader227: terminating thread VirtualThread[#621,leader227-writer-94]/waiting 09:49:13,638 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 commands after 1.403 ms 09:49:13,638 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: completed 1 commands in 18.35 μs 09:49:13,638 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: journal writer stopped 09:49:13,638 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader227: journal closed 09:49:13,638 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader227: journal closed 09:49:13,638 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks 09:49:13,638 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks 09:49:13,640 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - leader227: Starting recovery with journal batch size 1000 09:49:13,640 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader227: started executor [WARN] [06/30/2025 09:49:13.640] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader227]: org.opendaylight.controller.cluster.common.actor.Monitor@43a1c1d2 09:49:13,640 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader227: started executor 09:49:13,641 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader227: metadata journal open: replayFrom=1 applyTo=2 09:49:13,642 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader227: journal open: firstIndex=1 lastIndex=5 replayFrom=1 fileEntries=0 09:49:13,642 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader227: journal open: applyTo=2 09:49:13,642 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: journal writer started 09:49:13,642 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: waiting to receive commands 09:49:13,644 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=1, votedFor=leader227 09:49:13,644 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:13,644 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:13,644 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:13,644 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader227: no eligible files found 09:49:13,644 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader227: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:49:13,644 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - leader227: restoring local TermInfo{term=1, votedFor=leader227} 09:49:13,644 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=1, votedFor=leader227 09:49:13,644 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader227: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@35e8b0c 09:49:13,644 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from -1 to -1 09:49:13,645 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 09:49:13,645 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=1, term=1, command=one] 09:49:13,645 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=2, term=1, command=two] 09:49:13,646 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=3, term=1, command=three] 09:49:13,646 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=4, term=1, command=four] 09:49:13,647 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - leader227: journal recovery completedin 2.655 ms with journalIndex=1 09:49:14,123 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - leader227 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.12:17355, Removed) 09:49:14,123 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - leader227 (Follower): Received ElectionTimeout - switching to Candidate 09:49:14,123 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader227 (Candidate): Election: Candidate has following voting peers: [follower229, follower228] 09:49:14,127 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=2, votedFor=leader227 09:49:14,127 AM [test-pekko.actor.default-dispatcher-17] [INFO] Candidate - leader227 (Candidate): Starting new election term 2 09:49:14,127 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} to peer follower229 09:49:14,127 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} to peer follower228 09:49:14,127 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader227 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 09:49:14,127 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower228 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. [WARN] [06/30/2025 09:49:14.127] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} 09:49:14,127 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower228 (Follower): Cluster state: [] 09:49:14,127 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower228 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} with higher term appears reachable, updating term. 09:49:14,127 AM [test-pekko.actor.default-dispatcher-18] [INFO] Follower - follower228 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1}" message is greater than follower's term 1 - updating term 09:49:14,130 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=2, votedFor=null 09:49:14,130 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower228 (Follower): In requestVote: RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} - currentTerm: 2, votedFor: null, lastIndex: 1, lastTerm: 1 09:49:14,132 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=2, votedFor=leader227 09:49:14,132 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower228 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 09:49:14,132 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader227 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 09:49:14,132 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader227 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 09:49:14,132 AM [test-pekko.actor.default-dispatcher-6] [INFO] Candidate - leader227 (Candidate): LastApplied index -1 is behind last index 4 - switching to PreLeader 09:49:14,132 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (PreLeader): Election: Leader has following peers: [follower229, follower228] 09:49:14,133 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:49:14,133 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower228: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:49:14,133 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader227 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 2 09:49:14,133 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader227: Persist data index=5 term=2 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387 09:49:14,133 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=5, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387, pending=true} [WARN] [06/30/2025 09:49:14.133] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:14,133 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (PreLeader): Replicate message: identifier: null, logIndex: 5, isSendImmediate: true 09:49:14,133 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 09:49:14,133 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower228: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 [WARN] [06/30/2025 09:49:14.133] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:14,133 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: received 1 commands after 491.0 ms 09:49:14,135 AM [leader227-writer-95] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 09:49:14,135 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: completed 1 commands in 1.962 ms 09:49:14,135 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: waiting to receive commands 09:49:14,135 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 09:49:14,135 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=5, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387, pending=true} 09:49:14,235 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:14,235 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:14,235 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:14,235 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:14.243] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:14,335 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:14,335 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:14,335 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:14,335 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:14.364] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:14,436 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:14,436 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:14,436 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:14,436 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:14.483] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:14,536 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:14,536 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:14,536 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:14,536 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:14.603] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:14,637 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:14,637 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:14,637 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:14,637 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:14.723] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:14,737 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:14,737 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:14,737 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:14,737 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 09:49:14,838 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:14,838 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:14,838 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:14,838 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:14.844] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:14,939 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:14,939 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:14,939 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:14,939 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:14.963] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:15,39 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:15,39 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:15,39 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:15,39 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:15.084] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:15,140 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:15,140 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:15,140 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:15,140 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:15.203] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:15,240 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:15,240 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:15,240 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:15,240 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:15.323] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:15,341 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:15,341 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:15,341 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:15,341 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 09:49:15,441 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:15,441 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:15,441 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:15,441 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:15.444] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:15,542 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:15,542 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:15,542 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:15,542 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:15.564] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:15,643 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:15,643 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:15,643 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:15,643 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:15.683] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:15,743 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:15,743 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:15,743 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:15,743 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:15.804] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:15,844 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:15,844 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:15,844 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:15,844 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:15.923] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:15,944 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:15,944 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:15,944 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:15,944 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:16.043] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:16,45 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:16,45 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:16,45 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:16,45 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 09:49:16,145 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:16,145 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:16,146 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:16,146 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:16.164] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:16,246 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:16,246 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:16,246 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:16,246 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:16.283] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:16,347 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:16,347 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:16,347 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:16,347 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:16.403] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:16,447 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:16,447 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:16,447 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:16,447 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:16.524] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:16,548 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:16,548 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:16,548 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:16,548 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:16.643] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:16,648 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:16,648 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:16,648 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:16,649 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 09:49:16,749 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:16,749 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:16,749 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:16,749 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:16.763] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:16,850 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:16,850 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:16,850 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:16,850 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:16.883] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:16,950 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:16,950 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:16,950 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:16,950 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:17.003] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:17,51 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:17,51 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:17,51 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:17,51 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:17.124] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:17,152 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:17,152 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:17,152 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:17,152 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:17.243] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:17,252 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:17,252 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:17,252 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:17,252 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 09:49:17,353 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:17,353 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:17,353 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:17,353 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:17.354] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:17,453 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:17,453 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:17,453 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:17,453 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:17.473] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:17,554 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:17,554 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:17,554 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:17,554 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:17.594] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:17,654 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:17,654 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:17,654 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:17,654 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:17.704] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:17,755 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:17,755 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:17,755 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:17,755 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:17.823] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:17,856 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:17,856 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:17,856 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:17,856 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:17.944] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:17,957 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:17,957 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:17,957 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:17,957 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:18.053] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:18,58 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:18,58 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:18,58 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:18,58 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 09:49:18,158 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:18,158 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:18,158 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:18,158 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:18.174] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:18,259 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:18,259 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:18,259 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:18,259 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:18.283] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:18,360 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:18,360 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:18,360 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:18,360 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:18.403] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:18,460 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:18,460 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:18,460 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:18,460 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:18.524] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:18,561 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:18,561 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:18,561 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:18,561 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:18.643] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:18,661 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:18,661 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:18,661 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:18,661 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 09:49:18,762 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:18,762 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:18,762 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:18,762 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:18.765] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:18,863 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:18,863 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:18,863 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:18,863 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:18.883] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:18,963 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:18,963 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:18,963 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:18,963 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:18.993] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:19,64 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/TermInfo.properties 09:49:19,64 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/journal-v1-1.log 09:49:19,64 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9005691018506010990/leader227/metadata-v1-1.log 09:49:19,64 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/30/2025 09:49:19.103] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:19,165 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower228-collector230#-1421940066] 09:49:19,176 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower228] 09:49:19,176 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRaftStorage - follower228: terminating thread VirtualThread[#620,follower228-writer-93]/waiting 09:49:19,176 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 commands after 5.643 s 09:49:19,176 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: completed 1 commands in 32.72 μs 09:49:19,176 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: journal writer stopped 09:49:19,177 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower228: journal closed 09:49:19,177 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower228: journal closed 09:49:19,177 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower228: stopped executor with 0 remaining tasks 09:49:19,177 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower228: stopped executor with 0 remaining tasks 09:49:19,177 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader227-collector231#1676291482] 09:49:19,177 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader227] 09:49:19,177 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRaftStorage - leader227: terminating thread VirtualThread[#624,leader227-writer-95]/waiting 09:49:19,177 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: received 1 commands after 5.042 s 09:49:19,177 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: completed 1 commands in 17.20 μs 09:49:19,178 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: journal writer stopped 09:49:19,178 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader227: journal closed 09:49:19,178 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - leader227: journal closed 09:49:19,178 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks 09:49:19,178 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks [WARN] [06/30/2025 09:49:19.182] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower233]: org.opendaylight.controller.cluster.common.actor.Monitor@7d1d6fb6 09:49:19,183 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower233: Starting recovery with journal batch size 1000 09:49:19,183 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower233: started executor 09:49:19,183 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower233: started executor 09:49:19,184 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower233: metadata journal open: replayFrom=1 applyTo=0 09:49:19,185 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower233: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:49:19,185 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower233: journal open: applyTo=0 09:49:19,185 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: journal writer started 09:49:19,185 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting to receive commands 09:49:19,186 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest4622203029005826662/follower233/TermInfo.properties does not exist 09:49:19,186 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower233: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest4622203029005826662/follower233/journal-v1-1.log 09:49:19,186 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower233: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest4622203029005826662/follower233/metadata-v1-1.log 09:49:19,186 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower233: no eligible files found 09:49:19,186 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower233: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [06/30/2025 09:49:19.186] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader232]: org.opendaylight.controller.cluster.common.actor.Monitor@27492f50 09:49:19,187 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - leader232: Starting recovery with journal batch size 1000 09:49:19,188 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader232: started executor 09:49:19,188 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader232: started executor 09:49:19,188 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader232: metadata journal open: replayFrom=1 applyTo=0 09:49:19,189 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader232: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:49:19,189 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - leader232: journal open: applyTo=0 09:49:19,189 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: journal writer started 09:49:19,189 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting to receive commands 09:49:19,190 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest4622203029005826662/leader232/TermInfo.properties does not exist 09:49:19,190 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader232: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest4622203029005826662/leader232/journal-v1-1.log 09:49:19,190 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader232: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest4622203029005826662/leader232/metadata-v1-1.log 09:49:19,190 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader232: no eligible files found 09:49:19,190 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader232: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:49:19,228 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower233: Set currentTerm=0, votedFor=null 09:49:19,228 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower233: Local TermInfo store seeded with TermInfo{term=0} 09:49:19,228 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower233: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@43b5e1fb 09:49:19,228 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from -1 to -1 09:49:19,228 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - follower233: journal recovery completedin 491.7 μs with journalIndex=1 09:49:19,230 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader232: Set currentTerm=0, votedFor=null 09:49:19,230 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader232: Local TermInfo store seeded with TermInfo{term=0} 09:49:19,230 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader232: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@2990117b 09:49:19,230 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from -1 to -1 09:49:19,230 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader232: journal recovery completedin 358.6 μs with journalIndex=1 09:49:19,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 09:49:19,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader232 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.12:17355, Removed) 09:49:19,683 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader232 (Follower): Received ElectionTimeout - switching to Candidate 09:49:19,684 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader232 (Candidate): Election: Candidate has following voting peers: [follower234, follower233] 09:49:19,688 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader232: Set currentTerm=1, votedFor=leader232 09:49:19,688 AM [test-pekko.actor.default-dispatcher-6] [INFO] Candidate - leader232 (Candidate): Starting new election term 1 09:49:19,688 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader232 (Candidate): Sending RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} to peer follower234 09:49:19,688 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader232 (Candidate): Sending RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} to peer follower233 09:49:19,689 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower233 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 09:49:19,689 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower233 (Follower): Cluster state: [] 09:49:19,689 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower233 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 09:49:19,689 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower233 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term [WARN] [06/30/2025 09:49:19.689] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} 09:49:19,689 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader232 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 09:49:19,692 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower233: Set currentTerm=1, votedFor=null 09:49:19,692 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower233 (Follower): In requestVote: RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 09:49:19,694 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower233: Set currentTerm=1, votedFor=leader232 09:49:19,694 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower233 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 09:49:19,694 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader232 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 09:49:19,694 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader232 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 09:49:19,694 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Election: Leader has following peers: [follower234, follower233] 09:49:19,694 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:49:19,694 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:49:19,694 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader232 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 [WARN] [06/30/2025 09:49:19.694] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:19,694 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Last sync leader does not match current leader leader232, need to catch up to -1 09:49:19,694 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: -1, nextIndex: 0 [WARN] [06/30/2025 09:49:19.694] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower233] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower233, initialSyncDone=false] 09:49:19,694 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:49:19,740 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader232: Persist data index=0 term=1 command=zero 09:49:19,740 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader232: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:49:19,740 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader232 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 09:49:19,740 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:49:19,740 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 commands after 551.2 ms 09:49:19,740 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:49:19,740 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 0 is present for follower follower233 09:49:19,740 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower233: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} [WARN] [06/30/2025 09:49:19.740] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:19,740 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower233 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 09:49:19,740 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower233 (Follower): Number of entries to be appended = 1 09:49:19,740 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower233 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 09:49:19,741 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower233 (Follower): Append entry to log zero 09:49:19,741 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower233: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:49:19,741 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 commands after 555.9 ms 09:49:19,741 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower233 (Follower): Log size is now 1 09:49:19,741 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower233 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower233, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:49:19,741 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached -1 (of expected -1) 09:49:19,741 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower233: awaiting more completions to resolve 1 deferred callback(s) 09:49:19,742 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: 0, nextIndex: 1 09:49:19,742 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:49:19,744 AM [leader232-writer-97] [DEBUG] EntryStoreCompleter - leader232: 1 completion(s) pending 09:49:19,744 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: completed 1 commands in 4.235 ms 09:49:19,744 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting to receive commands 09:49:19,744 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - leader232: running 1 completion(s) 09:49:19,744 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader232: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:49:19,745 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 09:49:19,745 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader232 (Leader): Setting last applied to 0 09:49:19,745 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from -1 to 0 09:49:19,745 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader232: Applying state for log index 0 data zero 09:49:19,745 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader232: applyState called: zero 09:49:19,745 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 commands after 419.6 μs 09:49:19,745 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: completed 1 commands in 157.0 μs 09:49:19,745 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting to receive commands 09:49:19,745 AM [follower233-writer-96] [DEBUG] EntryStoreCompleter - follower233: 1 completion(s) pending 09:49:19,745 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower233: running 1 completion(s) 09:49:19,745 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower233: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 09:49:19,745 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower233: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@3c17ba24 [WARN] [06/30/2025 09:49:19.745] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower233] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower233, initialSyncDone=true] 09:49:19,745 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: completed 1 commands in 4.433 ms 09:49:19,746 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting to receive commands [WARN] [06/30/2025 09:49:19.814] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:19,842 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader232: Persist data index=1 term=1 command=one 09:49:19,842 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader232: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:49:19,842 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 09:49:19,842 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:49:19,842 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:49:19,842 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 1 is present for follower follower233 09:49:19,842 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower233: AppendEntries{term=1, leaderId=leader232, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} [WARN] [06/30/2025 09:49:19.842] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:19,842 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 09:49:19,842 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): Number of entries to be appended = 1 09:49:19,842 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 09:49:19,842 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): Append entry to log one 09:49:19,842 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 commands after 97.14 ms 09:49:19,842 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower233: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:49:19,842 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): Log size is now 2 09:49:19,842 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): Commit index set to 0 09:49:19,842 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower233, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:49:19,842 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 0 (of expected -1) 09:49:19,843 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 09:49:19,843 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower233 (Follower): Setting last applied to 0 09:49:19,843 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from -1 to 0 09:49:19,843 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower233: Applying state for log index 0 data zero 09:49:19,843 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower233: applyState called: zero 09:49:19,843 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 commands after 96.85 ms 09:49:19,843 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower233: awaiting more completions to resolve 1 deferred callback(s) 09:49:19,843 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: 1, nextIndex: 2 09:49:19,843 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:49:19,845 AM [leader232-writer-97] [DEBUG] EntryStoreCompleter - leader232: 1 completion(s) pending 09:49:19,845 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: completed 1 commands in 2.882 ms 09:49:19,845 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting to receive commands 09:49:19,845 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryStoreCompleter - leader232: running 1 completion(s) 09:49:19,845 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader232: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:49:19,845 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader232 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 09:49:19,845 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - leader232 (Leader): Setting last applied to 1 09:49:19,845 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from 0 to 1 09:49:19,846 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader232: Applying state for log index 1 data one 09:49:19,846 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - leader232: applyState called: one 09:49:19,846 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 commands after 620.1 μs 09:49:19,846 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: completed 1 commands in 149.0 μs 09:49:19,846 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting to receive commands 09:49:19,847 AM [follower233-writer-96] [DEBUG] EntryStoreCompleter - follower233: 1 completion(s) pending 09:49:19,847 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower233: running 1 completion(s) 09:49:19,847 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower233: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 09:49:19,847 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower233: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@6909a250 09:49:19,847 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: completed 1 commands in 4.097 ms 09:49:19,847 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 commands after 10.13 μs 09:49:19,847 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: completed 1 commands in 179.1 μs 09:49:19,847 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting to receive commands [WARN] [06/30/2025 09:49:19.933] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:49:19.946] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower234]: org.opendaylight.controller.cluster.common.actor.Monitor@286e7531 09:49:19,946 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower234: Starting recovery with journal batch size 1000 09:49:19,946 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower234: started executor 09:49:19,946 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower234: started executor 09:49:19,947 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower234: metadata journal open: replayFrom=1 applyTo=0 09:49:19,947 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower234: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:49:19,947 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower234: journal open: applyTo=0 09:49:19,948 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: journal writer started 09:49:19,948 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: waiting to receive commands 09:49:19,948 AM [test-pekko.actor.default-dispatcher-12] [INFO] PeerInfos - leader232: Peer address for peer follower234 set to pekko://test/user/follower234 09:49:19,948 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader232: Persist data index=2 term=1 command=two 09:49:19,948 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader232: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:49:19,948 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader232 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 09:49:19,948 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:49:19,948 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:49:19,948 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 2 is present for follower follower233 09:49:19,948 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower233: AppendEntries{term=1, leaderId=leader232, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 09:49:19,948 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 09:49:19,949 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): Number of entries to be appended = 1 09:49:19,949 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 09:49:19,949 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): Append entry to log two 09:49:19,949 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower233: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:49:19,949 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 commands after 102.3 ms 09:49:19,949 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): Log size is now 3 09:49:19,949 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): Commit index set to 1 09:49:19,949 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower233, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:49:19,949 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 1 (of expected -1) 09:49:19,949 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 2 09:49:19,949 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 commands after 101.5 ms 09:49:19,949 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower233 (Follower): Setting last applied to 1 09:49:19,949 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from 0 to 1 09:49:19,949 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower233: Applying state for log index 1 data one 09:49:19,949 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower233: applyState called: one 09:49:19,949 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower233: awaiting more completions to resolve 1 deferred callback(s) 09:49:19,949 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: 2, nextIndex: 3 09:49:19,949 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:49:19,949 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest4622203029005826662/follower234/TermInfo.properties does not exist 09:49:19,949 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest4622203029005826662/follower234/journal-v1-1.log 09:49:19,949 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest4622203029005826662/follower234/metadata-v1-1.log 09:49:19,949 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower234: no eligible files found 09:49:19,950 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower234: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:49:19,951 AM [follower233-writer-96] [DEBUG] EntryStoreCompleter - follower233: 1 completion(s) pending 09:49:19,951 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: completed 1 commands in 2.237 ms 09:49:19,951 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 commands after 4.140 μs 09:49:19,951 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower233: running 1 completion(s) 09:49:19,951 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower233: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 09:49:19,951 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower233: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@13c7e0f0 09:49:19,951 AM [leader232-writer-97] [DEBUG] EntryStoreCompleter - leader232: 1 completion(s) pending 09:49:19,951 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: completed 1 commands in 2.462 ms 09:49:19,951 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting to receive commands 09:49:19,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader232: running 1 completion(s) 09:49:19,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader232: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:49:19,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1 09:49:19,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader232 (Leader): Setting last applied to 2 09:49:19,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from 1 to 2 09:49:19,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader232: Applying state for log index 2 data two 09:49:19,951 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader232: applyState called: two 09:49:19,952 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: completed 1 commands in 493.5 μs 09:49:19,952 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting to receive commands 09:49:19,952 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 commands after 425.8 μs 09:49:19,952 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: completed 1 commands in 68.13 μs 09:49:19,952 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting to receive commands 09:49:19,952 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=0, votedFor=null 09:49:19,952 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower234: Local TermInfo store seeded with TermInfo{term=0} 09:49:19,952 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower234: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@2b8f1f64 09:49:19,952 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to -1 09:49:19,952 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower234: journal recovery completedin 284.1 μs with journalIndex=1 09:49:19,953 AM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - follower234 (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term 09:49:19,954 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=1, votedFor=null 09:49:19,954 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower234: Last sync leader does not match current leader leader232, need to catch up to -1 09:49:19,954 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower234 updated: matchIndex: -1, nextIndex: 0 09:49:19,954 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: true, followerNextIndex: 0, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:49:19,954 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 0 is present for follower follower234 09:49:19,955 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower234: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=false}, JournaledLogEntry{index=1, term=1, command=one, pending=false}, JournaledLogEntry{index=2, term=1, command=two, pending=false}]} [WARN] [06/30/2025 09:49:19.954] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=false] 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=false}, JournaledLogEntry{index=1, term=1, command=one, pending=false}, JournaledLogEntry{index=2, term=1, command=two, pending=false}]} 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Number of entries to be appended = 3 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Append entry to log zero 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=false} 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Append entry to log one 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=false} 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Append entry to log two 09:49:19,955 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: received 1 commands after 7.172 ms 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=false} 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Log size is now 3 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Commit index set to 2 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower234, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): -1, lastIndex(): 2 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 0 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to 0 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower234: Applying state for log index 0 data zero 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower234: applyState called: zero 09:49:19,955 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower234 updated: matchIndex: 2, nextIndex: 3 09:49:19,955 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotManager - leader232: fakeSnapshot purging log to 1 for term 1 09:49:19,955 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: 1 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 1 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 0 to 1 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower234: Applying state for log index 1 data one 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower234: applyState called: one 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 2 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 1 to 2 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower234: Applying state for log index 2 data two 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower234: applyState called: two 09:49:19,955 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: awaiting more completions to resolve 3 deferred callback(s) 09:49:19,957 AM [follower234-writer-98] [DEBUG] EntryStoreCompleter - follower234: 1 completion(s) pending 09:49:19,957 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: completed 1 commands in 2.589 ms 09:49:19,957 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: running 1 completion(s) 09:49:19,957 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: received 3 commands after 4.140 μs 09:49:19,957 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 09:49:19,958 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@4427df61 09:49:19,958 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: awaiting more completions to resolve 2 deferred callback(s) 09:49:19,959 AM [follower234-writer-98] [DEBUG] EntryStoreCompleter - follower234: 2 completion(s) pending 09:49:19,959 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: completed 3 commands in 1.402 ms 09:49:19,959 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: running 2 completion(s) 09:49:19,959 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: waiting to receive commands 09:49:19,959 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 09:49:19,959 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@4906a2e8 09:49:19,959 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 09:49:19,959 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@337fb437 [WARN] [06/30/2025 09:49:19.959] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=true] 09:49:20,53 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower233 (Follower): Commit index set to 2 09:49:20,53 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:20,53 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower233 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): 1, lastIndex(): 2 09:49:20,53 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower233 (Follower): Setting last applied to 2 09:49:20,53 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from 1 to 2 09:49:20,53 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower233: Applying state for log index 2 data two 09:49:20,53 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower233: applyState called: two 09:49:20,54 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotManager - follower233: fakeSnapshot purging log to 1 for term 1 09:49:20,54 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 commands after 102.2 ms 09:49:20,54 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: completed 1 commands in 140.4 μs 09:49:20,54 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting to receive commands 09:49:20,161 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower234: terminating thread VirtualThread[#630,follower234-writer-98]/waiting 09:49:20,162 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: received 1 commands after 202.7 ms 09:49:20,162 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: completed 1 commands in 20.73 μs 09:49:20,162 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: journal writer stopped 09:49:20,162 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower234: journal closed 09:49:20,162 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower234: journal closed 09:49:20,162 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks 09:49:20,162 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks [WARN] [06/30/2025 09:49:20.165] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower234]: org.opendaylight.controller.cluster.common.actor.Monitor@3bd90458 09:49:20,165 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower234: Starting recovery with journal batch size 1000 09:49:20,165 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower234: started executor 09:49:20,165 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower234: started executor 09:49:20,166 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower234: metadata journal open: replayFrom=1 applyTo=3 09:49:20,167 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower234: journal open: firstIndex=1 lastIndex=3 replayFrom=1 fileEntries=0 09:49:20,167 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower234: journal open: applyTo=3 09:49:20,167 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: journal writer started 09:49:20,167 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: waiting to receive commands 09:49:20,167 AM [test-pekko.actor.default-dispatcher-6] [INFO] PeerInfos - leader232: Peer address for peer follower234 set to pekko://test/user/follower234 09:49:20,168 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=1, votedFor=null 09:49:20,168 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest4622203029005826662/follower234/TermInfo.properties 09:49:20,168 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest4622203029005826662/follower234/journal-v1-1.log 09:49:20,168 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest4622203029005826662/follower234/metadata-v1-1.log 09:49:20,168 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower234: no eligible files found 09:49:20,168 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower234: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:49:20,168 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - follower234: restoring local TermInfo{term=1} 09:49:20,168 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=1, votedFor=null 09:49:20,168 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower234: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@137917fb 09:49:20,168 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to -1 09:49:20,169 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower234: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 09:49:20,169 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower234: recovered journal DefaultLogEntry[index=1, term=1, command=one] 09:49:20,169 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower234: recovered journal DefaultLogEntry[index=2, term=1, command=two] 09:49:20,169 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower234: journal recovery completedin 1.049 ms with journalIndex=1 09:49:20,173 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:20,174 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower234 (Follower): Commit index set to 2 09:49:20,174 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Last sync leader does not match current leader leader232, need to catch up to 2 09:49:20,174 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower234 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): -1, lastIndex(): 2 09:49:20,174 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 0 09:49:20,174 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to 0 09:49:20,174 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower234: Applying state for log index 0 data zero 09:49:20,174 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower234: applyState called: zero 09:49:20,174 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 1 09:49:20,174 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 0 to 1 09:49:20,174 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower234: Applying state for log index 1 data one 09:49:20,174 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower234: applyState called: one 09:49:20,174 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 2 09:49:20,174 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 1 to 2 09:49:20,174 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower234: Applying state for log index 2 data two 09:49:20,174 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower234: applyState called: two 09:49:20,174 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - follower234: fakeSnapshot purging log to 1 for term 1 09:49:20,174 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: received 1 commands after 7.489 ms [WARN] [06/30/2025 09:49:20.174] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=false] 09:49:20,174 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: completed 1 commands in 197.9 μs 09:49:20,174 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: waiting to receive commands 09:49:20,293 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:20,294 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) [WARN] [06/30/2025 09:49:20.294] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=true] 09:49:20,413 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:20,414 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:20,533 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:20,534 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:20,654 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:20,654 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:20,773 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:20,773 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:20,893 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:20,893 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:21,13 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:21,14 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:21,134 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:21,134 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:21,254 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:21,254 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:21,374 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:21,374 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:21,494 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:21,494 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:21,614 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:21,614 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:21,734 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:21,734 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:21,854 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:21,854 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:21,977 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:21,977 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:22,94 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:22,94 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:22,214 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:22,214 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:22,334 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:22,334 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:22,453 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:22,453 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:22,564 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:22,564 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:22,683 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:22,683 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:22,803 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:22,803 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:22,913 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:22,913 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:23,33 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:23,33 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:23,153 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:23,153 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:23,273 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:23,273 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:23,394 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:23,394 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:23,514 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:23,514 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:23,634 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:23,634 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:23,743 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:23,743 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:23,863 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:23,863 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:23,973 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:23,973 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:24,83 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:24,83 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:24,204 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:24,204 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:24,324 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:24,324 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:24,433 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:24,434 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:24,544 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:24,544 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:24,663 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:24,663 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:24,783 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:24,783 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:24,903 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:24,904 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:25,24 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:25,24 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:25,144 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 09:49:25,144 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 09:49:25,194 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower233-collector235#-1528357264] 09:49:25,206 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower233] 09:49:25,206 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - follower233: terminating thread VirtualThread[#626,follower233-writer-96]/waiting 09:49:25,206 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 commands after 5.152 s 09:49:25,206 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: completed 1 commands in 31.05 μs 09:49:25,206 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: journal writer stopped 09:49:25,207 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower233: journal closed 09:49:25,207 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower233: journal closed 09:49:25,207 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower233: stopped executor with 0 remaining tasks 09:49:25,207 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower233: stopped executor with 0 remaining tasks 09:49:25,207 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader232-collector236#-2101763752] 09:49:25,207 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader232] 09:49:25,207 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - leader232: terminating thread VirtualThread[#627,leader232-writer-97]/waiting 09:49:25,207 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 commands after 5.255 s 09:49:25,207 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: completed 1 commands in 17.74 μs 09:49:25,207 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: journal writer stopped 09:49:25,208 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader232: journal closed 09:49:25,208 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader232: journal closed 09:49:25,208 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader232: stopped executor with 0 remaining tasks 09:49:25,208 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader232: stopped executor with 0 remaining tasks 09:49:25,208 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower234-collector237#1063326330] 09:49:25,208 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower234] 09:49:25,209 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower234-collector238#-411054248] 09:49:25,209 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower234] 09:49:25,209 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - follower234: terminating thread VirtualThread[#633,follower234-writer-99]/waiting 09:49:25,209 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: received 1 commands after 5.035 s 09:49:25,209 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: completed 1 commands in 17.76 μs 09:49:25,209 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: journal writer stopped 09:49:25,209 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower234: journal closed 09:49:25,209 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower234: journal closed 09:49:25,209 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks 09:49:25,209 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks 09:49:25,217 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - follower240: Starting recovery with journal batch size 1000 09:49:25,217 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower240: started executor 09:49:25,217 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower240: started executor 09:49:25,217 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower240: metadata journal open: replayFrom=1 applyTo=0 09:49:25,218 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower240: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:49:25,218 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower240: journal open: applyTo=0 09:49:25,218 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: journal writer started 09:49:25,218 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting to receive commands [WARN] [06/30/2025 09:49:25.218] [test-pekko.actor.default-dispatcher-13] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower240]: org.opendaylight.controller.cluster.common.actor.Monitor@53e45cc8 09:49:25,219 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest13163891681099056099/follower240/TermInfo.properties does not exist 09:49:25,220 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower240: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest13163891681099056099/follower240/journal-v1-1.log 09:49:25,220 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower240: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest13163891681099056099/follower240/metadata-v1-1.log 09:49:25,220 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower240: no eligible files found 09:49:25,220 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower240: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [06/30/2025 09:49:25.220] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader239]: org.opendaylight.controller.cluster.common.actor.Monitor@436b97c7 09:49:25,220 AM [test-pekko.actor.default-dispatcher-13] [INFO] RaftActor - leader239: Starting recovery with journal batch size 1000 09:49:25,221 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - leader239: started executor 09:49:25,221 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - leader239: started executor 09:49:25,221 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryJournalV1 - leader239: metadata journal open: replayFrom=1 applyTo=0 09:49:25,222 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryJournalV1 - leader239: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:49:25,222 AM [test-pekko.actor.default-dispatcher-13] [INFO] PekkoRaftStorage - leader239: journal open: applyTo=0 09:49:25,222 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: journal writer started 09:49:25,222 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:49:25,223 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest13163891681099056099/leader239/TermInfo.properties does not exist 09:49:25,224 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest13163891681099056099/leader239/journal-v1-1.log 09:49:25,224 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest13163891681099056099/leader239/metadata-v1-1.log 09:49:25,224 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: no eligible files found 09:49:25,224 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader239: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:49:25,224 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=0, votedFor=null 09:49:25,224 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower240: Local TermInfo store seeded with TermInfo{term=0} 09:49:25,224 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower240: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4351ed3a 09:49:25,224 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from -1 to -1 09:49:25,225 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - follower240: journal recovery completedin 258.9 μs with journalIndex=1 09:49:25,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=0, votedFor=null 09:49:25,227 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader239: Local TermInfo store seeded with TermInfo{term=0} 09:49:25,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@3e8a1a22 09:49:25,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to -1 09:49:25,228 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader239: journal recovery completedin 374.8 μs with journalIndex=1 09:49:25,723 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 09:49:25,723 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Follower - leader239 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.12:17355, Removed) 09:49:25,723 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Follower - leader239 (Follower): Received ElectionTimeout - switching to Candidate 09:49:25,723 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Candidate - leader239 (Candidate): Election: Candidate has following voting peers: [follower241, follower240] 09:49:25,727 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=1, votedFor=leader239 09:49:25,727 AM [test-pekko.actor.default-dispatcher-13] [INFO] Candidate - leader239 (Candidate): Starting new election term 1 09:49:25,727 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} to peer follower241 09:49:25,728 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} to peer follower240 [WARN] [06/30/2025 09:49:25.728] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} 09:49:25,728 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower240 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 09:49:25,728 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower240 (Follower): Cluster state: [] 09:49:25,728 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower240 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 09:49:25,728 AM [test-pekko.actor.default-dispatcher-18] [INFO] Follower - follower240 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 09:49:25,728 AM [test-pekko.actor.default-dispatcher-13] [INFO] RaftActorBehavior - leader239 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 09:49:25,730 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=1, votedFor=null 09:49:25,730 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower240 (Follower): In requestVote: RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 09:49:25,737 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=1, votedFor=leader239 09:49:25,737 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower240 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 09:49:25,737 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader239 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 09:49:25,737 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader239 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 09:49:25,737 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (Leader): Election: Leader has following peers: [follower241, follower240] 09:49:25,737 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:49:25,738 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 09:49:25,738 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader239 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 09:49:25,738 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Last sync leader does not match current leader leader239, need to catch up to -1 09:49:25,738 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: -1, nextIndex: 0 09:49:25,738 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [06/30/2025 09:49:25.738] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower240] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower240, initialSyncDone=false] [WARN] [06/30/2025 09:49:25.738] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:25,782 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader239: Persist data index=0 term=1 command=zero 09:49:25,782 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:49:25,782 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 commands after 559.6 ms 09:49:25,782 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 09:49:25,783 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 [WARN] [06/30/2025 09:49:25.783] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:25,783 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:49:25,783 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 0 is present for follower follower240 09:49:25,783 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader239 (Leader): Sending AppendEntries to follower follower240: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 09:49:25,783 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower240 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 09:49:25,783 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower240 (Follower): Number of entries to be appended = 1 09:49:25,783 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower240 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 09:49:25,783 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower240 (Follower): Append entry to log zero 09:49:25,783 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:49:25,783 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower240 (Follower): Log size is now 1 09:49:25,783 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower240 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower240, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:49:25,783 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached -1 (of expected -1) 09:49:25,784 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 1 deferred callback(s) 09:49:25,784 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 commands after 565.5 ms 09:49:25,784 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader239 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 0, nextIndex: 1 09:49:25,784 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 09:49:25,787 AM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 09:49:25,787 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 4.911 ms 09:49:25,787 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:49:25,787 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 09:49:25,787 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 09:49:25,787 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 09:49:25,787 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader239 (Leader): Setting last applied to 0 09:49:25,787 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to 0 09:49:25,787 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Applying state for log index 0 data zero 09:49:25,787 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader239: applyState called: zero 09:49:25,788 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 commands after 545.8 μs 09:49:25,788 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 151.4 μs 09:49:25,788 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:49:25,788 AM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 1 completion(s) pending 09:49:25,788 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower240: running 1 completion(s) 09:49:25,788 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: completed 1 commands in 4.268 ms 09:49:25,788 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting to receive commands 09:49:25,788 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 09:49:25,788 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@343a6f15 [WARN] [06/30/2025 09:49:25.788] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower240] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower240, initialSyncDone=true] [WARN] [06/30/2025 09:49:25.853] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:25,885 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader239: Persist data index=1 term=1 command=one 09:49:25,885 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:49:25,885 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 09:49:25,885 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 commands after 97.46 ms 09:49:25,885 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:49:25,885 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:49:25,885 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 1 is present for follower follower240 09:49:25,886 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (Leader): Sending AppendEntries to follower follower240: AppendEntries{term=1, leaderId=leader239, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 09:49:25,886 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower240 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader239, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 09:49:25,886 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower240 (Follower): Number of entries to be appended = 1 09:49:25,886 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower240 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 09:49:25,886 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower240 (Follower): Append entry to log one 09:49:25,886 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:49:25,886 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower240 (Follower): Log size is now 2 09:49:25,886 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower240 (Follower): Commit index set to 0 09:49:25,886 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower240 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower240, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:49:25,886 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 0 (of expected -1) 09:49:25,886 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower240 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 09:49:25,886 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 0 09:49:25,886 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from -1 to 0 09:49:25,886 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower240: Applying state for log index 0 data zero 09:49:25,886 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower240: applyState called: zero 09:49:25,886 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 commands after 97.97 ms 09:49:25,886 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 1 deferred callback(s) [WARN] [06/30/2025 09:49:25.886] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:25,886 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 1, nextIndex: 2 09:49:25,886 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 09:49:25,887 AM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 09:49:25,887 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 1.825 ms 09:49:25,887 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 09:49:25,887 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 09:49:25,887 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader239 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 09:49:25,887 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:49:25,887 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - leader239 (Leader): Setting last applied to 1 09:49:25,887 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 0 to 1 09:49:25,887 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader239: Applying state for log index 1 data one 09:49:25,887 AM [test-pekko.actor.default-dispatcher-13] [INFO] MockRaftActor - leader239: applyState called: one 09:49:25,887 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 commands after 321.4 μs 09:49:25,888 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 120.8 μs 09:49:25,888 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:49:25,888 AM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 1 completion(s) pending 09:49:25,888 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: completed 1 commands in 1.818 ms 09:49:25,888 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower240: running 1 completion(s) 09:49:25,888 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 commands after 6.750 μs 09:49:25,888 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 09:49:25,888 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@1d823d05 09:49:25,888 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: completed 1 commands in 104.6 μs 09:49:25,888 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting to receive commands [WARN] [06/30/2025 09:49:25.973] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:25,987 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader239: Persist data index=2 term=1 command=two 09:49:25,987 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:49:25,987 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 09:49:25,988 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:49:25,988 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 commands after 99.92 ms 09:49:25,988 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 09:49:25,988 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 2 is present for follower follower240 09:49:25,988 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Sending AppendEntries to follower follower240: AppendEntries{term=1, leaderId=leader239, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 09:49:25,988 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader239: Persist data index=3 term=1 command=three 09:49:25,988 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 09:49:25,988 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true 09:49:25,988 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:49:25,988 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:49:25,988 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 2 is present for follower follower240 [WARN] [06/30/2025 09:49:25.988] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:49:25.988] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:25,989 AM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 09:49:25,990 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 1.947 ms 09:49:25,990 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 09:49:25,990 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 commands after 8.590 μs 09:49:25,990 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 09:49:25,991 AM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 09:49:25,991 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 09:49:25,991 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 947.1 μs 09:49:25,991 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true} 09:49:25,991 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:49:25,991 AM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader239: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=2, mandatoryTrim=false] 09:49:25,991 AM [test-pekko.actor.default-dispatcher-5] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:139) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:349) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 09:49:25,991 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PekkoRaftStorage - leader239: terminating thread VirtualThread[#635,leader239-writer-101]/waiting 09:49:25,992 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 commands after 1.121 ms 09:49:25,992 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 18.10 μs 09:49:25,992 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: journal writer stopped [ERROR] [06/30/2025 09:49:25.991] [test-pekko.actor.internal-dispatcher-10] [pekko://test/user/leader239] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:139) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:349) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 09:49:25,992 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryJournalV1 - leader239: journal closed 09:49:25,992 AM [test-pekko.actor.default-dispatcher-13] [INFO] PekkoRaftStorage - leader239: journal closed 09:49:25,992 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks 09:49:25,992 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks [WARN] [06/30/2025 09:49:25.993] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader239]: org.opendaylight.controller.cluster.common.actor.Monitor@34a263f 09:49:25,994 AM [test-pekko.actor.default-dispatcher-13] [INFO] RaftActor - leader239: Starting recovery with journal batch size 1000 09:49:25,994 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - leader239: started executor 09:49:25,994 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - leader239: started executor 09:49:25,995 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryJournalV1 - leader239: metadata journal open: replayFrom=1 applyTo=2 09:49:25,996 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryJournalV1 - leader239: journal open: firstIndex=1 lastIndex=4 replayFrom=1 fileEntries=0 09:49:25,996 AM [test-pekko.actor.default-dispatcher-13] [INFO] PekkoRaftStorage - leader239: journal open: applyTo=2 09:49:25,996 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: journal writer started 09:49:25,996 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:49:25,998 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=1, votedFor=leader239 09:49:25,998 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest13163891681099056099/leader239/TermInfo.properties 09:49:25,998 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest13163891681099056099/leader239/journal-v1-1.log 09:49:25,998 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest13163891681099056099/leader239/metadata-v1-1.log 09:49:25,998 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: no eligible files found 09:49:25,998 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader239: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:49:25,998 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - leader239: restoring local TermInfo{term=1, votedFor=leader239} 09:49:25,998 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=1, votedFor=leader239 09:49:25,998 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@5f4342c1 09:49:25,998 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to -1 09:49:25,999 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 09:49:25,999 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=1, term=1, command=one] 09:49:25,999 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=2, term=1, command=two] 09:49:25,999 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=3, term=1, command=three] 09:49:25,999 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader239: journal recovery completedin 1.407 ms with journalIndex=1 09:49:26,463 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Follower - leader239 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.12:17355, Removed) 09:49:26,463 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Follower - leader239 (Follower): Received ElectionTimeout - switching to Candidate 09:49:26,463 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Candidate - leader239 (Candidate): Election: Candidate has following voting peers: [follower241, follower240] 09:49:26,467 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=2, votedFor=leader239 09:49:26,467 AM [test-pekko.actor.default-dispatcher-13] [INFO] Candidate - leader239 (Candidate): Starting new election term 2 09:49:26,468 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} to peer follower241 09:49:26,468 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} to peer follower240 09:49:26,468 AM [test-pekko.actor.default-dispatcher-13] [INFO] RaftActorBehavior - leader239 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 [WARN] [06/30/2025 09:49:26.468] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} 09:49:26,468 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower240 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 09:49:26,468 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower240 (Follower): Cluster state: [] 09:49:26,468 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower240 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} with higher term appears reachable, updating term. 09:49:26,468 AM [test-pekko.actor.default-dispatcher-18] [INFO] Follower - follower240 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1}" message is greater than follower's term 1 - updating term 09:49:26,472 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=2, votedFor=null 09:49:26,472 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower240 (Follower): In requestVote: RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} - currentTerm: 2, votedFor: null, lastIndex: 1, lastTerm: 1 09:49:26,473 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=2, votedFor=leader239 09:49:26,473 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower240 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 09:49:26,474 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader239 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 09:49:26,474 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader239 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 09:49:26,474 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - leader239 (Candidate): LastApplied index -1 is behind last index 3 - switching to PreLeader 09:49:26,474 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (PreLeader): Election: Leader has following peers: [follower241, follower240] 09:49:26,474 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:49:26,474 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 09:49:26,474 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader239 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 2 09:49:26,474 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader239: Persist data index=4 term=2 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387 09:49:26,474 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387, pending=true} 09:49:26,474 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (PreLeader): Replicate message: identifier: null, logIndex: 4, isSendImmediate: true 09:49:26,474 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 [WARN] [06/30/2025 09:49:26.474] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:26,474 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 09:49:26,474 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 commands after 478.2 ms [WARN] [06/30/2025 09:49:26.474] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:26,476 AM [leader239-writer-102] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 09:49:26,476 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 1.559 ms 09:49:26,476 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:49:26,476 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 09:49:26,476 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387, pending=true} 09:49:26,490 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader239: Persist data index=5 term=2 command=four 09:49:26,490 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=5, term=2, command=four, pending=true} 09:49:26,490 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (PreLeader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 5, isSendImmediate: true 09:49:26,490 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 commands after 13.90 ms 09:49:26,490 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 09:49:26,490 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 [WARN] [06/30/2025 09:49:26.490] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:26,490 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging -1 entries behind leader leader239 and reached 0 (of expected -1) 09:49:26,490 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 1, nextIndex: 2 09:49:26,490 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 09:49:26,490 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 09:49:26,490 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 5, leaderSnapShotIndex: -1 09:49:26,490 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (PreLeader): sendAppendEntries: 2 is present for follower follower240 09:49:26,490 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (PreLeader): Sending AppendEntries to follower follower240: AppendEntries{term=2, leaderId=leader239, prevLogIndex=1, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387, pending=false}, JournaledLogEntry{index=5, term=2, command=four, pending=true}]} 09:49:26,491 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower240 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader239, prevLogIndex=1, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387, pending=false}, JournaledLogEntry{index=5, term=2, command=four, pending=true}]} 09:49:26,491 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower240 (Follower): Number of entries to be appended = 4 09:49:26,491 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower240 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 09:49:26,491 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower240 (Follower): Append entry to log two 09:49:26,491 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=false} 09:49:26,491 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower240 (Follower): Append entry to log three 09:49:26,491 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=false} 09:49:26,491 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower240 (Follower): Append entry to log org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387 09:49:26,491 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387, pending=false} 09:49:26,491 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower240 (Follower): Append entry to log four 09:49:26,491 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=5, term=2, command=four, pending=true} 09:49:26,491 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower240 (Follower): Log size is now 6 09:49:26,491 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower240 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower240, logLastIndex=5, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:49:26,491 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging -1 entries behind leader leader239 and reached 0 (of expected -1) 09:49:26,491 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 4 deferred callback(s) 09:49:26,491 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 4 commands after 602.7 ms 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader239 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 5, nextIndex: 6 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader239 (PreLeader): Applying to log - commitIndex: 4, lastAppliedIndex: -1 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 0 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to 0 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader239: Applying state for log index 0 data zero 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [INFO] MockRaftActor - leader239: applyState called: zero 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 1 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 0 to 1 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader239: Applying state for log index 1 data one 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [INFO] MockRaftActor - leader239: applyState called: one 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 2 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 1 to 2 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader239: Applying state for log index 2 data two 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [INFO] MockRaftActor - leader239: applyState called: two 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 3 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 2 to 3 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader239: Applying state for log index 3 data three 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [INFO] MockRaftActor - leader239: applyState called: three 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 4 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 3 to 4 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader239: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387 09:49:26,491 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 6, leaderLastIndex: 5, leaderSnapShotIndex: -1 09:49:26,492 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PreLeader - leader239 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}] - lastApplied: 4, lastIndex: 5 09:49:26,492 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PreLeader - leader239 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=1, term=1, command=one, pending=false}] - lastApplied: 4, lastIndex: 5 09:49:26,492 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PreLeader - leader239 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=2, term=1, command=two, pending=false}] - lastApplied: 4, lastIndex: 5 09:49:26,492 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PreLeader - leader239 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=3, term=1, command=three, pending=false}] - lastApplied: 4, lastIndex: 5 09:49:26,492 AM [leader239-writer-102] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 09:49:26,492 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 1.981 ms 09:49:26,492 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 commands after 17.08 μs 09:49:26,492 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 181.9 μs 09:49:26,492 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:49:26,492 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 09:49:26,492 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=5, term=2, command=four, pending=true} 09:49:26,492 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (PreLeader): Applying to log - commitIndex: 5, lastAppliedIndex: 4 09:49:26,492 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 5 09:49:26,492 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 4 to 5 09:49:26,492 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader239: Applying state for log index 5 data four 09:49:26,492 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader239: applyState called: four 09:49:26,493 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PreLeader - leader239 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387, pending=false}] - lastApplied: 5, lastIndex: 5 09:49:26,493 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 commands after 357.9 μs 09:49:26,493 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 78.40 μs 09:49:26,493 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting to receive commands 09:49:26,493 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Election: Leader has following peers: [follower241, follower240] 09:49:26,493 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 09:49:26,493 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 6, leaderLastIndex: 5, leaderSnapShotIndex: -1 09:49:26,493 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader239 (PreLeader) :- Switching from behavior PreLeader to Leader, election term: 2 [WARN] [06/30/2025 09:49:26.493] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:26,496 AM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 4 completion(s) pending 09:49:26,496 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryStoreCompleter - follower240: running 4 completion(s) 09:49:26,496 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 09:49:26,496 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: completed 4 commands in 5.545 ms 09:49:26,496 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@236202bc 09:49:26,496 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=false} 09:49:26,496 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@4ffe8bf9 09:49:26,496 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387, pending=false} 09:49:26,496 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@1a48c4a3 09:49:26,496 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=5, term=2, command=four, pending=false} 09:49:26,496 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0882d58@15be3bd2 09:49:26,496 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting to receive commands 09:49:26,496 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower240 (Follower): Commit index set to 4 09:49:26,496 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 4 (of expected -1) 09:49:26,496 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower240 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 4, context.getLastApplied(): 0, lastIndex(): 5 09:49:26,496 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 1 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 0 to 1 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower240: Applying state for log index 1 data one 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower240: applyState called: one 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 2 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 1 to 2 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower240: Applying state for log index 2 data two 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower240: applyState called: two 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 3 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 2 to 3 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower240: Applying state for log index 3 data three 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower240: applyState called: three 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 4 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 3 to 4 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower240: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@40666387 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower240 (Follower): Commit index set to 5 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower240 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 5, context.getLastApplied(): 4, lastIndex(): 5 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 5 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 4 to 5 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower240: Applying state for log index 5 data four 09:49:26,497 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower240: applyState called: four 09:49:26,497 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 commands after 418.5 μs 09:49:26,497 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: completed 1 commands in 135.9 μs 09:49:26,497 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 commands after 4.670 μs 09:49:26,497 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: completed 1 commands in 80.51 μs 09:49:26,497 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting to receive commands 09:49:26,603 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:26.603] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:49:26.723] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:26,724 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:26.843] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:26,843 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:26.963] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:26,964 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:49:27,83 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:27.084] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:27,203 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:27.203] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:27,323 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:27.323] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:27,444 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:27.444] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:27,563 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:27.563] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:27,683 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:27.683] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:27,803 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:27.803] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:27,924 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:27.924] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:28,44 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:28.044] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:28,164 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:28.164] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:28,283 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:28.283] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:28,403 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:28.403] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:28,513 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:28.513] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:28,633 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:28.633] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:28,753 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:28.753] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:28,873 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:28.873] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:28,993 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:28.994] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:49:29.113] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:29,113 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:49:29,234 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:29.233] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:49:29.354] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:29,354 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:49:29,473 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:29.473] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:29,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:29.593] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:29,714 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:29.714] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:49:29.833] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:29,833 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:49:29,953 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:29.953] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:49:30.073] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:30,73 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:49:30,194 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:30.194] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:30,314 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:30.314] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:30,434 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:30.434] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:49:30.554] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:30,554 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:49:30,674 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:30.674] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:30,794 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:30.794] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/30/2025 09:49:30.913] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:30,913 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:31.033] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:31,34 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:31.153] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:31,153 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 09:49:31,273 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:31.273] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:31,393 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:31.393] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:31,507 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower240-collector242#299624450] 09:49:31,514 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/30/2025 09:49:31.514] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 09:49:31,518 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower240] 09:49:31,518 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - follower240: terminating thread VirtualThread[#634,follower240-writer-100]/waiting 09:49:31,518 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 commands after 5.021 s 09:49:31,518 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: completed 1 commands in 32.54 μs 09:49:31,518 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: journal writer stopped 09:49:31,519 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower240: journal closed 09:49:31,519 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower240: journal closed 09:49:31,519 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower240: stopped executor with 0 remaining tasks 09:49:31,519 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower240: stopped executor with 0 remaining tasks 09:49:31,519 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader239-collector243#-1792064340] 09:49:31,519 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader239] 09:49:31,519 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - leader239: terminating thread VirtualThread[#638,leader239-writer-102]/waiting 09:49:31,519 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 commands after 5.027 s 09:49:31,519 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: completed 1 commands in 10.46 μs 09:49:31,519 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: journal writer stopped 09:49:31,520 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader239: journal closed 09:49:31,520 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - leader239: journal closed 09:49:31,520 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks 09:49:31,520 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks 09:49:31,522 AM [test-pekko.actor.default-dispatcher-16] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [INFO] [06/30/2025 09:49:31.522] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 09:49:31,523 AM [test-pekko.actor.default-dispatcher-16] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.12:17355] - Exiting completed [WARN] [06/30/2025 09:49:31.523] [test-pekko.actor.default-dispatcher-16] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.170.12:17355) 09:49:31,523 AM [test-pekko.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.12:17355] - Shutting down... [INFO] [06/30/2025 09:49:31.523] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.12:17355] - Exiting completed [INFO] [06/30/2025 09:49:31.523] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.12:17355] - Shutting down... [INFO] [06/30/2025 09:49:31.524] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.12:17355] - Successfully shut down 09:49:31,524 AM [test-pekko.actor.default-dispatcher-16] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.12:17355] - Successfully shut down [INFO] [06/30/2025 09:49:31.525] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.170.12:17355/system/remoting-terminator] Shutting down remote daemon. [INFO] [06/30/2025 09:49:31.525] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.170.12:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports. 09:49:31,526 AM [test-pekko.actor.default-dispatcher-5] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 09:49:31,526 AM [test-pekko.actor.default-dispatcher-5] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [INFO] [06/30/2025 09:49:31.528] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.170.12:17355/system/remoting-terminator] Remoting shut down. [DEBUG] [06/30/2025 09:49:31.528] [test-pekko.actor.internal-dispatcher-4] [EventStream] shutting down: StandardOutLogger 09:49:31,528 AM [test-pekko.actor.default-dispatcher-18] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.