[DEBUG] [06/27/2025 10:14:59.545] [main] [EventStream(pekko://test)] logger log1-TestEventListener started 10:14:59,546 AM [test-pekko.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [06/27/2025 10:14:59.546] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started [DEBUG] [06/27/2025 10:14:59.546] [main] [EventStream(pekko://test)] Default Loggers started [INFO] [06/27/2025 10:14:59.561] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.113:17355] with UID [4946927621502213710] 10:14:59,561 AM [test-pekko.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.113:17355] with UID [4946927621502213710] 10:14:59,562 AM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.113:17355] - Starting up, Pekko version [1.0.3] ... [INFO] [06/27/2025 10:14:59.562] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.113:17355] - Starting up, Pekko version [1.0.3] ... 10:14:59,567 AM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.113:17355] - Registered cluster JMX MBean [pekko:type=Cluster] [INFO] [06/27/2025 10:14:59.567] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.113:17355] - Registered cluster JMX MBean [pekko:type=Cluster] 10:14:59,567 AM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.113:17355] - Started up successfully [INFO] [06/27/2025 10:14:59.567] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.113:17355] - Started up successfully [INFO] [06/27/2025 10:14:59.567] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.113:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing [INFO] [06/27/2025 10:14:59.568] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.113:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 10:14:59,568 AM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.113:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing 10:14:59,568 AM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.113:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining [WARN] [06/27/2025 10:14:59.582] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower223]: org.opendaylight.controller.cluster.common.actor.Monitor@1458a7b6 [INFO] [pekkoDeadLetter][06/27/2025 10:14:59.582] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower223] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:14:59,583 AM [test-pekko.actor.default-dispatcher-7] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower223] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:14:59,586 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower223: Starting recovery with journal batch size 1000 10:14:59,586 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower223: started executor 10:14:59,586 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower223: started executor 10:14:59,587 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower223: metadata journal open: replayFrom=1 applyTo=0 10:14:59,588 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower223: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:14:59,588 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower223: journal open: applyTo=0 10:14:59,588 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@4cc0479d started 10:14:59,588 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for [WARN] [06/27/2025 10:14:59.589] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader222]: org.opendaylight.controller.cluster.common.actor.Monitor@6c5ff85f [INFO] [pekkoDeadLetter][06/27/2025 10:14:59.589] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:14:59,589 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:14:59,590 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - leader222: Starting recovery with journal batch size 1000 10:14:59,590 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader222: started executor 10:14:59,590 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader222: started executor 10:14:59,590 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/follower223/TermInfo.properties does not exist 10:14:59,590 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower223: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/follower223/journal-v1-1.log 10:14:59,590 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower223: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/follower223/metadata-v1-1.log 10:14:59,590 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower223: no eligible files found 10:14:59,590 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower223: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:14:59,590 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader222: metadata journal open: replayFrom=1 applyTo=0 10:14:59,591 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader222: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:14:59,591 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - leader222: journal open: applyTo=0 10:14:59,591 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@7a9848ba started 10:14:59,591 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for 10:14:59,592 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties does not exist 10:14:59,592 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:14:59,592 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:14:59,592 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader222: no eligible files found 10:14:59,592 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader222: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:14:59,594 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=0, votedFor=null 10:14:59,594 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower223: Local TermInfo store seeded with TermInfo{term=0} 10:14:59,594 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower223: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@69f7f6a4 10:14:59,594 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from -1 to -1 10:14:59,595 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower223: journal recovery completedin 428.8 μs with journalIndex=1 10:14:59,597 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=0, votedFor=null 10:14:59,597 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader222: Local TermInfo store seeded with TermInfo{term=0} 10:14:59,597 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader222: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@165a1e73 10:14:59,597 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to -1 10:14:59,597 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - leader222: journal recovery completedin 272.6 μs with journalIndex=1 10:15:00,71 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 10:15:00,71 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader222 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.113:17355, Removed) 10:15:00,72 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader222 (Follower): Received ElectionTimeout - switching to Candidate 10:15:00,72 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader222 (Candidate): Election: Candidate has following voting peers: [follower223, follower224] 10:15:00,76 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222 10:15:00,76 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - leader222 (Candidate): Starting new election term 1 10:15:00,76 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} to peer follower223 10:15:00,76 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} to peer follower224 10:15:00,76 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower223 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 10:15:00,76 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower223 (Follower): Cluster state: [] 10:15:00,76 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower223 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 10:15:00,76 AM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - follower223 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 10:15:00,76 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader222 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 [WARN] [06/27/2025 10:15:00.076] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} [INFO] [pekkoDeadLetter][06/27/2025 10:15:00.077] [test-pekko.actor.default-dispatcher-14] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:15:00,77 AM [test-pekko.actor.default-dispatcher-15] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:15:00,79 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=1, votedFor=null 10:15:00,79 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower223 (Follower): In requestVote: RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 10:15:00,83 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=1, votedFor=leader222 10:15:00,83 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower223 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 10:15:00,83 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader222 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 10:15:00,83 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader222 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 10:15:00,83 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (Leader): Election: Leader has following peers: [follower223, follower224] 10:15:00,83 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:15:00,84 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:15:00,84 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - leader222 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 10:15:00,84 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower223: Last sync leader does not match current leader leader222, need to catch up to -1 10:15:00,84 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: -1, nextIndex: 0 10:15:00,84 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [06/27/2025 10:15:00.084] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower223] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower223, initialSyncDone=false] [INFO] [pekkoDeadLetter][06/27/2025 10:15:00.084] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower223] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:15:00,84 AM [test-pekko.actor.default-dispatcher-7] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [06/27/2025 10:15:00.087] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:00,87 AM [test-pekko.actor.default-dispatcher-7] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][06/27/2025 10:15:00.087] [test-pekko.actor.default-dispatcher-7] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:15:00,102 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader222: Persist data index=0 term=1 command=zero 10:15:00,102 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:15:00,102 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 10:15:00,102 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:15:00,102 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 0 is present for follower follower223 10:15:00,102 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 10:15:00,102 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:15:00,102 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 510.6 ms [WARN] [06/27/2025 10:15:00.102] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [INFO] [pekkoDeadLetter][06/27/2025 10:15:00.102] [test-pekko.actor.default-dispatcher-7] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:15:00,102 AM [test-pekko.actor.default-dispatcher-11] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:15:00,102 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 10:15:00,102 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 10:15:00,102 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 10:15:00,102 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Append entry to log zero 10:15:00,102 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:15:00,102 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Log size is now 1 10:15:00,102 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:15:00,102 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 0, nextIndex: 1 10:15:00,103 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:15:00,103 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 514.8 ms 10:15:00,103 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached -1 (of expected -1) 10:15:00,103 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 10:15:00,108 AM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 10:15:00,108 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 6.464 ms 10:15:00,109 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for 10:15:00,109 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 10:15:00,109 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:15:00,109 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 10:15:00,109 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 0 10:15:00,109 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to 0 10:15:00,109 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader222: Applying state for log index 0 data zero 10:15:00,109 AM [test-pekko.actor.default-dispatcher-14] [INFO] MockRaftActor - leader222: applyState called: zero 10:15:00,109 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 10:15:00,110 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 6.865 ms 10:15:00,110 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 980.3 μs 10:15:00,110 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for 10:15:00,110 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 10:15:00,110 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 10:15:00,110 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@2944b738} 10:15:00,110 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 103.4 μs 10:15:00,110 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for [WARN] [06/27/2025 10:15:00.110] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower223] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower223, initialSyncDone=true] [INFO] [pekkoDeadLetter][06/27/2025 10:15:00.110] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower223] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:15:00,110 AM [test-pekko.actor.default-dispatcher-14] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [06/27/2025 10:15:00.202] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [INFO] [pekkoDeadLetter][06/27/2025 10:15:00.202] [test-pekko.actor.default-dispatcher-11] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:15:00,203 AM [test-pekko.actor.default-dispatcher-11] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:15:00,203 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader222: Persist data index=1 term=1 command=one 10:15:00,203 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:15:00,203 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 10:15:00,203 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:15:00,203 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 1 is present for follower follower223 10:15:00,203 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 10:15:00,203 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:15:00,203 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 93.72 ms [WARN] [06/27/2025 10:15:00.204] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:00,204 AM [test-pekko.actor.default-dispatcher-11] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][06/27/2025 10:15:00.204] [test-pekko.actor.default-dispatcher-15] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:15:00,204 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 10:15:00,204 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 10:15:00,204 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 10:15:00,204 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower223 (Follower): Append entry to log one 10:15:00,204 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:15:00,204 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower223 (Follower): Log size is now 2 10:15:00,204 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower223 (Follower): Commit index set to 0 10:15:00,204 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:15:00,204 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 0 (of expected -1) 10:15:00,204 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 94.48 ms 10:15:00,204 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 10:15:00,204 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 0 10:15:00,204 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from -1 to 0 10:15:00,204 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower223: Applying state for log index 0 data zero 10:15:00,204 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 1, nextIndex: 2 10:15:00,204 AM [test-pekko.actor.default-dispatcher-14] [INFO] MockRaftActor - follower223: applyState called: zero 10:15:00,204 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:15:00,204 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 10:15:00,207 AM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 10:15:00,207 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 3.334 ms 10:15:00,207 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for 10:15:00,207 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 10:15:00,207 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:15:00,207 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 10:15:00,207 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 1 10:15:00,207 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 0 to 1 10:15:00,207 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader222: Applying state for log index 1 data one 10:15:00,207 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader222: applyState called: one 10:15:00,208 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 786.4 μs 10:15:00,208 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 10:15:00,208 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 174.0 μs 10:15:00,208 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for 10:15:00,208 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 3.818 ms 10:15:00,208 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 10:15:00,208 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 10:15:00,208 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 14.03 μs 10:15:00,208 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@573d3afb} 10:15:00,208 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 238.6 μs 10:15:00,208 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for 10:15:00,304 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader222: Persist data index=2 term=1 command=two 10:15:00,304 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:15:00,304 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 10:15:00,304 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:15:00,304 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 2 is present for follower follower223 10:15:00,304 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 10:15:00,305 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:15:00,305 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader222: Persist data index=3 term=1 command=three 10:15:00,305 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 10:15:00,305 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true 10:15:00,305 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:15:00,305 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 2 is present for follower follower223 10:15:00,305 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:15:00,305 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 10:15:00,305 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 10:15:00,305 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 10:15:00,305 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): Append entry to log two 10:15:00,305 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:15:00,305 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 2 entries in 97.01 ms 10:15:00,305 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): Log size is now 3 10:15:00,305 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): Commit index set to 1 10:15:00,305 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:15:00,305 AM [test-pekko.actor.default-dispatcher-11] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:15:00,305 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 2, nextIndex: 3 10:15:00,305 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 3, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:15:00,305 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 3 is present for follower follower223 10:15:00,305 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=2, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=three, pending=true}]} 10:15:00,305 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 1 (of expected -1) 10:15:00,305 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 2 10:15:00,305 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 1 10:15:00,305 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 0 to 1 10:15:00,305 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower223: Applying state for log index 1 data one 10:15:00,305 AM [test-pekko.actor.default-dispatcher-7] [INFO] MockRaftActor - follower223: applyState called: one [WARN] [06/27/2025 10:15:00.305] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [INFO] [pekkoDeadLetter][06/27/2025 10:15:00.305] [test-pekko.actor.default-dispatcher-11] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [06/27/2025 10:15:00.306] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:00,306 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 97.19 ms 10:15:00,306 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 10:15:00,308 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 10:15:00,308 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 10:15:00,308 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 1.979 ms 10:15:00,308 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 10:15:00,308 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 9.150 μs 10:15:00,308 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@6831c6ef} 10:15:00,308 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 180.4 μs 10:15:00,308 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for 10:15:00,310 AM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 2 completion(s) pending 10:15:00,310 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 2 entries in 4.546 ms 10:15:00,310 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for 10:15:00,315 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=2, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=three, pending=true}]} 10:15:00,315 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 10:15:00,315 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 2, entries to be added from: 0 10:15:00,315 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): Append entry to log three 10:15:00,315 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 10:15:00,315 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): Log size is now 4 10:15:00,315 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=3, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:15:00,315 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 1 (of expected -1) 10:15:00,315 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 10:15:00,315 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader222: running 2 completion(s) 10:15:00,315 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:15:00,315 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 6.973 ms 10:15:00,315 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1 10:15:00,315 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 2 10:15:00,315 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 1 to 2 10:15:00,315 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader222: Applying state for log index 2 data two 10:15:00,315 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader222: applyState called: two 10:15:00,315 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true} 10:15:00,315 AM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader222: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=2, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 10:15:00,315 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 5.770 ms 10:15:00,316 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 206.9 μs 10:15:00,316 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for 10:15:00,316 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - leader222: terminating thread VirtualThread[#600,leader222-writer-91]/waiting 10:15:00,316 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 217.6 μs 10:15:00,316 AM [test-pekko.actor.default-dispatcher-16] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:305) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 10:15:00,316 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 32.50 μs 10:15:00,317 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@7a9848ba stopped 10:15:00,317 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader222: journal closed 10:15:00,317 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader222: journal closed 10:15:00,317 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks 10:15:00,317 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks [ERROR] [06/27/2025 10:15:00.316] [test-pekko.actor.internal-dispatcher-4] [pekko://test/user/leader222] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:305) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) [WARN] [06/27/2025 10:15:00.317] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader222]: org.opendaylight.controller.cluster.common.actor.Monitor@57f25547 10:15:00,318 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - leader222: Starting recovery with journal batch size 1000 10:15:00,318 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader222: started executor 10:15:00,318 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader222: started executor 10:15:00,318 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 10:15:00,318 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 10:15:00,318 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=false} 10:15:00,318 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@5f86257f} 10:15:00,318 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 3.196 ms 10:15:00,318 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for 10:15:00,319 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader222: metadata journal open: replayFrom=1 applyTo=2 10:15:00,320 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader222: journal open: firstIndex=1 lastIndex=4 replayFrom=1 fileEntries=0 10:15:00,320 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader222: journal open: applyTo=2 10:15:00,320 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@12c702b8 started 10:15:00,320 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: waiting for 10:15:00,321 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222 10:15:00,321 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:00,321 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:00,321 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:00,322 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:00,322 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader222: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:15:00,322 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - leader222: restoring local TermInfo{term=1, votedFor=leader222} 10:15:00,322 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222 10:15:00,322 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@16cf5f7c 10:15:00,322 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to -1 10:15:00,322 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 10:15:00,323 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=1, term=1, command=one] 10:15:00,324 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=2, term=1, command=two] 10:15:00,324 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=3, term=1, command=three] 10:15:00,324 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - leader222: journal recovery completedin 2.536 ms with journalIndex=1 10:15:00,407 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:00,407 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:00,407 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:00,407 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:00,508 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:00,508 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:00,508 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:00,508 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:00,609 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:00,609 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:00,609 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:00,609 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:00,710 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:00,710 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:00,710 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:00,710 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:00,811 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:00,811 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:00,811 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:00,811 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:00,812 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - leader222 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.113:17355, Removed) 10:15:00,812 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - leader222 (Follower): Received ElectionTimeout - switching to Candidate 10:15:00,812 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader222 (Candidate): Election: Candidate has following voting peers: [follower223, follower224] 10:15:00,816 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=2, votedFor=leader222 10:15:00,816 AM [test-pekko.actor.default-dispatcher-18] [INFO] Candidate - leader222 (Candidate): Starting new election term 2 10:15:00,816 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} to peer follower223 10:15:00,816 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} to peer follower224 10:15:00,816 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader222 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 10:15:00,816 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower223 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 10:15:00,816 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower223 (Follower): Cluster state: [] 10:15:00,816 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower223 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} with higher term appears reachable, updating term. [WARN] [06/27/2025 10:15:00.816] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} 10:15:00,816 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower223 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1}" message is greater than follower's term 1 - updating term 10:15:00,819 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=2, votedFor=null 10:15:00,819 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower223 (Follower): In requestVote: RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} - currentTerm: 2, votedFor: null, lastIndex: 3, lastTerm: 1 10:15:00,822 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=2, votedFor=leader222 10:15:00,822 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower223 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 10:15:00,822 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader222 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 10:15:00,822 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - leader222 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 10:15:00,822 AM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - leader222 (Candidate): LastApplied index -1 is behind last index 3 - switching to PreLeader 10:15:00,822 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (PreLeader): Election: Leader has following peers: [follower223, follower224] 10:15:00,822 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:15:00,822 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:15:00,822 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - leader222 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 2 10:15:00,823 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader222: Persist data index=4 term=2 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38 10:15:00,823 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38, pending=true} 10:15:00,823 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (PreLeader): Replicate message: identifier: null, logIndex: 4, isSendImmediate: true 10:15:00,823 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 [WARN] [06/27/2025 10:15:00.823] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:00,823 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:15:00,823 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: received 1 entries in 502.7 ms 10:15:00,823 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 3, nextIndex: 4 10:15:00,823 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 10:15:00,823 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 10:15:00,823 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 10:15:00,823 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 10:15:00,823 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:15:00,823 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (PreLeader): sendAppendEntries: 4 is present for follower follower223 10:15:00,823 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader222 (PreLeader): Sending AppendEntries to follower follower223: AppendEntries{term=2, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38, pending=true}]} 10:15:00,824 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging -2 entries behind leader leader222 and reached 1 (of expected -1) 10:15:00,824 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 10:15:00,824 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 10:15:00,824 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 10:15:00,824 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 10:15:00,824 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): sendAppendEntries: 4 is present for follower follower223 [WARN] [06/27/2025 10:15:00.824] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:00,825 AM [leader222-writer-92] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 10:15:00,825 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 2.089 ms 10:15:00,825 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: waiting for 10:15:00,825 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 10:15:00,825 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38, pending=true} 10:15:00,825 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 10:15:00,825 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 10:15:00,825 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 10:15:00,825 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 10:15:00,835 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging -2 entries behind leader leader222 and reached 1 (of expected -1) 10:15:00,835 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38, pending=false}]} 10:15:00,835 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 10:15:00,835 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 3, entries to be added from: 0 10:15:00,835 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Append entry to log org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38 10:15:00,835 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38, pending=false} 10:15:00,835 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Log size is now 5 10:15:00,835 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower223, logLastIndex=4, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:15:00,835 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging -2 entries behind leader leader222 and reached 1 (of expected -1) 10:15:00,835 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 10:15:00,835 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 517.1 ms 10:15:00,835 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 4, nextIndex: 5 10:15:00,835 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Applying to log - commitIndex: 4, lastAppliedIndex: -1 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 0 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to 0 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 0 data zero 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader222: applyState called: zero 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 1 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 0 to 1 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 1 data one 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader222: applyState called: one 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 2 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 1 to 2 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 2 data two 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader222: applyState called: two 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 3 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 2 to 3 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 3 data three 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader222: applyState called: three 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 4 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 3 to 4 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader222: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38 10:15:00,836 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: received 1 entries in 11.10 ms 10:15:00,836 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 5, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:15:00,836 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 314.9 μs 10:15:00,837 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: waiting for 10:15:00,837 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PreLeader - leader222 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}] - lastApplied: 4, lastIndex: 4 10:15:00,837 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): Election: Leader has following peers: [follower223, follower224] 10:15:00,837 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 5, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:15:00,837 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:15:00,837 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader222 (PreLeader) :- Switching from behavior PreLeader to Leader, election term: 2 [WARN] [06/27/2025 10:15:00.837] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:00,837 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38, pending=false} 10:15:00,838 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 2.115 ms 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@29fec663} 10:15:00,838 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Commit index set to 4 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 4, context.getLastApplied(): 1, lastIndex(): 4 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 2 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 1 to 2 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower223: Applying state for log index 2 data two 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower223: applyState called: two 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 3 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 2 to 3 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower223: Applying state for log index 3 data three 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower223: applyState called: three 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 4 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 3 to 4 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower223: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38 10:15:00,838 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 10:15:00,838 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 419.2 μs 10:15:00,838 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 138.7 μs 10:15:00,838 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for 10:15:00,912 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:00,912 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:00,912 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:00,912 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:00,952 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:00.952] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:01,16 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:01,16 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:01,16 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:01,16 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/27/2025 10:15:01.072] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:01,72 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 10:15:01,117 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:01,117 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:01,117 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:01,117 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:01,192 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:01.192] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:01,217 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:01,217 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:01,217 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:01,217 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:01,312 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:01.312] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:01,318 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:01,318 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:01,318 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:01,318 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:01,419 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:01,419 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:01,419 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:01,419 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:01,432 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:01.432] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:01,520 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:01,520 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:01,520 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:01,521 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:01,552 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:01.552] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:01,622 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:01,622 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:01,622 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:01,622 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:01,672 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:01.672] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:01,723 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:01,723 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:01,723 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:01,723 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:01,792 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:01.792] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:01,824 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:01,824 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:01,824 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:01,824 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:01,912 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:01.912] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:01,925 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:01,925 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:01,925 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:01,925 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:02,26 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:02,26 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:02,26 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:02,26 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:02,32 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:02.032] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:02,127 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:02,127 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:02,127 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:02,127 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:02,152 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:02.152] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:02,228 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:02,228 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:02,228 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:02,228 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/27/2025 10:15:02.272] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:02,272 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 10:15:02,328 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:02,328 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:02,328 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:02,328 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:02,392 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:02.393] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:02,429 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:02,429 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:02,429 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:02,429 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:02,514 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:02.514] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:02,530 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:02,530 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:02,530 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:02,530 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:02,631 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:02,631 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:02,631 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:02,631 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:02,632 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:02.632] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:02,731 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:02,732 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:02,732 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:02,732 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:02,752 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:02.753] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:02,832 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:02,832 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:02,832 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:02,832 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:02,872 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:02.872] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:02,933 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:02,933 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:02,933 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:02,933 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:02,982 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:02.982] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:03,34 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:03,34 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:03,34 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:03,34 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:03,104 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:03.104] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:03,134 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:03,134 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:03,135 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:03,135 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:03,222 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:03.222] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:03,235 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:03,235 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:03,235 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:03,235 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:03,332 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:03.332] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:03,336 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:03,336 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:03,336 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:03,336 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:03,437 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:03,437 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:03,437 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:03,437 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:03,453 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:03.453] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:03,537 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:03,537 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:03,537 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:03,538 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:03,572 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:03.572] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:03,638 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:03,638 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:03,638 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:03,638 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:03,682 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:03.682] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:03,739 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:03,739 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:03,739 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:03,739 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:03,802 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:03.802] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:03,840 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:03,840 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:03,840 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:03,840 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:03,922 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:03.929] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:03,941 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:03,941 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:03,941 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:03,941 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:04,42 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:04,42 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:04,42 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:04,42 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:04,43 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:04.043] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:04,143 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:04,143 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:04,143 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:04,143 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:04,162 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:04.162] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:04,244 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:04,244 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:04,244 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:04,244 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:04,286 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:04.285] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:04,344 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:04,344 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:04,344 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:04,344 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:04,402 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:04.402] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:04,445 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:04,445 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:04,445 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:04,445 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:04,523 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:04.523] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:04,546 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:04,546 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:04,546 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:04,546 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:04,642 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:04.642] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:04,647 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:04,647 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:04,647 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:04,647 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:04,747 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:04,747 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:04,747 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:04,747 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:04,762 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:04.762] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:04,848 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:04,848 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:04,848 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:04,848 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:04,883 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:04.883] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:04,949 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:04,949 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:04,949 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:04,949 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:05,2 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:05.002] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:05,49 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:05,49 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:05,49 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:05,49 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:05,122 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:05.122] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:05,150 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:05,150 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:05,150 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:05,150 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:05,242 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:05.242] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:05,251 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/TermInfo.properties 10:15:05,251 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/journal-v1-1.log 10:15:05,251 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11918560664151102424/leader222/metadata-v1-1.log 10:15:05,251 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:15:05,353 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower223-collector225#-1063307959] 10:15:05,362 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:15:05.362] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:05,365 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower223] 10:15:05,366 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - follower223: terminating thread VirtualThread[#599,follower223-writer-90]/waiting 10:15:05,366 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 4.528 s 10:15:05,366 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 64.01 μs 10:15:05,366 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@4cc0479d stopped 10:15:05,367 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower223: journal closed 10:15:05,367 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower223: journal closed 10:15:05,367 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower223: stopped executor with 0 remaining tasks 10:15:05,367 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower223: stopped executor with 0 remaining tasks 10:15:05,367 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader222-collector226#1677163629] 10:15:05,367 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader222] 10:15:05,367 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - leader222: terminating thread VirtualThread[#608,leader222-writer-92]/waiting 10:15:05,367 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: received 1 entries in 4.531 s 10:15:05,367 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 23.65 μs 10:15:05,368 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@12c702b8 stopped 10:15:05,368 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader222: journal closed 10:15:05,368 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - leader222: journal closed 10:15:05,368 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks 10:15:05,368 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks [WARN] [06/27/2025 10:15:05.374] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower228]: org.opendaylight.controller.cluster.common.actor.Monitor@63b08739 10:15:05,375 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower228: Starting recovery with journal batch size 1000 10:15:05,375 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower228: started executor 10:15:05,376 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower228: started executor 10:15:05,376 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower228: metadata journal open: replayFrom=1 applyTo=0 10:15:05,377 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower228: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:15:05,377 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower228: journal open: applyTo=0 10:15:05,377 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@12a9dde1 started 10:15:05,377 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: waiting for 10:15:05,378 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/follower228/TermInfo.properties does not exist 10:15:05,379 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/follower228/journal-v1-1.log 10:15:05,379 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/follower228/metadata-v1-1.log 10:15:05,379 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower228: no eligible files found [WARN] [06/27/2025 10:15:05.379] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader227]: org.opendaylight.controller.cluster.common.actor.Monitor@7f5c2ade 10:15:05,379 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower228: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:15:05,379 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - leader227: Starting recovery with journal batch size 1000 10:15:05,379 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader227: started executor 10:15:05,380 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader227: started executor 10:15:05,380 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader227: metadata journal open: replayFrom=1 applyTo=0 10:15:05,381 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader227: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:15:05,381 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - leader227: journal open: applyTo=0 10:15:05,381 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@3859f26e started 10:15:05,381 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for 10:15:05,383 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties does not exist 10:15:05,383 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:05,383 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:05,383 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader227: no eligible files found 10:15:05,383 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=0, votedFor=null 10:15:05,383 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader227: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:15:05,383 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower228: Local TermInfo store seeded with TermInfo{term=0} 10:15:05,383 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower228: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@429a87bb 10:15:05,383 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower228: Moving last applied index from -1 to -1 10:15:05,384 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - follower228: journal recovery completedin 314.8 μs with journalIndex=1 10:15:05,387 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=0, votedFor=null 10:15:05,387 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader227: Local TermInfo store seeded with TermInfo{term=0} 10:15:05,387 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader227: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@45d4e353 10:15:05,387 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from -1 to -1 10:15:05,388 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader227: journal recovery completedin 605.3 μs with journalIndex=1 10:15:05,861 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 10:15:05,862 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader227 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.113:17355, Removed) 10:15:05,862 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader227 (Follower): Received ElectionTimeout - switching to Candidate 10:15:05,862 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader227 (Candidate): Election: Candidate has following voting peers: [follower229, follower228] 10:15:05,875 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=1, votedFor=leader227 10:15:05,875 AM [test-pekko.actor.default-dispatcher-6] [INFO] Candidate - leader227 (Candidate): Starting new election term 1 10:15:05,875 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} to peer follower229 10:15:05,875 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} to peer follower228 10:15:05,875 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader227 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 10:15:05,876 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower228 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 10:15:05,876 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower228 (Follower): Cluster state: [] 10:15:05,876 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower228 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 10:15:05,876 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower228 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term [WARN] [06/27/2025 10:15:05.876] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} 10:15:05,879 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=1, votedFor=null 10:15:05,879 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower228 (Follower): In requestVote: RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 10:15:05,881 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=1, votedFor=leader227 10:15:05,881 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower228 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 10:15:05,882 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader227 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 10:15:05,882 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader227 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 10:15:05,882 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Election: Leader has following peers: [follower229, follower228] 10:15:05,882 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:15:05,882 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:15:05,882 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader227 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 [WARN] [06/27/2025 10:15:05.882] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:05,882 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower228: Last sync leader does not match current leader leader227, need to catch up to -1 10:15:05,882 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader227 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower228 updated: matchIndex: -1, nextIndex: 0 10:15:05,883 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [06/27/2025 10:15:05.883] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower228] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower228, initialSyncDone=false] 10:15:05,893 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader227: Persist data index=0 term=1 command=zero 10:15:05,893 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:15:05,893 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 10:15:05,893 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:15:05,893 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:15:05,893 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 0 is present for follower follower228 10:15:05,893 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 512.1 ms 10:15:05,894 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Sending AppendEntries to follower follower228: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 10:15:05,894 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower228 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 10:15:05,894 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower228 (Follower): Number of entries to be appended = 1 10:15:05,894 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower228 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 10:15:05,894 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower228 (Follower): Append entry to log zero 10:15:05,894 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower228: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:15:05,894 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower228 (Follower): Log size is now 1 10:15:05,894 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower228 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower228, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:15:05,894 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower228: Lagging 0 entries behind leader leader227 and reached -1 (of expected -1) 10:15:05,894 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower228: awaiting more completions to resolve 1 deferred callback(s) 10:15:05,894 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 entries in 517.0 ms 10:15:05,894 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower228 updated: matchIndex: 0, nextIndex: 1 10:15:05,894 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 [WARN] [06/27/2025 10:15:05.894] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:05,898 AM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 10:15:05,898 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 4.270 ms 10:15:05,898 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for 10:15:05,898 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 10:15:05,898 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:15:05,898 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 10:15:05,898 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader227 (Leader): Setting last applied to 0 10:15:05,898 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from -1 to 0 10:15:05,898 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader227: Applying state for log index 0 data zero 10:15:05,898 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader227: applyState called: zero 10:15:05,899 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 850.5 μs 10:15:05,899 AM [follower228-writer-93] [DEBUG] EntryStoreCompleter - follower228: 1 completion(s) pending 10:15:05,899 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 214.1 μs 10:15:05,899 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for 10:15:05,899 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower228: running 1 completion(s) 10:15:05,899 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: persisted 1 entries in 4.760 ms 10:15:05,899 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: waiting for 10:15:05,899 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower228: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 10:15:05,899 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower228: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@6879bd03} [WARN] [06/27/2025 10:15:05.899] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower228] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower228, initialSyncDone=true] 10:15:05,994 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader227: Persist data index=1 term=1 command=one 10:15:05,994 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:15:05,995 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 10:15:05,995 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:15:05,995 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:15:05,995 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 1 is present for follower follower228 10:15:05,995 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (Leader): Sending AppendEntries to follower follower228: AppendEntries{term=1, leaderId=leader227, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 10:15:05,995 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 96.01 ms [WARN] [06/27/2025 10:15:05.995] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:05,995 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader227, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 10:15:05,995 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): Number of entries to be appended = 1 10:15:05,995 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 10:15:05,996 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): Append entry to log one 10:15:05,996 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower228: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:15:05,996 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): Log size is now 2 10:15:05,996 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): Commit index set to 0 10:15:05,996 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower228, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:15:05,996 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 entries in 96.56 ms 10:15:05,996 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower228: Lagging 0 entries behind leader leader227 and reached 0 (of expected -1) 10:15:05,996 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 10:15:05,996 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower228 (Follower): Setting last applied to 0 10:15:05,996 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower228: Moving last applied index from -1 to 0 10:15:05,996 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower228: Applying state for log index 0 data zero 10:15:05,996 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower228: applyState called: zero 10:15:05,996 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower228: awaiting more completions to resolve 1 deferred callback(s) 10:15:05,996 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower228 updated: matchIndex: 1, nextIndex: 2 10:15:05,996 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:15:05,998 AM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 10:15:05,998 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 2.424 ms 10:15:05,998 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for 10:15:05,998 AM [follower228-writer-93] [DEBUG] EntryStoreCompleter - follower228: 1 completion(s) pending 10:15:05,998 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: persisted 1 entries in 2.021 ms 10:15:05,998 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower228: running 1 completion(s) 10:15:05,998 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 entries in 7.800 μs 10:15:05,998 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower228: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 10:15:05,998 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower228: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@b79037f} 10:15:05,998 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 10:15:05,998 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:15:05,998 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader227 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 10:15:05,998 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader227 (Leader): Setting last applied to 1 10:15:05,998 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: persisted 1 entries in 162.7 μs 10:15:05,998 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from 0 to 1 10:15:05,998 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: waiting for 10:15:05,998 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader227: Applying state for log index 1 data one 10:15:05,998 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader227: applyState called: one 10:15:05,998 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 587.8 μs 10:15:05,998 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 128.6 μs 10:15:05,998 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for [WARN] [06/27/2025 10:15:06.001] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader227: Persist data index=2 term=1 command=two 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:15:06,96 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 97.36 ms 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 2 is present for follower follower228 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Sending AppendEntries to follower follower228: AppendEntries{term=1, leaderId=leader227, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader227: Persist data index=3 term=1 command=three 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 2 is present for follower follower228 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader227: Persist data index=4 term=1 command=four 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=4, term=1, command=four, pending=true} 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 4, isSendImmediate: true 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:15:06,96 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 2 is present for follower follower228 [WARN] [06/27/2025 10:15:06.097] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:15:06.097] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:15:06.097] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:06,98 AM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 10:15:06,99 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 2.655 ms 10:15:06,99 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 10:15:06,99 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 2 entries in 8.350 μs 10:15:06,99 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:15:06,101 AM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 2 completion(s) pending 10:15:06,101 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 2 entries in 2.814 ms 10:15:06,101 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader227: running 2 completion(s) 10:15:06,101 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for 10:15:06,101 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true} 10:15:06,102 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader227: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=3, mandatoryTrim=false] [ERROR] [06/27/2025 10:15:06.102] [test-pekko.actor.internal-dispatcher-5] [pekko://test/user/leader227] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:305) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 10:15:06,103 AM [test-pekko.actor.default-dispatcher-16] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:305) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 10:15:06,103 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - leader227: terminating thread VirtualThread[#611,leader227-writer-94]/waiting 10:15:06,103 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 1.538 ms 10:15:06,103 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 72.91 μs 10:15:06,103 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@3859f26e stopped 10:15:06,103 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader227: journal closed 10:15:06,103 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader227: journal closed 10:15:06,103 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks 10:15:06,103 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks 10:15:06,105 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader227: Starting recovery with journal batch size 1000 10:15:06,105 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader227: started executor 10:15:06,105 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader227: started executor 10:15:06,105 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader227: metadata journal open: replayFrom=1 applyTo=1 10:15:06,106 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader227: journal open: firstIndex=1 lastIndex=5 replayFrom=1 fileEntries=0 10:15:06,106 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader227: journal open: applyTo=1 10:15:06,106 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@4e6ff54b started 10:15:06,107 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: waiting for [WARN] [06/27/2025 10:15:06.107] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader227]: org.opendaylight.controller.cluster.common.actor.Monitor@6239ab53 10:15:06,108 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=1, votedFor=leader227 10:15:06,108 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:06,108 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:06,108 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:06,108 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader227: no eligible files found 10:15:06,108 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader227: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:15:06,108 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - leader227: restoring local TermInfo{term=1, votedFor=leader227} 10:15:06,108 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=1, votedFor=leader227 10:15:06,108 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader227: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@2d627346 10:15:06,108 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from -1 to -1 10:15:06,109 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 10:15:06,109 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=1, term=1, command=one] 10:15:06,109 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=2, term=1, command=two] 10:15:06,110 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=3, term=1, command=three] 10:15:06,110 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=4, term=1, command=four] 10:15:06,110 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader227: journal recovery completedin 1.736 ms with journalIndex=1 10:15:06,612 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader227 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.113:17355, Removed) 10:15:06,612 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader227 (Follower): Received ElectionTimeout - switching to Candidate 10:15:06,612 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader227 (Candidate): Election: Candidate has following voting peers: [follower229, follower228] 10:15:06,617 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=2, votedFor=leader227 10:15:06,617 AM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader227 (Candidate): Starting new election term 2 10:15:06,617 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} to peer follower229 10:15:06,618 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} to peer follower228 [WARN] [06/27/2025 10:15:06.618] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} 10:15:06,618 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower228 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 10:15:06,618 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower228 (Follower): Cluster state: [] 10:15:06,618 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower228 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} with higher term appears reachable, updating term. 10:15:06,618 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower228 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1}" message is greater than follower's term 1 - updating term 10:15:06,619 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader227 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 10:15:06,623 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=2, votedFor=null 10:15:06,623 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower228 (Follower): In requestVote: RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} - currentTerm: 2, votedFor: null, lastIndex: 1, lastTerm: 1 10:15:06,626 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=2, votedFor=leader227 10:15:06,626 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower228 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 10:15:06,626 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader227 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 10:15:06,626 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader227 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 10:15:06,626 AM [test-pekko.actor.default-dispatcher-17] [INFO] Candidate - leader227 (Candidate): LastApplied index -1 is behind last index 4 - switching to PreLeader 10:15:06,626 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (PreLeader): Election: Leader has following peers: [follower229, follower228] 10:15:06,626 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:15:06,626 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower228: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:15:06,626 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader227 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 2 10:15:06,626 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader227: Persist data index=5 term=2 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38 10:15:06,627 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=5, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38, pending=true} 10:15:06,627 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (PreLeader): Replicate message: identifier: null, logIndex: 5, isSendImmediate: true 10:15:06,627 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 10:15:06,627 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower228: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 [WARN] [06/27/2025 10:15:06.627] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:15:06.627] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:06,627 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: received 1 entries in 520.6 ms 10:15:06,629 AM [leader227-writer-95] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 10:15:06,629 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 2.042 ms 10:15:06,629 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: waiting for 10:15:06,629 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 10:15:06,629 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=5, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38, pending=true} [WARN] [06/27/2025 10:15:06.742] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:06,750 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:06,750 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:06,750 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:06,751 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 10:15:06,851 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:06,851 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:06,851 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:06,851 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:06.862] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:06,952 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:06,952 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:06,952 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:06,952 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:06.982] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:07,53 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:07,53 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:07,53 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:07,53 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:07.102] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:07,153 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:07,153 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:07,153 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:07,154 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:07.222] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:07,254 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:07,254 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:07,254 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:07,254 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:07.342] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:07,355 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:07,355 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:07,355 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:07,355 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 10:15:07,455 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:07,455 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:07,455 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:07,455 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:07.462] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:07,556 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:07,556 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:07,556 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:07,556 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:07.581] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:07,657 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:07,657 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:07,657 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:07,657 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:07.702] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:07,757 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:07,757 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:07,757 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:07,757 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:07.822] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:07,858 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:07,858 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:07,858 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:07,858 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:07.942] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:07,959 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:07,959 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:07,959 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:07,959 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 10:15:08,59 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:08,59 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:08,59 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:08,59 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:08.062] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:08,160 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:08,160 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:08,160 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:08,160 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:08.182] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:08,261 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:08,261 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:08,261 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:08,261 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:08.302] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:08,361 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:08,362 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:08,362 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:08,362 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:08.422] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:08,462 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:08,462 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:08,462 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:08,462 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:08.542] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:08,563 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:08,563 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:08,563 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:08,563 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:08.662] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:08,664 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:08,664 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:08,664 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:08,664 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 10:15:08,764 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:08,764 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:08,764 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:08,764 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:08.782] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:08,865 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:08,865 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:08,865 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:08,865 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:08.902] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:08,966 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:08,966 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:08,966 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:08,966 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:09.021] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:09,66 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:09,66 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:09,66 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:09,66 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:09.142] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:09,167 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:09,167 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:09,167 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:09,167 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:09.262] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:09,267 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:09,268 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:09,268 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:09,268 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 10:15:09,368 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:09,368 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:09,368 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:09,368 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:09.382] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:09,469 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:09,469 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:09,469 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:09,469 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:09.502] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:09,570 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:09,570 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:09,570 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:09,570 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:09.622] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:09,670 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:09,670 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:09,670 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:09,670 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:09.742] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:09,771 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:09,771 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:09,771 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:09,771 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:09.862] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:09,872 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:09,872 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:09,872 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:09,872 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 10:15:09,973 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:09,973 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:09,973 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:09,973 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:09.982] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:10,73 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:10,73 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:10,73 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:10,73 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:10.102] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:10,174 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:10,174 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:10,174 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:10,174 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:10.222] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:10,275 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:10,275 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:10,275 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:10,275 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:10.342] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:10,375 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:10,375 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:10,375 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:10,375 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:10.462] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:10,476 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:10,476 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:10,476 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:10,476 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 10:15:10,577 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:10,577 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:10,577 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:10,577 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:10.582] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:10,677 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:10,677 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:10,677 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:10,677 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:10.702] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:10,778 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:10,778 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:10,778 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:10,778 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:10.821] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:10,879 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:10,879 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:10,879 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:10,879 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:10.942] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:10,979 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:10,979 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:10,979 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:10,980 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:11.062] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:11,80 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:11,80 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:11,80 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:11,80 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 10:15:11,181 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:11,181 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:11,181 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:11,181 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:11.182] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:11,282 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:11,282 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:11,282 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:11,282 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:11.302] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:11,383 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:11,383 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:11,383 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:11,383 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:11.422] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:11,483 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:11,483 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:11,483 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:11,484 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:11.542] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:11,584 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/TermInfo.properties 10:15:11,584 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/journal-v1-1.log 10:15:11,584 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest11919688293879115626/leader227/metadata-v1-1.log 10:15:11,584 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:15:11.661] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:11,686 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower228-collector230#-1118573610] 10:15:11,696 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower228] 10:15:11,697 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - follower228: terminating thread VirtualThread[#610,follower228-writer-93]/waiting 10:15:11,697 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 entries in 5.699 s 10:15:11,697 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: persisted 1 entries in 73.12 μs 10:15:11,697 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@12a9dde1 stopped 10:15:11,697 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower228: journal closed 10:15:11,697 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower228: journal closed 10:15:11,697 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower228: stopped executor with 0 remaining tasks 10:15:11,698 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower228: stopped executor with 0 remaining tasks 10:15:11,698 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader227-collector231#1834342313] 10:15:11,698 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader227] 10:15:11,698 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - leader227: terminating thread VirtualThread[#614,leader227-writer-95]/waiting 10:15:11,698 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: received 1 entries in 5.069 s 10:15:11,698 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 27.85 μs 10:15:11,698 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@4e6ff54b stopped 10:15:11,698 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader227: journal closed 10:15:11,698 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader227: journal closed 10:15:11,698 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks 10:15:11,699 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks [WARN] [06/27/2025 10:15:11.712] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower233]: org.opendaylight.controller.cluster.common.actor.Monitor@37a200c7 10:15:11,713 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - follower233: Starting recovery with journal batch size 1000 10:15:11,713 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower233: started executor 10:15:11,713 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower233: started executor 10:15:11,714 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower233: metadata journal open: replayFrom=1 applyTo=0 10:15:11,715 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower233: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:15:11,715 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower233: journal open: applyTo=0 10:15:11,715 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@1c37450c started 10:15:11,715 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting for 10:15:11,716 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6252438345255811960/follower233/TermInfo.properties does not exist 10:15:11,716 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower233: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6252438345255811960/follower233/journal-v1-1.log 10:15:11,716 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower233: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6252438345255811960/follower233/metadata-v1-1.log 10:15:11,716 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower233: no eligible files found 10:15:11,716 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower233: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [06/27/2025 10:15:11.718] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader232]: org.opendaylight.controller.cluster.common.actor.Monitor@4e9f7381 10:15:11,719 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - leader232: Starting recovery with journal batch size 1000 10:15:11,719 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader232: started executor 10:15:11,719 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader232: started executor 10:15:11,720 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader232: metadata journal open: replayFrom=1 applyTo=0 10:15:11,721 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader232: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:15:11,721 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader232: journal open: applyTo=0 10:15:11,721 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@2dc33e6c started 10:15:11,721 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for 10:15:11,721 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower233: Set currentTerm=0, votedFor=null 10:15:11,721 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower233: Local TermInfo store seeded with TermInfo{term=0} 10:15:11,721 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower233: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@36956f93 10:15:11,721 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from -1 to -1 10:15:11,721 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - follower233: journal recovery completedin 336.3 μs with journalIndex=1 10:15:11,723 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6252438345255811960/leader232/TermInfo.properties does not exist 10:15:11,723 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader232: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6252438345255811960/leader232/journal-v1-1.log 10:15:11,723 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader232: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6252438345255811960/leader232/metadata-v1-1.log 10:15:11,723 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader232: no eligible files found 10:15:11,723 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader232: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:15:11,729 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader232: Set currentTerm=0, votedFor=null 10:15:11,729 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader232: Local TermInfo store seeded with TermInfo{term=0} 10:15:11,729 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader232: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@118ea4d0 10:15:11,729 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from -1 to -1 10:15:11,729 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader232: journal recovery completedin 205.7 μs with journalIndex=1 10:15:12,172 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 10:15:12,172 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader232 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.113:17355, Removed) 10:15:12,172 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader232 (Follower): Received ElectionTimeout - switching to Candidate 10:15:12,172 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader232 (Candidate): Election: Candidate has following voting peers: [follower234, follower233] 10:15:12,183 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader232: Set currentTerm=1, votedFor=leader232 10:15:12,183 AM [test-pekko.actor.default-dispatcher-6] [INFO] Candidate - leader232 (Candidate): Starting new election term 1 10:15:12,184 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader232 (Candidate): Sending RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} to peer follower234 10:15:12,184 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader232 (Candidate): Sending RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} to peer follower233 10:15:12,184 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower233 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 10:15:12,184 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower233 (Follower): Cluster state: [] 10:15:12,184 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower233 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 10:15:12,184 AM [test-pekko.actor.default-dispatcher-14] [INFO] Follower - follower233 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term [WARN] [06/27/2025 10:15:12.184] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} 10:15:12,184 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader232 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 10:15:12,188 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower233: Set currentTerm=1, votedFor=null 10:15:12,188 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower233 (Follower): In requestVote: RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 10:15:12,191 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower233: Set currentTerm=1, votedFor=leader232 10:15:12,191 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower233 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 10:15:12,192 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader232 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 10:15:12,192 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader232 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 10:15:12,192 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader232 (Leader): Election: Leader has following peers: [follower234, follower233] 10:15:12,192 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:15:12,192 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:15:12,192 AM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader232 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 [WARN] [06/27/2025 10:15:12.192] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:12,192 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Last sync leader does not match current leader leader232, need to catch up to -1 10:15:12,192 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: -1, nextIndex: 0 [WARN] [06/27/2025 10:15:12.193] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower233] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower233, initialSyncDone=false] 10:15:12,193 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:15:12,235 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader232: Persist data index=0 term=1 command=zero 10:15:12,235 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader232: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:15:12,235 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 10:15:12,236 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:15:12,236 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 514.8 ms 10:15:12,236 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:15:12,236 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 0 is present for follower follower233 10:15:12,236 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower233: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 10:15:12,236 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 10:15:12,236 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): Number of entries to be appended = 1 10:15:12,236 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 10:15:12,236 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): Append entry to log zero 10:15:12,236 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower233: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} [WARN] [06/27/2025 10:15:12.236] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:12,236 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): Log size is now 1 10:15:12,236 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower233 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower233, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:15:12,236 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 521.2 ms 10:15:12,236 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached -1 (of expected -1) 10:15:12,236 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower233: awaiting more completions to resolve 1 deferred callback(s) 10:15:12,236 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: 0, nextIndex: 1 10:15:12,236 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:15:12,240 AM [leader232-writer-97] [DEBUG] EntryStoreCompleter - leader232: 1 completion(s) pending 10:15:12,240 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 4.182 ms 10:15:12,240 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for 10:15:12,240 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - leader232: running 1 completion(s) 10:15:12,240 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader232: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:15:12,240 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader232 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 10:15:12,240 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader232 (Leader): Setting last applied to 0 10:15:12,240 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from -1 to 0 10:15:12,240 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader232: Applying state for log index 0 data zero 10:15:12,240 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader232: applyState called: zero 10:15:12,240 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 558.6 μs 10:15:12,240 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 94.72 μs 10:15:12,240 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for 10:15:12,241 AM [follower233-writer-96] [DEBUG] EntryStoreCompleter - follower233: 1 completion(s) pending 10:15:12,241 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 4.817 ms 10:15:12,241 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting for 10:15:12,241 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower233: running 1 completion(s) 10:15:12,241 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower233: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 10:15:12,241 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower233: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@2cdf42eb} [WARN] [06/27/2025 10:15:12.241] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower233] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower233, initialSyncDone=true] [WARN] [06/27/2025 10:15:12.311] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:12,336 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader232: Persist data index=1 term=1 command=one 10:15:12,336 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader232: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:15:12,336 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 10:15:12,337 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:15:12,336 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 96.04 ms 10:15:12,337 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:15:12,337 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 1 is present for follower follower233 10:15:12,337 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower233: AppendEntries{term=1, leaderId=leader232, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} [WARN] [06/27/2025 10:15:12.337] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:12,337 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower233 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 10:15:12,337 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower233 (Follower): Number of entries to be appended = 1 10:15:12,337 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower233 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 10:15:12,337 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower233 (Follower): Append entry to log one 10:15:12,337 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower233: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:15:12,337 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower233 (Follower): Log size is now 2 10:15:12,337 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower233 (Follower): Commit index set to 0 10:15:12,337 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 96.23 ms 10:15:12,337 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower233 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower233, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:15:12,337 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 0 (of expected -1) 10:15:12,337 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower233 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 10:15:12,337 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower233 (Follower): Setting last applied to 0 10:15:12,337 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from -1 to 0 10:15:12,337 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower233: Applying state for log index 0 data zero 10:15:12,337 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower233: applyState called: zero 10:15:12,337 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: 1, nextIndex: 2 10:15:12,337 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:15:12,337 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower233: awaiting more completions to resolve 1 deferred callback(s) 10:15:12,338 AM [leader232-writer-97] [DEBUG] EntryStoreCompleter - leader232: 1 completion(s) pending 10:15:12,338 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 1.842 ms 10:15:12,338 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for 10:15:12,338 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - leader232: running 1 completion(s) 10:15:12,338 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader232: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:15:12,339 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 10:15:12,339 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader232 (Leader): Setting last applied to 1 10:15:12,339 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from 0 to 1 10:15:12,339 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader232: Applying state for log index 1 data one 10:15:12,339 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader232: applyState called: one 10:15:12,339 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 439.4 μs 10:15:12,339 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 59.36 μs 10:15:12,339 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for 10:15:12,339 AM [follower233-writer-96] [DEBUG] EntryStoreCompleter - follower233: 1 completion(s) pending 10:15:12,339 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 2.398 ms 10:15:12,340 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 3.630 μs 10:15:12,340 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower233: running 1 completion(s) 10:15:12,340 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower233: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 10:15:12,340 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 59.98 μs 10:15:12,340 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting for 10:15:12,340 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower233: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@6106d15e} [WARN] [06/27/2025 10:15:12.432] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:15:12.439] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower234]: org.opendaylight.controller.cluster.common.actor.Monitor@14fdae33 10:15:12,440 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower234: Starting recovery with journal batch size 1000 10:15:12,440 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower234: started executor 10:15:12,440 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower234: started executor 10:15:12,441 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower234: metadata journal open: replayFrom=1 applyTo=0 10:15:12,442 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower234: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:15:12,442 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower234: journal open: applyTo=0 10:15:12,442 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@19b6050c started 10:15:12,442 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: waiting for 10:15:12,443 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6252438345255811960/follower234/TermInfo.properties does not exist 10:15:12,443 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6252438345255811960/follower234/journal-v1-1.log 10:15:12,443 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6252438345255811960/follower234/metadata-v1-1.log 10:15:12,443 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower234: no eligible files found 10:15:12,443 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower234: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:15:12,447 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=0, votedFor=null 10:15:12,447 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower234: Local TermInfo store seeded with TermInfo{term=0} 10:15:12,447 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower234: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@420e5d0f 10:15:12,447 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to -1 10:15:12,447 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - follower234: journal recovery completedin 331.5 μs with journalIndex=1 10:15:12,540 AM [test-pekko.actor.default-dispatcher-6] [INFO] PeerInfos - leader232: Peer address for peer follower234 set to pekko://test/user/follower234 10:15:12,540 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader232: Persist data index=2 term=1 command=two 10:15:12,540 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader232: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:15:12,540 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader232 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 10:15:12,540 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 201.1 ms 10:15:12,540 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:15:12,540 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:15:12,540 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 2 is present for follower follower233 10:15:12,540 AM [test-pekko.actor.default-dispatcher-18] [INFO] Follower - follower234 (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term 10:15:12,540 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower233: AppendEntries{term=1, leaderId=leader232, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 10:15:12,540 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower233 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 10:15:12,541 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower233 (Follower): Number of entries to be appended = 1 10:15:12,541 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower233 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 10:15:12,541 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower233 (Follower): Append entry to log two 10:15:12,541 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower233: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:15:12,541 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower233 (Follower): Log size is now 3 10:15:12,541 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower233 (Follower): Commit index set to 1 10:15:12,541 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower233 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower233, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:15:12,541 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 1 (of expected -1) 10:15:12,541 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower233 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 2 10:15:12,541 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower233 (Follower): Setting last applied to 1 10:15:12,541 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from 0 to 1 10:15:12,541 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower233: Applying state for log index 1 data one 10:15:12,541 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower233: applyState called: one 10:15:12,541 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 201.2 ms 10:15:12,541 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower233: awaiting more completions to resolve 1 deferred callback(s) 10:15:12,541 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: 2, nextIndex: 3 10:15:12,542 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:15:12,545 AM [leader232-writer-97] [DEBUG] EntryStoreCompleter - leader232: 1 completion(s) pending 10:15:12,545 AM [follower233-writer-96] [DEBUG] EntryStoreCompleter - follower233: 1 completion(s) pending 10:15:12,545 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 3.701 ms 10:15:12,545 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 4.456 ms 10:15:12,545 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for 10:15:12,545 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 8.220 μs 10:15:12,545 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower233: running 1 completion(s) 10:15:12,545 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower233: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 10:15:12,545 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower233: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@66fddb3c} 10:15:12,545 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader232: running 1 completion(s) 10:15:12,545 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 190.1 μs 10:15:12,545 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader232: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:15:12,545 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting for 10:15:12,545 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader232 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1 10:15:12,545 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader232 (Leader): Setting last applied to 2 10:15:12,545 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from 1 to 2 10:15:12,545 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader232: Applying state for log index 2 data two 10:15:12,545 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader232: applyState called: two 10:15:12,545 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 654.1 μs 10:15:12,545 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=1, votedFor=null 10:15:12,545 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower234: Last sync leader does not match current leader leader232, need to catch up to -1 10:15:12,546 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 165.7 μs 10:15:12,546 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for 10:15:12,546 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower234 updated: matchIndex: -1, nextIndex: 0 10:15:12,546 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: true, followerNextIndex: 0, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:15:12,546 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 0 is present for follower follower234 [WARN] [06/27/2025 10:15:12.546] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=false] 10:15:12,546 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower234: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=false}, JournaledLogEntry{index=1, term=1, command=one, pending=false}, JournaledLogEntry{index=2, term=1, command=two, pending=false}]} 10:15:12,546 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower234 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=false}, JournaledLogEntry{index=1, term=1, command=one, pending=false}, JournaledLogEntry{index=2, term=1, command=two, pending=false}]} 10:15:12,547 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower234 (Follower): Number of entries to be appended = 3 10:15:12,547 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower234 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 10:15:12,547 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower234 (Follower): Append entry to log zero 10:15:12,547 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower234: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=false} 10:15:12,547 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower234 (Follower): Append entry to log one 10:15:12,547 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower234: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=false} 10:15:12,547 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower234 (Follower): Append entry to log two 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower234: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=false} 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower234 (Follower): Log size is now 3 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower234 (Follower): Commit index set to 2 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower234 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower234, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower234 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): -1, lastIndex(): 2 10:15:12,548 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: received 2 entries in 105.7 ms 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 0 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to 0 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower234: Applying state for log index 0 data zero 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower234: applyState called: zero 10:15:12,548 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower234 updated: matchIndex: 2, nextIndex: 3 10:15:12,548 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - leader232: fakeSnapshot purging log to 1 for term 1 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 1 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 0 to 1 10:15:12,548 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: 1 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower234: Applying state for log index 1 data one 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower234: applyState called: one 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 2 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 1 to 2 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower234: Applying state for log index 2 data two 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower234: applyState called: two 10:15:12,548 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower234: awaiting more completions to resolve 3 deferred callback(s) 10:15:12,561 AM [follower234-writer-98] [DEBUG] EntryStoreCompleter - follower234: 2 completion(s) pending 10:15:12,561 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower234: running 2 completion(s) 10:15:12,561 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: persisted 2 entries in 13.50 ms 10:15:12,561 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower234: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 10:15:12,561 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: received 2 entries in 8.070 μs 10:15:12,561 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower234: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@52c784f9} 10:15:12,561 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower234: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 10:15:12,561 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower234: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@44b7d059} 10:15:12,561 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower234: awaiting more completions to resolve 1 deferred callback(s) 10:15:12,563 AM [follower234-writer-98] [DEBUG] EntryStoreCompleter - follower234: 1 completion(s) pending 10:15:12,563 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: persisted 2 entries in 1.938 ms 10:15:12,563 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower234: running 1 completion(s) 10:15:12,563 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: waiting for 10:15:12,563 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower234: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 10:15:12,563 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - follower234: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@72ddc0ce} [WARN] [06/27/2025 10:15:12.564] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=true] 10:15:12,672 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower233 (Follower): Commit index set to 2 10:15:12,672 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:12,672 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:12,672 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower233 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): 1, lastIndex(): 2 10:15:12,672 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - follower234: fakeSnapshot purging log to 1 for term 1 10:15:12,672 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower233 (Follower): Setting last applied to 2 10:15:12,672 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from 1 to 2 10:15:12,672 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower233: Applying state for log index 2 data two 10:15:12,672 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower233: applyState called: two 10:15:12,672 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotManager - follower233: fakeSnapshot purging log to 1 for term 1 10:15:12,673 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 127.6 ms 10:15:12,673 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 242.7 μs 10:15:12,673 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting for 10:15:12,743 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - follower234: terminating thread VirtualThread[#620,follower234-writer-98]/waiting 10:15:12,743 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: received 1 entries in 179.6 ms 10:15:12,743 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: persisted 1 entries in 43.45 μs 10:15:12,743 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@19b6050c stopped 10:15:12,743 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower234: journal closed 10:15:12,743 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower234: journal closed 10:15:12,743 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks 10:15:12,743 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks [WARN] [06/27/2025 10:15:12.745] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower234]: org.opendaylight.controller.cluster.common.actor.Monitor@6fa9bc3c 10:15:12,746 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower234: Starting recovery with journal batch size 1000 10:15:12,746 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower234: started executor 10:15:12,746 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower234: started executor 10:15:12,746 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower234: metadata journal open: replayFrom=1 applyTo=2 10:15:12,747 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower234: journal open: firstIndex=1 lastIndex=3 replayFrom=1 fileEntries=0 10:15:12,747 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower234: journal open: applyTo=2 10:15:12,747 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@2ff947b started 10:15:12,747 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: waiting for 10:15:12,747 AM [test-pekko.actor.default-dispatcher-18] [INFO] PeerInfos - leader232: Peer address for peer follower234 set to pekko://test/user/follower234 10:15:12,748 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=1, votedFor=null 10:15:12,748 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6252438345255811960/follower234/TermInfo.properties 10:15:12,748 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6252438345255811960/follower234/journal-v1-1.log 10:15:12,748 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6252438345255811960/follower234/metadata-v1-1.log 10:15:12,748 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower234: no eligible files found 10:15:12,748 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower234: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:15:12,748 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - follower234: restoring local TermInfo{term=1} 10:15:12,748 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=1, votedFor=null 10:15:12,748 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower234: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@34f0b303 10:15:12,748 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to -1 10:15:12,749 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - follower234: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 10:15:12,749 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - follower234: recovered journal DefaultLogEntry[index=1, term=1, command=one] 10:15:12,749 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - follower234: recovered journal DefaultLogEntry[index=2, term=1, command=two] 10:15:12,749 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - follower234: journal recovery completedin 850.8 μs with journalIndex=1 10:15:12,792 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower234 (Follower): Commit index set to 2 10:15:12,792 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower234: Last sync leader does not match current leader leader232, need to catch up to 2 10:15:12,792 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower234 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): -1, lastIndex(): 2 10:15:12,792 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 0 10:15:12,792 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:12,792 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to 0 10:15:12,792 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower234: Applying state for log index 0 data zero 10:15:12,792 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower234: applyState called: zero 10:15:12,792 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 1 10:15:12,792 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 0 to 1 10:15:12,792 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower234: Applying state for log index 1 data one 10:15:12,792 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower234: applyState called: one 10:15:12,792 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 2 10:15:12,792 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 1 to 2 10:15:12,792 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower234: Applying state for log index 2 data two 10:15:12,792 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - follower234: applyState called: two 10:15:12,792 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - follower234: fakeSnapshot purging log to 1 for term 1 [WARN] [06/27/2025 10:15:12.793] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=false] 10:15:12,793 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: received 1 entries in 45.46 ms 10:15:12,793 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: persisted 1 entries in 270.5 μs 10:15:12,793 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: waiting for 10:15:12,912 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:12,912 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) [WARN] [06/27/2025 10:15:12.913] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=true] 10:15:13,32 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:13,32 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:13,152 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:13,152 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:13,271 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:13,271 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:13,392 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:13,392 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:13,512 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:13,512 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:13,632 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:13,632 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:13,751 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:13,751 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:13,872 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:13,872 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:13,992 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:13,992 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:14,112 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:14,112 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:14,232 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:14,232 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:14,352 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:14,352 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:14,471 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:14,471 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:14,592 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:14,592 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:14,712 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:14,712 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:14,832 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:14,832 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:14,952 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:14,952 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:15,71 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:15,71 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:15,192 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:15,193 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:15,312 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:15,312 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:15,422 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:15,422 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:15,532 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:15,532 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:15,642 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:15,642 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:15,752 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:15,752 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:15,862 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:15,862 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:15,972 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:15,972 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:16,82 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:16,82 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:16,192 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:16,192 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:16,302 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:16,302 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:16,412 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:16,412 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:16,522 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:16,522 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:16,632 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:16,632 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:16,742 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:16,742 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:16,852 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:16,852 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:16,972 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:16,972 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:17,92 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:17,92 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:17,212 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:17,212 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:17,331 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:17,332 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:17,452 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:17,453 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:17,572 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:17,572 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:17,692 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:15:17,692 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:15:17,784 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower233-collector235#1060834305] 10:15:17,795 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower233] 10:15:17,795 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - follower233: terminating thread VirtualThread[#616,follower233-writer-96]/waiting 10:15:17,795 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 5.122 s 10:15:17,795 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 48.81 μs 10:15:17,796 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@1c37450c stopped 10:15:17,796 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower233: journal closed 10:15:17,796 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower233: journal closed 10:15:17,796 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower233: stopped executor with 0 remaining tasks 10:15:17,796 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower233: stopped executor with 0 remaining tasks 10:15:17,796 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader232-collector236#547016753] 10:15:17,796 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader232] 10:15:17,796 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - leader232: terminating thread VirtualThread[#617,leader232-writer-97]/waiting 10:15:17,796 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 5.251 s 10:15:17,796 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 27.52 μs 10:15:17,797 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@2dc33e6c stopped 10:15:17,797 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader232: journal closed 10:15:17,797 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - leader232: journal closed 10:15:17,797 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader232: stopped executor with 0 remaining tasks 10:15:17,797 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader232: stopped executor with 0 remaining tasks 10:15:17,797 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower234-collector237#1800065794] 10:15:17,797 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower234] 10:15:17,797 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower234-collector238#-2080797675] 10:15:17,798 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower234] 10:15:17,798 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - follower234: terminating thread VirtualThread[#623,follower234-writer-99]/waiting 10:15:17,798 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: received 1 entries in 5.005 s 10:15:17,798 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: persisted 1 entries in 27.73 μs 10:15:17,798 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@2ff947b stopped 10:15:17,798 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower234: journal closed 10:15:17,798 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower234: journal closed 10:15:17,798 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks 10:15:17,798 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks [WARN] [06/27/2025 10:15:17.803] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower240]: org.opendaylight.controller.cluster.common.actor.Monitor@4dfba7b9 10:15:17,804 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - follower240: Starting recovery with journal batch size 1000 10:15:17,804 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower240: started executor 10:15:17,804 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower240: started executor 10:15:17,804 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower240: metadata journal open: replayFrom=1 applyTo=0 10:15:17,805 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower240: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:15:17,805 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - follower240: journal open: applyTo=0 10:15:17,805 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@7f355048 started 10:15:17,805 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting for 10:15:17,806 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17578363784633797042/follower240/TermInfo.properties does not exist 10:15:17,806 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower240: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17578363784633797042/follower240/journal-v1-1.log 10:15:17,806 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower240: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17578363784633797042/follower240/metadata-v1-1.log 10:15:17,806 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower240: no eligible files found 10:15:17,806 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - follower240: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [06/27/2025 10:15:17.807] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader239]: org.opendaylight.controller.cluster.common.actor.Monitor@7a1d755f 10:15:17,807 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - leader239: Starting recovery with journal batch size 1000 10:15:17,808 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: started executor 10:15:17,808 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: started executor 10:15:17,808 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader239: metadata journal open: replayFrom=1 applyTo=0 10:15:17,808 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader239: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:15:17,809 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader239: journal open: applyTo=0 10:15:17,809 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@1175f99 started 10:15:17,809 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for 10:15:17,810 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17578363784633797042/leader239/TermInfo.properties does not exist 10:15:17,810 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17578363784633797042/leader239/journal-v1-1.log 10:15:17,810 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17578363784633797042/leader239/metadata-v1-1.log 10:15:17,810 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader239: no eligible files found 10:15:17,810 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader239: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:15:17,908 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=0, votedFor=null 10:15:17,908 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader239: Local TermInfo store seeded with TermInfo{term=0} 10:15:17,908 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader239: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@13977316 10:15:17,908 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=0, votedFor=null 10:15:17,908 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - follower240: Local TermInfo store seeded with TermInfo{term=0} 10:15:17,908 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower240: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@762fcf8f 10:15:17,908 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to -1 10:15:17,908 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from -1 to -1 10:15:17,909 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader239: journal recovery completedin 422.5 μs with journalIndex=1 10:15:17,909 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - follower240: journal recovery completedin 880.4 μs with journalIndex=1 10:15:18,361 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 10:15:18,362 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - leader239 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.113:17355, Removed) 10:15:18,362 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - leader239 (Follower): Received ElectionTimeout - switching to Candidate 10:15:18,362 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader239 (Candidate): Election: Candidate has following voting peers: [follower241, follower240] 10:15:18,367 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=1, votedFor=leader239 10:15:18,367 AM [test-pekko.actor.default-dispatcher-17] [INFO] Candidate - leader239 (Candidate): Starting new election term 1 10:15:18,367 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} to peer follower241 10:15:18,367 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} to peer follower240 [WARN] [06/27/2025 10:15:18.367] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} 10:15:18,367 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader239 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 10:15:18,367 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 10:15:18,367 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): Cluster state: [] 10:15:18,367 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 10:15:18,367 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower240 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 10:15:18,372 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=1, votedFor=null 10:15:18,372 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): In requestVote: RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 10:15:18,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=1, votedFor=leader239 10:15:18,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 10:15:18,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader239 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 10:15:18,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader239 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 10:15:18,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Election: Leader has following peers: [follower241, follower240] 10:15:18,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:15:18,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:15:18,375 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader239 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 [WARN] [06/27/2025 10:15:18.375] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:18,375 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Last sync leader does not match current leader leader239, need to catch up to -1 [WARN] [06/27/2025 10:15:18.375] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower240] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower240, initialSyncDone=false] 10:15:18,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: -1, nextIndex: 0 10:15:18,376 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:15:18,418 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader239: Persist data index=0 term=1 command=zero 10:15:18,418 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:15:18,418 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 10:15:18,418 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 609.4 ms 10:15:18,418 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 [WARN] [06/27/2025 10:15:18.418] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:18,418 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:15:18,419 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 0 is present for follower follower240 10:15:18,419 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Sending AppendEntries to follower follower240: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 10:15:18,419 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 10:15:18,419 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): Number of entries to be appended = 1 10:15:18,419 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 10:15:18,419 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): Append entry to log zero 10:15:18,419 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:15:18,419 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): Log size is now 1 10:15:18,419 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower240, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:15:18,419 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached -1 (of expected -1) 10:15:18,419 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 1 deferred callback(s) 10:15:18,419 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 entries in 614.4 ms 10:15:18,420 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 0, nextIndex: 1 10:15:18,420 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:15:18,421 AM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 10:15:18,421 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 2.535 ms 10:15:18,421 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for 10:15:18,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 10:15:18,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:15:18,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 10:15:18,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader239 (Leader): Setting last applied to 0 10:15:18,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to 0 10:15:18,421 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader239: Applying state for log index 0 data zero 10:15:18,421 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader239: applyState called: zero 10:15:18,421 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 441.9 μs 10:15:18,421 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 98.40 μs 10:15:18,421 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for 10:15:18,422 AM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 1 completion(s) pending 10:15:18,422 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 1 entries in 2.840 ms 10:15:18,422 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower240: running 1 completion(s) 10:15:18,422 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting for 10:15:18,422 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 10:15:18,422 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@1f2468dd} [WARN] [06/27/2025 10:15:18.423] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower240] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower240, initialSyncDone=true] [WARN] [06/27/2025 10:15:18.492] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:18,519 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader239: Persist data index=1 term=1 command=one 10:15:18,519 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:15:18,519 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 10:15:18,519 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:15:18,519 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 97.90 ms 10:15:18,519 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:15:18,519 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 1 is present for follower follower240 10:15:18,519 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Sending AppendEntries to follower follower240: AppendEntries{term=1, leaderId=leader239, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 10:15:18,520 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader239, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 10:15:18,520 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): Number of entries to be appended = 1 10:15:18,520 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 10:15:18,520 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): Append entry to log one 10:15:18,520 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:15:18,520 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): Log size is now 2 10:15:18,520 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): Commit index set to 0 10:15:18,520 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower240, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:15:18,520 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 0 (of expected -1) 10:15:18,520 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower240 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 10:15:18,520 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 0 10:15:18,520 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from -1 to 0 10:15:18,520 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower240: Applying state for log index 0 data zero 10:15:18,520 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower240: applyState called: zero 10:15:18,520 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 1 deferred callback(s) 10:15:18,520 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 2 entries in 97.57 ms [WARN] [06/27/2025 10:15:18.520] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:18,520 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 1, nextIndex: 2 10:15:18,520 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:15:18,524 AM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 10:15:18,524 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 4.553 ms 10:15:18,524 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for 10:15:18,524 AM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 1 completion(s) pending 10:15:18,524 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 10:15:18,524 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 2 entries in 4.075 ms 10:15:18,524 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting for 10:15:18,524 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:15:18,524 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower240: running 1 completion(s) 10:15:18,524 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 10:15:18,524 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader239 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 10:15:18,524 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@88b5a46} 10:15:18,524 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader239 (Leader): Setting last applied to 1 10:15:18,524 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 0 to 1 10:15:18,524 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader239: Applying state for log index 1 data one 10:15:18,524 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - leader239: applyState called: one 10:15:18,525 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 564.3 μs 10:15:18,525 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 110.2 μs 10:15:18,525 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for [WARN] [06/27/2025 10:15:18.604] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:18,625 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader239: Persist data index=2 term=1 command=two 10:15:18,625 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:15:18,625 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 10:15:18,625 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:15:18,625 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:15:18,625 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 2 is present for follower follower240 10:15:18,625 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 100.1 ms 10:15:18,625 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Sending AppendEntries to follower follower240: AppendEntries{term=1, leaderId=leader239, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 10:15:18,625 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader239: Persist data index=3 term=1 command=three 10:15:18,625 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 10:15:18,625 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true [WARN] [06/27/2025 10:15:18.625] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:18,625 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:15:18,625 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:15:18,625 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 2 is present for follower follower240 [WARN] [06/27/2025 10:15:18.625] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:18,629 AM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 10:15:18,629 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 3.923 ms 10:15:18,629 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 7.940 μs 10:15:18,629 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 10:15:18,629 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:15:18,632 AM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 10:15:18,632 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 10:15:18,632 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 3.354 ms 10:15:18,632 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true} 10:15:18,632 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for 10:15:18,632 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader239: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=2, mandatoryTrim=false] 10:15:18,633 AM [test-pekko.actor.default-dispatcher-17] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException [ERROR] [06/27/2025 10:15:18.633] [test-pekko.actor.internal-dispatcher-3] [pekko://test/user/leader239] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:305) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:305) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 10:15:18,633 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRaftStorage - leader239: terminating thread VirtualThread[#625,leader239-writer-101]/waiting 10:15:18,634 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 1.302 ms 10:15:18,634 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 31.23 μs 10:15:18,634 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@1175f99 stopped 10:15:18,634 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader239: journal closed 10:15:18,634 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - leader239: journal closed 10:15:18,634 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks 10:15:18,634 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks [WARN] [06/27/2025 10:15:18.635] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader239]: org.opendaylight.controller.cluster.common.actor.Monitor@25629d1d 10:15:18,636 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - leader239: Starting recovery with journal batch size 1000 10:15:18,636 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader239: started executor 10:15:18,636 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader239: started executor 10:15:18,637 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader239: metadata journal open: replayFrom=1 applyTo=1 10:15:18,638 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader239: journal open: firstIndex=1 lastIndex=4 replayFrom=1 fileEntries=0 10:15:18,638 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRaftStorage - leader239: journal open: applyTo=1 10:15:18,638 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@54dde23d started 10:15:18,638 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting for 10:15:18,640 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=1, votedFor=leader239 10:15:18,640 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17578363784633797042/leader239/TermInfo.properties 10:15:18,640 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17578363784633797042/leader239/journal-v1-1.log 10:15:18,640 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17578363784633797042/leader239/metadata-v1-1.log 10:15:18,640 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader239: no eligible files found 10:15:18,640 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader239: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:15:18,640 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - leader239: restoring local TermInfo{term=1, votedFor=leader239} 10:15:18,640 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=1, votedFor=leader239 10:15:18,640 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader239: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@3ab68fe0 10:15:18,640 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to -1 10:15:18,642 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 10:15:18,642 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=1, term=1, command=one] 10:15:18,642 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=2, term=1, command=two] 10:15:18,643 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=3, term=1, command=three] 10:15:18,643 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader239: journal recovery completedin 2.908 ms with journalIndex=1 10:15:19,132 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - leader239 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.113:17355, Removed) 10:15:19,132 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - leader239 (Follower): Received ElectionTimeout - switching to Candidate 10:15:19,132 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader239 (Candidate): Election: Candidate has following voting peers: [follower241, follower240] 10:15:19,137 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=2, votedFor=leader239 10:15:19,137 AM [test-pekko.actor.default-dispatcher-18] [INFO] Candidate - leader239 (Candidate): Starting new election term 2 10:15:19,137 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} to peer follower241 10:15:19,137 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} to peer follower240 10:15:19,137 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader239 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 10:15:19,137 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. [WARN] [06/27/2025 10:15:19.137] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} 10:15:19,137 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): Cluster state: [] 10:15:19,137 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} with higher term appears reachable, updating term. 10:15:19,137 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower240 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1}" message is greater than follower's term 1 - updating term 10:15:19,141 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=2, votedFor=null 10:15:19,141 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): In requestVote: RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} - currentTerm: 2, votedFor: null, lastIndex: 1, lastTerm: 1 10:15:19,143 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=2, votedFor=leader239 10:15:19,143 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 10:15:19,143 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader239 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 10:15:19,143 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader239 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 10:15:19,143 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader239 (Candidate): LastApplied index -1 is behind last index 3 - switching to PreLeader 10:15:19,144 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader239 (PreLeader): Election: Leader has following peers: [follower241, follower240] 10:15:19,144 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:15:19,144 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 [WARN] [06/27/2025 10:15:19.144] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:19,144 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader239 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 2 10:15:19,144 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader239: Persist data index=4 term=2 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38 10:15:19,144 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38, pending=true} 10:15:19,144 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader239 (PreLeader): Replicate message: identifier: null, logIndex: 4, isSendImmediate: true 10:15:19,144 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:15:19,144 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:15:19,144 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 entries in 506.3 ms [WARN] [06/27/2025 10:15:19.145] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:19,146 AM [leader239-writer-102] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 10:15:19,146 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 2.074 ms 10:15:19,146 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting for 10:15:19,146 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 10:15:19,146 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38, pending=true} 10:15:19,177 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader239: Persist data index=5 term=2 command=four 10:15:19,177 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=5, term=2, command=four, pending=true} 10:15:19,177 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader239 (PreLeader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 5, isSendImmediate: true 10:15:19,177 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 10:15:19,178 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 10:15:19,177 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 entries in 31.03 ms 10:15:19,178 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging -1 entries behind leader leader239 and reached 0 (of expected -1) 10:15:19,178 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader239 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 1, nextIndex: 2 10:15:19,178 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 10:15:19,178 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 10:15:19,178 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 5, leaderSnapShotIndex: -1 10:15:19,178 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader239 (PreLeader): sendAppendEntries: 2 is present for follower follower240 10:15:19,178 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader239 (PreLeader): Sending AppendEntries to follower follower240: AppendEntries{term=2, leaderId=leader239, prevLogIndex=1, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38, pending=false}, JournaledLogEntry{index=5, term=2, command=four, pending=true}]} [WARN] [06/27/2025 10:15:19.178] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:19,178 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader239, prevLogIndex=1, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38, pending=false}, JournaledLogEntry{index=5, term=2, command=four, pending=true}]} 10:15:19,178 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): Number of entries to be appended = 4 10:15:19,178 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 10:15:19,178 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): Append entry to log two 10:15:19,178 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=false} 10:15:19,178 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): Append entry to log three 10:15:19,178 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=false} 10:15:19,178 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): Append entry to log org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38 10:15:19,178 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38, pending=false} 10:15:19,178 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): Append entry to log four 10:15:19,178 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=5, term=2, command=four, pending=true} 10:15:19,178 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): Log size is now 6 10:15:19,178 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower240, logLastIndex=5, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:15:19,178 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging -1 entries behind leader leader239 and reached 0 (of expected -1) 10:15:19,178 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 4 deferred callback(s) 10:15:19,178 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 4 entries in 654.2 ms 10:15:19,178 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 5, nextIndex: 6 10:15:19,178 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 10:15:19,178 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 10:15:19,178 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 10:15:19,178 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 10:15:19,178 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Applying to log - commitIndex: 4, lastAppliedIndex: -1 10:15:19,178 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 0 10:15:19,178 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to 0 10:15:19,178 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Applying state for log index 0 data zero 10:15:19,178 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader239: applyState called: zero 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 1 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 0 to 1 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Applying state for log index 1 data one 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader239: applyState called: one 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 2 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 1 to 2 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Applying state for log index 2 data two 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader239: applyState called: two 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 3 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 2 to 3 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Applying state for log index 3 data three 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader239: applyState called: three 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 4 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 3 to 4 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 6, leaderLastIndex: 5, leaderSnapShotIndex: -1 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PreLeader - leader239 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}] - lastApplied: 4, lastIndex: 5 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PreLeader - leader239 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=1, term=1, command=one, pending=false}] - lastApplied: 4, lastIndex: 5 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PreLeader - leader239 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=2, term=1, command=two, pending=false}] - lastApplied: 4, lastIndex: 5 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PreLeader - leader239 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=3, term=1, command=three, pending=false}] - lastApplied: 4, lastIndex: 5 10:15:19,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PreLeader - leader239 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38, pending=false}] - lastApplied: 4, lastIndex: 5 10:15:19,181 AM [leader239-writer-102] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 10:15:19,181 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 3.641 ms 10:15:19,181 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 entries in 6.010 μs 10:15:19,181 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 160.0 μs 10:15:19,181 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting for 10:15:19,182 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 10:15:19,182 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=5, term=2, command=four, pending=true} 10:15:19,182 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (PreLeader): Applying to log - commitIndex: 5, lastAppliedIndex: 4 10:15:19,182 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 5 10:15:19,182 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 4 to 5 10:15:19,182 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader239: Applying state for log index 5 data four 10:15:19,182 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader239: applyState called: four 10:15:19,182 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 entries in 431.7 μs 10:15:19,182 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 90.59 μs 10:15:19,182 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting for 10:15:19,182 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PreLeader - leader239 (PreLeader): Received ApplyState[identifier=MockIdentifier{value=four}, entry=JournaledLogEntry{index=5, term=2, command=four, pending=false}] - lastApplied: 5, lastIndex: 5 10:15:19,182 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (Leader): Election: Leader has following peers: [follower241, follower240] 10:15:19,182 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 10:15:19,182 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 6, leaderLastIndex: 5, leaderSnapShotIndex: -1 10:15:19,182 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorBehavior - leader239 (PreLeader) :- Switching from behavior PreLeader to Leader, election term: 2 [WARN] [06/27/2025 10:15:19.183] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:19,186 AM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 4 completion(s) pending 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower240: running 4 completion(s) 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@563895bb} 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=false} 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@75e5858d} 10:15:19,186 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 4 entries in 7.335 ms 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38, pending=false} 10:15:19,186 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting for 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@774331dd} 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=5, term=2, command=four, pending=false} 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0883190@46cac9d9} 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): Commit index set to 4 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 4 (of expected -1) 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 4, context.getLastApplied(): 0, lastIndex(): 5 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 1 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 0 to 1 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower240: Applying state for log index 1 data one 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower240: applyState called: one 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 2 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 1 to 2 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower240: Applying state for log index 2 data two 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower240: applyState called: two 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 3 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 2 to 3 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower240: Applying state for log index 3 data three 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower240: applyState called: three 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 4 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 3 to 4 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower240: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@1b7aed38 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): Commit index set to 5 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 5, context.getLastApplied(): 4, lastIndex(): 5 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 5 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 4 to 5 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower240: Applying state for log index 5 data four 10:15:19,186 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower240: applyState called: four 10:15:19,186 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 entries in 305.0 μs 10:15:19,186 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 1 entries in 122.6 μs 10:15:19,186 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 entries in 3.780 μs 10:15:19,186 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 1 entries in 42.29 μs 10:15:19,186 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting for [WARN] [06/27/2025 10:15:19.302] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:19,302 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:19.422] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:19,422 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:15:19,542 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:19.542] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:15:19.662] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:19,662 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:15:19,781 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:19.781] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:19,901 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:19.902] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:20,22 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:20.022] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:15:20.142] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:20,142 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:15:20,262 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:20.262] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:20,382 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:20.382] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:20,502 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:20.502] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:20,622 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:20.622] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:20,742 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:20.742] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:20,862 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:20.863] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:20,982 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:20.982] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:21,102 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:21.102] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:21,222 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:21.222] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:21,342 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:21.342] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:15:21.461] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:21,462 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:15:21,582 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:21.582] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:15:21.692] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:21,692 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:15:21,811 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:21.811] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:21,932 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:21.932] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:15:22.051] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:22,52 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:22.172] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:22,172 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:15:22,292 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:22.292] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:22,402 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:22.403] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:22,512 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:22.512] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:22,622 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:22.622] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:22,742 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:22.742] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:22,861 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:22.861] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:22,982 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:22.982] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:23,102 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:23.102] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:15:23.222] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:23,222 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:23.341] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:23,341 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:23.462] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:23,462 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:15:23,581 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:23.581] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:23,702 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:23.702] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:23,821 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:23.822] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:23,942 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:23.942] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:24,62 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:15:24.062] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:15:24.182] [test-pekko.actor.default-dispatcher-14] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:15:24,182 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:15:24,194 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower240-collector242#-609766406] 10:15:24,205 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower240] 10:15:24,205 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - follower240: terminating thread VirtualThread[#624,follower240-writer-100]/waiting 10:15:24,205 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 entries in 5.019 s 10:15:24,206 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 1 entries in 65.38 μs 10:15:24,206 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@7f355048 stopped 10:15:24,206 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower240: journal closed 10:15:24,206 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower240: journal closed 10:15:24,206 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower240: stopped executor with 0 remaining tasks 10:15:24,206 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower240: stopped executor with 0 remaining tasks 10:15:24,206 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader239-collector243#-866018322] 10:15:24,207 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader239] 10:15:24,207 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - leader239: terminating thread VirtualThread[#628,leader239-writer-102]/waiting 10:15:24,207 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 entries in 5.025 s 10:15:24,207 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 34.29 μs 10:15:24,207 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@54dde23d stopped 10:15:24,207 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader239: journal closed 10:15:24,207 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - leader239: journal closed 10:15:24,207 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks 10:15:24,207 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks 10:15:24,210 AM [test-pekko.actor.default-dispatcher-14] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [INFO] [06/27/2025 10:15:24.210] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [WARN] [06/27/2025 10:15:24.212] [test-pekko.actor.default-dispatcher-11] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.170.113:17355) [INFO] [06/27/2025 10:15:24.212] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.113:17355] - Exiting completed [INFO] [06/27/2025 10:15:24.212] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.113:17355] - Shutting down... 10:15:24,213 AM [test-pekko.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.113:17355] - Exiting completed 10:15:24,213 AM [test-pekko.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.113:17355] - Shutting down... 10:15:24,213 AM [test-pekko.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.113:17355] - Successfully shut down [INFO] [06/27/2025 10:15:24.212] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.113:17355] - Successfully shut down 10:15:24,214 AM [test-pekko.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 10:15:24,214 AM [test-pekko.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [INFO] [06/27/2025 10:15:24.214] [test-pekko.remote.default-remote-dispatcher-10] [pekko://test@10.30.170.113:17355/system/remoting-terminator] Shutting down remote daemon. [INFO] [06/27/2025 10:15:24.214] [test-pekko.remote.default-remote-dispatcher-10] [pekko://test@10.30.170.113:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports. [INFO] [06/27/2025 10:15:24.216] [test-pekko.remote.default-remote-dispatcher-8] [pekko://test@10.30.170.113:17355/system/remoting-terminator] Remoting shut down. 10:15:24,216 AM [test-pekko.actor.default-dispatcher-18] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down. [DEBUG] [06/27/2025 10:15:24.216] [test-pekko.actor.internal-dispatcher-3] [EventStream] shutting down: StandardOutLogger