[DEBUG] [06/27/2025 10:44:58.959] [main] [EventStream(pekko://test)] logger log1-TestEventListener started 10:44:58,965 AM [test-pekko.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [06/27/2025 10:44:58.965] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started [DEBUG] [06/27/2025 10:44:58.965] [main] [EventStream(pekko://test)] Default Loggers started [INFO] [06/27/2025 10:44:58.977] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.171.179:17355] with UID [8947019450438897928] 10:44:58,977 AM [test-pekko.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.171.179:17355] with UID [8947019450438897928] [INFO] [06/27/2025 10:44:58.978] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.179:17355] - Starting up, Pekko version [1.0.3] ... 10:44:58,978 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.179:17355] - Starting up, Pekko version [1.0.3] ... [INFO] [06/27/2025 10:44:58.981] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.179:17355] - Registered cluster JMX MBean [pekko:type=Cluster] [INFO] [06/27/2025 10:44:58.981] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.179:17355] - Started up successfully 10:44:58,982 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.179:17355] - Registered cluster JMX MBean [pekko:type=Cluster] 10:44:58,982 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.179:17355] - Started up successfully [INFO] [06/27/2025 10:44:58.982] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.179:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing [INFO] [06/27/2025 10:44:58.982] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.179:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 10:44:58,982 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.179:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing 10:44:58,982 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.179:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 10:44:59,9 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower223: Starting recovery with journal batch size 1000 10:44:59,9 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower223: started executor 10:44:59,9 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower223: started executor 10:44:59,10 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower223: metadata journal open: replayFrom=1 applyTo=0 10:44:59,11 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower223: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:44:59,11 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower223: journal open: applyTo=0 10:44:59,12 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@282016fe started 10:44:59,12 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for more work 10:44:59,12 AM [test-pekko.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower223] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [06/27/2025 10:44:59.012] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower223]: org.opendaylight.controller.cluster.common.actor.Monitor@2f790b50 [INFO] [pekkoDeadLetter][06/27/2025 10:44:59.011] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower223] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [06/27/2025 10:44:59.014] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader222]: org.opendaylight.controller.cluster.common.actor.Monitor@605b692b [INFO] [pekkoDeadLetter][06/27/2025 10:44:59.015] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:44:59,15 AM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:44:59,15 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader222: Starting recovery with journal batch size 1000 10:44:59,15 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: started executor 10:44:59,15 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: started executor 10:44:59,16 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader222: metadata journal open: replayFrom=1 applyTo=0 10:44:59,16 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader222: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:44:59,16 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader222: journal open: applyTo=0 10:44:59,17 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@6f43235e started 10:44:59,17 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for more work 10:44:59,19 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties does not exist 10:44:59,19 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/follower223/TermInfo.properties does not exist 10:44:59,20 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower223: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/follower223/journal-v1-1.log 10:44:59,20 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower223: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/follower223/metadata-v1-1.log 10:44:59,20 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower223: no eligible files found 10:44:59,20 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower223: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:44:59,20 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:44:59,20 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:44:59,20 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - leader222: no eligible files found 10:44:59,20 AM [test-pekko.actor.default-dispatcher-13] [INFO] PekkoRecovery - leader222: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:44:59,24 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=0, votedFor=null 10:44:59,24 AM [test-pekko.actor.default-dispatcher-13] [INFO] PekkoRecovery - leader222: Local TermInfo store seeded with TermInfo{term=0} 10:44:59,24 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader222: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@570f8c51 10:44:59,24 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to -1 10:44:59,25 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] JournalRecovery - leader222: journal recovery completedin 427.1 μs with journalIndex=1 10:44:59,27 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=0, votedFor=null 10:44:59,27 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower223: Local TermInfo store seeded with TermInfo{term=0} 10:44:59,27 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower223: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@44556dd4 10:44:59,27 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from -1 to -1 10:44:59,27 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower223: journal recovery completedin 244.9 μs with journalIndex=1 10:44:59,516 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 10:44:59,516 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Follower - leader222 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.179:17355, Removed) 10:44:59,516 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Follower - leader222 (Follower): Received ElectionTimeout - switching to Candidate 10:44:59,516 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Candidate - leader222 (Candidate): Election: Candidate has following voting peers: [follower223, follower224] 10:44:59,520 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222 10:44:59,520 AM [test-pekko.actor.default-dispatcher-13] [INFO] Candidate - leader222 (Candidate): Starting new election term 1 10:44:59,520 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} to peer follower223 10:44:59,520 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} to peer follower224 10:44:59,520 AM [test-pekko.actor.default-dispatcher-13] [INFO] RaftActorBehavior - leader222 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 10:44:59,520 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 10:44:59,520 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): Cluster state: [] 10:44:59,520 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 10:44:59,520 AM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - follower223 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term [WARN] [06/27/2025 10:44:59.520] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} [INFO] [pekkoDeadLetter][06/27/2025 10:44:59.520] [test-pekko.actor.default-dispatcher-16] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:44:59,521 AM [test-pekko.actor.default-dispatcher-5] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:44:59,523 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=1, votedFor=null 10:44:59,523 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): In requestVote: RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 10:44:59,526 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=1, votedFor=leader222 10:44:59,526 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 10:44:59,526 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader222 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 10:44:59,526 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader222 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 10:44:59,526 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Election: Leader has following peers: [follower223, follower224] 10:44:59,526 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:44:59,526 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:44:59,526 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader222 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 10:44:59,527 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Last sync leader does not match current leader leader222, need to catch up to -1 [WARN] [06/27/2025 10:44:59.527] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:44:59.527] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower223] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower223, initialSyncDone=false] [INFO] [pekkoDeadLetter][06/27/2025 10:44:59.527] [test-pekko.actor.default-dispatcher-5] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:44:59,527 AM [test-pekko.actor.default-dispatcher-5] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][06/27/2025 10:44:59.527] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower223] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:44:59,527 AM [test-pekko.actor.default-dispatcher-5] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:44:59,527 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: -1, nextIndex: 0 10:44:59,527 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:44:59,530 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader222: Persist data index=0 term=1 command=zero 10:44:59,530 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:44:59,530 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 10:44:59,530 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:44:59,530 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 0 is present for follower follower223 10:44:59,530 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 513.3 ms 10:44:59,530 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 10:44:59,530 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:44:59,530 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 10:44:59,530 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 10:44:59,530 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 10:44:59,530 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): Append entry to log zero 10:44:59,531 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} [WARN] [06/27/2025 10:44:59.531] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:44:59,531 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): Log size is now 1 10:44:59,531 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:44:59,531 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached -1 (of expected -1) 10:44:59,531 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 10:44:59,531 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 0, nextIndex: 1 10:44:59,531 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 519.1 ms 10:44:59,531 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 [INFO] [pekkoDeadLetter][06/27/2025 10:44:59.531] [test-pekko.actor.default-dispatcher-6] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:44:59,531 AM [test-pekko.actor.default-dispatcher-11] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:44:59,535 AM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 10:44:59,535 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 5.336 ms 10:44:59,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 10:44:59,535 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for more work 10:44:59,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:44:59,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 10:44:59,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 0 10:44:59,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to 0 10:44:59,535 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader222: Applying state for log index 0 data zero 10:44:59,535 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader222: applyState called: zero 10:44:59,536 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 297.9 μs 10:44:59,536 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 136.4 μs 10:44:59,536 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for more work 10:44:59,536 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 10:44:59,536 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 10:44:59,536 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 5.549 ms 10:44:59,536 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 10:44:59,536 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for more work 10:44:59,536 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@47b6a66} [WARN] [06/27/2025 10:44:59.537] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower223] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower223, initialSyncDone=true] [INFO] [pekkoDeadLetter][06/27/2025 10:44:59.537] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower223] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:44:59,537 AM [test-pekko.actor.default-dispatcher-16] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:44:59,631 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Persist data index=1 term=1 command=one 10:44:59,631 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:44:59,631 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 10:44:59,631 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:44:59,631 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 1 is present for follower follower223 10:44:59,631 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 10:44:59,631 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:44:59,631 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 95.03 ms 10:44:59,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} [WARN] [06/27/2025 10:44:59.631] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:44:59,631 AM [test-pekko.actor.default-dispatcher-11] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:44:59,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 [INFO] [pekkoDeadLetter][06/27/2025 10:44:59.631] [test-pekko.actor.default-dispatcher-11] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:44:59,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 10:44:59,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): Append entry to log one 10:44:59,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:44:59,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): Log size is now 2 10:44:59,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): Commit index set to 0 10:44:59,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:44:59,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 0 (of expected -1) 10:44:59,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 10:44:59,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 0 10:44:59,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from -1 to 0 10:44:59,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower223: Applying state for log index 0 data zero 10:44:59,631 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower223: applyState called: zero 10:44:59,631 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 1, nextIndex: 2 10:44:59,631 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 94.91 ms 10:44:59,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 10:44:59,631 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:44:59,633 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 10:44:59,633 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 10:44:59,633 AM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 10:44:59,633 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 10:44:59,633 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@cd2fcd2} 10:44:59,633 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 1.585 ms 10:44:59,633 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 10:44:59,633 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 7.590 μs 10:44:59,633 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:44:59,633 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 10:44:59,633 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 2.013 ms 10:44:59,633 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 1 10:44:59,633 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for more work 10:44:59,633 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 0 to 1 10:44:59,633 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader222: Applying state for log index 1 data one 10:44:59,633 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - leader222: applyState called: one 10:44:59,633 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 148.2 μs 10:44:59,633 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for more work 10:44:59,633 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 286.2 μs 10:44:59,634 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 111.0 μs 10:44:59,634 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for more work [WARN] [06/27/2025 10:44:59.645] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [INFO] [pekkoDeadLetter][06/27/2025 10:44:59.645] [test-pekko.actor.default-dispatcher-16] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:44:59,645 AM [test-pekko.actor.default-dispatcher-16] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:44:59,732 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Persist data index=2 term=1 command=two 10:44:59,732 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:44:59,732 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 10:44:59,732 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:44:59,732 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 2 is present for follower follower223 10:44:59,732 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 10:44:59,732 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:44:59,732 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Persist data index=3 term=1 command=three 10:44:59,732 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 10:44:59,732 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true 10:44:59,732 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:44:59,732 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 10:44:59,732 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 2 is present for follower follower223 10:44:59,732 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 10:44:59,732 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:44:59,732 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 10:44:59,732 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): Append entry to log two 10:44:59,732 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:44:59,732 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): Log size is now 3 10:44:59,732 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): Commit index set to 1 10:44:59,732 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:44:59,732 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 2 entries in 98.81 ms 10:44:59,732 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 1 (of expected -1) 10:44:59,732 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 2 10:44:59,732 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 1 10:44:59,732 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 0 to 1 10:44:59,732 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower223: Applying state for log index 1 data one 10:44:59,733 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower223: applyState called: one 10:44:59,733 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 99.32 ms 10:44:59,733 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 10:44:59,733 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 2, nextIndex: 3 10:44:59,733 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 3, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:44:59,733 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 3 is present for follower follower223 10:44:59,733 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=2, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=three, pending=true}]} [WARN] [06/27/2025 10:44:59.733] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:44:59.733] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [INFO] [pekkoDeadLetter][06/27/2025 10:44:59.733] [test-pekko.actor.default-dispatcher-11] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:44:59,733 AM [test-pekko.actor.default-dispatcher-11] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 10:44:59,734 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 10:44:59,735 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 10:44:59,735 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 1.972 ms 10:44:59,735 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 10:44:59,735 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@54f4bc52} 10:44:59,735 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 7.890 μs 10:44:59,735 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=2, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=three, pending=true}]} 10:44:59,735 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 10:44:59,735 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 141.1 μs 10:44:59,735 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for more work 10:44:59,735 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 2, entries to be added from: 0 10:44:59,735 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): Append entry to log three 10:44:59,735 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 10:44:59,735 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): Log size is now 4 10:44:59,735 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=3, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:44:59,735 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 1 (of expected -1) 10:44:59,735 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 161.1 μs 10:44:59,735 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 3, nextIndex: 4 10:44:59,735 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 10:44:59,735 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:44:59,735 AM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 2 completion(s) pending 10:44:59,735 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - leader222: running 2 completion(s) 10:44:59,735 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 2 entries in 2.896 ms 10:44:59,735 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:44:59,735 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for more work 10:44:59,735 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1 10:44:59,735 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 2 10:44:59,735 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 1 to 2 10:44:59,735 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader222: Applying state for log index 2 data two 10:44:59,736 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - leader222: applyState called: two 10:44:59,736 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true} 10:44:59,736 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 292.3 μs 10:44:59,736 AM [test-pekko.actor.default-dispatcher-11] [INFO] SnapshotManager - leader222: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=2, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 10:44:59,736 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 139.1 μs 10:44:59,736 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for more work 10:44:59,736 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 10:44:59,736 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 10:44:59,736 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=false} 10:44:59,736 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 859.8 μs 10:44:59,736 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@1e8adf05} 10:44:59,736 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for more work 10:44:59,736 AM [test-pekko.actor.default-dispatcher-11] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:305) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 10:44:59,736 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - leader222: terminating thread VirtualThread[#608,leader222-writer-91]/waiting [ERROR] [06/27/2025 10:44:59.736] [test-pekko.actor.internal-dispatcher-10] [pekko://test/user/leader222] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:305) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 10:44:59,737 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 955.3 μs 10:44:59,737 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 34.31 μs 10:44:59,737 AM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@6f43235e stopped 10:44:59,737 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader222: journal closed 10:44:59,737 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader222: journal closed 10:44:59,737 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks 10:44:59,737 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks [WARN] [06/27/2025 10:44:59.738] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader222]: org.opendaylight.controller.cluster.common.actor.Monitor@67f3084d 10:44:59,739 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader222: Starting recovery with journal batch size 1000 10:44:59,739 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: started executor 10:44:59,739 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader222: started executor 10:44:59,740 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader222: metadata journal open: replayFrom=1 applyTo=2 10:44:59,741 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader222: journal open: firstIndex=1 lastIndex=4 replayFrom=1 fileEntries=0 10:44:59,741 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader222: journal open: applyTo=2 10:44:59,741 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@3e4f6d77 started 10:44:59,741 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: waiting for more work 10:44:59,742 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222 10:44:59,742 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:44:59,742 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:44:59,742 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:44:59,742 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader222: no eligible files found 10:44:59,742 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader222: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:44:59,742 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - leader222: restoring local TermInfo{term=1, votedFor=leader222} 10:44:59,742 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222 10:44:59,742 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader222: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4ec776d3 10:44:59,742 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to -1 10:44:59,743 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 10:44:59,743 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=1, term=1, command=one] 10:44:59,744 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=2, term=1, command=two] 10:44:59,744 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=3, term=1, command=three] 10:44:59,744 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader222: journal recovery completedin 2.215 ms with journalIndex=1 10:44:59,833 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:44:59,833 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:44:59,833 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:44:59,833 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:44:59,934 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:44:59,934 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:44:59,934 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:44:59,934 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:00,35 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:00,35 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:00,35 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:00,35 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:00,136 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:00,136 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:00,136 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:00,136 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:00,237 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:00,237 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:00,237 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:00,237 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:00,246 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader222 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.179:17355, Removed) 10:45:00,246 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader222 (Follower): Received ElectionTimeout - switching to Candidate 10:45:00,246 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader222 (Candidate): Election: Candidate has following voting peers: [follower223, follower224] 10:45:00,249 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=2, votedFor=leader222 10:45:00,249 AM [test-pekko.actor.default-dispatcher-6] [INFO] Candidate - leader222 (Candidate): Starting new election term 2 10:45:00,249 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} to peer follower223 10:45:00,250 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} to peer follower224 10:45:00,250 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader222 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 10:45:00,250 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower223 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 10:45:00,250 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower223 (Follower): Cluster state: [] 10:45:00,250 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower223 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} with higher term appears reachable, updating term. 10:45:00,250 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower223 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1}" message is greater than follower's term 1 - updating term [WARN] [06/27/2025 10:45:00.250] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} 10:45:00,252 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=2, votedFor=null 10:45:00,252 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower223 (Follower): In requestVote: RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} - currentTerm: 2, votedFor: null, lastIndex: 3, lastTerm: 1 10:45:00,257 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=2, votedFor=leader222 10:45:00,257 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower223 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 10:45:00,257 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader222 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 10:45:00,257 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader222 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 10:45:00,257 AM [test-pekko.actor.default-dispatcher-6] [INFO] Candidate - leader222 (Candidate): LastApplied index -1 is behind last index 3 - switching to PreLeader 10:45:00,257 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): Election: Leader has following peers: [follower223, follower224] 10:45:00,258 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:45:00,258 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:45:00,258 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging -2 entries behind leader leader222 and reached 1 (of expected -1) [WARN] [06/27/2025 10:45:00.258] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:00,258 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader222 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 2 10:45:00,258 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 3, nextIndex: 4 10:45:00,258 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 10:45:00,258 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 10:45:00,258 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 10:45:00,258 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 10:45:00,258 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:45:00,258 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader222: Persist data index=4 term=2 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e 10:45:00,258 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e, pending=true} 10:45:00,259 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): Replicate message: identifier: null, logIndex: 4, isSendImmediate: true 10:45:00,259 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:45:00,259 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): sendAppendEntries: 4 is present for follower follower223 10:45:00,259 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): Sending AppendEntries to follower follower223: AppendEntries{term=2, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e, pending=true}]} 10:45:00,259 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: received 1 entries in 517.9 ms 10:45:00,259 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e, pending=true}]} 10:45:00,259 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 10:45:00,259 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 3, entries to be added from: 0 10:45:00,259 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): Append entry to log org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e 10:45:00,259 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e, pending=true} 10:45:00,259 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): Log size is now 5 10:45:00,259 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower223, logLastIndex=4, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:45:00,259 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging -2 entries behind leader leader222 and reached 1 (of expected -1) 10:45:00,259 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 10:45:00,259 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 523.0 ms 10:45:00,259 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:45:00,259 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 4, nextIndex: 5 10:45:00,259 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 10:45:00,259 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 10:45:00,260 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 10:45:00,260 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 [WARN] [06/27/2025 10:45:00.259] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:00,260 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 5, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:45:00,261 AM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 10:45:00,261 AM [leader222-writer-92] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 10:45:00,261 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 10:45:00,261 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 1.981 ms 10:45:00,261 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for more work 10:45:00,261 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 2.408 ms 10:45:00,261 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e, pending=false} 10:45:00,261 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: waiting for more work 10:45:00,261 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 10:45:00,261 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@1488a785} 10:45:00,261 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e, pending=true} 10:45:00,261 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 10:45:00,261 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 10:45:00,261 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 10:45:00,261 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 10:45:00,261 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader222 (PreLeader): Applying to log - commitIndex: 4, lastAppliedIndex: -1 10:45:00,261 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 0 10:45:00,261 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to 0 10:45:00,261 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader222: Applying state for log index 0 data zero 10:45:00,261 AM [test-pekko.actor.default-dispatcher-13] [INFO] MockRaftActor - leader222: applyState called: zero 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 1 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 0 to 1 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader222: Applying state for log index 1 data one 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [INFO] MockRaftActor - leader222: applyState called: one 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 2 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 1 to 2 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader222: Applying state for log index 2 data two 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [INFO] MockRaftActor - leader222: applyState called: two 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 3 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 2 to 3 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader222: Applying state for log index 3 data three 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [INFO] MockRaftActor - leader222: applyState called: three 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 4 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 3 to 4 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader222: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e 10:45:00,262 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: received 1 entries in 824.2 μs 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PreLeader - leader222 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}] - lastApplied: 4, lastIndex: 4 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader222 (Leader): Election: Leader has following peers: [follower223, follower224] 10:45:00,262 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 246.2 μs 10:45:00,262 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: waiting for more work 10:45:00,262 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 5, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:45:00,263 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:45:00,263 AM [test-pekko.actor.default-dispatcher-13] [INFO] RaftActorBehavior - leader222 (PreLeader) :- Switching from behavior PreLeader to Leader, election term: 2 10:45:00,263 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): Commit index set to 4 10:45:00,263 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 10:45:00,263 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 4, context.getLastApplied(): 1, lastIndex(): 4 10:45:00,263 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 2 10:45:00,263 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 1 to 2 10:45:00,263 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower223: Applying state for log index 2 data two 10:45:00,263 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower223: applyState called: two 10:45:00,263 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 3 10:45:00,263 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 2 to 3 10:45:00,263 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower223: Applying state for log index 3 data three 10:45:00,263 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower223: applyState called: three 10:45:00,263 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 4 10:45:00,263 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 3 to 4 10:45:00,263 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower223: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e 10:45:00,263 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 1.968 ms [WARN] [06/27/2025 10:45:00.263] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:00,263 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 156.6 μs 10:45:00,263 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for more work 10:45:00,337 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:00,337 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:00,337 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:00,337 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/27/2025 10:45:00.376] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:00,376 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 10:45:00,438 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:00,438 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:00,438 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:00,438 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:00,496 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:00.496] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:00,538 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:00,538 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:00,538 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:00,538 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:00,616 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:00.616] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:00,639 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:00,639 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:00,639 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:00,639 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:00,736 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:00.736] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:00,740 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:00,740 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:00,740 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:00,740 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:00,840 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:00,840 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:00,840 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:00,840 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:00,856 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:00.856] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:00,941 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:00,941 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:00,941 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:00,941 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:00,976 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:00.976] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:01,42 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:01,42 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:01,42 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:01,42 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:01,96 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:01.096] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:01,142 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:01,142 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:01,142 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:01,142 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:01,216 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:01.216] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:01,243 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:01,243 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:01,243 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:01,243 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:01,336 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:01.336] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:01,344 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:01,344 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:01,344 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:01,344 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:01,444 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:01,444 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:01,444 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:01,444 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/27/2025 10:45:01.456] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:01,456 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 10:45:01,545 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:01,545 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:01,545 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:01,545 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/27/2025 10:45:01.576] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:01,576 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 10:45:01,646 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:01,646 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:01,646 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:01,646 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:01,696 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:01.696] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:01,746 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:01,746 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:01,746 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:01,746 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:01,816 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:01.816] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:01,847 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:01,847 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:01,847 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:01,847 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:01,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:01.936] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:01,948 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:01,948 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:01,948 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:01,948 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:02,48 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:02,48 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:02,48 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:02,48 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:02,55 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:02.056] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:02,149 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:02,149 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:02,149 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:02,149 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:02,176 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:02.176] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:02,250 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:02,250 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:02,250 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:02,250 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:02,296 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:02.296] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:02,350 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:02,350 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:02,350 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:02,350 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:02,415 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:02.415] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:02,451 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:02,451 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:02,451 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:02,451 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:02,536 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:02.536] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:02,551 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:02,551 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:02,551 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:02,551 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:02,652 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:02,652 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:02,652 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:02,652 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:02,656 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:02.656] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:02,753 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:02,753 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:02,753 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:02,753 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:02,775 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:02.775] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:02,854 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:02,854 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:02,854 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:02,854 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:02,896 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:02.896] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:02,954 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:02,954 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:02,954 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:02,954 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:03,15 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:03.015] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:03,55 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:03,55 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:03,55 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:03,55 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:03,136 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:03.136] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:03,155 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:03,156 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:03,156 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:03,156 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:03,256 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 10:45:03,256 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:03,256 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log [WARN] [06/27/2025 10:45:03.256] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:03,256 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:03,256 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:03,357 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:03,357 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:03,357 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:03,357 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:03,376 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:03.375] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:03,457 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:03,458 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:03,458 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:03,458 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:03,496 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:03.496] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:03,558 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:03,558 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:03,558 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:03,558 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:03,615 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:03.616] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:03,659 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:03,659 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:03,659 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:03,659 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:03,736 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:03.736] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:03,759 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:03,759 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:03,759 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:03,760 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:03,856 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:03.856] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:03,860 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:03,860 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:03,860 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:03,860 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:03,961 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:03,961 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:03,961 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:03,961 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:03,975 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:03.976] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:04,62 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:04,62 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:04,62 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:04,62 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:04,96 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:04.096] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:04,162 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:04,162 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:04,162 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:04,162 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:04,216 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:04.216] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:04,263 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:04,263 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:04,263 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:04,263 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:04,335 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:04.335] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:04,364 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:04,364 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:04,364 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:04,364 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:04,456 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:04.456] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:04,464 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:04,464 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:04,464 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:04,464 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:04,565 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:04,565 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:04,565 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:04,565 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 10:45:04,576 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 10:45:04.576] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:04,665 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/TermInfo.properties 10:45:04,665 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/journal-v1-1.log 10:45:04,665 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10640101513864831985/leader222/metadata-v1-1.log 10:45:04,666 AM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/27/2025 10:45:04.695] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:04,695 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 10:45:04,767 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower223-collector225#-10331124] 10:45:04,779 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower223] 10:45:04,779 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower223: terminating thread VirtualThread[#602,follower223-writer-90]/waiting 10:45:04,779 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 4.516 s 10:45:04,779 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 46.17 μs 10:45:04,779 AM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@282016fe stopped 10:45:04,779 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower223: journal closed 10:45:04,780 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower223: journal closed 10:45:04,780 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower223: stopped executor with 0 remaining tasks 10:45:04,780 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower223: stopped executor with 0 remaining tasks 10:45:04,780 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader222-collector226#-1276445439] 10:45:04,780 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader222] 10:45:04,781 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRaftStorage - leader222: terminating thread VirtualThread[#611,leader222-writer-92]/waiting 10:45:04,781 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: received 1 entries in 4.518 s 10:45:04,781 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 29.87 μs 10:45:04,781 AM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@3e4f6d77 stopped 10:45:04,781 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader222: journal closed 10:45:04,781 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - leader222: journal closed 10:45:04,781 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks 10:45:04,781 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks [WARN] [06/27/2025 10:45:04.786] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower228]: org.opendaylight.controller.cluster.common.actor.Monitor@4faff1cd 10:45:04,787 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower228: Starting recovery with journal batch size 1000 10:45:04,787 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower228: started executor 10:45:04,787 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower228: started executor 10:45:04,787 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower228: metadata journal open: replayFrom=1 applyTo=0 10:45:04,788 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower228: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:45:04,788 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower228: journal open: applyTo=0 10:45:04,788 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@791cae0d started 10:45:04,788 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: waiting for more work 10:45:04,790 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/follower228/TermInfo.properties does not exist 10:45:04,790 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - follower228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/follower228/journal-v1-1.log 10:45:04,790 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - follower228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/follower228/metadata-v1-1.log 10:45:04,790 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - follower228: no eligible files found 10:45:04,790 AM [test-pekko.actor.default-dispatcher-13] [INFO] PekkoRecovery - follower228: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [06/27/2025 10:45:04.791] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader227]: org.opendaylight.controller.cluster.common.actor.Monitor@4e5ee5bd 10:45:04,791 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - leader227: Starting recovery with journal batch size 1000 10:45:04,792 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader227: started executor 10:45:04,792 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader227: started executor 10:45:04,792 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader227: metadata journal open: replayFrom=1 applyTo=0 10:45:04,792 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader227: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:45:04,792 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - leader227: journal open: applyTo=0 10:45:04,792 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@77b85789 started 10:45:04,792 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for more work 10:45:04,793 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=0, votedFor=null 10:45:04,793 AM [test-pekko.actor.default-dispatcher-13] [INFO] PekkoRecovery - follower228: Local TermInfo store seeded with TermInfo{term=0} 10:45:04,793 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - follower228: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@59307146 10:45:04,793 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractReplicatedLog - follower228: Moving last applied index from -1 to -1 10:45:04,794 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] JournalRecovery - follower228: journal recovery completedin 197.7 μs with journalIndex=1 10:45:04,794 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties does not exist 10:45:04,794 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:04,794 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:04,794 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - leader227: no eligible files found 10:45:04,794 AM [test-pekko.actor.default-dispatcher-13] [INFO] PekkoRecovery - leader227: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:45:04,797 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=0, votedFor=null 10:45:04,797 AM [test-pekko.actor.default-dispatcher-13] [INFO] PekkoRecovery - leader227: Local TermInfo store seeded with TermInfo{term=0} 10:45:04,797 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader227: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@48546d85 10:45:04,797 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from -1 to -1 10:45:04,797 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] JournalRecovery - leader227: journal recovery completedin 153.1 μs with journalIndex=1 10:45:05,265 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 10:45:05,265 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Follower - leader227 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.179:17355, Removed) 10:45:05,265 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Follower - leader227 (Follower): Received ElectionTimeout - switching to Candidate 10:45:05,265 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Candidate - leader227 (Candidate): Election: Candidate has following voting peers: [follower229, follower228] 10:45:05,269 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=1, votedFor=leader227 10:45:05,269 AM [test-pekko.actor.default-dispatcher-13] [INFO] Candidate - leader227 (Candidate): Starting new election term 1 10:45:05,269 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} to peer follower229 10:45:05,269 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} to peer follower228 10:45:05,269 AM [test-pekko.actor.default-dispatcher-13] [INFO] RaftActorBehavior - leader227 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 10:45:05,269 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower228 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. [WARN] [06/27/2025 10:45:05.269] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} 10:45:05,269 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower228 (Follower): Cluster state: [] 10:45:05,269 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower228 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 10:45:05,269 AM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - follower228 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 10:45:05,271 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=1, votedFor=null 10:45:05,271 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower228 (Follower): In requestVote: RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 10:45:05,273 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=1, votedFor=leader227 10:45:05,273 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower228 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 10:45:05,273 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader227 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 10:45:05,273 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader227 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 10:45:05,273 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Election: Leader has following peers: [follower229, follower228] 10:45:05,273 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:45:05,273 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:45:05,274 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActorBehavior - leader227 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 [WARN] [06/27/2025 10:45:05.274] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:05,274 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower228 updated: matchIndex: -1, nextIndex: 0 10:45:05,274 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:45:05,274 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower228: Last sync leader does not match current leader leader227, need to catch up to -1 [WARN] [06/27/2025 10:45:05.274] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower228] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower228, initialSyncDone=false] 10:45:05,302 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader227: Persist data index=0 term=1 command=zero 10:45:05,302 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:45:05,302 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 10:45:05,302 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:45:05,302 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 509.5 ms 10:45:05,302 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:45:05,302 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 0 is present for follower follower228 10:45:05,302 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Sending AppendEntries to follower follower228: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} [WARN] [06/27/2025 10:45:05.302] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:05,302 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower228 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 10:45:05,302 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower228 (Follower): Number of entries to be appended = 1 10:45:05,302 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower228 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 10:45:05,302 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower228 (Follower): Append entry to log zero 10:45:05,302 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower228: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:45:05,302 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower228 (Follower): Log size is now 1 10:45:05,302 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower228 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower228, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:45:05,302 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower228: Lagging 0 entries behind leader leader227 and reached -1 (of expected -1) 10:45:05,302 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower228: awaiting more completions to resolve 1 deferred callback(s) 10:45:05,303 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower228 updated: matchIndex: 0, nextIndex: 1 10:45:05,303 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:45:05,303 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 entries in 514.3 ms 10:45:05,306 AM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 10:45:05,306 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 4.376 ms 10:45:05,306 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for more work 10:45:05,306 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 10:45:05,307 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:45:05,307 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 10:45:05,307 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader227 (Leader): Setting last applied to 0 10:45:05,307 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from -1 to 0 10:45:05,307 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader227: Applying state for log index 0 data zero 10:45:05,307 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader227: applyState called: zero 10:45:05,307 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 433.9 μs 10:45:05,307 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 189.4 μs 10:45:05,307 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for more work 10:45:05,307 AM [follower228-writer-93] [DEBUG] EntryStoreCompleter - follower228: 1 completion(s) pending 10:45:05,307 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower228: running 1 completion(s) 10:45:05,307 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: persisted 1 entries in 4.669 ms 10:45:05,307 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower228: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 10:45:05,307 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: waiting for more work 10:45:05,307 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower228: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@214e2134} [WARN] [06/27/2025 10:45:05.307] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower228] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower228, initialSyncDone=true] [WARN] [06/27/2025 10:45:05.386] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:05,403 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader227: Persist data index=1 term=1 command=one 10:45:05,403 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:45:05,403 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 10:45:05,403 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:45:05,403 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 95.81 ms 10:45:05,403 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:45:05,403 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 1 is present for follower follower228 10:45:05,403 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): Sending AppendEntries to follower follower228: AppendEntries{term=1, leaderId=leader227, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} [WARN] [06/27/2025 10:45:05.403] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:05,403 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader227, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 10:45:05,403 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): Number of entries to be appended = 1 10:45:05,403 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 10:45:05,403 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): Append entry to log one 10:45:05,403 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower228: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:45:05,403 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): Log size is now 2 10:45:05,403 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): Commit index set to 0 10:45:05,403 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower228, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:45:05,403 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower228: Lagging 0 entries behind leader leader227 and reached 0 (of expected -1) 10:45:05,404 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 10:45:05,404 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower228 (Follower): Setting last applied to 0 10:45:05,403 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 entries in 96.16 ms 10:45:05,404 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower228: Moving last applied index from -1 to 0 10:45:05,404 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower228: Applying state for log index 0 data zero 10:45:05,404 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower228: applyState called: zero 10:45:05,404 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower228: awaiting more completions to resolve 1 deferred callback(s) 10:45:05,404 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower228 updated: matchIndex: 1, nextIndex: 2 10:45:05,404 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:45:05,405 AM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 10:45:05,405 AM [follower228-writer-93] [DEBUG] EntryStoreCompleter - follower228: 1 completion(s) pending 10:45:05,405 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower228: running 1 completion(s) 10:45:05,405 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower228: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 10:45:05,405 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: persisted 1 entries in 1.526 ms 10:45:05,405 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 10:45:05,405 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower228: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@72f0a384} 10:45:05,405 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 2.021 ms 10:45:05,405 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:45:05,405 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 entries in 8.000 μs 10:45:05,405 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for more work 10:45:05,405 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader227 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 10:45:05,405 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader227 (Leader): Setting last applied to 1 10:45:05,405 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from 0 to 1 10:45:05,405 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader227: Applying state for log index 1 data one 10:45:05,405 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader227: applyState called: one 10:45:05,405 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: persisted 1 entries in 167.2 μs 10:45:05,405 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: waiting for more work 10:45:05,406 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 393.9 μs 10:45:05,406 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 118.0 μs 10:45:05,406 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for more work 10:45:05,504 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader227: Persist data index=2 term=1 command=two 10:45:05,504 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:45:05,504 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 98.34 ms 10:45:05,504 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 10:45:05,504 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:45:05,505 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:45:05,505 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 2 is present for follower follower228 10:45:05,505 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): Sending AppendEntries to follower follower228: AppendEntries{term=1, leaderId=leader227, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} [WARN] [06/27/2025 10:45:05.505] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:05,505 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader227: Persist data index=3 term=1 command=three 10:45:05,505 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 10:45:05,505 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true 10:45:05,505 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:45:05,505 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:45:05,505 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 2 is present for follower follower228 [WARN] [06/27/2025 10:45:05.505] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:05,505 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader227: Persist data index=4 term=1 command=four 10:45:05,505 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=4, term=1, command=four, pending=true} 10:45:05,505 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 4, isSendImmediate: true 10:45:05,505 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:45:05,505 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:45:05,505 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 2 is present for follower follower228 [WARN] [06/27/2025 10:45:05.505] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:05,506 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 2 is present for follower follower228 [WARN] [06/27/2025 10:45:05.506] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:05,506 AM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 10:45:05,506 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 2.127 ms 10:45:05,506 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 2 entries in 7.770 μs 10:45:05,507 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 10:45:05,507 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:45:05,508 AM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 2 completion(s) pending 10:45:05,508 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 2 entries in 2.061 ms 10:45:05,508 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for more work 10:45:05,509 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - leader227: running 2 completion(s) 10:45:05,509 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true} 10:45:05,509 AM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - leader227: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=3, mandatoryTrim=false] 10:45:05,509 AM [test-pekko.actor.default-dispatcher-6] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:305) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 10:45:05,510 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - leader227: terminating thread VirtualThread[#614,leader227-writer-94]/waiting 10:45:05,510 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 1.348 ms 10:45:05,510 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 34.54 μs 10:45:05,510 AM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@77b85789 stopped [ERROR] [06/27/2025 10:45:05.509] [test-pekko.actor.internal-dispatcher-10] [pekko://test/user/leader227] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:305) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 10:45:05,510 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader227: journal closed 10:45:05,510 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader227: journal closed 10:45:05,510 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks 10:45:05,510 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks [WARN] [06/27/2025 10:45:05.511] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader227]: org.opendaylight.controller.cluster.common.actor.Monitor@1a4400ae 10:45:05,512 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader227: Starting recovery with journal batch size 1000 10:45:05,512 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader227: started executor 10:45:05,512 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader227: started executor 10:45:05,513 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader227: metadata journal open: replayFrom=1 applyTo=1 10:45:05,514 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader227: journal open: firstIndex=1 lastIndex=5 replayFrom=1 fileEntries=0 10:45:05,514 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader227: journal open: applyTo=1 10:45:05,514 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@7a2b3f8e started 10:45:05,514 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: waiting for more work 10:45:05,516 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=1, votedFor=leader227 10:45:05,516 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:05,516 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:05,516 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:05,516 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader227: no eligible files found 10:45:05,516 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader227: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:45:05,516 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - leader227: restoring local TermInfo{term=1, votedFor=leader227} 10:45:05,516 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=1, votedFor=leader227 10:45:05,516 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader227: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@152ea0fa 10:45:05,516 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from -1 to -1 10:45:05,516 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 10:45:05,517 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=1, term=1, command=one] 10:45:05,517 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=2, term=1, command=two] 10:45:05,517 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=3, term=1, command=three] 10:45:05,517 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=4, term=1, command=four] 10:45:05,518 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader227: journal recovery completedin 1.641 ms with journalIndex=1 10:45:06,25 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader227 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.179:17355, Removed) 10:45:06,25 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader227 (Follower): Received ElectionTimeout - switching to Candidate 10:45:06,25 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader227 (Candidate): Election: Candidate has following voting peers: [follower229, follower228] 10:45:06,234 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=2, votedFor=leader227 10:45:06,234 AM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader227 (Candidate): Starting new election term 2 10:45:06,234 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} to peer follower229 10:45:06,234 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} to peer follower228 10:45:06,234 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader227 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 10:45:06,234 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower228 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 10:45:06,234 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower228 (Follower): Cluster state: [] 10:45:06,234 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower228 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} with higher term appears reachable, updating term. 10:45:06,234 AM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - follower228 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1}" message is greater than follower's term 1 - updating term [WARN] [06/27/2025 10:45:06.234] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} 10:45:06,237 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=2, votedFor=null 10:45:06,237 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower228 (Follower): In requestVote: RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} - currentTerm: 2, votedFor: null, lastIndex: 1, lastTerm: 1 10:45:06,240 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=2, votedFor=leader227 10:45:06,240 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower228 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 10:45:06,240 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader227 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 10:45:06,240 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader227 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 10:45:06,240 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - leader227 (Candidate): LastApplied index -1 is behind last index 4 - switching to PreLeader 10:45:06,240 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (PreLeader): Election: Leader has following peers: [follower229, follower228] 10:45:06,240 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:45:06,240 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower228: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:45:06,241 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader227 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 2 [WARN] [06/27/2025 10:45:06.241] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:06,241 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader227: Persist data index=5 term=2 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e 10:45:06,241 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=5, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e, pending=true} 10:45:06,241 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: received 1 entries in 726.7 ms 10:45:06,241 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (PreLeader): Replicate message: identifier: null, logIndex: 5, isSendImmediate: true 10:45:06,242 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 [WARN] [06/27/2025 10:45:06.242] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:06,242 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower228: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 10:45:06,243 AM [leader227-writer-95] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 10:45:06,243 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 2.232 ms 10:45:06,243 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: waiting for more work 10:45:06,243 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 10:45:06,243 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=5, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e, pending=true} [WARN] [06/27/2025 10:45:06.355] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:06,360 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:06,360 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:06,360 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:06,360 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 10:45:06,461 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:06,461 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:06,461 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:06,461 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:06.476] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:06,561 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:06,561 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:06,561 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:06,561 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:06.596] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:06,662 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:06,662 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:06,662 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:06,662 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:06.716] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:06,763 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:06,763 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:06,763 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:06,763 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:06.836] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:06,864 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:06,864 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:06,864 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:06,864 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:06.956] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:06,965 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:06,965 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:06,965 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:06,965 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 10:45:07,66 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:07,66 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:07,66 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:07,66 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:07.076] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:07,167 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:07,167 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:07,167 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:07,167 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:07.196] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:07,268 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:07,268 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:07,268 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:07,268 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:07.317] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:07,369 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:07,369 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:07,369 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:07,369 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:07.436] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:07,469 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:07,470 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:07,470 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:07,470 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:07.555] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:07,570 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:07,570 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:07,570 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:07,570 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 10:45:07,671 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:07,671 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:07,671 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:07,671 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:07.676] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:07,772 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:07,772 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:07,772 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:07,772 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:07.795] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:07,873 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:07,873 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:07,873 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:07,873 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:07.915] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:07,973 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:07,974 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:07,974 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:07,974 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:08.036] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:08,74 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:08,74 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:08,74 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:08,74 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:08.156] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:08,175 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:08,175 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:08,175 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:08,175 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:08.276] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:08,276 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:08,276 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:08,276 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:08,276 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 10:45:08,377 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:08,377 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:08,377 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:08,377 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:08.395] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:08,478 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:08,478 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:08,478 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:08,478 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:08.516] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:08,579 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:08,579 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:08,579 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:08,579 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:08.636] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:08,679 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:08,679 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:08,679 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:08,679 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:08.756] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:08,780 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:08,780 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:08,780 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:08,780 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:08.875] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:08,881 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:08,881 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:08,881 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:08,881 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 10:45:08,981 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:08,982 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:08,982 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:08,982 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:08.996] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:09,83 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:09,83 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:09,83 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:09,83 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:09.116] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:09,184 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:09,184 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:09,184 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:09,184 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:09.236] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:09,285 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:09,285 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:09,285 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:09,285 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:09.356] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:09,386 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:09,386 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:09,386 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:09,386 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:09.476] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:09,487 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:09,487 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:09,487 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:09,487 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 10:45:09,588 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:09,588 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:09,588 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:09,588 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:09.596] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:09,689 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:09,689 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:09,689 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:09,689 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:09.716] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:09,790 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:09,790 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:09,790 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:09,790 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:09.835] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:09,891 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:09,891 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:09,891 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:09,891 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:09.956] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:09,992 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:09,992 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:09,992 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:09,992 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:10.077] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:10,93 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:10,93 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:10,93 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:10,93 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 10:45:10,194 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:10,194 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:10,194 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:10,194 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:10.195] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:10,295 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:10,295 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:10,295 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:10,295 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:10.316] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:10,396 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:10,396 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:10,397 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:10,397 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:10.436] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:10,498 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:10,498 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:10,498 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:10,498 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:10.546] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:10,599 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:10,599 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:10,599 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:10,599 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:10.656] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:10,700 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:10,700 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:10,700 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:10,700 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:10.765] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:10,801 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:10,801 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:10,801 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:10,801 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:10.886] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:10,902 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:10,902 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:10,902 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:10,902 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 10:45:11,2 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:11,2 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:11,2 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:11,2 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:11.006] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:11,103 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:11,103 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:11,103 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:11,103 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:11.126] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:11,203 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/TermInfo.properties 10:45:11,203 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/journal-v1-1.log 10:45:11,203 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest1543452552160165733/leader227/metadata-v1-1.log 10:45:11,203 AM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 10:45:11.245] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:11,305 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower228-collector230#536531569] 10:45:11,316 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower228] 10:45:11,317 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PekkoRaftStorage - follower228: terminating thread VirtualThread[#613,follower228-writer-93]/waiting 10:45:11,317 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 entries in 5.911 s 10:45:11,317 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: persisted 1 entries in 52.53 μs 10:45:11,317 AM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@791cae0d stopped 10:45:11,317 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryJournalV1 - follower228: journal closed 10:45:11,317 AM [test-pekko.actor.default-dispatcher-13] [INFO] PekkoRaftStorage - follower228: journal closed 10:45:11,317 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - follower228: stopped executor with 0 remaining tasks 10:45:11,317 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - follower228: stopped executor with 0 remaining tasks 10:45:11,317 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader227-collector231#-1610148178] 10:45:11,318 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader227] 10:45:11,318 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PekkoRaftStorage - leader227: terminating thread VirtualThread[#617,leader227-writer-95]/waiting 10:45:11,318 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: received 1 entries in 5.075 s 10:45:11,318 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 12.72 μs 10:45:11,318 AM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@7a2b3f8e stopped 10:45:11,318 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryJournalV1 - leader227: journal closed 10:45:11,318 AM [test-pekko.actor.default-dispatcher-13] [INFO] PekkoRaftStorage - leader227: journal closed 10:45:11,318 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks 10:45:11,318 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks [WARN] [06/27/2025 10:45:11.323] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower233]: org.opendaylight.controller.cluster.common.actor.Monitor@71cd20e2 10:45:11,324 AM [test-pekko.actor.default-dispatcher-13] [INFO] RaftActor - follower233: Starting recovery with journal batch size 1000 10:45:11,324 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - follower233: started executor 10:45:11,325 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - follower233: started executor 10:45:11,325 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryJournalV1 - follower233: metadata journal open: replayFrom=1 applyTo=0 10:45:11,326 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryJournalV1 - follower233: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:45:11,326 AM [test-pekko.actor.default-dispatcher-13] [INFO] PekkoRaftStorage - follower233: journal open: applyTo=0 10:45:11,326 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@525edc9c started 10:45:11,326 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting for more work 10:45:11,328 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17637886538930802978/follower233/TermInfo.properties does not exist 10:45:11,328 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower233: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17637886538930802978/follower233/journal-v1-1.log 10:45:11,328 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower233: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17637886538930802978/follower233/metadata-v1-1.log 10:45:11,328 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower233: no eligible files found 10:45:11,328 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower233: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [06/27/2025 10:45:11.329] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader232]: org.opendaylight.controller.cluster.common.actor.Monitor@531f2055 10:45:11,330 AM [test-pekko.actor.default-dispatcher-13] [INFO] RaftActor - leader232: Starting recovery with journal batch size 1000 10:45:11,330 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - leader232: started executor 10:45:11,330 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - leader232: started executor 10:45:11,330 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryJournalV1 - leader232: metadata journal open: replayFrom=1 applyTo=0 10:45:11,331 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryJournalV1 - leader232: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:45:11,331 AM [test-pekko.actor.default-dispatcher-13] [INFO] PekkoRaftStorage - leader232: journal open: applyTo=0 10:45:11,331 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@712a5e16 started 10:45:11,331 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for more work 10:45:11,332 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower233: Set currentTerm=0, votedFor=null 10:45:11,332 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower233: Local TermInfo store seeded with TermInfo{term=0} 10:45:11,332 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower233: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4650008f 10:45:11,332 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from -1 to -1 10:45:11,332 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower233: journal recovery completedin 418.7 μs with journalIndex=1 10:45:11,333 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17637886538930802978/leader232/TermInfo.properties does not exist 10:45:11,333 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader232: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17637886538930802978/leader232/journal-v1-1.log 10:45:11,333 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader232: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17637886538930802978/leader232/metadata-v1-1.log 10:45:11,333 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader232: no eligible files found 10:45:11,333 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader232: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:45:11,337 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader232: Set currentTerm=0, votedFor=null 10:45:11,337 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader232: Local TermInfo store seeded with TermInfo{term=0} 10:45:11,337 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader232: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4b4dd0e4 10:45:11,337 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from -1 to -1 10:45:11,337 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - leader232: journal recovery completedin 272.9 μs with journalIndex=1 10:45:11,825 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 10:45:11,825 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader232 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.179:17355, Removed) 10:45:11,826 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader232 (Follower): Received ElectionTimeout - switching to Candidate 10:45:11,826 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader232 (Candidate): Election: Candidate has following voting peers: [follower234, follower233] 10:45:11,830 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader232: Set currentTerm=1, votedFor=leader232 10:45:11,830 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - leader232 (Candidate): Starting new election term 1 10:45:11,830 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader232 (Candidate): Sending RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} to peer follower234 10:45:11,830 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader232 (Candidate): Sending RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} to peer follower233 10:45:11,830 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader232 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 10:45:11,830 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - follower233 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. [WARN] [06/27/2025 10:45:11.830] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} 10:45:11,831 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - follower233 (Follower): Cluster state: [] 10:45:11,831 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - follower233 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 10:45:11,831 AM [test-pekko.actor.default-dispatcher-13] [INFO] Follower - follower233 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 10:45:11,834 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PropertiesTermInfoStore - follower233: Set currentTerm=1, votedFor=null 10:45:11,834 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - follower233 (Follower): In requestVote: RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 10:45:11,835 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PropertiesTermInfoStore - follower233: Set currentTerm=1, votedFor=leader232 10:45:11,835 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - follower233 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 10:45:11,836 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader232 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 10:45:11,836 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader232 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 10:45:11,836 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader232 (Leader): Election: Leader has following peers: [follower234, follower233] 10:45:11,836 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:45:11,836 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:45:11,836 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActorBehavior - leader232 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 [WARN] [06/27/2025 10:45:11.836] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:11,836 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Last sync leader does not match current leader leader232, need to catch up to -1 10:45:11,836 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: -1, nextIndex: 0 10:45:11,836 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [06/27/2025 10:45:11.836] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower233] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower233, initialSyncDone=false] 10:45:11,842 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader232: Persist data index=0 term=1 command=zero 10:45:11,842 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] ReplicatedLogImpl - leader232: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:45:11,842 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 511.2 ms 10:45:11,843 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 10:45:11,843 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 [WARN] [06/27/2025 10:45:11.843] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:11,843 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:45:11,843 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 0 is present for follower follower233 10:45:11,843 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower233: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 10:45:11,843 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower233 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 10:45:11,843 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower233 (Follower): Number of entries to be appended = 1 10:45:11,843 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower233 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 10:45:11,843 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower233 (Follower): Append entry to log zero 10:45:11,843 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower233: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:45:11,844 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower233 (Follower): Log size is now 1 10:45:11,844 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower233 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower233, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:45:11,844 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached -1 (of expected -1) 10:45:11,844 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryStoreCompleter - follower233: awaiting more completions to resolve 1 deferred callback(s) 10:45:11,844 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 517.1 ms 10:45:11,844 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: 0, nextIndex: 1 10:45:11,844 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:45:11,844 AM [leader232-writer-97] [DEBUG] EntryStoreCompleter - leader232: 1 completion(s) pending 10:45:11,844 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 1.974 ms 10:45:11,844 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for more work 10:45:11,844 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryStoreCompleter - leader232: running 1 completion(s) 10:45:11,844 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] ReplicatedLogImpl - leader232: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:45:11,844 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 10:45:11,844 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - leader232 (Leader): Setting last applied to 0 10:45:11,844 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from -1 to 0 10:45:11,844 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader232: Applying state for log index 0 data zero 10:45:11,844 AM [test-pekko.actor.default-dispatcher-13] [INFO] MockRaftActor - leader232: applyState called: zero 10:45:11,845 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 354.8 μs 10:45:11,845 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 127.9 μs 10:45:11,845 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for more work 10:45:11,845 AM [follower233-writer-96] [DEBUG] EntryStoreCompleter - follower233: 1 completion(s) pending 10:45:11,845 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryStoreCompleter - follower233: running 1 completion(s) 10:45:11,845 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 1.494 ms 10:45:11,845 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower233: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 10:45:11,845 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting for more work 10:45:11,845 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryStoreCompleter - follower233: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@13f0bfa4} [WARN] [06/27/2025 10:45:11.845] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower233] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower233, initialSyncDone=true] 10:45:11,943 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader232: Persist data index=1 term=1 command=one 10:45:11,943 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] ReplicatedLogImpl - leader232: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:45:11,943 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 10:45:11,943 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 98.18 ms 10:45:11,943 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:45:11,943 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:45:11,943 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 1 is present for follower follower233 [WARN] [06/27/2025 10:45:11.943] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:11,943 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower233: AppendEntries{term=1, leaderId=leader232, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 10:45:11,943 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower233 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 10:45:11,944 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower233 (Follower): Number of entries to be appended = 1 10:45:11,944 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower233 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 10:45:11,944 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower233 (Follower): Append entry to log one 10:45:11,944 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower233: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:45:11,944 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower233 (Follower): Log size is now 2 10:45:11,944 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower233 (Follower): Commit index set to 0 10:45:11,944 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower233 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower233, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:45:11,944 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 0 (of expected -1) 10:45:11,944 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower233 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 10:45:11,944 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower233 (Follower): Setting last applied to 0 10:45:11,944 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from -1 to 0 10:45:11,944 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower233: Applying state for log index 0 data zero 10:45:11,944 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower233: applyState called: zero 10:45:11,944 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: 1, nextIndex: 2 10:45:11,944 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryStoreCompleter - follower233: awaiting more completions to resolve 1 deferred callback(s) 10:45:11,944 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 98.73 ms 10:45:11,944 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:45:11,946 AM [leader232-writer-97] [DEBUG] EntryStoreCompleter - leader232: 1 completion(s) pending 10:45:11,946 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 2.589 ms 10:45:11,946 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for more work 10:45:11,946 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - leader232: running 1 completion(s) 10:45:11,946 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader232: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:45:11,946 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 10:45:11,946 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader232 (Leader): Setting last applied to 1 10:45:11,946 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from 0 to 1 10:45:11,946 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader232: Applying state for log index 1 data one 10:45:11,946 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader232: applyState called: one 10:45:11,946 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 538.6 μs 10:45:11,946 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 117.7 μs 10:45:11,946 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for more work 10:45:11,947 AM [follower233-writer-96] [DEBUG] EntryStoreCompleter - follower233: 1 completion(s) pending 10:45:11,947 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 2.325 ms 10:45:11,947 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 7.920 μs 10:45:11,947 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 191.2 μs 10:45:11,947 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting for more work 10:45:11,947 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryStoreCompleter - follower233: running 1 completion(s) 10:45:11,947 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower233: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 10:45:11,947 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryStoreCompleter - follower233: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@1739bb88} [WARN] [06/27/2025 10:45:11.956] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:45:12.045] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower234]: org.opendaylight.controller.cluster.common.actor.Monitor@4ec36e60 10:45:12,47 AM [test-pekko.actor.default-dispatcher-13] [INFO] RaftActor - follower234: Starting recovery with journal batch size 1000 10:45:12,47 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - follower234: started executor 10:45:12,47 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - follower234: started executor 10:45:12,48 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryJournalV1 - follower234: metadata journal open: replayFrom=1 applyTo=0 10:45:12,49 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryJournalV1 - follower234: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:45:12,49 AM [test-pekko.actor.default-dispatcher-13] [INFO] PekkoRaftStorage - follower234: journal open: applyTo=0 10:45:12,49 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@2b1a3724 started 10:45:12,49 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: waiting for more work 10:45:12,50 AM [test-pekko.actor.default-dispatcher-5] [INFO] PeerInfos - leader232: Peer address for peer follower234 set to pekko://test/user/follower234 10:45:12,50 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader232: Persist data index=2 term=1 command=two 10:45:12,50 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader232: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:45:12,50 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 10:45:12,50 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:45:12,50 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 103.7 ms 10:45:12,50 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:45:12,50 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 2 is present for follower follower233 10:45:12,50 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower233: AppendEntries{term=1, leaderId=leader232, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 10:45:12,50 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 10:45:12,50 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): Number of entries to be appended = 1 10:45:12,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 10:45:12,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): Append entry to log two 10:45:12,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower233: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:45:12,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): Log size is now 3 10:45:12,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): Commit index set to 1 10:45:12,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower233, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:45:12,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 1 (of expected -1) 10:45:12,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 2 10:45:12,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower233 (Follower): Setting last applied to 1 10:45:12,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from 0 to 1 10:45:12,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower233: Applying state for log index 1 data one 10:45:12,51 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower233: applyState called: one 10:45:12,51 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 103.7 ms 10:45:12,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower233: awaiting more completions to resolve 1 deferred callback(s) 10:45:12,51 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: 2, nextIndex: 3 10:45:12,51 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:45:12,52 AM [leader232-writer-97] [DEBUG] EntryStoreCompleter - leader232: 1 completion(s) pending 10:45:12,52 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 1.656 ms 10:45:12,52 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for more work 10:45:12,52 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] EntryStoreCompleter - leader232: running 1 completion(s) 10:45:12,52 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17637886538930802978/follower234/TermInfo.properties does not exist 10:45:12,52 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17637886538930802978/follower234/journal-v1-1.log 10:45:12,52 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17637886538930802978/follower234/metadata-v1-1.log 10:45:12,52 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower234: no eligible files found 10:45:12,52 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower234: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:45:12,52 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] ReplicatedLogImpl - leader232: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:45:12,53 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1 10:45:12,53 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActorBehavior - leader232 (Leader): Setting last applied to 2 10:45:12,53 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from 1 to 2 10:45:12,53 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - leader232: Applying state for log index 2 data two 10:45:12,53 AM [test-pekko.actor.default-dispatcher-13] [INFO] MockRaftActor - leader232: applyState called: two 10:45:12,53 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 998.1 μs 10:45:12,53 AM [follower233-writer-96] [DEBUG] EntryStoreCompleter - follower233: 1 completion(s) pending 10:45:12,53 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 2.206 ms 10:45:12,53 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 130.2 μs 10:45:12,53 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for more work 10:45:12,53 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 8.600 μs 10:45:12,53 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower233: running 1 completion(s) 10:45:12,53 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower233: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 10:45:12,53 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower233: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@4350e0db} 10:45:12,54 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 484.5 μs 10:45:12,54 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting for more work 10:45:12,56 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=0, votedFor=null 10:45:12,56 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower234: Local TermInfo store seeded with TermInfo{term=0} 10:45:12,56 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower234: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4143b906 10:45:12,56 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to -1 10:45:12,56 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower234: journal recovery completedin 248.4 μs with journalIndex=1 10:45:12,56 AM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower234 (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term 10:45:12,59 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=1, votedFor=null 10:45:12,60 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Last sync leader does not match current leader leader232, need to catch up to -1 10:45:12,60 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower234 updated: matchIndex: -1, nextIndex: 0 [WARN] [06/27/2025 10:45:12.060] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=false] 10:45:12,60 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: true, followerNextIndex: 0, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:45:12,60 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 0 is present for follower follower234 10:45:12,60 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower234: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=false}, JournaledLogEntry{index=1, term=1, command=one, pending=false}, JournaledLogEntry{index=2, term=1, command=two, pending=false}]} 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=false}, JournaledLogEntry{index=1, term=1, command=one, pending=false}, JournaledLogEntry{index=2, term=1, command=two, pending=false}]} 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Number of entries to be appended = 3 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Append entry to log zero 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=false} 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Append entry to log one 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=false} 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Append entry to log two 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=false} 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Log size is now 3 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Commit index set to 2 10:45:12,60 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: received 2 entries in 10.97 ms 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower234, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): -1, lastIndex(): 2 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 0 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to 0 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower234: Applying state for log index 0 data zero 10:45:12,60 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower234: applyState called: zero 10:45:12,61 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 1 10:45:12,61 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 0 to 1 10:45:12,61 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower234: Applying state for log index 1 data one 10:45:12,61 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower234: applyState called: one 10:45:12,61 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 2 10:45:12,61 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 1 to 2 10:45:12,61 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower234: Applying state for log index 2 data two 10:45:12,61 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower234: applyState called: two 10:45:12,61 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: awaiting more completions to resolve 3 deferred callback(s) 10:45:12,61 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower234 updated: matchIndex: 2, nextIndex: 3 10:45:12,61 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SnapshotManager - leader232: fakeSnapshot purging log to 1 for term 1 10:45:12,61 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: 1 10:45:12,68 AM [follower234-writer-98] [DEBUG] EntryStoreCompleter - follower234: 2 completion(s) pending 10:45:12,68 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: running 2 completion(s) 10:45:12,68 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: persisted 2 entries in 7.493 ms 10:45:12,68 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 10:45:12,68 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: received 2 entries in 9.391 μs 10:45:12,68 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@3f7900c7} 10:45:12,68 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 10:45:12,68 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@37893447} 10:45:12,68 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: awaiting more completions to resolve 1 deferred callback(s) 10:45:12,71 AM [follower234-writer-98] [DEBUG] EntryStoreCompleter - follower234: 1 completion(s) pending 10:45:12,71 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: running 1 completion(s) 10:45:12,71 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: persisted 2 entries in 3.040 ms 10:45:12,71 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 10:45:12,71 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: waiting for more work 10:45:12,71 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@6d85aa15} [WARN] [06/27/2025 10:45:12.071] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=true] 10:45:12,196 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower233 (Follower): Commit index set to 2 10:45:12,196 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:12,196 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower233 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): 1, lastIndex(): 2 10:45:12,196 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower233 (Follower): Setting last applied to 2 10:45:12,196 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from 1 to 2 10:45:12,196 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower233: Applying state for log index 2 data two 10:45:12,196 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower233: applyState called: two 10:45:12,196 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SnapshotManager - follower233: fakeSnapshot purging log to 1 for term 1 10:45:12,196 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:12,196 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SnapshotManager - follower234: fakeSnapshot purging log to 1 for term 1 10:45:12,196 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 142.5 ms 10:45:12,196 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 166.6 μs 10:45:12,196 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting for more work 10:45:12,263 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRaftStorage - follower234: terminating thread VirtualThread[#623,follower234-writer-98]/waiting 10:45:12,263 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: received 1 entries in 191.8 ms 10:45:12,263 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: persisted 1 entries in 39.03 μs 10:45:12,263 AM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@2b1a3724 stopped 10:45:12,263 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower234: journal closed 10:45:12,263 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower234: journal closed 10:45:12,263 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks 10:45:12,263 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks [WARN] [06/27/2025 10:45:12.265] [test-pekko.actor.default-dispatcher-13] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower234]: org.opendaylight.controller.cluster.common.actor.Monitor@277441bd 10:45:12,266 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - follower234: Starting recovery with journal batch size 1000 10:45:12,267 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower234: started executor 10:45:12,267 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower234: started executor 10:45:12,267 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower234: metadata journal open: replayFrom=1 applyTo=2 10:45:12,268 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower234: journal open: firstIndex=1 lastIndex=3 replayFrom=1 fileEntries=0 10:45:12,268 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower234: journal open: applyTo=2 10:45:12,269 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@c5c467f started 10:45:12,269 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: waiting for more work 10:45:12,269 AM [test-pekko.actor.default-dispatcher-6] [INFO] PeerInfos - leader232: Peer address for peer follower234 set to pekko://test/user/follower234 10:45:12,270 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=1, votedFor=null 10:45:12,270 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17637886538930802978/follower234/TermInfo.properties 10:45:12,270 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17637886538930802978/follower234/journal-v1-1.log 10:45:12,270 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest17637886538930802978/follower234/metadata-v1-1.log 10:45:12,270 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftStorage - follower234: no eligible files found 10:45:12,270 AM [test-pekko.actor.default-dispatcher-13] [INFO] PekkoRecovery - follower234: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:45:12,270 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PekkoRecovery - follower234: restoring local TermInfo{term=1} 10:45:12,270 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=1, votedFor=null 10:45:12,271 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] RaftActor - follower234: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@3089a9ca 10:45:12,271 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to -1 10:45:12,271 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] JournalRecovery - follower234: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 10:45:12,272 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] JournalRecovery - follower234: recovered journal DefaultLogEntry[index=1, term=1, command=one] 10:45:12,272 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] JournalRecovery - follower234: recovered journal DefaultLogEntry[index=2, term=1, command=two] 10:45:12,272 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] JournalRecovery - follower234: journal recovery completedin 1.783 ms with journalIndex=1 10:45:12,315 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:12,316 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower234 (Follower): Commit index set to 2 10:45:12,316 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Last sync leader does not match current leader leader232, need to catch up to 2 10:45:12,316 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower234 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): -1, lastIndex(): 2 10:45:12,316 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 0 10:45:12,316 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to 0 10:45:12,316 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower234: Applying state for log index 0 data zero 10:45:12,316 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower234: applyState called: zero 10:45:12,316 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 1 10:45:12,316 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 0 to 1 10:45:12,316 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower234: Applying state for log index 1 data one 10:45:12,316 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower234: applyState called: one 10:45:12,316 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 2 10:45:12,316 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 1 to 2 10:45:12,316 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower234: Applying state for log index 2 data two 10:45:12,316 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - follower234: applyState called: two 10:45:12,316 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: received 1 entries in 47.47 ms 10:45:12,316 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: persisted 1 entries in 180.1 μs 10:45:12,316 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: waiting for more work 10:45:12,316 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SnapshotManager - follower234: fakeSnapshot purging log to 1 for term 1 [WARN] [06/27/2025 10:45:12.317] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=false] 10:45:12,436 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:12,436 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) [WARN] [06/27/2025 10:45:12.436] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=true] 10:45:12,555 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:12,555 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:12,676 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:12,676 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:12,796 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:12,796 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:12,916 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:12,916 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:13,35 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:13,35 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:13,155 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:13,155 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:13,275 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:13,275 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:13,396 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:13,396 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:13,516 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:13,516 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:13,636 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:13,636 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:13,756 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:13,756 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:13,876 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:13,876 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:13,996 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:13,996 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:14,116 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:14,116 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:14,235 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:14,235 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:14,355 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:14,355 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:14,476 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:14,476 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:14,596 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:14,596 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:14,716 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:14,717 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:14,835 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:14,835 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:14,955 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:14,955 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:15,76 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:15,76 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:15,196 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:15,196 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:15,316 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:15,316 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:15,436 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:15,436 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:15,556 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:15,556 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:15,675 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:15,675 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:15,795 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:15,795 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:15,915 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:15,915 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:16,36 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:16,36 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:16,155 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:16,156 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:16,276 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:16,276 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:16,396 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:16,396 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:16,517 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:16,517 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:16,636 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:16,636 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:16,756 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:16,756 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:16,875 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:16,875 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:16,996 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:16,996 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:17,116 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:17,116 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:17,226 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 10:45:17,226 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 10:45:17,300 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower233-collector235#1429271746] 10:45:17,304 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower233] 10:45:17,304 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRaftStorage - follower233: terminating thread VirtualThread[#619,follower233-writer-96]/waiting 10:45:17,304 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 5.108 s 10:45:17,305 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 48.43 μs 10:45:17,305 AM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@525edc9c stopped 10:45:17,305 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower233: journal closed 10:45:17,305 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower233: journal closed 10:45:17,305 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower233: stopped executor with 0 remaining tasks 10:45:17,305 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower233: stopped executor with 0 remaining tasks 10:45:17,306 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader232-collector236#1646869310] 10:45:17,306 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader232] 10:45:17,306 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRaftStorage - leader232: terminating thread VirtualThread[#620,leader232-writer-97]/waiting 10:45:17,306 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 5.253 s 10:45:17,306 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 32.09 μs 10:45:17,306 AM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@712a5e16 stopped 10:45:17,307 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader232: journal closed 10:45:17,307 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - leader232: journal closed 10:45:17,307 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader232: stopped executor with 0 remaining tasks 10:45:17,307 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader232: stopped executor with 0 remaining tasks 10:45:17,307 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower234-collector237#-749161213] 10:45:17,307 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower234] 10:45:17,308 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower234-collector238#531483858] 10:45:17,308 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower234] 10:45:17,308 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRaftStorage - follower234: terminating thread VirtualThread[#626,follower234-writer-99]/waiting 10:45:17,308 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: received 1 entries in 4.992 s 10:45:17,308 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: persisted 1 entries in 31.90 μs 10:45:17,308 AM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@c5c467f stopped 10:45:17,309 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower234: journal closed 10:45:17,309 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower234: journal closed 10:45:17,309 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks 10:45:17,309 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks [WARN] [06/27/2025 10:45:17.316] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower240]: org.opendaylight.controller.cluster.common.actor.Monitor@4e3dad65 10:45:17,316 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower240: Starting recovery with journal batch size 1000 10:45:17,316 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower240: started executor 10:45:17,316 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower240: started executor 10:45:17,317 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower240: metadata journal open: replayFrom=1 applyTo=0 10:45:17,317 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower240: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:45:17,317 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower240: journal open: applyTo=0 10:45:17,317 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@7bc774cb started 10:45:17,317 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting for more work 10:45:17,319 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6429650639582296210/follower240/TermInfo.properties does not exist 10:45:17,320 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower240: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6429650639582296210/follower240/journal-v1-1.log 10:45:17,320 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower240: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6429650639582296210/follower240/metadata-v1-1.log 10:45:17,320 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower240: no eligible files found 10:45:17,320 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower240: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [06/27/2025 10:45:17.321] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader239]: org.opendaylight.controller.cluster.common.actor.Monitor@7e6569f3 10:45:17,322 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - leader239: Starting recovery with journal batch size 1000 10:45:17,322 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader239: started executor 10:45:17,322 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader239: started executor 10:45:17,323 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader239: metadata journal open: replayFrom=1 applyTo=0 10:45:17,323 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader239: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 10:45:17,323 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - leader239: journal open: applyTo=0 10:45:17,323 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@15c6aa72 started 10:45:17,323 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for more work 10:45:17,324 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6429650639582296210/leader239/TermInfo.properties does not exist 10:45:17,324 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6429650639582296210/leader239/journal-v1-1.log 10:45:17,324 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6429650639582296210/leader239/metadata-v1-1.log 10:45:17,324 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader239: no eligible files found 10:45:17,324 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader239: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:45:17,325 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=0, votedFor=null 10:45:17,325 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower240: Local TermInfo store seeded with TermInfo{term=0} 10:45:17,325 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower240: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@23897111 10:45:17,325 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from -1 to -1 10:45:17,326 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower240: journal recovery completedin 696.6 μs with journalIndex=1 10:45:17,330 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=0, votedFor=null 10:45:17,330 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader239: Local TermInfo store seeded with TermInfo{term=0} 10:45:17,330 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader239: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@6e93c132 10:45:17,330 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to -1 10:45:17,330 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader239: journal recovery completedin 207.9 μs with journalIndex=1 10:45:17,775 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 10:45:17,775 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader239 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.179:17355, Removed) 10:45:17,775 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader239 (Follower): Received ElectionTimeout - switching to Candidate 10:45:17,775 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader239 (Candidate): Election: Candidate has following voting peers: [follower241, follower240] 10:45:17,781 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=1, votedFor=leader239 10:45:17,781 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - leader239 (Candidate): Starting new election term 1 10:45:17,781 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} to peer follower241 [WARN] [06/27/2025 10:45:17.781] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} 10:45:17,782 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} to peer follower240 10:45:17,782 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader239 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 10:45:17,782 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower240 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 10:45:17,782 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower240 (Follower): Cluster state: [] 10:45:17,782 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower240 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 10:45:17,782 AM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower240 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 10:45:17,789 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=1, votedFor=null 10:45:17,789 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower240 (Follower): In requestVote: RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 10:45:17,792 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=1, votedFor=leader239 10:45:17,792 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower240 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 10:45:17,792 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader239 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 10:45:17,792 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader239 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 10:45:17,792 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): Election: Leader has following peers: [follower241, follower240] 10:45:17,792 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:45:17,792 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:45:17,793 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Last sync leader does not match current leader leader239, need to catch up to -1 [WARN] [06/27/2025 10:45:17.792] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:45:17.793] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower240] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower240, initialSyncDone=false] 10:45:17,793 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActorBehavior - leader239 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 10:45:17,793 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: -1, nextIndex: 0 10:45:17,793 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 10:45:17,834 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader239: Persist data index=0 term=1 command=zero 10:45:17,834 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:45:17,834 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 10:45:17,834 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 511.2 ms 10:45:17,834 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:45:17,834 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:45:17,835 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 0 is present for follower follower240 10:45:17,835 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Sending AppendEntries to follower follower240: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 10:45:17,835 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower240 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 10:45:17,835 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower240 (Follower): Number of entries to be appended = 1 10:45:17,835 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower240 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 10:45:17,835 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower240 (Follower): Append entry to log zero 10:45:17,835 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} [WARN] [06/27/2025 10:45:17.835] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:17,835 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower240 (Follower): Log size is now 1 10:45:17,835 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower240 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower240, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:45:17,835 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached -1 (of expected -1) 10:45:17,835 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 1 deferred callback(s) 10:45:17,835 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 entries in 517.6 ms 10:45:17,835 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 0, nextIndex: 1 10:45:17,835 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 10:45:17,839 AM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 10:45:17,839 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 4.603 ms 10:45:17,839 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for more work 10:45:17,840 AM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 1 completion(s) pending 10:45:17,840 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 1 entries in 5.117 ms 10:45:17,840 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting for more work 10:45:17,840 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower240: running 1 completion(s) 10:45:17,840 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 10:45:17,840 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@2f79e4e7} [WARN] [06/27/2025 10:45:17.840] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower240] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower240, initialSyncDone=true] 10:45:17,841 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 10:45:17,841 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 10:45:17,841 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 10:45:17,841 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader239 (Leader): Setting last applied to 0 10:45:17,841 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to 0 10:45:17,841 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader239: Applying state for log index 0 data zero 10:45:17,841 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader239: applyState called: zero 10:45:17,841 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 1.818 ms 10:45:17,841 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 149.8 μs 10:45:17,841 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for more work [WARN] [06/27/2025 10:45:17.905] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:17,935 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader239: Persist data index=1 term=1 command=one 10:45:17,935 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:45:17,935 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 10:45:17,935 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:45:17,935 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:45:17,935 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 1 is present for follower follower240 10:45:17,935 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (Leader): Sending AppendEntries to follower follower240: AppendEntries{term=1, leaderId=leader239, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 10:45:17,936 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader239, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} [WARN] [06/27/2025 10:45:17.936] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:17,936 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Number of entries to be appended = 1 10:45:17,936 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 94.49 ms 10:45:17,936 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 10:45:17,936 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Append entry to log one 10:45:17,936 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:45:17,936 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Log size is now 2 10:45:17,936 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Commit index set to 0 10:45:17,936 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower240, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:45:17,936 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 0 (of expected -1) 10:45:17,936 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 10:45:17,936 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 0 10:45:17,936 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from -1 to 0 10:45:17,936 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower240: Applying state for log index 0 data zero 10:45:17,936 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower240: applyState called: zero 10:45:17,936 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 1, nextIndex: 2 10:45:17,936 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 1 deferred callback(s) 10:45:17,936 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 10:45:17,936 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 2 entries in 95.91 ms 10:45:17,939 AM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 10:45:17,939 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 3.368 ms 10:45:17,939 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for more work 10:45:17,939 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 10:45:17,939 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 10:45:17,939 AM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 1 completion(s) pending 10:45:17,939 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 10:45:17,939 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 2 entries in 3.083 ms 10:45:17,939 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting for more work 10:45:17,939 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader239 (Leader): Setting last applied to 1 10:45:17,939 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 0 to 1 10:45:17,939 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader239: Applying state for log index 1 data one 10:45:17,939 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: running 1 completion(s) 10:45:17,939 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader239: applyState called: one 10:45:17,939 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 10:45:17,939 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@4dac7320} 10:45:17,939 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 422.1 μs 10:45:17,940 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 92.19 μs 10:45:17,940 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for more work [WARN] [06/27/2025 10:45:18.025] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:18,37 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader239: Persist data index=2 term=1 command=two 10:45:18,37 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:45:18,37 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 10:45:18,37 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:45:18,37 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 10:45:18,37 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 97.65 ms 10:45:18,37 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 2 is present for follower follower240 [WARN] [06/27/2025 10:45:18.037] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:18,38 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Sending AppendEntries to follower follower240: AppendEntries{term=1, leaderId=leader239, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 10:45:18,38 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader239: Persist data index=3 term=1 command=three 10:45:18,38 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 10:45:18,38 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true 10:45:18,38 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:45:18,38 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:45:18,38 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 2 is present for follower follower240 [WARN] [06/27/2025 10:45:18.038] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:18,39 AM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 10:45:18,39 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 2.147 ms 10:45:18,40 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 4.730 μs 10:45:18,40 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 10:45:18,40 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 10:45:18,41 AM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 10:45:18,41 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 1.167 ms 10:45:18,41 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for more work 10:45:18,41 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 10:45:18,41 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true} 10:45:18,41 AM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - leader239: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=2, mandatoryTrim=false] 10:45:18,41 AM [test-pekko.actor.default-dispatcher-6] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException [ERROR] [06/27/2025 10:45:18.041] [test-pekko.actor.internal-dispatcher-4] [pekko://test/user/leader239] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:305) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:305) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 10:45:18,42 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - leader239: terminating thread VirtualThread[#628,leader239-writer-101]/waiting 10:45:18,42 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 1.502 ms 10:45:18,42 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 29.09 μs 10:45:18,42 AM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@15c6aa72 stopped 10:45:18,42 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader239: journal closed 10:45:18,42 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader239: journal closed 10:45:18,42 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks 10:45:18,42 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks 10:45:18,44 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader239: Starting recovery with journal batch size 1000 10:45:18,44 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader239: started executor 10:45:18,44 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader239: started executor 10:45:18,44 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader239: metadata journal open: replayFrom=1 applyTo=1 10:45:18,45 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader239: journal open: firstIndex=1 lastIndex=4 replayFrom=1 fileEntries=0 10:45:18,45 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader239: journal open: applyTo=1 [WARN] [06/27/2025 10:45:18.045] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader239]: org.opendaylight.controller.cluster.common.actor.Monitor@511ba7d4 10:45:18,46 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@72bf7aa7 started 10:45:18,46 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting for more work 10:45:18,47 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=1, votedFor=leader239 10:45:18,47 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6429650639582296210/leader239/TermInfo.properties 10:45:18,47 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6429650639582296210/leader239/journal-v1-1.log 10:45:18,47 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest6429650639582296210/leader239/metadata-v1-1.log 10:45:18,47 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader239: no eligible files found 10:45:18,49 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader239: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 10:45:18,49 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - leader239: restoring local TermInfo{term=1, votedFor=leader239} 10:45:18,49 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=1, votedFor=leader239 10:45:18,49 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader239: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@67d8b74 10:45:18,49 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to -1 10:45:18,49 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 10:45:18,50 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=1, term=1, command=one] 10:45:18,50 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=2, term=1, command=two] 10:45:18,50 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=3, term=1, command=three] 10:45:18,50 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader239: journal recovery completedin 1.168 ms with journalIndex=1 10:45:18,555 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader239 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.179:17355, Removed) 10:45:18,556 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader239 (Follower): Received ElectionTimeout - switching to Candidate 10:45:18,556 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader239 (Candidate): Election: Candidate has following voting peers: [follower241, follower240] 10:45:18,560 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=2, votedFor=leader239 10:45:18,560 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - leader239 (Candidate): Starting new election term 2 10:45:18,560 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} to peer follower241 10:45:18,560 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} to peer follower240 10:45:18,560 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader239 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 10:45:18,560 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. [WARN] [06/27/2025 10:45:18.560] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} 10:45:18,560 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): Cluster state: [] 10:45:18,560 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} with higher term appears reachable, updating term. 10:45:18,560 AM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - follower240 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1}" message is greater than follower's term 1 - updating term 10:45:18,563 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=2, votedFor=null 10:45:18,563 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): In requestVote: RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} - currentTerm: 2, votedFor: null, lastIndex: 1, lastTerm: 1 10:45:18,565 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=2, votedFor=leader239 10:45:18,565 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 10:45:18,565 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader239 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 10:45:18,565 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader239 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 10:45:18,565 AM [test-pekko.actor.default-dispatcher-6] [INFO] Candidate - leader239 (Candidate): LastApplied index -1 is behind last index 3 - switching to PreLeader 10:45:18,565 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Election: Leader has following peers: [follower241, follower240] 10:45:18,565 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:45:18,565 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 10:45:18,565 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader239 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 2 [WARN] [06/27/2025 10:45:18.565] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:18,566 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader239: Persist data index=4 term=2 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e 10:45:18,566 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e, pending=true} 10:45:18,566 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 entries in 520.1 ms 10:45:18,566 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Replicate message: identifier: null, logIndex: 4, isSendImmediate: true 10:45:18,566 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 10:45:18,566 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 [WARN] [06/27/2025 10:45:18.566] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:18,568 AM [leader239-writer-102] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 10:45:18,568 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 1.978 ms 10:45:18,568 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting for more work 10:45:18,568 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 10:45:18,568 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e, pending=true} 10:45:18,591 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader239: Persist data index=5 term=2 command=four 10:45:18,591 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=5, term=2, command=four, pending=true} 10:45:18,591 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 5, isSendImmediate: true 10:45:18,591 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 entries in 23.09 ms 10:45:18,591 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 10:45:18,591 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 10:45:18,591 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging -1 entries behind leader leader239 and reached 0 (of expected -1) 10:45:18,591 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 1, nextIndex: 2 [WARN] [06/27/2025 10:45:18.591] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:18,591 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 10:45:18,591 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 10:45:18,591 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 5, leaderSnapShotIndex: -1 10:45:18,591 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): sendAppendEntries: 2 is present for follower follower240 10:45:18,592 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Sending AppendEntries to follower follower240: AppendEntries{term=2, leaderId=leader239, prevLogIndex=1, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e, pending=false}, JournaledLogEntry{index=5, term=2, command=four, pending=true}]} 10:45:18,592 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader239, prevLogIndex=1, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e, pending=false}, JournaledLogEntry{index=5, term=2, command=four, pending=true}]} 10:45:18,592 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Number of entries to be appended = 4 10:45:18,592 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 10:45:18,592 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Append entry to log two 10:45:18,592 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=false} 10:45:18,592 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 entries in 652.8 ms 10:45:18,593 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Append entry to log three 10:45:18,593 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=false} 10:45:18,593 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Append entry to log org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e 10:45:18,593 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e, pending=false} 10:45:18,593 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Append entry to log four 10:45:18,593 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=5, term=2, command=four, pending=true} 10:45:18,593 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Log size is now 6 10:45:18,593 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower240, logLastIndex=5, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 10:45:18,593 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging -1 entries behind leader leader239 and reached 0 (of expected -1) 10:45:18,593 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 4 deferred callback(s) 10:45:18,593 AM [leader239-writer-102] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 5, nextIndex: 6 10:45:18,593 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 2.089 ms 10:45:18,593 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting for more work 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (PreLeader): Applying to log - commitIndex: 4, lastAppliedIndex: -1 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 0 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to 0 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader239: Applying state for log index 0 data zero 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader239: applyState called: zero 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 1 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 0 to 1 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader239: Applying state for log index 1 data one 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader239: applyState called: one 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 2 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 1 to 2 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader239: Applying state for log index 2 data two 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader239: applyState called: two 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 3 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 2 to 3 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader239: Applying state for log index 3 data three 10:45:18,593 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader239: applyState called: three 10:45:18,594 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 4 10:45:18,594 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 3 to 4 10:45:18,594 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader239: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e 10:45:18,594 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 entries in 697.2 μs 10:45:18,594 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 6, leaderLastIndex: 5, leaderSnapShotIndex: -1 10:45:18,594 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 10:45:18,594 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=5, term=2, command=four, pending=true} 10:45:18,594 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 157.5 μs 10:45:18,594 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting for more work 10:45:18,594 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (PreLeader): Applying to log - commitIndex: 5, lastAppliedIndex: 4 10:45:18,594 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 5 10:45:18,594 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 4 to 5 10:45:18,594 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader239: Applying state for log index 5 data four 10:45:18,594 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader239: applyState called: four 10:45:18,594 AM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 1 completion(s) pending 10:45:18,594 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 1 entries in 2.006 ms 10:45:18,594 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 3 entries in 8.630 μs 10:45:18,594 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 entries in 218.3 μs 10:45:18,594 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: running 1 completion(s) 10:45:18,594 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PreLeader - leader239 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}] - lastApplied: 5, lastIndex: 5 10:45:18,594 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 10:45:18,594 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@584e65e0} 10:45:18,594 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 3 deferred callback(s) 10:45:18,594 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 136.0 μs 10:45:18,594 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting for more work 10:45:18,594 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Election: Leader has following peers: [follower241, follower240] 10:45:18,594 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 [WARN] [06/27/2025 10:45:18.595] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:18,595 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 6, leaderLastIndex: 5, leaderSnapShotIndex: -1 10:45:18,595 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader239 (PreLeader) :- Switching from behavior PreLeader to Leader, election term: 2 10:45:18,598 AM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 3 completion(s) pending 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: running 3 completion(s) 10:45:18,598 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 3 entries in 3.981 ms 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=false} 10:45:18,598 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting for more work 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@623897d9} 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e, pending=false} 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@cde98b} 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=5, term=2, command=four, pending=false} 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback DeferredPersistCallback{delegate=org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c0887c88@65c2b182} 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Commit index set to 4 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 4 (of expected -1) 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 4, context.getLastApplied(): 0, lastIndex(): 5 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 1 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 0 to 1 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower240: Applying state for log index 1 data one 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower240: applyState called: one 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 2 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 1 to 2 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower240: Applying state for log index 2 data two 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower240: applyState called: two 10:45:18,598 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 3 10:45:18,599 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 2 to 3 10:45:18,599 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower240: Applying state for log index 3 data three 10:45:18,599 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower240: applyState called: three 10:45:18,599 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 4 10:45:18,599 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 3 to 4 10:45:18,599 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower240: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@6815090e 10:45:18,599 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 entries in 534.6 μs 10:45:18,599 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Commit index set to 5 10:45:18,599 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 1 entries in 113.3 μs 10:45:18,599 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting for more work 10:45:18,599 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:45:18,599 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 5, context.getLastApplied(): 4, lastIndex(): 5 10:45:18,599 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 5 10:45:18,599 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 4 to 5 10:45:18,599 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower240: Applying state for log index 5 data four 10:45:18,599 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower240: applyState called: four 10:45:18,599 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 entries in 403.1 μs 10:45:18,599 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 1 entries in 90.01 μs 10:45:18,599 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting for more work [WARN] [06/27/2025 10:45:18.706] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:18,706 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:45:18,826 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:18.826] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:45:18.946] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:18,946 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:19.065] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:19,65 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:45:19,185 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:19.186] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:45:19.306] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:19,306 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:45:19,425 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:19.426] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:19,546 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:19.546] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:19,665 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:19.665] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:19,786 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:19.786] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:19,905 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:19.905] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:20,26 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:20.026] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:20,145 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:20.145] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:20,265 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:20.265] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:20,385 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:20.385] [test-pekko.actor.default-dispatcher-13] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:20,506 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:20.506] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:20,626 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:20.626] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:45:20.746] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:20,746 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:45:20,865 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:20.865] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:20,986 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:20.986] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:45:21.106] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:21,106 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:21.226] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:21,226 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:45:21,346 AM [test-pekko.actor.default-dispatcher-13] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:21.346] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:21,466 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:21.466] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:21,586 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:21.586] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:21,706 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:21.706] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:21,826 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:21.826] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:21,946 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:21.946] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:45:22.065] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:22,66 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:45:22,186 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:22.186] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:45:22.306] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:22,306 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:45:22,426 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:22.426] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:22,545 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:22.545] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:45:22.666] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:22,666 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:45:22,786 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:22.786] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:22,905 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:22.905] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:23,25 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:23.025] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:23,146 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:23.146] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:23,265 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:23.265] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 10:45:23.386] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:23,386 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 10:45:23.505] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 10:45:23,506 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 10:45:23,608 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower240-collector242#2120777131] 10:45:23,619 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower240] 10:45:23,620 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower240: terminating thread VirtualThread[#627,follower240-writer-100]/waiting 10:45:23,620 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 entries in 5.020 s 10:45:23,620 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 1 entries in 48.08 μs 10:45:23,620 AM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@7bc774cb stopped 10:45:23,620 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower240: journal closed 10:45:23,620 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower240: journal closed 10:45:23,620 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower240: stopped executor with 0 remaining tasks 10:45:23,620 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower240: stopped executor with 0 remaining tasks 10:45:23,621 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader239-collector243#-1356634110] 10:45:23,621 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader239] 10:45:23,621 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - leader239: terminating thread VirtualThread[#631,leader239-writer-102]/waiting 10:45:23,621 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 entries in 5.027 s 10:45:23,621 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 29.52 μs 10:45:23,621 AM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@72bf7aa7 stopped 10:45:23,622 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader239: journal closed 10:45:23,622 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader239: journal closed 10:45:23,622 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks 10:45:23,622 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks [INFO] [06/27/2025 10:45:23.624] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 10:45:23,625 AM [test-pekko.actor.default-dispatcher-6] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [WARN] [06/27/2025 10:45:23.625] [test-pekko.actor.default-dispatcher-6] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.171.179:17355) [INFO] [06/27/2025 10:45:23.626] [test-pekko.actor.internal-dispatcher-10] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.179:17355] - Exiting completed 10:45:23,626 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.179:17355] - Exiting completed 10:45:23,626 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.179:17355] - Shutting down... [INFO] [06/27/2025 10:45:23.626] [test-pekko.actor.internal-dispatcher-10] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.179:17355] - Shutting down... [INFO] [06/27/2025 10:45:23.626] [test-pekko.actor.internal-dispatcher-10] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.179:17355] - Successfully shut down 10:45:23,626 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.179:17355] - Successfully shut down [INFO] [06/27/2025 10:45:23.628] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.171.179:17355/system/remoting-terminator] Shutting down remote daemon. [INFO] [06/27/2025 10:45:23.628] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.171.179:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports. 10:45:23,628 AM [test-pekko.actor.default-dispatcher-5] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 10:45:23,628 AM [test-pekko.actor.default-dispatcher-5] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. 10:45:23,631 AM [test-pekko.actor.default-dispatcher-5] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.