[DEBUG] [06/27/2025 14:31:09.921] [main] [EventStream(pekko://test)] logger log1-TestEventListener started 02:31:09,921 PM [test-pekko.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [06/27/2025 14:31:09.921] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started [DEBUG] [06/27/2025 14:31:09.921] [main] [EventStream(pekko://test)] Default Loggers started [INFO] [06/27/2025 14:31:09.934] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.8:17355] with UID [-2868751214083651173] 02:31:09,934 PM [test-pekko.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.8:17355] with UID [-2868751214083651173] 02:31:09,935 PM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.8:17355] - Starting up, Pekko version [1.0.3] ... [INFO] [06/27/2025 14:31:09.935] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.8:17355] - Starting up, Pekko version [1.0.3] ... 02:31:09,939 PM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.8:17355] - Registered cluster JMX MBean [pekko:type=Cluster] 02:31:09,939 PM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.8:17355] - Started up successfully 02:31:09,940 PM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.8:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing [INFO] [06/27/2025 14:31:09.939] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.8:17355] - Registered cluster JMX MBean [pekko:type=Cluster] [INFO] [06/27/2025 14:31:09.939] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.8:17355] - Started up successfully [INFO] [06/27/2025 14:31:09.940] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.8:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing 02:31:09,941 PM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.8:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining [INFO] [06/27/2025 14:31:09.941] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.8:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining [WARN] [06/27/2025 14:31:09.955] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower223]: org.opendaylight.controller.cluster.common.actor.Monitor@7c720db2 [INFO] [pekkoDeadLetter][06/27/2025 14:31:09.955] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower223] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 02:31:09,955 PM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower223] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 02:31:09,957 PM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower223: Starting recovery with journal batch size 1000 02:31:09,958 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower223: started executor 02:31:09,958 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower223: started executor 02:31:09,959 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower223: metadata journal open: replayFrom=1 applyTo=0 02:31:09,960 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower223: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 02:31:09,961 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower223: journal open: applyTo=0 02:31:09,961 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@735ecfc4 started 02:31:09,961 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for more work [WARN] [06/27/2025 14:31:09.962] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader222]: org.opendaylight.controller.cluster.common.actor.Monitor@3d06b89a 02:31:09,962 PM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][06/27/2025 14:31:09.962] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 02:31:09,963 PM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - leader222: Starting recovery with journal batch size 1000 02:31:09,963 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader222: started executor 02:31:09,963 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader222: started executor 02:31:09,963 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/follower223/TermInfo.properties does not exist 02:31:09,963 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower223: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/follower223/journal-v1-1.log 02:31:09,963 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower223: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/follower223/metadata-v1-1.log 02:31:09,963 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower223: no eligible files found 02:31:09,963 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower223: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 02:31:09,964 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader222: metadata journal open: replayFrom=1 applyTo=0 02:31:09,964 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader222: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 02:31:09,964 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - leader222: journal open: applyTo=0 02:31:09,965 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@3290631e started 02:31:09,965 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for more work 02:31:09,966 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties does not exist 02:31:09,966 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:09,966 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:09,966 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:09,966 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader222: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 02:31:09,969 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=0, votedFor=null 02:31:09,969 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower223: Local TermInfo store seeded with TermInfo{term=0} 02:31:09,969 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower223: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@2d7ef596 02:31:09,969 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from -1 to -1 02:31:09,969 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - follower223: journal recovery completedin 344.2 μs with journalIndex=1 02:31:09,971 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=0, votedFor=null 02:31:09,971 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader222: Local TermInfo store seeded with TermInfo{term=0} 02:31:09,971 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader222: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@73c472ff 02:31:09,971 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to -1 02:31:09,971 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - leader222: journal recovery completedin 367.4 μs with journalIndex=1 02:31:10,437 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 02:31:10,437 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader222 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.8:17355, Removed) 02:31:10,437 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader222 (Follower): Received ElectionTimeout - switching to Candidate 02:31:10,437 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader222 (Candidate): Election: Candidate has following voting peers: [follower223, follower224] 02:31:10,440 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222 02:31:10,440 PM [test-pekko.actor.default-dispatcher-6] [INFO] Candidate - leader222 (Candidate): Starting new election term 1 02:31:10,440 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} to peer follower223 02:31:10,441 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} to peer follower224 02:31:10,441 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower223 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 02:31:10,441 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader222 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 02:31:10,441 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower223 (Follower): Cluster state: [] 02:31:10,441 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower223 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 02:31:10,441 PM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - follower223 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term [WARN] [06/27/2025 14:31:10.441] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} [INFO] [pekkoDeadLetter][06/27/2025 14:31:10.441] [test-pekko.actor.default-dispatcher-12] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 02:31:10,441 PM [test-pekko.actor.default-dispatcher-6] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 02:31:10,443 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=1, votedFor=null 02:31:10,443 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower223 (Follower): In requestVote: RequestVote{term=1, candidateId=leader222, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 02:31:10,446 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=1, votedFor=leader222 02:31:10,446 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower223 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 02:31:10,446 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader222 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 02:31:10,446 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader222 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 02:31:10,446 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader222 (Leader): Election: Leader has following peers: [follower223, follower224] 02:31:10,446 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 02:31:10,446 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 02:31:10,446 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader222 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 02:31:10,446 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Last sync leader does not match current leader leader222, need to catch up to -1 [WARN] [06/27/2025 14:31:10.446] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:10,446 PM [test-pekko.actor.default-dispatcher-5] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 02:31:10,446 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: -1, nextIndex: 0 02:31:10,447 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [INFO] [pekkoDeadLetter][06/27/2025 14:31:10.446] [test-pekko.actor.default-dispatcher-16] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [06/27/2025 14:31:10.447] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower223] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower223, initialSyncDone=false] 02:31:10,447 PM [test-pekko.actor.default-dispatcher-16] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][06/27/2025 14:31:10.447] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower223] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 02:31:10,475 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader222: Persist data index=0 term=1 command=zero 02:31:10,475 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 02:31:10,475 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 02:31:10,476 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 02:31:10,476 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 0 is present for follower follower223 02:31:10,475 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 510.9 ms 02:31:10,476 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 02:31:10,476 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 02:31:10,476 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 02:31:10,476 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 02:31:10,476 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 02:31:10,476 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Append entry to log zero 02:31:10,476 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 02:31:10,476 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Log size is now 1 02:31:10,476 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 02:31:10,476 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached -1 (of expected -1) 02:31:10,476 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) [WARN] [06/27/2025 14:31:10.476] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:10,476 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 515.4 ms 02:31:10,476 PM [test-pekko.actor.default-dispatcher-6] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][06/27/2025 14:31:10.476] [test-pekko.actor.default-dispatcher-6] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 02:31:10,477 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 0, nextIndex: 1 02:31:10,477 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 02:31:10,480 PM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 02:31:10,480 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 4.723 ms 02:31:10,480 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for more work 02:31:10,480 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 02:31:10,480 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 02:31:10,480 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 02:31:10,480 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 0 02:31:10,480 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to 0 02:31:10,481 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader222: Applying state for log index 0 data zero 02:31:10,481 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader222: applyState called: zero 02:31:10,481 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 719.9 μs 02:31:10,481 PM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 02:31:10,481 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 4.965 ms 02:31:10,481 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for more work 02:31:10,481 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 02:31:10,481 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 157.3 μs 02:31:10,481 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for more work 02:31:10,481 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 02:31:10,481 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@1995b44f [WARN] [06/27/2025 14:31:10.482] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower223] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower223, initialSyncDone=true] [INFO] [pekkoDeadLetter][06/27/2025 14:31:10.482] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower223] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 02:31:10,482 PM [test-pekko.actor.default-dispatcher-15] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower223] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [06/27/2025 14:31:10.558] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [INFO] [pekkoDeadLetter][06/27/2025 14:31:10.558] [test-pekko.actor.default-dispatcher-17] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 02:31:10,558 PM [test-pekko.actor.default-dispatcher-17] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 02:31:10,576 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader222: Persist data index=1 term=1 command=one 02:31:10,576 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 02:31:10,576 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 02:31:10,576 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 02:31:10,577 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 1 is present for follower follower223 02:31:10,577 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 02:31:10,577 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 95.13 ms 02:31:10,577 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 02:31:10,577 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 02:31:10,577 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 02:31:10,577 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 02:31:10,577 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Append entry to log one 02:31:10,577 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 02:31:10,577 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 95.72 ms 02:31:10,578 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Log size is now 2 02:31:10,578 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): Commit index set to 0 [WARN] [06/27/2025 14:31:10.578] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:10,578 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} [INFO] [pekkoDeadLetter][06/27/2025 14:31:10.578] [test-pekko.actor.default-dispatcher-17] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 02:31:10,578 PM [test-pekko.actor.default-dispatcher-17] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 02:31:10,578 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 1, nextIndex: 2 02:31:10,578 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 02:31:10,578 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 0 (of expected -1) 02:31:10,578 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 02:31:10,578 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 0 02:31:10,578 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from -1 to 0 02:31:10,578 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower223: Applying state for log index 0 data zero 02:31:10,578 PM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower223: applyState called: zero 02:31:10,579 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 02:31:10,579 PM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 02:31:10,579 PM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 02:31:10,579 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 2.053 ms 02:31:10,579 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 02:31:10,579 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 2.560 ms 02:31:10,579 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 8.281 μs 02:31:10,579 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for more work 02:31:10,579 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 02:31:10,579 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 02:31:10,579 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 1 02:31:10,579 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 0 to 1 02:31:10,579 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader222: Applying state for log index 1 data one 02:31:10,579 PM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - leader222: applyState called: one 02:31:10,579 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 155.0 μs 02:31:10,579 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for more work 02:31:10,580 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 398.8 μs 02:31:10,580 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 02:31:10,580 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 02:31:10,580 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@58a8be74 02:31:10,580 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 130.9 μs 02:31:10,580 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for more work 02:31:10,677 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader222: Persist data index=2 term=1 command=two 02:31:10,677 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 02:31:10,677 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 02:31:10,678 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 02:31:10,678 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 2 is present for follower follower223 02:31:10,678 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 98.56 ms 02:31:10,678 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 02:31:10,679 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 02:31:10,679 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 2 is present for follower follower223 02:31:10,679 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader222: Persist data index=3 term=1 command=three 02:31:10,679 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 02:31:10,679 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 02:31:10,679 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true 02:31:10,679 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 02:31:10,679 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 02:31:10,679 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1 02:31:10,679 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Append entry to log two 02:31:10,679 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 2 is present for follower follower223 02:31:10,679 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 02:31:10,679 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 [WARN] [06/27/2025 14:31:10.679] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 14:31:10.679] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:10,679 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Log size is now 3 02:31:10,679 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Commit index set to 1 [WARN] [06/27/2025 14:31:10.679] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=1, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:10,679 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 02:31:10,679 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 99.64 ms 02:31:10,679 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 1 (of expected -1) 02:31:10,679 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 2 02:31:10,679 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 1 02:31:10,679 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 0 to 1 02:31:10,679 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower223: Applying state for log index 1 data one [INFO] [pekkoDeadLetter][06/27/2025 14:31:10.679] [test-pekko.actor.default-dispatcher-15] [pekko://test/] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 02:31:10,679 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower223: applyState called: one 02:31:10,679 PM [test-pekko.actor.default-dispatcher-15] [INFO] LocalActorRefProvider$$anon$2 - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntries] from TestActor[pekko://test/user/leader222] to Actor[pekko://test/] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 02:31:10,679 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 2, nextIndex: 3 02:31:10,679 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 3, leaderLastIndex: 3, leaderSnapShotIndex: -1 02:31:10,679 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): sendAppendEntries: 3 is present for follower follower223 02:31:10,679 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Sending AppendEntries to follower follower223: AppendEntries{term=1, leaderId=leader222, prevLogIndex=2, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=three, pending=true}]} 02:31:10,680 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 02:31:10,681 PM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 02:31:10,681 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 2.280 ms 02:31:10,681 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 7.710 μs 02:31:10,681 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 02:31:10,681 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 02:31:10,681 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1 02:31:10,681 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader222 (Leader): Setting last applied to 2 02:31:10,681 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 1 to 2 02:31:10,681 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Applying state for log index 2 data two 02:31:10,681 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader222: applyState called: two 02:31:10,682 PM [leader222-writer-91] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 02:31:10,682 PM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 02:31:10,682 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 02:31:10,682 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 1.239 ms 02:31:10,682 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 2.932 ms 02:31:10,682 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 02:31:10,682 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true} 02:31:10,682 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 02:31:10,682 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 5.400 μs 02:31:10,682 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 8.000 μs 02:31:10,682 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@690454c9 02:31:10,682 PM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader222: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=2, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 02:31:10,682 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 117.7 μs 02:31:10,682 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for more work 02:31:10,682 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader222, prevLogIndex=2, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=three, pending=false}]} 02:31:10,682 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 141.3 μs 02:31:10,682 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: waiting for more work 02:31:10,682 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 02:31:10,682 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 2, entries to be added from: 0 02:31:10,682 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Append entry to log three 02:31:10,682 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=false} 02:31:10,682 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): Log size is now 4 02:31:10,682 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower223, logLastIndex=3, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 02:31:10,682 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 1 (of expected -1) 02:31:10,682 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 200.6 μs 02:31:10,683 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 02:31:10,683 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRaftStorage - leader222: terminating thread VirtualThread[#605,leader222-writer-91]/waiting 02:31:10,683 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: received 1 entries in 585.6 μs 02:31:10,683 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 26.71 μs 02:31:10,683 PM [leader222-writer-91] [DEBUG] JournalWriteTask - leader222: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@3290631e stopped [ERROR] [06/27/2025 14:31:10.683] [test-pekko.actor.internal-dispatcher-4] [pekko://test/user/leader222] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:308) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 02:31:10,683 PM [test-pekko.actor.default-dispatcher-16] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:308) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 02:31:10,683 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader222: journal closed 02:31:10,684 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - leader222: journal closed 02:31:10,684 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks 02:31:10,684 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks 02:31:10,684 PM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 02:31:10,684 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 1.822 ms 02:31:10,684 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for more work 02:31:10,684 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 02:31:10,685 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=false} 02:31:10,685 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@28395ef2 [WARN] [06/27/2025 14:31:10.685] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader222]: org.opendaylight.controller.cluster.common.actor.Monitor@25c110e9 02:31:10,686 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - leader222: Starting recovery with journal batch size 1000 02:31:10,686 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader222: started executor 02:31:10,686 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader222: started executor 02:31:10,687 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader222: metadata journal open: replayFrom=1 applyTo=2 02:31:10,688 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader222: journal open: firstIndex=1 lastIndex=4 replayFrom=1 fileEntries=0 02:31:10,688 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - leader222: journal open: applyTo=2 02:31:10,688 PM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@64be86e3 started 02:31:10,688 PM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: waiting for more work 02:31:10,690 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222 02:31:10,690 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:10,690 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:10,690 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:10,690 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:10,690 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader222: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 02:31:10,690 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - leader222: restoring local TermInfo{term=1, votedFor=leader222} 02:31:10,690 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=1, votedFor=leader222 02:31:10,690 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader222: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@3887413b 02:31:10,690 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to -1 02:31:10,690 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 02:31:10,691 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=1, term=1, command=one] 02:31:10,691 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=2, term=1, command=two] 02:31:10,691 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader222: recovered journal DefaultLogEntry[index=3, term=1, command=three] 02:31:10,691 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader222: journal recovery completedin 1.426 ms with journalIndex=1 02:31:10,779 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:10,779 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:10,779 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:10,779 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:10,880 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:10,880 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:10,880 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:10,880 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:10,981 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:10,981 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:10,981 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:10,981 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:11,82 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:11,82 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:11,82 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:11,82 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:11,117 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader222 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.8:17355, Removed) 02:31:11,117 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader222 (Follower): Received ElectionTimeout - switching to Candidate 02:31:11,117 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader222 (Candidate): Election: Candidate has following voting peers: [follower223, follower224] 02:31:11,122 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader222: Set currentTerm=2, votedFor=leader222 02:31:11,122 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader222 (Candidate): Starting new election term 2 02:31:11,122 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} to peer follower223 02:31:11,123 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader222 (Candidate): Sending RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} to peer follower224 02:31:11,123 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader222 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 02:31:11,123 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower223 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 02:31:11,123 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower223 (Follower): Cluster state: [] 02:31:11,123 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower223 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} with higher term appears reachable, updating term. 02:31:11,123 PM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - follower223 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1}" message is greater than follower's term 1 - updating term [WARN] [06/27/2025 14:31:11.123] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} 02:31:11,125 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=2, votedFor=null 02:31:11,126 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower223 (Follower): In requestVote: RequestVote{term=2, candidateId=leader222, lastLogIndex=3, lastLogTerm=1} - currentTerm: 2, votedFor: null, lastIndex: 3, lastTerm: 1 02:31:11,128 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower223: Set currentTerm=2, votedFor=leader222 02:31:11,128 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower223 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 02:31:11,128 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader222 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 02:31:11,128 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader222 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 02:31:11,128 PM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader222 (Candidate): LastApplied index -1 is behind last index 3 - switching to PreLeader 02:31:11,129 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Election: Leader has following peers: [follower223, follower224] 02:31:11,129 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 02:31:11,129 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 02:31:11,129 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader222 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 2 02:31:11,129 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging -2 entries behind leader leader222 and reached 1 (of expected -1) [WARN] [06/27/2025 14:31:11.129] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:11,129 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader222: Persist data index=4 term=2 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7 02:31:11,129 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader222: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7, pending=true} 02:31:11,129 PM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: received 1 entries in 441.1 ms 02:31:11,130 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Replicate message: identifier: null, logIndex: 4, isSendImmediate: true 02:31:11,130 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 02:31:11,130 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 02:31:11,130 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 3, nextIndex: 4 02:31:11,130 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 02:31:11,130 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 [WARN] [06/27/2025 14:31:11.130] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:11,130 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 02:31:11,130 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 02:31:11,130 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 4, leaderLastIndex: 4, leaderSnapShotIndex: -1 02:31:11,130 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): sendAppendEntries: 4 is present for follower follower223 02:31:11,130 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging -2 entries behind leader leader222 and reached 1 (of expected -1) 02:31:11,130 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Sending AppendEntries to follower follower223: AppendEntries{term=2, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7, pending=true}]} 02:31:11,131 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 02:31:11,131 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader222, prevLogIndex=3, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7, pending=true}]} 02:31:11,131 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 02:31:11,131 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): Number of entries to be appended = 1 02:31:11,131 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 02:31:11,131 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): After cleanup, lastIndex: 3, entries to be added from: 0 02:31:11,131 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 02:31:11,131 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): Append entry to log org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7 02:31:11,131 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower223: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7, pending=true} 02:31:11,131 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): sendAppendEntries: 4 is present for follower follower223 02:31:11,131 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): Log size is now 5 02:31:11,131 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower223, logLastIndex=4, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 02:31:11,131 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging -2 entries behind leader leader222 and reached 1 (of expected -1) 02:31:11,131 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower223: awaiting more completions to resolve 1 deferred callback(s) 02:31:11,131 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower223 updated: matchIndex: 4, nextIndex: 5 02:31:11,131 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 02:31:11,131 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 02:31:11,131 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 02:31:11,131 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 02:31:11,131 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 446.5 ms 02:31:11,131 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader222 (PreLeader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 5, leaderLastIndex: 4, leaderSnapShotIndex: -1 02:31:11,132 PM [leader222-writer-92] [DEBUG] EntryStoreCompleter - leader222: 1 completion(s) pending 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader222: running 1 completion(s) 02:31:11,132 PM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 2.392 ms 02:31:11,132 PM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: waiting for more work 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader222: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7, pending=true} 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader222 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader222 (PreLeader): Applying to log - commitIndex: 4, lastAppliedIndex: -1 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 0 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from -1 to 0 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader222: Applying state for log index 0 data zero 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader222: applyState called: zero 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 1 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 0 to 1 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader222: Applying state for log index 1 data one 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader222: applyState called: one 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 2 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 1 to 2 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader222: Applying state for log index 2 data two 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader222: applyState called: two 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 3 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 2 to 3 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader222: Applying state for log index 3 data three 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader222: applyState called: three 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader222 (PreLeader): Setting last applied to 4 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader222: Moving last applied index from 3 to 4 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader222: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7 02:31:11,132 PM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: received 1 entries in 611.1 μs 02:31:11,132 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PreLeader - leader222 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}] - lastApplied: 4, lastIndex: 4 02:31:11,133 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader222 (Leader): Election: Leader has following peers: [follower223, follower224] 02:31:11,133 PM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 171.5 μs 02:31:11,133 PM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: waiting for more work 02:31:11,133 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower223: active: true, followerNextIndex: 5, leaderLastIndex: 4, leaderSnapShotIndex: -1 02:31:11,133 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader222 (Leader): Checking sendAppendEntries for follower follower224: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 02:31:11,133 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader222 (PreLeader) :- Switching from behavior PreLeader to Leader, election term: 2 [WARN] [06/27/2025 14:31:11.133] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:11,133 PM [follower223-writer-90] [DEBUG] EntryStoreCompleter - follower223: 1 completion(s) pending 02:31:11,133 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower223: running 1 completion(s) 02:31:11,133 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower223: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7, pending=false} 02:31:11,133 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 2.244 ms 02:31:11,133 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower223: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@57c8b91b 02:31:11,133 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for more work 02:31:11,133 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): Commit index set to 4 02:31:11,134 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 02:31:11,134 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower223 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 4, context.getLastApplied(): 1, lastIndex(): 4 02:31:11,134 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 2 02:31:11,134 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 1 to 2 02:31:11,134 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower223: Applying state for log index 2 data two 02:31:11,134 PM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower223: applyState called: two 02:31:11,134 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 3 02:31:11,134 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 2 to 3 02:31:11,134 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower223: Applying state for log index 3 data three 02:31:11,134 PM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower223: applyState called: three 02:31:11,134 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower223 (Follower): Setting last applied to 4 02:31:11,134 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower223: Moving last applied index from 3 to 4 02:31:11,134 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower223: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7 02:31:11,134 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 620.0 μs 02:31:11,134 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 166.8 μs 02:31:11,134 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: waiting for more work 02:31:11,182 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:11,183 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:11,183 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:11,183 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:11,248 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:11.248] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:11,283 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:11,283 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:11,283 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:11,283 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:11,368 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:11.368] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:11,384 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:11,384 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:11,384 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:11,384 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:11,485 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:11,485 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:11,485 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:11,485 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:11,487 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:11.487] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:11,585 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:11,585 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:11,585 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:11,585 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:11,608 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:11.608] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:11,686 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:11,686 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:11,686 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:11,686 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:11,727 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:11.727] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:11,787 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:11,787 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:11,787 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:11,787 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:11,848 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:11.848] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:11,888 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:11,888 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:11,888 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:11,888 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:11,968 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:11.968] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:11,988 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:11,988 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:11,988 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:11,988 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:12,88 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:12.088] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:12,89 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:12,89 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:12,89 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:12,89 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:12,190 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:12,190 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:12,190 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:12,190 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:12,207 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:12.207] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:12,291 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:12,291 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:12,291 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:12,291 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:12,328 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:12.328] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:12,391 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:12,391 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:12,391 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:12,391 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:12,448 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:12.448] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:12,492 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:12,492 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:12,492 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:12,492 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:12,568 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:12.568] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:12,594 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:12,594 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:12,594 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:12,594 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:12,687 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:12.687] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:12,695 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:12,695 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:12,695 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:12,695 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:12,795 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:12,795 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:12,795 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:12,795 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:12,807 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:12.807] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:12,896 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:12,896 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:12,896 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:12,896 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:12,928 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:12.928] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:12,997 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:12,997 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:12,997 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:12,997 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/27/2025 14:31:13.048] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:13,48 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 02:31:13,97 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:13,97 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:13,97 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:13,97 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/27/2025 14:31:13.167] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:13,168 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 02:31:13,198 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:13,198 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:13,198 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:13,198 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:13,288 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:13.288] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:13,298 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:13,298 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:13,298 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:13,298 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:13,399 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:13,399 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:13,399 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:13,399 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:13,407 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:13.408] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:13,500 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:13,500 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:13,500 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:13,500 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:13,528 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:13.528] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:13,600 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:13,600 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:13,600 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:13,601 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:13,648 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:13.648] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:13,701 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:13,701 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:13,701 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:13,701 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:13,768 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:13.768] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:13,802 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:13,802 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:13,802 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:13,802 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:13,887 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:13.887] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:13,903 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:13,903 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:13,903 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:13,903 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:14,4 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:14,4 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:14,4 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:14,4 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:14,8 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:14.008] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:14,104 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:14,104 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:14,104 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:14,104 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:14,128 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:14.128] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:14,205 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:14,205 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:14,205 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:14,205 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:14,248 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:14.248] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:14,306 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:14,306 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:14,306 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:14,306 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:14,367 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:14.367] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:14,407 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:14,407 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:14,407 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:14,407 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:14,477 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:14.477] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:14,507 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:14,507 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:14,507 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:14,508 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:14,598 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:14.598] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:14,608 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:14,608 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:14,608 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:14,608 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:14,709 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:14,709 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:14,709 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:14,709 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:14,717 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:14.718] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:14,809 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:14,809 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:14,809 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:14,809 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:14,837 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:14.837] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:14,910 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:14,910 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:14,910 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:14,910 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found [WARN] [06/27/2025 14:31:14.958] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:14,958 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) 02:31:15,11 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:15,11 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:15,11 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:15,11 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:15,78 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:15.078] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:15,112 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:15,112 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:15,112 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:15,112 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:15,197 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:15.197] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:15,212 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:15,212 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:15,212 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:15,212 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:15,308 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:15.308] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:15,313 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:15,313 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:15,313 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:15,313 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:15,414 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:15,414 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:15,414 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:15,414 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:15,427 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:15.427] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:15,514 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:15,514 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:15,514 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:15,514 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:15,537 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:15.538] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:15,615 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/TermInfo.properties 02:31:15,615 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/journal-v1-1.log 02:31:15,615 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest10962898922866855504/leader222/metadata-v1-1.log 02:31:15,615 PM [awaitility-thread] [DEBUG] RaftStorage - leader222: no eligible files found 02:31:15,657 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower223: Lagging 0 entries behind leader leader222 and reached 4 (of expected -1) [WARN] [06/27/2025 14:31:15.657] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader222]: AppendEntries{term=2, leaderId=leader222, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:15,716 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower223-collector225#-1189610398] 02:31:15,728 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower223] 02:31:15,728 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - follower223: terminating thread VirtualThread[#604,follower223-writer-90]/waiting 02:31:15,728 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: received 1 entries in 4.594 s 02:31:15,728 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: persisted 1 entries in 53.24 μs 02:31:15,728 PM [follower223-writer-90] [DEBUG] JournalWriteTask - follower223: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@735ecfc4 stopped 02:31:15,729 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower223: journal closed 02:31:15,729 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower223: journal closed 02:31:15,729 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower223: stopped executor with 0 remaining tasks 02:31:15,729 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower223: stopped executor with 0 remaining tasks 02:31:15,729 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader222-collector226#1934915158] 02:31:15,729 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader222] 02:31:15,729 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - leader222: terminating thread VirtualThread[#611,leader222-writer-92]/waiting 02:31:15,729 PM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: received 1 entries in 4.597 s 02:31:15,730 PM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: persisted 1 entries in 28.59 μs 02:31:15,730 PM [leader222-writer-92] [DEBUG] JournalWriteTask - leader222: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@64be86e3 stopped 02:31:15,730 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader222: journal closed 02:31:15,730 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - leader222: journal closed 02:31:15,730 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks 02:31:15,730 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader222: stopped executor with 0 remaining tasks 02:31:15,735 PM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower228: Starting recovery with journal batch size 1000 02:31:15,735 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower228: started executor 02:31:15,736 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower228: started executor 02:31:15,736 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower228: metadata journal open: replayFrom=1 applyTo=0 [WARN] [06/27/2025 14:31:15.736] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower228]: org.opendaylight.controller.cluster.common.actor.Monitor@2abaa4d6 02:31:15,737 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower228: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 02:31:15,737 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower228: journal open: applyTo=0 02:31:15,737 PM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@3caad615 started 02:31:15,737 PM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: waiting for more work 02:31:15,738 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/follower228/TermInfo.properties does not exist 02:31:15,738 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/follower228/journal-v1-1.log [WARN] [06/27/2025 14:31:15.738] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader227]: org.opendaylight.controller.cluster.common.actor.Monitor@6fc24817 02:31:15,738 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower228: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/follower228/metadata-v1-1.log 02:31:15,738 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower228: no eligible files found 02:31:15,738 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower228: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 02:31:15,739 PM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - leader227: Starting recovery with journal batch size 1000 02:31:15,739 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader227: started executor 02:31:15,739 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader227: started executor 02:31:15,739 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader227: metadata journal open: replayFrom=1 applyTo=0 02:31:15,740 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader227: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 02:31:15,740 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - leader227: journal open: applyTo=0 02:31:15,740 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@5433d5c4 started 02:31:15,740 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for more work 02:31:15,741 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties does not exist 02:31:15,741 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:15,741 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:15,741 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader227: no eligible files found 02:31:15,741 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader227: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 02:31:15,741 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=0, votedFor=null 02:31:15,741 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower228: Local TermInfo store seeded with TermInfo{term=0} 02:31:15,741 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower228: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4f60f944 02:31:15,741 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower228: Moving last applied index from -1 to -1 02:31:15,742 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower228: journal recovery completedin 523.3 μs with journalIndex=1 02:31:15,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=0, votedFor=null 02:31:15,745 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader227: Local TermInfo store seeded with TermInfo{term=0} 02:31:15,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader227: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@207fc7b7 02:31:15,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from -1 to -1 02:31:15,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader227: journal recovery completedin 258.6 μs with journalIndex=1 02:31:16,198 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 02:31:16,198 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader227 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.8:17355, Removed) 02:31:16,198 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader227 (Follower): Received ElectionTimeout - switching to Candidate 02:31:16,198 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader227 (Candidate): Election: Candidate has following voting peers: [follower229, follower228] 02:31:16,203 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=1, votedFor=leader227 02:31:16,203 PM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - leader227 (Candidate): Starting new election term 1 02:31:16,203 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} to peer follower229 02:31:16,203 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} to peer follower228 02:31:16,203 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower228 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 02:31:16,203 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower228 (Follower): Cluster state: [] [WARN] [06/27/2025 14:31:16.203] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} 02:31:16,203 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower228 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 02:31:16,203 PM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower228 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 02:31:16,204 PM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader227 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 02:31:16,207 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=1, votedFor=null 02:31:16,207 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower228 (Follower): In requestVote: RequestVote{term=1, candidateId=leader227, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 02:31:16,210 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=1, votedFor=leader227 02:31:16,210 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower228 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 02:31:16,210 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader227 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 02:31:16,210 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader227 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 02:31:16,210 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader227 (Leader): Election: Leader has following peers: [follower229, follower228] 02:31:16,210 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 02:31:16,210 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 02:31:16,210 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower228: Last sync leader does not match current leader leader227, need to catch up to -1 [WARN] [06/27/2025 14:31:16.210] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:16,210 PM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader227 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 [WARN] [06/27/2025 14:31:16.210] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower228] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower228, initialSyncDone=false] 02:31:16,211 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader227 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower228 updated: matchIndex: -1, nextIndex: 0 02:31:16,211 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 02:31:16,242 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader227: Persist data index=0 term=1 command=zero 02:31:16,242 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 02:31:16,242 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 02:31:16,243 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 02:31:16,243 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 02:31:16,243 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 0 is present for follower follower228 02:31:16,243 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader227 (Leader): Sending AppendEntries to follower follower228: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 02:31:16,243 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 02:31:16,243 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 503.1 ms 02:31:16,243 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): Number of entries to be appended = 1 02:31:16,243 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 02:31:16,243 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): Append entry to log zero 02:31:16,243 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower228: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 02:31:16,243 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): Log size is now 1 02:31:16,243 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower228 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower228, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 02:31:16,243 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower228: Lagging 0 entries behind leader leader227 and reached -1 (of expected -1) 02:31:16,244 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower228: awaiting more completions to resolve 1 deferred callback(s) 02:31:16,244 PM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 entries in 506.9 ms [WARN] [06/27/2025 14:31:16.244] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:16,244 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower228 updated: matchIndex: 0, nextIndex: 1 02:31:16,244 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 02:31:16,250 PM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 02:31:16,250 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 6.811 ms 02:31:16,250 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for more work 02:31:16,250 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 02:31:16,250 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 02:31:16,250 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader227 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 02:31:16,250 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader227 (Leader): Setting last applied to 0 02:31:16,250 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from -1 to 0 02:31:16,250 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader227: Applying state for log index 0 data zero 02:31:16,250 PM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - leader227: applyState called: zero 02:31:16,251 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 760.8 μs 02:31:16,251 PM [follower228-writer-93] [DEBUG] EntryStoreCompleter - follower228: 1 completion(s) pending 02:31:16,251 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower228: running 1 completion(s) 02:31:16,251 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 234.9 μs 02:31:16,251 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower228: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 02:31:16,251 PM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: persisted 1 entries in 7.321 ms 02:31:16,251 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for more work 02:31:16,251 PM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: waiting for more work 02:31:16,251 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower228: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@4aef24c4 [WARN] [06/27/2025 14:31:16.251] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower228] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower228, initialSyncDone=true] [WARN] [06/27/2025 14:31:16.327] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:16,344 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader227: Persist data index=1 term=1 command=one 02:31:16,344 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 02:31:16,344 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 92.88 ms 02:31:16,344 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 02:31:16,345 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 02:31:16,345 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 02:31:16,345 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 1 is present for follower follower228 02:31:16,345 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader227 (Leader): Sending AppendEntries to follower follower228: AppendEntries{term=1, leaderId=leader227, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} [WARN] [06/27/2025 14:31:16.345] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:16,345 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower228 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader227, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 02:31:16,345 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower228 (Follower): Number of entries to be appended = 1 02:31:16,345 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower228 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 02:31:16,345 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower228 (Follower): Append entry to log one 02:31:16,345 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower228: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 02:31:16,345 PM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 entries in 94.23 ms 02:31:16,346 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower228 (Follower): Log size is now 2 02:31:16,346 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower228 (Follower): Commit index set to 0 02:31:16,346 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower228 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower228, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 02:31:16,346 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower228: Lagging 0 entries behind leader leader227 and reached 0 (of expected -1) 02:31:16,346 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower228 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 02:31:16,346 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower228 (Follower): Setting last applied to 0 02:31:16,346 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower228: Moving last applied index from -1 to 0 02:31:16,346 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower228: Applying state for log index 0 data zero 02:31:16,346 PM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower228: applyState called: zero 02:31:16,346 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower228 updated: matchIndex: 1, nextIndex: 2 02:31:16,346 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 02:31:16,346 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower228: awaiting more completions to resolve 1 deferred callback(s) 02:31:16,346 PM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 02:31:16,347 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 2.495 ms 02:31:16,347 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 02:31:16,347 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for more work 02:31:16,347 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 02:31:16,347 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader227 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 02:31:16,347 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader227 (Leader): Setting last applied to 1 02:31:16,347 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from 0 to 1 02:31:16,347 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader227: Applying state for log index 1 data one 02:31:16,347 PM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader227: applyState called: one 02:31:16,347 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 425.1 μs 02:31:16,347 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 221.1 μs 02:31:16,347 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for more work 02:31:16,348 PM [follower228-writer-93] [DEBUG] EntryStoreCompleter - follower228: 1 completion(s) pending 02:31:16,348 PM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: persisted 1 entries in 2.321 ms 02:31:16,348 PM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 entries in 8.280 μs 02:31:16,348 PM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: persisted 1 entries in 132.7 μs 02:31:16,348 PM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: waiting for more work 02:31:16,348 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower228: running 1 completion(s) 02:31:16,348 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower228: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 02:31:16,348 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower228: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@69e026bc [WARN] [06/27/2025 14:31:16.438] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader227: Persist data index=2 term=1 command=two 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 2 is present for follower follower228 02:31:16,445 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 97.65 ms 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Sending AppendEntries to follower follower228: AppendEntries{term=1, leaderId=leader227, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader227: Persist data index=3 term=1 command=three 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 2 is present for follower follower228 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader227: Persist data index=4 term=1 command=four 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=4, term=1, command=four, pending=true} 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 4, isSendImmediate: true 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 02:31:16,445 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): Checking sendAppendEntries for follower follower228: active: true, followerNextIndex: 2, leaderLastIndex: 4, leaderSnapShotIndex: -1 02:31:16,446 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader227 (Leader): sendAppendEntries: 2 is present for follower follower228 [WARN] [06/27/2025 14:31:16.446] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 14:31:16.446] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 14:31:16.446] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=1, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:16,447 PM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 02:31:16,448 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 2.472 ms 02:31:16,448 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 02:31:16,448 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 2 entries in 8.700 μs 02:31:16,448 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 02:31:16,449 PM [leader227-writer-94] [DEBUG] EntryStoreCompleter - leader227: 2 completion(s) pending 02:31:16,450 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - leader227: running 2 completion(s) 02:31:16,450 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 2 entries in 1.907 ms 02:31:16,450 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: waiting for more work 02:31:16,450 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true} 02:31:16,450 PM [test-pekko.actor.default-dispatcher-11] [INFO] SnapshotManager - leader227: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=3, mandatoryTrim=false] 02:31:16,450 PM [test-pekko.actor.default-dispatcher-16] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:308) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 02:31:16,450 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRaftStorage - leader227: terminating thread VirtualThread[#614,leader227-writer-94]/waiting [ERROR] [06/27/2025 14:31:16.450] [test-pekko.actor.internal-dispatcher-4] [pekko://test/user/leader227] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:308) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 02:31:16,451 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: received 1 entries in 1.158 ms 02:31:16,451 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 37.80 μs 02:31:16,451 PM [leader227-writer-94] [DEBUG] JournalWriteTask - leader227: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@5433d5c4 stopped 02:31:16,451 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader227: journal closed 02:31:16,451 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - leader227: journal closed 02:31:16,451 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks 02:31:16,451 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks [WARN] [06/27/2025 14:31:16.452] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader227]: org.opendaylight.controller.cluster.common.actor.Monitor@49ec1b5b 02:31:16,453 PM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - leader227: Starting recovery with journal batch size 1000 02:31:16,453 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader227: started executor 02:31:16,453 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader227: started executor 02:31:16,454 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader227: metadata journal open: replayFrom=1 applyTo=1 02:31:16,455 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader227: journal open: firstIndex=1 lastIndex=5 replayFrom=1 fileEntries=0 02:31:16,455 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - leader227: journal open: applyTo=1 02:31:16,455 PM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@2d989ff3 started 02:31:16,455 PM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: waiting for more work 02:31:16,456 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=1, votedFor=leader227 02:31:16,456 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:16,456 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:16,456 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:16,456 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader227: no eligible files found 02:31:16,456 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader227: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 02:31:16,456 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - leader227: restoring local TermInfo{term=1, votedFor=leader227} 02:31:16,456 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=1, votedFor=leader227 02:31:16,456 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader227: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@6117c4b3 02:31:16,456 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - leader227: Moving last applied index from -1 to -1 02:31:16,457 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 02:31:16,457 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=1, term=1, command=one] 02:31:16,457 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=2, term=1, command=two] 02:31:16,457 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=3, term=1, command=three] 02:31:16,458 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - leader227: recovered journal DefaultLogEntry[index=4, term=1, command=four] 02:31:16,458 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - leader227: journal recovery completedin 1.558 ms with journalIndex=1 02:31:16,958 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - leader227 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.8:17355, Removed) 02:31:16,958 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - leader227 (Follower): Received ElectionTimeout - switching to Candidate 02:31:16,958 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader227 (Candidate): Election: Candidate has following voting peers: [follower229, follower228] 02:31:16,962 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader227: Set currentTerm=2, votedFor=leader227 02:31:16,962 PM [test-pekko.actor.default-dispatcher-12] [INFO] Candidate - leader227 (Candidate): Starting new election term 2 02:31:16,962 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} to peer follower229 02:31:16,962 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - leader227 (Candidate): Sending RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} to peer follower228 02:31:16,962 PM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActorBehavior - leader227 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 02:31:16,963 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower228 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 02:31:16,963 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower228 (Follower): Cluster state: [] 02:31:16,963 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower228 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} with higher term appears reachable, updating term. 02:31:16,963 PM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower228 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1}" message is greater than follower's term 1 - updating term [WARN] [06/27/2025 14:31:16.963] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} 02:31:16,967 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=2, votedFor=null 02:31:16,967 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower228 (Follower): In requestVote: RequestVote{term=2, candidateId=leader227, lastLogIndex=4, lastLogTerm=1} - currentTerm: 2, votedFor: null, lastIndex: 1, lastTerm: 1 02:31:16,970 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower228: Set currentTerm=2, votedFor=leader227 02:31:16,970 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower228 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 02:31:16,970 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader227 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 02:31:16,970 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader227 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 02:31:16,970 PM [test-pekko.actor.default-dispatcher-17] [INFO] Candidate - leader227 (Candidate): LastApplied index -1 is behind last index 4 - switching to PreLeader 02:31:16,970 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (PreLeader): Election: Leader has following peers: [follower229, follower228] 02:31:16,970 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 02:31:16,970 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower228: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 02:31:16,970 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader227 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 2 [WARN] [06/27/2025 14:31:16.970] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:16,970 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader227: Persist data index=5 term=2 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7 02:31:16,971 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader227: Append log entry and persist JournaledLogEntry{index=5, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7, pending=true} 02:31:16,971 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (PreLeader): Replicate message: identifier: null, logIndex: 5, isSendImmediate: true 02:31:16,971 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower229: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 02:31:16,971 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader227 (PreLeader): Checking sendAppendEntries for follower follower228: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 [WARN] [06/27/2025 14:31:16.971] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:16,971 PM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: received 1 entries in 515.9 ms 02:31:16,973 PM [leader227-writer-95] [DEBUG] EntryStoreCompleter - leader227: 1 completion(s) pending 02:31:16,973 PM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 2.297 ms 02:31:16,973 PM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: waiting for more work 02:31:16,973 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader227: running 1 completion(s) 02:31:16,973 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader227: persist complete JournaledLogEntry{index=5, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7, pending=true} [WARN] [06/27/2025 14:31:17.088] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:17,100 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:17,100 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:17,100 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:17,100 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 02:31:17,201 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:17,201 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:17,201 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:17,201 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:17.208] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:17,301 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:17,301 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:17,301 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:17,301 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:17.328] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:17,402 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:17,402 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:17,402 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:17,402 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:17.448] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:17,503 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:17,503 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:17,503 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:17,503 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:17.568] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:17,604 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:17,604 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:17,604 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:17,604 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:17.688] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:17,704 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:17,705 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:17,705 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:17,705 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 02:31:17,805 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:17,805 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:17,805 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:17,805 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:17.808] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:17,906 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:17,906 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:17,906 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:17,906 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:17.927] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:18,7 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:18,7 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:18,7 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:18,7 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:18.048] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:18,107 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:18,107 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:18,108 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:18,108 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:18.168] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:18,208 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:18,208 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:18,208 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:18,208 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:18.287] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:18,309 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:18,309 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:18,309 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:18,309 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:18.408] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:18,410 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:18,410 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:18,410 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:18,410 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 02:31:18,510 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:18,510 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:18,510 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:18,511 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:18.528] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:18,611 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:18,611 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:18,611 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:18,611 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:18.638] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:18,712 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:18,712 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:18,712 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:18,712 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:18.748] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:18,813 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:18,813 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:18,813 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:18,813 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:18.867] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:18,913 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:18,913 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:18,913 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:18,913 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:18.978] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:19,15 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:19,15 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:19,15 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:19,15 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:19.097] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:19,116 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:19,116 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:19,116 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:19,116 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 02:31:19,217 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:19,217 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:19,217 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:19,217 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:19.218] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:19,318 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:19,318 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:19,318 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:19,318 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:19.338] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:19,418 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:19,418 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:19,419 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:19,419 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:19.458] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:19,519 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:19,519 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:19,519 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:19,519 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:19.578] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:19,620 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:19,620 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:19,620 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:19,620 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:19.698] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:19,720 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:19,720 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:19,720 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:19,720 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:19.818] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:19,821 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:19,821 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:19,821 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:19,821 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 02:31:19,921 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:19,921 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:19,921 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:19,921 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:19.937] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:20,22 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:20,22 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:20,22 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:20,22 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:20.047] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:20,122 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:20,122 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:20,122 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:20,122 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:20.167] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:20,223 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:20,223 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:20,223 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:20,223 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:20.288] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:20,324 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:20,324 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:20,324 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:20,324 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:20.397] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:20,424 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:20,424 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:20,424 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:20,424 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:20.518] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:20,525 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:20,525 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:20,525 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:20,525 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 02:31:20,625 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:20,625 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:20,625 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:20,625 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:20.637] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:20,726 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:20,726 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:20,726 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:20,726 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:20.747] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:20,827 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:20,827 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:20,827 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:20,827 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:20.867] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:20,927 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:20,927 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:20,927 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:20,927 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:20.988] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:21,28 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:21,28 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:21,28 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:21,28 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:21.107] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:21,128 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:21,128 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:21,128 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:21,128 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:21.228] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:21,229 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:21,229 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:21,229 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:21,229 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 02:31:21,329 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:21,329 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:21,330 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:21,330 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:21.348] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:21,430 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:21,430 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:21,430 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:21,430 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:21.457] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:21,531 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:21,531 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:21,531 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:21,531 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:21.578] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:21,631 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:21,631 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:21,631 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:21,631 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:21.688] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:21,732 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:21,732 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:21,732 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:21,732 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:21.808] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:21,833 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:21,833 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:21,833 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:21,833 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found [WARN] [06/27/2025 14:31:21.928] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:21,934 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/TermInfo.properties 02:31:21,934 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/journal-v1-1.log 02:31:21,934 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest2723598290852145553/leader227/metadata-v1-1.log 02:31:21,934 PM [awaitility-thread] [DEBUG] RaftStorage - leader227: no eligible files found 02:31:22,36 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower228-collector230#1344490707] [WARN] [06/27/2025 14:31:22.038] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader227]: AppendEntries{term=2, leaderId=leader227, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:22,47 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower228] 02:31:22,47 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRaftStorage - follower228: terminating thread VirtualThread[#613,follower228-writer-93]/waiting 02:31:22,47 PM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: received 1 entries in 5.699 s 02:31:22,47 PM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: persisted 1 entries in 58.79 μs 02:31:22,47 PM [follower228-writer-93] [DEBUG] JournalWriteTask - follower228: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@3caad615 stopped 02:31:22,48 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower228: journal closed 02:31:22,48 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower228: journal closed 02:31:22,48 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower228: stopped executor with 0 remaining tasks 02:31:22,48 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower228: stopped executor with 0 remaining tasks 02:31:22,48 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader227-collector231#-565595299] 02:31:22,48 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader227] 02:31:22,48 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRaftStorage - leader227: terminating thread VirtualThread[#617,leader227-writer-95]/waiting 02:31:22,48 PM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: received 1 entries in 5.075 s 02:31:22,48 PM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: persisted 1 entries in 23.97 μs 02:31:22,49 PM [leader227-writer-95] [DEBUG] JournalWriteTask - leader227: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@2d989ff3 stopped 02:31:22,49 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader227: journal closed 02:31:22,49 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - leader227: journal closed 02:31:22,49 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks 02:31:22,49 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader227: stopped executor with 0 remaining tasks [WARN] [06/27/2025 14:31:22.053] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower233]: org.opendaylight.controller.cluster.common.actor.Monitor@4d7d627d 02:31:22,54 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower233: Starting recovery with journal batch size 1000 02:31:22,55 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower233: started executor 02:31:22,55 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower233: started executor 02:31:22,56 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower233: metadata journal open: replayFrom=1 applyTo=0 02:31:22,56 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower233: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 02:31:22,56 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower233: journal open: applyTo=0 02:31:22,57 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@36be03af started 02:31:22,57 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting for more work [WARN] [06/27/2025 14:31:22.058] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader232]: org.opendaylight.controller.cluster.common.actor.Monitor@73259604 02:31:22,58 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9761719651511561054/follower233/TermInfo.properties does not exist 02:31:22,58 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower233: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9761719651511561054/follower233/journal-v1-1.log 02:31:22,58 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower233: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9761719651511561054/follower233/metadata-v1-1.log 02:31:22,58 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower233: no eligible files found 02:31:22,58 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower233: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 02:31:22,58 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader232: Starting recovery with journal batch size 1000 02:31:22,59 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader232: started executor 02:31:22,59 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader232: started executor 02:31:22,59 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader232: metadata journal open: replayFrom=1 applyTo=0 02:31:22,59 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader232: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 02:31:22,59 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader232: journal open: applyTo=0 02:31:22,59 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@5f30658c started 02:31:22,59 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for more work 02:31:22,60 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9761719651511561054/leader232/TermInfo.properties does not exist 02:31:22,61 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader232: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9761719651511561054/leader232/journal-v1-1.log 02:31:22,61 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader232: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9761719651511561054/leader232/metadata-v1-1.log 02:31:22,61 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader232: no eligible files found 02:31:22,61 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader232: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 02:31:22,64 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower233: Set currentTerm=0, votedFor=null 02:31:22,64 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower233: Local TermInfo store seeded with TermInfo{term=0} 02:31:22,64 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower233: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4edd58c8 02:31:22,64 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from -1 to -1 02:31:22,65 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower233: journal recovery completedin 527.4 μs with journalIndex=1 02:31:22,66 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader232: Set currentTerm=0, votedFor=null 02:31:22,66 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader232: Local TermInfo store seeded with TermInfo{term=0} 02:31:22,67 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader232: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@1594e3be 02:31:22,67 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from -1 to -1 02:31:22,67 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader232: journal recovery completedin 410.3 μs with journalIndex=1 02:31:22,497 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 02:31:22,497 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader232 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.8:17355, Removed) 02:31:22,498 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader232 (Follower): Received ElectionTimeout - switching to Candidate 02:31:22,498 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader232 (Candidate): Election: Candidate has following voting peers: [follower234, follower233] 02:31:22,501 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader232: Set currentTerm=1, votedFor=leader232 02:31:22,501 PM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader232 (Candidate): Starting new election term 1 02:31:22,501 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader232 (Candidate): Sending RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} to peer follower234 02:31:22,501 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader232 (Candidate): Sending RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} to peer follower233 02:31:22,501 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader232 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 [WARN] [06/27/2025 14:31:22.501] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} 02:31:22,501 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower233 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 02:31:22,501 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower233 (Follower): Cluster state: [] 02:31:22,501 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower233 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 02:31:22,501 PM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower233 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 02:31:22,505 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower233: Set currentTerm=1, votedFor=null 02:31:22,505 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower233 (Follower): In requestVote: RequestVote{term=1, candidateId=leader232, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 02:31:22,508 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower233: Set currentTerm=1, votedFor=leader232 02:31:22,508 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower233 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 02:31:22,509 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader232 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 02:31:22,509 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader232 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 02:31:22,509 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Election: Leader has following peers: [follower234, follower233] 02:31:22,509 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 02:31:22,509 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 02:31:22,509 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader232 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 [WARN] [06/27/2025 14:31:22.509] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:22,509 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Last sync leader does not match current leader leader232, need to catch up to -1 02:31:22,509 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: -1, nextIndex: 0 02:31:22,509 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [06/27/2025 14:31:22.509] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower233] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower233, initialSyncDone=false] 02:31:22,533 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader232: Persist data index=0 term=1 command=zero 02:31:22,533 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader232: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 02:31:22,533 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 473.4 ms 02:31:22,533 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 02:31:22,533 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 02:31:22,534 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 02:31:22,534 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 0 is present for follower follower233 02:31:22,534 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower233: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} [WARN] [06/27/2025 14:31:22.534] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:22,534 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 02:31:22,534 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): Number of entries to be appended = 1 02:31:22,534 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 02:31:22,534 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): Append entry to log zero 02:31:22,534 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower233: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 02:31:22,534 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): Log size is now 1 02:31:22,534 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower233, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 02:31:22,534 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached -1 (of expected -1) 02:31:22,534 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower233: awaiting more completions to resolve 1 deferred callback(s) 02:31:22,534 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 477.8 ms 02:31:22,535 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: 0, nextIndex: 1 02:31:22,535 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 02:31:22,539 PM [leader232-writer-97] [DEBUG] EntryStoreCompleter - leader232: 1 completion(s) pending 02:31:22,539 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 6.073 ms 02:31:22,539 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for more work 02:31:22,539 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader232: running 1 completion(s) 02:31:22,539 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader232: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 02:31:22,539 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 02:31:22,539 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader232 (Leader): Setting last applied to 0 02:31:22,539 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from -1 to 0 02:31:22,539 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader232: Applying state for log index 0 data zero 02:31:22,539 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader232: applyState called: zero 02:31:22,539 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 446.8 μs 02:31:22,540 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 170.9 μs 02:31:22,540 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for more work 02:31:22,540 PM [follower233-writer-96] [DEBUG] EntryStoreCompleter - follower233: 1 completion(s) pending 02:31:22,540 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower233: running 1 completion(s) 02:31:22,540 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower233: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 02:31:22,540 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 5.670 ms 02:31:22,540 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower233: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@55b9c42 02:31:22,540 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting for more work [WARN] [06/27/2025 14:31:22.540] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower233] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower233, initialSyncDone=true] [WARN] [06/27/2025 14:31:22.628] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:22,634 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader232: Persist data index=1 term=1 command=one 02:31:22,634 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader232: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 02:31:22,634 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 02:31:22,634 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 02:31:22,634 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 94.71 ms 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 1 is present for follower follower233 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower233: AppendEntries{term=1, leaderId=leader232, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): Number of entries to be appended = 1 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): Append entry to log one 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower233: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): Log size is now 2 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): Commit index set to 0 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower233, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 0 (of expected -1) 02:31:22,635 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 94.72 ms 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower233 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower233 (Follower): Setting last applied to 0 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from -1 to 0 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower233: Applying state for log index 0 data zero 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower233: applyState called: zero 02:31:22,635 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: 1, nextIndex: 2 [WARN] [06/27/2025 14:31:22.635] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader232]: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:22,635 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 02:31:22,635 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower233: awaiting more completions to resolve 1 deferred callback(s) 02:31:22,637 PM [leader232-writer-97] [DEBUG] EntryStoreCompleter - leader232: 1 completion(s) pending 02:31:22,637 PM [follower233-writer-96] [DEBUG] EntryStoreCompleter - follower233: 1 completion(s) pending 02:31:22,637 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower233: running 1 completion(s) 02:31:22,637 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 2.007 ms 02:31:22,637 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower233: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 02:31:22,637 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 1.541 ms 02:31:22,637 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for more work 02:31:22,637 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - leader232: running 1 completion(s) 02:31:22,637 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower233: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@7ece4b3 02:31:22,637 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 8.431 μs 02:31:22,637 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader232: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 02:31:22,637 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 02:31:22,637 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader232 (Leader): Setting last applied to 1 02:31:22,637 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from 0 to 1 02:31:22,637 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader232: Applying state for log index 1 data one 02:31:22,637 PM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - leader232: applyState called: one 02:31:22,637 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 158.3 μs 02:31:22,637 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting for more work 02:31:22,637 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 488.2 μs 02:31:22,637 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 114.8 μs 02:31:22,637 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for more work [WARN] [06/27/2025 14:31:22.741] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower234]: org.opendaylight.controller.cluster.common.actor.Monitor@adb37ef 02:31:22,742 PM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower234: Starting recovery with journal batch size 1000 02:31:22,742 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower234: started executor 02:31:22,743 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower234: started executor 02:31:22,743 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower234: metadata journal open: replayFrom=1 applyTo=0 02:31:22,744 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower234: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 02:31:22,744 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower234: journal open: applyTo=0 02:31:22,744 PM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@6d13c9b started 02:31:22,744 PM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: waiting for more work 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [INFO] PeerInfos - leader232: Peer address for peer follower234 set to pekko://test/user/follower234 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader232: Persist data index=2 term=1 command=two 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader232: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 2 is present for follower follower233 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower233: AppendEntries{term=1, leaderId=leader232, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): Number of entries to be appended = 1 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): Append entry to log two 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower233: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): Log size is now 3 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): Commit index set to 1 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower233, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 1 (of expected -1) 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 2 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower233 (Follower): Setting last applied to 1 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from 0 to 1 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower233: Applying state for log index 1 data one 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower233: applyState called: one 02:31:22,745 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower233: awaiting more completions to resolve 1 deferred callback(s) 02:31:22,745 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9761719651511561054/follower234/TermInfo.properties does not exist 02:31:22,745 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 107.4 ms 02:31:22,745 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 108.3 ms 02:31:22,746 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower233 updated: matchIndex: 2, nextIndex: 3 02:31:22,746 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9761719651511561054/follower234/journal-v1-1.log 02:31:22,746 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9761719651511561054/follower234/metadata-v1-1.log 02:31:22,746 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower233: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: -1 02:31:22,746 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower234: no eligible files found 02:31:22,746 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower234: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 02:31:22,748 PM [follower233-writer-96] [DEBUG] EntryStoreCompleter - follower233: 1 completion(s) pending 02:31:22,748 PM [leader232-writer-97] [DEBUG] EntryStoreCompleter - leader232: 1 completion(s) pending 02:31:22,748 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 2.344 ms 02:31:22,748 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 2.320 ms 02:31:22,748 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for more work 02:31:22,748 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 6.250 μs 02:31:22,748 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower233: running 1 completion(s) 02:31:22,748 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower233: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 02:31:22,748 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower233: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@27294dda 02:31:22,748 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 108.7 μs 02:31:22,748 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting for more work 02:31:22,748 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader232: running 1 completion(s) 02:31:22,748 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader232: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 02:31:22,748 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader232 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1 02:31:22,748 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader232 (Leader): Setting last applied to 2 02:31:22,748 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader232: Moving last applied index from 1 to 2 02:31:22,748 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader232: Applying state for log index 2 data two 02:31:22,748 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader232: applyState called: two 02:31:22,748 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 414.3 μs 02:31:22,748 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 78.02 μs 02:31:22,748 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: waiting for more work 02:31:22,749 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=0, votedFor=null 02:31:22,749 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower234: Local TermInfo store seeded with TermInfo{term=0} 02:31:22,749 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower234: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@3536ffaf 02:31:22,749 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to -1 02:31:22,749 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - follower234: journal recovery completedin 374.1 μs with journalIndex=1 02:31:22,750 PM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower234 (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term 02:31:22,752 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=1, votedFor=null 02:31:22,752 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Last sync leader does not match current leader leader232, need to catch up to -1 02:31:22,752 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower234 updated: matchIndex: -1, nextIndex: 0 02:31:22,752 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: true, followerNextIndex: 0, leaderLastIndex: 2, leaderSnapShotIndex: -1 02:31:22,752 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 0 is present for follower follower234 02:31:22,752 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached -1 (of expected -1) 02:31:22,752 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): Sending AppendEntries to follower follower234: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=false}, JournaledLogEntry{index=1, term=1, command=one, pending=false}, JournaledLogEntry{index=2, term=1, command=two, pending=false}]} 02:31:22,752 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader232, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=2, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=false}, JournaledLogEntry{index=1, term=1, command=one, pending=false}, JournaledLogEntry{index=2, term=1, command=two, pending=false}]} 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Number of entries to be appended = 3 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Append entry to log zero 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=false} [WARN] [06/27/2025 14:31:22.753] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=false] 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Append entry to log one 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=false} 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Append entry to log two 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=false} 02:31:22,753 PM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: received 1 entries in 8.745 ms 02:31:22,753 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): sendAppendEntries: 0 is present for follower follower234 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Log size is now 3 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): Commit index set to 2 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower234, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower234 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): -1, lastIndex(): 2 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 0 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to 0 02:31:22,753 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower234 updated: matchIndex: 2, nextIndex: 3 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower234: Applying state for log index 0 data zero 02:31:22,753 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - leader232: fakeSnapshot purging log to 1 for term 1 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower234: applyState called: zero 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 1 02:31:22,753 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader232 (Leader): Checking sendAppendEntries for follower follower234: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: 1 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 0 to 1 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower234: Applying state for log index 1 data one 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower234: applyState called: one 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 2 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 1 to 2 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower234: Applying state for log index 2 data two 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower234: applyState called: two 02:31:22,753 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: awaiting more completions to resolve 3 deferred callback(s) 02:31:22,756 PM [follower234-writer-98] [DEBUG] EntryStoreCompleter - follower234: 1 completion(s) pending 02:31:22,756 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: running 1 completion(s) 02:31:22,756 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 02:31:22,756 PM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: persisted 1 entries in 3.639 ms 02:31:22,756 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@63a9d63c 02:31:22,756 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: awaiting more completions to resolve 2 deferred callback(s) 02:31:22,756 PM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: received 3 entries in 7.420 μs 02:31:22,759 PM [follower234-writer-98] [DEBUG] EntryStoreCompleter - follower234: 2 completion(s) pending 02:31:22,759 PM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: persisted 3 entries in 2.990 ms 02:31:22,759 PM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: waiting for more work 02:31:22,760 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: running 2 completion(s) 02:31:22,760 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 02:31:22,760 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@3f5e840e 02:31:22,760 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower234: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 02:31:22,760 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower234: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@420b5307 [WARN] [06/27/2025 14:31:22.760] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=true] 02:31:22,868 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): Commit index set to 2 02:31:22,868 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:22,868 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower233 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): 1, lastIndex(): 2 02:31:22,868 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower233 (Follower): Setting last applied to 2 02:31:22,868 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower233: Moving last applied index from 1 to 2 02:31:22,868 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower233: Applying state for log index 2 data two 02:31:22,868 PM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower233: applyState called: two 02:31:22,869 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SnapshotManager - follower233: fakeSnapshot purging log to 1 for term 1 02:31:22,869 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 120.5 ms 02:31:22,869 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:22,869 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - follower234: fakeSnapshot purging log to 1 for term 1 02:31:22,869 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 329.3 μs 02:31:22,869 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: waiting for more work 02:31:22,961 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRaftStorage - follower234: terminating thread VirtualThread[#623,follower234-writer-98]/waiting 02:31:22,961 PM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: received 1 entries in 201.9 ms 02:31:22,962 PM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: persisted 1 entries in 46.85 μs 02:31:22,962 PM [follower234-writer-98] [DEBUG] JournalWriteTask - follower234: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@6d13c9b stopped 02:31:22,962 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower234: journal closed 02:31:22,962 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower234: journal closed 02:31:22,962 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks 02:31:22,962 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks [WARN] [06/27/2025 14:31:22.963] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower234]: org.opendaylight.controller.cluster.common.actor.Monitor@2c21471f 02:31:22,964 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower234: Starting recovery with journal batch size 1000 02:31:22,964 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower234: started executor 02:31:22,964 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower234: started executor 02:31:22,965 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower234: metadata journal open: replayFrom=1 applyTo=2 02:31:22,965 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower234: journal open: firstIndex=1 lastIndex=3 replayFrom=1 fileEntries=0 02:31:22,965 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower234: journal open: applyTo=2 02:31:22,966 PM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@765151c1 started 02:31:22,966 PM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: waiting for more work 02:31:22,966 PM [test-pekko.actor.default-dispatcher-6] [INFO] PeerInfos - leader232: Peer address for peer follower234 set to pekko://test/user/follower234 02:31:22,967 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=1, votedFor=null 02:31:22,967 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9761719651511561054/follower234/TermInfo.properties 02:31:22,967 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9761719651511561054/follower234/journal-v1-1.log 02:31:22,967 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower234: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest9761719651511561054/follower234/metadata-v1-1.log 02:31:22,967 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower234: no eligible files found 02:31:22,967 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower234: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 02:31:22,967 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower234: restoring local TermInfo{term=1} 02:31:22,967 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower234: Set currentTerm=1, votedFor=null 02:31:22,967 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower234: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@52c1361f 02:31:22,967 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to -1 02:31:22,967 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower234: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 02:31:22,968 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower234: recovered journal DefaultLogEntry[index=1, term=1, command=one] 02:31:22,968 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower234: recovered journal DefaultLogEntry[index=2, term=1, command=two] 02:31:22,968 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower234: journal recovery completedin 1.248 ms with journalIndex=1 02:31:22,988 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:22,988 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower234 (Follower): Commit index set to 2 02:31:22,988 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Last sync leader does not match current leader leader232, need to catch up to 2 02:31:22,988 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower234 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): -1, lastIndex(): 2 02:31:22,988 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 0 02:31:22,988 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from -1 to 0 02:31:22,988 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower234: Applying state for log index 0 data zero 02:31:22,988 PM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower234: applyState called: zero 02:31:22,988 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 1 02:31:22,988 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 0 to 1 02:31:22,988 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower234: Applying state for log index 1 data one 02:31:22,988 PM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower234: applyState called: one 02:31:22,988 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower234 (Follower): Setting last applied to 2 02:31:22,988 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower234: Moving last applied index from 1 to 2 02:31:22,988 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower234: Applying state for log index 2 data two 02:31:22,988 PM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower234: applyState called: two 02:31:22,988 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - follower234: fakeSnapshot purging log to 1 for term 1 02:31:22,988 PM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: received 1 entries in 22.80 ms [WARN] [06/27/2025 14:31:22.989] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=false] 02:31:22,989 PM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: persisted 1 entries in 390.5 μs 02:31:22,989 PM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: waiting for more work 02:31:23,108 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:23,108 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) [WARN] [06/27/2025 14:31:23.108] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower234] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower234, initialSyncDone=true] 02:31:23,227 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:23,227 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:23,348 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:23,348 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:23,468 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:23,469 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:23,588 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:23,588 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:23,708 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:23,708 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:23,828 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:23,828 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:23,948 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:23,948 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:24,68 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:24,68 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:24,188 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:24,188 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:24,308 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:24,308 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:24,428 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:24,428 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:24,548 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:24,548 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:24,667 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:24,667 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:24,788 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:24,788 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:24,908 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:24,908 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:25,28 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:25,28 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:25,148 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:25,148 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:25,268 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:25,268 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:25,387 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:25,387 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:25,508 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:25,508 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:25,627 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:25,627 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:25,748 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:25,748 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:25,868 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:25,868 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:25,988 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:25,988 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:26,107 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:26,108 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:26,228 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:26,228 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:26,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:26,348 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:26,468 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:26,468 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:26,587 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:26,587 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:26,708 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:26,708 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:26,828 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:26,828 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:26,948 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:26,948 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:27,68 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:27,68 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:27,188 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:27,188 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:27,308 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:27,308 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:27,427 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:27,427 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:27,550 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:27,550 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:27,668 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:27,668 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:27,778 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:27,778 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:27,898 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:27,898 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:28,8 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower233: Lagging 0 entries behind leader leader232 and reached 2 (of expected -1) 02:31:28,8 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower234: Lagging 0 entries behind leader leader232 and reached 2 (of expected 2) 02:31:28,55 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower233-collector235#150098303] 02:31:28,66 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower233] 02:31:28,66 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower233: terminating thread VirtualThread[#619,follower233-writer-96]/waiting 02:31:28,67 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: received 1 entries in 5.198 s 02:31:28,67 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: persisted 1 entries in 48.72 μs 02:31:28,67 PM [follower233-writer-96] [DEBUG] JournalWriteTask - follower233: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@36be03af stopped 02:31:28,67 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower233: journal closed 02:31:28,67 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower233: journal closed 02:31:28,67 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower233: stopped executor with 0 remaining tasks 02:31:28,67 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower233: stopped executor with 0 remaining tasks 02:31:28,67 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader232-collector236#-391529810] 02:31:28,67 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader232] 02:31:28,67 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - leader232: terminating thread VirtualThread[#620,leader232-writer-97]/waiting 02:31:28,67 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: received 1 entries in 5.319 s 02:31:28,68 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: persisted 1 entries in 17.99 μs 02:31:28,68 PM [leader232-writer-97] [DEBUG] JournalWriteTask - leader232: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@5f30658c stopped 02:31:28,68 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader232: journal closed 02:31:28,68 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader232: journal closed 02:31:28,68 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader232: stopped executor with 0 remaining tasks 02:31:28,68 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader232: stopped executor with 0 remaining tasks 02:31:28,68 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower234-collector237#1872973139] 02:31:28,68 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower234] 02:31:28,68 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower234-collector238#-2087571415] 02:31:28,69 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower234] 02:31:28,69 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower234: terminating thread VirtualThread[#626,follower234-writer-99]/waiting 02:31:28,69 PM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: received 1 entries in 5.080 s 02:31:28,69 PM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: persisted 1 entries in 27.59 μs 02:31:28,69 PM [follower234-writer-99] [DEBUG] JournalWriteTask - follower234: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@765151c1 stopped 02:31:28,69 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower234: journal closed 02:31:28,69 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower234: journal closed 02:31:28,69 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks 02:31:28,69 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower234: stopped executor with 0 remaining tasks [WARN] [06/27/2025 14:31:28.077] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower240]: org.opendaylight.controller.cluster.common.actor.Monitor@5f76c1a5 02:31:28,78 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower240: Starting recovery with journal batch size 1000 02:31:28,78 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower240: started executor 02:31:28,78 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower240: started executor 02:31:28,79 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower240: metadata journal open: replayFrom=1 applyTo=0 02:31:28,80 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower240: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 02:31:28,80 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower240: journal open: applyTo=0 02:31:28,80 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@2618a120 started 02:31:28,80 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting for more work 02:31:28,82 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest15003981780368397182/follower240/TermInfo.properties does not exist 02:31:28,82 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower240: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest15003981780368397182/follower240/journal-v1-1.log 02:31:28,82 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower240: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest15003981780368397182/follower240/metadata-v1-1.log 02:31:28,82 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower240: no eligible files found 02:31:28,82 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower240: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [06/27/2025 14:31:28.082] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader239]: org.opendaylight.controller.cluster.common.actor.Monitor@1649e222 02:31:28,83 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader239: Starting recovery with journal batch size 1000 02:31:28,84 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader239: started executor 02:31:28,84 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader239: started executor 02:31:28,84 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader239: metadata journal open: replayFrom=1 applyTo=0 02:31:28,85 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader239: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 02:31:28,85 PM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader239: journal open: applyTo=0 02:31:28,85 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@5a3b337b started 02:31:28,85 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for more work 02:31:28,85 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=0, votedFor=null 02:31:28,85 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower240: Local TermInfo store seeded with TermInfo{term=0} 02:31:28,85 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower240: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@10e90a9d 02:31:28,85 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from -1 to -1 02:31:28,86 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - follower240: journal recovery completedin 322.5 μs with journalIndex=1 02:31:28,86 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest15003981780368397182/leader239/TermInfo.properties does not exist 02:31:28,87 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest15003981780368397182/leader239/journal-v1-1.log 02:31:28,87 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest15003981780368397182/leader239/metadata-v1-1.log 02:31:28,87 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader239: no eligible files found 02:31:28,87 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader239: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 02:31:28,90 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=0, votedFor=null 02:31:28,90 PM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader239: Local TermInfo store seeded with TermInfo{term=0} 02:31:28,90 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader239: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@2bf3a894 02:31:28,90 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to -1 02:31:28,90 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - leader239: journal recovery completedin 238.5 μs with journalIndex=1 02:31:28,557 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 02:31:28,557 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader239 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.8:17355, Removed) 02:31:28,558 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - leader239 (Follower): Received ElectionTimeout - switching to Candidate 02:31:28,558 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader239 (Candidate): Election: Candidate has following voting peers: [follower241, follower240] 02:31:28,563 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=1, votedFor=leader239 02:31:28,563 PM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - leader239 (Candidate): Starting new election term 1 02:31:28,563 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} to peer follower241 02:31:28,564 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} to peer follower240 02:31:28,564 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - leader239 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 [WARN] [06/27/2025 14:31:28.564] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} 02:31:28,564 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower240 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 02:31:28,564 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower240 (Follower): Cluster state: [] 02:31:28,564 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower240 (Follower): Candidate in requestVote:RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 02:31:28,564 PM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower240 (Follower): Term 1 in "RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 02:31:28,568 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=1, votedFor=null 02:31:28,568 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower240 (Follower): In requestVote: RequestVote{term=1, candidateId=leader239, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 02:31:28,572 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=1, votedFor=leader239 02:31:28,572 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower240 (Follower): requestVote returning: RequestVoteReply{term=1, voteGranted=true} 02:31:28,572 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader239 (Candidate): RaftRPC message received RequestVoteReply{term=1, voteGranted=true}, my term is 1 02:31:28,572 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader239 (Candidate): handleRequestVoteReply: RequestVoteReply{term=1, voteGranted=true}, current voteCount: 1 02:31:28,572 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Election: Leader has following peers: [follower241, follower240] 02:31:28,572 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 02:31:28,572 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [06/27/2025 14:31:28.572] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:28,573 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader239 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 02:31:28,573 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Last sync leader does not match current leader leader239, need to catch up to -1 02:31:28,573 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: -1, nextIndex: 0 02:31:28,573 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [06/27/2025 14:31:28.573] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower240] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower240, initialSyncDone=false] 02:31:28,587 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader239: Persist data index=0 term=1 command=zero 02:31:28,587 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 02:31:28,587 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 02:31:28,587 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 02:31:28,587 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 501.9 ms 02:31:28,587 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 02:31:28,587 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 0 is present for follower follower240 [WARN] [06/27/2025 14:31:28.587] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:28,587 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Sending AppendEntries to follower follower240: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 02:31:28,587 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=zero, pending=true}]} 02:31:28,587 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): Number of entries to be appended = 1 02:31:28,587 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 02:31:28,588 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): Append entry to log zero 02:31:28,588 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=0, term=1, command=zero, pending=true} 02:31:28,588 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): Log size is now 1 02:31:28,588 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower240 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower240, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 02:31:28,588 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached -1 (of expected -1) 02:31:28,588 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 1 deferred callback(s) 02:31:28,588 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 entries in 507.7 ms 02:31:28,588 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 0, nextIndex: 1 02:31:28,588 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 02:31:28,593 PM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 02:31:28,593 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 5.520 ms 02:31:28,593 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for more work 02:31:28,593 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 02:31:28,593 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=true} 02:31:28,593 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 02:31:28,593 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - leader239 (Leader): Setting last applied to 0 02:31:28,593 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to 0 02:31:28,593 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader239: Applying state for log index 0 data zero 02:31:28,593 PM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - leader239: applyState called: zero 02:31:28,593 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 527.8 μs 02:31:28,593 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 145.7 μs 02:31:28,593 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for more work 02:31:28,594 PM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 1 completion(s) pending 02:31:28,594 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower240: running 1 completion(s) 02:31:28,594 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 1 entries in 6.467 ms 02:31:28,594 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=0, term=1, command=zero, pending=false} 02:31:28,594 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting for more work 02:31:28,594 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@5a99acc6 [WARN] [06/27/2025 14:31:28.595] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower240] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower240, initialSyncDone=true] [WARN] [06/27/2025 14:31:28.688] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Persist data index=1 term=1 command=one 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 1, leaderSnapShotIndex: -1 02:31:28,688 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 94.74 ms 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 1 is present for follower follower240 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (Leader): Sending AppendEntries to follower follower240: AppendEntries{term=1, leaderId=leader239, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader239, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=one, pending=true}]} 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): Number of entries to be appended = 1 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): Append entry to log one 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=1, term=1, command=one, pending=true} 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): Log size is now 2 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): Commit index set to 0 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower240, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 0 (of expected -1) 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower240 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 02:31:28,688 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 0 02:31:28,689 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from -1 to 0 02:31:28,688 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 entries in 94.15 ms 02:31:28,689 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower240: Applying state for log index 0 data zero 02:31:28,689 PM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower240: applyState called: zero 02:31:28,689 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 1, nextIndex: 2 02:31:28,689 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 1 deferred callback(s) 02:31:28,689 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 [WARN] [06/27/2025 14:31:28.688] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:28,690 PM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 02:31:28,690 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 1.963 ms 02:31:28,690 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 02:31:28,690 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=true} 02:31:28,690 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for more work 02:31:28,690 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 02:31:28,690 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader239 (Leader): Setting last applied to 1 02:31:28,690 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 0 to 1 02:31:28,690 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader239: Applying state for log index 1 data one 02:31:28,690 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader239: applyState called: one 02:31:28,690 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 278.9 μs 02:31:28,691 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 146.8 μs 02:31:28,691 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for more work 02:31:28,691 PM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 1 completion(s) pending 02:31:28,691 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 1 entries in 2.545 ms 02:31:28,691 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower240: running 1 completion(s) 02:31:28,691 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 entries in 7.610 μs 02:31:28,691 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=1, term=1, command=one, pending=false} 02:31:28,691 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@527954df 02:31:28,691 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 1 entries in 129.1 μs 02:31:28,691 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting for more work 02:31:28,790 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader239: Persist data index=2 term=1 command=two 02:31:28,790 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=true} 02:31:28,790 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 02:31:28,790 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 2, leaderSnapShotIndex: -1 02:31:28,790 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1 02:31:28,790 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 2 is present for follower follower240 02:31:28,790 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 99.65 ms 02:31:28,790 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): Sending AppendEntries to follower follower240: AppendEntries{term=1, leaderId=leader239, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=true}]} 02:31:28,791 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader239: Persist data index=3 term=1 command=three 02:31:28,791 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=true} 02:31:28,791 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true 02:31:28,791 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 02:31:28,791 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: -1 02:31:28,791 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader239 (Leader): sendAppendEntries: 2 is present for follower follower240 [WARN] [06/27/2025 14:31:28.791] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 14:31:28.791] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=1, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:28,793 PM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 02:31:28,793 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 02:31:28,793 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 2.938 ms 02:31:28,793 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=true} 02:31:28,793 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 9.141 μs 02:31:28,796 PM [leader239-writer-101] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 02:31:28,796 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 2.261 ms 02:31:28,796 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: waiting for more work 02:31:28,796 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 02:31:28,796 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=true} 02:31:28,796 PM [test-pekko.actor.default-dispatcher-12] [INFO] SnapshotManager - leader239: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=2, mandatoryTrim=false] 02:31:28,796 PM [test-pekko.actor.default-dispatcher-16] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException [ERROR] [06/27/2025 14:31:28.796] [test-pekko.actor.internal-dispatcher-8] [pekko://test/user/leader239] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:308) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:308) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 02:31:28,797 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - leader239: terminating thread VirtualThread[#628,leader239-writer-101]/waiting 02:31:28,798 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: received 1 entries in 1.971 ms 02:31:28,798 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 39.20 μs 02:31:28,798 PM [leader239-writer-101] [DEBUG] JournalWriteTask - leader239: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@5a3b337b stopped 02:31:28,798 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader239: journal closed 02:31:28,798 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader239: journal closed 02:31:28,798 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks 02:31:28,798 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks [WARN] [06/27/2025 14:31:28.799] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader239]: org.opendaylight.controller.cluster.common.actor.Monitor@7cc20f39 02:31:28,800 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - leader239: Starting recovery with journal batch size 1000 02:31:28,800 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: started executor 02:31:28,800 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: started executor 02:31:28,801 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader239: metadata journal open: replayFrom=1 applyTo=1 02:31:28,802 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader239: journal open: firstIndex=1 lastIndex=4 replayFrom=1 fileEntries=0 02:31:28,802 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader239: journal open: applyTo=1 02:31:28,803 PM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@21aa8802 started 02:31:28,803 PM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting for more work 02:31:28,804 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=1, votedFor=leader239 02:31:28,804 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest15003981780368397182/leader239/TermInfo.properties 02:31:28,804 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest15003981780368397182/leader239/journal-v1-1.log 02:31:28,804 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RecoveryIntegrationTest15003981780368397182/leader239/metadata-v1-1.log 02:31:28,804 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: no eligible files found 02:31:28,804 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader239: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 02:31:28,804 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - leader239: restoring local TermInfo{term=1, votedFor=leader239} 02:31:28,804 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=1, votedFor=leader239 02:31:28,804 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@7b9f3a8e 02:31:28,804 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to -1 02:31:28,805 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=0, term=1, command=zero] 02:31:28,805 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=1, term=1, command=one] 02:31:28,806 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=2, term=1, command=two] 02:31:28,806 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader239: recovered journal DefaultLogEntry[index=3, term=1, command=three] 02:31:28,806 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader239: journal recovery completedin 2.035 ms with journalIndex=1 02:31:29,307 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader239 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.8:17355, Removed) 02:31:29,308 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader239 (Follower): Received ElectionTimeout - switching to Candidate 02:31:29,308 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader239 (Candidate): Election: Candidate has following voting peers: [follower241, follower240] 02:31:29,311 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader239: Set currentTerm=2, votedFor=leader239 02:31:29,311 PM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader239 (Candidate): Starting new election term 2 02:31:29,311 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} to peer follower241 02:31:29,311 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader239 (Candidate): Sending RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} to peer follower240 02:31:29,311 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader239 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 02:31:29,311 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 02:31:29,311 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): Cluster state: [] [WARN] [06/27/2025 14:31:29.311] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} 02:31:29,311 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} with higher term appears reachable, updating term. 02:31:29,311 PM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - follower240 (Follower): Term 2 in "RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1}" message is greater than follower's term 1 - updating term 02:31:29,315 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=2, votedFor=null 02:31:29,315 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): In requestVote: RequestVote{term=2, candidateId=leader239, lastLogIndex=3, lastLogTerm=1} - currentTerm: 2, votedFor: null, lastIndex: 1, lastTerm: 1 02:31:29,318 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower240: Set currentTerm=2, votedFor=leader239 02:31:29,318 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true} 02:31:29,318 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader239 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2 02:31:29,318 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader239 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1 02:31:29,318 PM [test-pekko.actor.default-dispatcher-17] [INFO] Candidate - leader239 (Candidate): LastApplied index -1 is behind last index 3 - switching to PreLeader 02:31:29,318 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Election: Leader has following peers: [follower241, follower240] 02:31:29,318 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 02:31:29,318 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 02:31:29,318 PM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader239 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 2 [WARN] [06/27/2025 14:31:29.318] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:29,319 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader239: Persist data index=4 term=2 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7 02:31:29,319 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7, pending=true} 02:31:29,319 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Replicate message: identifier: null, logIndex: 4, isSendImmediate: true 02:31:29,319 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 02:31:29,319 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 02:31:29,319 PM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 entries in 516.3 ms [WARN] [06/27/2025 14:31:29.319] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:29,321 PM [leader239-writer-102] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 02:31:29,321 PM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 2.280 ms 02:31:29,321 PM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting for more work 02:31:29,321 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 02:31:29,321 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7, pending=true} 02:31:29,346 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader239: Persist data index=5 term=2 command=four 02:31:29,346 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader239: Append log entry and persist JournaledLogEntry{index=5, term=2, command=four, pending=true} 02:31:29,346 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 5, isSendImmediate: true 02:31:29,346 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 02:31:29,346 PM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 entries in 25.04 ms 02:31:29,346 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 02:31:29,346 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging -1 entries behind leader leader239 and reached 0 (of expected -1) 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 1, nextIndex: 2 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 2, leaderLastIndex: 5, leaderSnapShotIndex: -1 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): sendAppendEntries: 2 is present for follower follower240 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader239 (PreLeader): Sending AppendEntries to follower follower240: AppendEntries{term=2, leaderId=leader239, prevLogIndex=1, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7, pending=false}, JournaledLogEntry{index=5, term=2, command=four, pending=true}]} [WARN] [06/27/2025 14:31:29.347] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=leader239, prevLogIndex=1, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=two, pending=false}, JournaledLogEntry{index=3, term=1, command=three, pending=false}, JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7, pending=false}, JournaledLogEntry{index=5, term=2, command=four, pending=true}]} 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Number of entries to be appended = 4 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Append entry to log two 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=2, term=1, command=two, pending=false} 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Append entry to log three 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=3, term=1, command=three, pending=false} 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Append entry to log org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7, pending=false} 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Append entry to log four 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: Append log entry and persist JournaledLogEntry{index=5, term=2, command=four, pending=true} 02:31:29,347 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 2 entries in 655.9 ms 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Log size is now 6 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=follower240, logLastIndex=5, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging -1 entries behind leader leader239 and reached 0 (of expected -1) 02:31:29,347 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 4 deferred callback(s) 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower240 updated: matchIndex: 5, nextIndex: 6 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 1 does not match the current term 2 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 1 does not match the current term 2 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 1 does not match the current term 2 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (PreLeader): Applying to log - commitIndex: 4, lastAppliedIndex: -1 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 0 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from -1 to 0 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader239: Applying state for log index 0 data zero 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader239: applyState called: zero 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 1 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 0 to 1 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader239: Applying state for log index 1 data one 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader239: applyState called: one 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 2 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 1 to 2 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader239: Applying state for log index 2 data two 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader239: applyState called: two 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 3 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 2 to 3 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader239: Applying state for log index 3 data three 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader239: applyState called: three 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 4 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 3 to 4 02:31:29,348 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader239: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7 02:31:29,349 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (PreLeader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 6, leaderLastIndex: 5, leaderSnapShotIndex: -1 02:31:29,349 PM [leader239-writer-102] [DEBUG] EntryStoreCompleter - leader239: 1 completion(s) pending 02:31:29,349 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader239: running 1 completion(s) 02:31:29,349 PM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 2.534 ms 02:31:29,349 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader239: persist complete JournaledLogEntry{index=5, term=2, command=four, pending=true} 02:31:29,349 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (PreLeader): Applying to log - commitIndex: 5, lastAppliedIndex: 4 02:31:29,349 PM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 entries in 10.61 μs 02:31:29,349 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader239 (PreLeader): Setting last applied to 5 02:31:29,349 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader239: Moving last applied index from 4 to 5 02:31:29,349 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader239: Applying state for log index 5 data four 02:31:29,349 PM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader239: applyState called: four 02:31:29,349 PM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 239.5 μs 02:31:29,349 PM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 entries in 7.851 μs 02:31:29,349 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] PreLeader - leader239 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=0, term=1, command=zero, pending=false}] - lastApplied: 5, lastIndex: 5 02:31:29,349 PM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 107.1 μs 02:31:29,349 PM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: waiting for more work 02:31:29,350 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Election: Leader has following peers: [follower241, follower240] 02:31:29,350 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower241: active: false, followerNextIndex: -1, leaderLastIndex: 5, leaderSnapShotIndex: -1 02:31:29,350 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader239 (Leader): Checking sendAppendEntries for follower follower240: active: true, followerNextIndex: 6, leaderLastIndex: 5, leaderSnapShotIndex: -1 [WARN] [06/27/2025 14:31:29.350] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:29,350 PM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader239 (PreLeader) :- Switching from behavior PreLeader to Leader, election term: 2 02:31:29,352 PM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 2 completion(s) pending 02:31:29,352 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: running 2 completion(s) 02:31:29,352 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 2 entries in 4.744 ms 02:31:29,352 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=2, term=1, command=two, pending=false} 02:31:29,352 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 2 entries in 10.22 μs 02:31:29,352 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@1e661f02 02:31:29,352 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=3, term=1, command=three, pending=false} 02:31:29,352 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@530634c9 02:31:29,352 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: awaiting more completions to resolve 2 deferred callback(s) 02:31:29,354 PM [follower240-writer-100] [DEBUG] EntryStoreCompleter - follower240: 2 completion(s) pending 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: running 2 completion(s) 02:31:29,354 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 2 entries in 1.797 ms 02:31:29,354 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting for more work 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=4, term=2, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7, pending=false} 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@e318ce9 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower240: persist complete JournaledLogEntry{index=5, term=2, command=four, pending=false} 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower240: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087fa30@14646d9b 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Commit index set to 4 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 4 (of expected -1) 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 4, context.getLastApplied(): 0, lastIndex(): 5 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 1 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 0 to 1 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower240: Applying state for log index 1 data one 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower240: applyState called: one 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 2 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 1 to 2 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower240: Applying state for log index 2 data two 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower240: applyState called: two 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 3 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 2 to 3 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower240: Applying state for log index 3 data three 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower240: applyState called: three 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 4 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 3 to 4 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower240: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@d03c8e7 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): Commit index set to 5 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 02:31:29,354 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 entries in 492.2 μs 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower240 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 5, context.getLastApplied(): 4, lastIndex(): 5 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower240 (Follower): Setting last applied to 5 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower240: Moving last applied index from 4 to 5 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower240: Applying state for log index 5 data four 02:31:29,354 PM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower240: applyState called: four 02:31:29,355 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 1 entries in 83.77 μs 02:31:29,355 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 entries in 16.98 μs 02:31:29,355 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 1 entries in 57.38 μs 02:31:29,355 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: waiting for more work [WARN] [06/27/2025 14:31:29.467] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:29,467 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:29.588] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:29,588 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 02:31:29,708 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:29.708] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:29,828 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:29.828] [test-pekko.actor.default-dispatcher-6] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:29,948 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:29.947] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:30,67 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:30.067] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:30,188 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:30.188] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:30,307 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:30.307] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:30,428 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:30.428] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:30,547 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:30.547] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 14:31:30.667] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:30,667 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 02:31:30,788 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:30.788] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 14:31:30.908] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:30,908 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:31.027] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:31,27 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 02:31:31,147 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:31.147] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:31,267 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:31.267] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:31,388 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:31.388] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 14:31:31.508] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:31,508 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:31.628] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:31,628 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:31.748] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:31,748 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 02:31:31,867 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:31.867] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:31,988 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:31.988] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:32,107 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:32.107] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 14:31:32.228] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:32,228 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 02:31:32,348 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:32.348] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:32,467 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:32.467] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 14:31:32.588] [test-pekko.actor.default-dispatcher-5] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:32,588 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 02:31:32,708 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:32.708] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:32,828 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:32.828] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:32,947 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:32.947] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:33,68 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:33.068] [test-pekko.actor.default-dispatcher-15] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:33,188 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:33.188] [test-pekko.actor.default-dispatcher-17] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 14:31:33.307] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:33,307 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:33.428] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:33,428 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:33.548] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:33,548 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 02:31:33,668 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:33.668] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 14:31:33.787] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:33,787 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:33.908] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:33,908 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:34.027] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:34,28 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 02:31:34,148 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:34.148] [test-pekko.actor.default-dispatcher-11] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 14:31:34.268] [test-pekko.actor.default-dispatcher-16] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:34,268 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) 02:31:34,381 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower240-collector242#-1706986002] 02:31:34,387 PM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower240: Lagging 0 entries behind leader leader239 and reached 5 (of expected -1) [WARN] [06/27/2025 14:31:34.387] [test-pekko.actor.default-dispatcher-12] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader239]: AppendEntries{term=2, leaderId=leader239, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 02:31:34,392 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower240] 02:31:34,392 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - follower240: terminating thread VirtualThread[#627,follower240-writer-100]/waiting 02:31:34,392 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: received 1 entries in 5.038 s 02:31:34,392 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: persisted 1 entries in 45.95 μs 02:31:34,392 PM [follower240-writer-100] [DEBUG] JournalWriteTask - follower240: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@2618a120 stopped 02:31:34,393 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower240: journal closed 02:31:34,393 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower240: journal closed 02:31:34,393 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower240: stopped executor with 0 remaining tasks 02:31:34,393 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower240: stopped executor with 0 remaining tasks 02:31:34,393 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader239-collector243#-503730995] 02:31:34,393 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader239] 02:31:34,394 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - leader239: terminating thread VirtualThread[#631,leader239-writer-102]/waiting 02:31:34,394 PM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: received 1 entries in 5.044 s 02:31:34,394 PM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: persisted 1 entries in 29.93 μs 02:31:34,394 PM [leader239-writer-102] [DEBUG] JournalWriteTask - leader239: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@21aa8802 stopped 02:31:34,394 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader239: journal closed 02:31:34,394 PM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader239: journal closed 02:31:34,394 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks 02:31:34,394 PM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader239: stopped executor with 0 remaining tasks 02:31:34,398 PM [test-pekko.actor.default-dispatcher-12] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [INFO] [06/27/2025 14:31:34.398] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [WARN] [06/27/2025 14:31:34.399] [test-pekko.actor.default-dispatcher-17] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.170.8:17355) [INFO] [06/27/2025 14:31:34.400] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.8:17355] - Exiting completed 02:31:34,401 PM [test-pekko.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.8:17355] - Exiting completed 02:31:34,401 PM [test-pekko.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.8:17355] - Shutting down... 02:31:34,401 PM [test-pekko.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.8:17355] - Successfully shut down [INFO] [06/27/2025 14:31:34.400] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.8:17355] - Shutting down... [INFO] [06/27/2025 14:31:34.400] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.8:17355] - Successfully shut down [INFO] [06/27/2025 14:31:34.402] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.170.8:17355/system/remoting-terminator] Shutting down remote daemon. [INFO] [06/27/2025 14:31:34.402] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.170.8:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports. 02:31:34,402 PM [test-pekko.actor.default-dispatcher-17] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 02:31:34,402 PM [test-pekko.actor.default-dispatcher-17] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [INFO] [06/27/2025 14:31:34.403] [test-pekko.remote.default-remote-dispatcher-9] [pekko://test@10.30.170.8:17355/system/remoting-terminator] Remoting shut down. 02:31:34,403 PM [test-pekko.actor.default-dispatcher-16] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.