[DEBUG] [06/27/2025 11:17:12.160] [main] [EventStream(pekko://test)] logger log1-TestEventListener started 11:17:12,161 AM [test-pekko.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [06/27/2025 11:17:12.161] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started [DEBUG] [06/27/2025 11:17:12.161] [main] [EventStream(pekko://test)] Default Loggers started [INFO] [06/27/2025 11:17:12.182] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.168:17355] with UID [-6378532241716279475] 11:17:12,182 AM [test-pekko.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.168:17355] with UID [-6378532241716279475] [INFO] [06/27/2025 11:17:12.182] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Starting up, Pekko version [1.0.3] ... 11:17:12,183 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Starting up, Pekko version [1.0.3] ... [INFO] [06/27/2025 11:17:12.184] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Registered cluster JMX MBean [pekko:type=Cluster] 11:17:12,184 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Registered cluster JMX MBean [pekko:type=Cluster] [INFO] [06/27/2025 11:17:12.184] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Started up successfully 11:17:12,185 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Started up successfully [INFO] [06/27/2025 11:17:12.185] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing [INFO] [06/27/2025 11:17:12.185] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 11:17:12,185 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing 11:17:12,186 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 11:17:12,195 AM [main] [INFO] ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest - testReplicationsWithLaggingFollowerCaughtUpViaAppendEntries starting: sending 2 new payloads [WARN] [06/27/2025 11:17:12.197] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower759]: org.opendaylight.controller.cluster.common.actor.Monitor@38ca326b [INFO] [pekkoDeadLetter][06/27/2025 11:17:12.197] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower759] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:12,198 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower759] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:12,199 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower759: Starting recovery with journal batch size 1000 11:17:12,199 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower759: started executor 11:17:12,199 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower759: started executor 11:17:12,200 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower759: metadata journal open: replayFrom=1 applyTo=0 11:17:12,200 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower759: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 11:17:12,200 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower759: journal open: applyTo=0 11:17:12,200 AM [follower759-writer-159] [DEBUG] JournalWriteTask - follower759: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@bf6d97e started 11:17:12,200 AM [follower759-writer-159] [DEBUG] JournalWriteTask - follower759: waiting for more work 11:17:12,205 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest13327362809412472616/follower759/TermInfo.properties does not exist 11:17:12,205 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower759: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest13327362809412472616/follower759/journal-v1-1.log 11:17:12,205 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower759: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest13327362809412472616/follower759/metadata-v1-1.log 11:17:12,205 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower759: no eligible files found 11:17:12,205 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower759: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:17:12,210 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower759: Set currentTerm=0, votedFor=null 11:17:12,210 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower759: Local TermInfo store seeded with TermInfo{term=0} 11:17:12,210 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower759: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@72dc7fcc 11:17:12,210 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower759: Moving last applied index from -1 to -1 11:17:12,211 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower759: journal recovery completedin 260.8 μs with journalIndex=1 11:17:12,298 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower760] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [06/27/2025 11:17:12.298] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower760]: org.opendaylight.controller.cluster.common.actor.Monitor@4757f583 [INFO] [pekkoDeadLetter][06/27/2025 11:17:12.298] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower760] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:12,299 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - follower760: Starting recovery with journal batch size 1000 11:17:12,299 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower760: started executor 11:17:12,299 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower760: started executor 11:17:12,300 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower760: metadata journal open: replayFrom=1 applyTo=0 11:17:12,300 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - follower760: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 11:17:12,301 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - follower760: journal open: applyTo=0 11:17:12,301 AM [follower760-writer-160] [DEBUG] JournalWriteTask - follower760: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@6d09ddf7 started 11:17:12,301 AM [follower760-writer-160] [DEBUG] JournalWriteTask - follower760: waiting for more work 11:17:12,302 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest13327362809412472616/follower760/TermInfo.properties does not exist 11:17:12,302 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower760: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest13327362809412472616/follower760/journal-v1-1.log 11:17:12,302 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower760: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest13327362809412472616/follower760/metadata-v1-1.log 11:17:12,302 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower760: no eligible files found 11:17:12,302 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower760: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:17:12,305 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower760: Set currentTerm=0, votedFor=null 11:17:12,305 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower760: Local TermInfo store seeded with TermInfo{term=0} 11:17:12,305 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower760: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@145eee5 11:17:12,305 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower760: Moving last applied index from -1 to -1 11:17:12,306 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower760: journal recovery completedin 235.1 μs with journalIndex=1 [WARN] [06/27/2025 11:17:12.399] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader758]: org.opendaylight.controller.cluster.common.actor.Monitor@5825a0ca [INFO] [pekkoDeadLetter][06/27/2025 11:17:12.399] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader758] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:12,399 AM [test-pekko.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader758] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:12,400 AM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - leader758: Starting recovery with journal batch size 1000 11:17:12,400 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader758: started executor 11:17:12,400 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader758: started executor 11:17:12,401 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader758: metadata journal open: replayFrom=1 applyTo=0 11:17:12,401 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader758: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 11:17:12,401 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - leader758: journal open: applyTo=0 11:17:12,401 AM [leader758-writer-161] [DEBUG] JournalWriteTask - leader758: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@40ea3ea3 started 11:17:12,402 AM [leader758-writer-161] [DEBUG] JournalWriteTask - leader758: waiting for more work 11:17:12,403 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest13327362809412472616/leader758/TermInfo.properties does not exist 11:17:12,403 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader758: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest13327362809412472616/leader758/journal-v1-1.log 11:17:12,403 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader758: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest13327362809412472616/leader758/metadata-v1-1.log 11:17:12,403 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader758: no eligible files found 11:17:12,403 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader758: Set currentTerm=5, votedFor=leader758 11:17:12,403 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader758: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:17:12,406 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader758: Set currentTerm=5, votedFor=leader758 11:17:12,406 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader758: Local TermInfo store seeded with TermInfo{term=5, votedFor=leader758} 11:17:12,406 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader758: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@502284c 11:17:12,406 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader758: Moving last applied index from -1 to -1 11:17:12,406 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader758: journal recovery completedin 253.6 μs with journalIndex=1 11:17:12,848 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 11:17:12,848 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - leader758 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed) 11:17:12,848 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - leader758 (Follower): Received ElectionTimeout - switching to Candidate 11:17:12,849 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader758 (Candidate): Election: Candidate has following voting peers: [follower759, follower760] 11:17:12,852 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader758: Set currentTerm=6, votedFor=leader758 11:17:12,852 AM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - leader758 (Candidate): Starting new election term 6 11:17:12,852 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader758 (Candidate): Sending RequestVote{term=6, candidateId=leader758, lastLogIndex=-1, lastLogTerm=-1} to peer follower759 11:17:12,852 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader758 (Candidate): Sending RequestVote{term=6, candidateId=leader758, lastLogIndex=-1, lastLogTerm=-1} to peer follower760 11:17:12,852 AM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader758 (Follower) :- Switching from behavior Follower to Candidate, election term: 6 11:17:12,852 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower759 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:12,852 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower760 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:12,852 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower759 (Follower): Cluster state: [] 11:17:12,852 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower759 (Follower): Candidate in requestVote:RequestVote{term=6, candidateId=leader758, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 11:17:12,852 AM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - follower759 (Follower): Term 6 in "RequestVote{term=6, candidateId=leader758, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 11:17:12,852 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower760 (Follower): Cluster state: [] 11:17:12,852 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower760 (Follower): Candidate in requestVote:RequestVote{term=6, candidateId=leader758, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 11:17:12,852 AM [test-pekko.actor.default-dispatcher-11] [INFO] Follower - follower760 (Follower): Term 6 in "RequestVote{term=6, candidateId=leader758, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 11:17:12,855 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower760: Set currentTerm=6, votedFor=null 11:17:12,856 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower760 (Follower): In requestVote: RequestVote{term=6, candidateId=leader758, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 6, votedFor: null, lastIndex: -1, lastTerm: -1 11:17:12,857 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower759: Set currentTerm=6, votedFor=null 11:17:12,857 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower759 (Follower): In requestVote: RequestVote{term=6, candidateId=leader758, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 6, votedFor: null, lastIndex: -1, lastTerm: -1 11:17:12,859 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower760: Set currentTerm=6, votedFor=leader758 11:17:12,859 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower760 (Follower): requestVote returning: RequestVoteReply{term=6, voteGranted=true} 11:17:12,859 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader758 (Candidate): RaftRPC message received RequestVoteReply{term=6, voteGranted=true}, my term is 6 11:17:12,859 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader758 (Candidate): handleRequestVoteReply: RequestVoteReply{term=6, voteGranted=true}, current voteCount: 1 11:17:12,859 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader758 (Leader): Election: Leader has following peers: [follower759, follower760] 11:17:12,860 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader758 (Leader): Checking sendAppendEntries for follower follower759: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 11:17:12,860 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader758 (Leader): Checking sendAppendEntries for follower follower760: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 11:17:12,860 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader758 (Candidate) :- Switching from behavior Candidate to Leader, election term: 6 11:17:12,860 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower760: Last sync leader does not match current leader leader758, need to catch up to -1 11:17:12,861 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader758 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower760 updated: matchIndex: -1, nextIndex: 0 11:17:12,861 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader758 (Leader): Checking sendAppendEntries for follower follower760: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [06/27/2025 11:17:12.861] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower760] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower760, initialSyncDone=false] 11:17:12,861 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower759: Set currentTerm=6, votedFor=leader758 11:17:12,861 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower759 (Follower): requestVote returning: RequestVoteReply{term=6, voteGranted=true} [INFO] [pekkoDeadLetter][06/27/2025 11:17:12.861] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower760] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower760] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:12,861 AM [test-pekko.actor.default-dispatcher-14] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower760] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:12,861 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader758 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower759 updated: matchIndex: -1, nextIndex: 0 11:17:12,862 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader758 (Leader): Checking sendAppendEntries for follower follower759: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 11:17:12,862 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower759: Last sync leader does not match current leader leader758, need to catch up to -1 [WARN] [06/27/2025 11:17:12.862] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower759] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower759, initialSyncDone=false] [INFO] [pekkoDeadLetter][06/27/2025 11:17:12.862] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower759] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower759] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:12,862 AM [test-pekko.actor.default-dispatcher-6] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower759] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:12,903 AM [main] [INFO] ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest - Leader created and elected 11:17:12,903 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader758: Persist data index=0 term=6 command=zero 11:17:12,903 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader758: Append log entry and persist JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:12,903 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 11:17:12,903 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): Checking sendAppendEntries for follower follower759: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 11:17:12,903 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): sendAppendEntries: 0 is present for follower follower759 11:17:12,904 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): Sending AppendEntries to follower follower759: AppendEntries{term=6, leaderId=leader758, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:12,903 AM [leader758-writer-161] [DEBUG] JournalWriteTask - leader758: received 1 entries in 502.0 ms 11:17:12,904 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower759 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader758, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:12,904 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower759 (Follower): Number of entries to be appended = 1 11:17:12,904 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower759 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 11:17:12,904 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower759 (Follower): Append entry to log zero 11:17:12,904 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower759: Append log entry and persist JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:12,904 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower759 (Follower): Log size is now 1 11:17:12,904 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower759 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower759, logLastIndex=0, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:12,904 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower759: Lagging 0 entries behind leader leader758 and reached -1 (of expected -1) 11:17:12,904 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower759: awaiting more completions to resolve 1 deferred callback(s) 11:17:12,904 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): Checking sendAppendEntries for follower follower760: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 11:17:12,904 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): sendAppendEntries: 0 is present for follower follower760 11:17:12,904 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): Sending AppendEntries to follower follower760: AppendEntries{term=6, leaderId=leader758, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:12,904 AM [follower759-writer-159] [DEBUG] JournalWriteTask - follower759: received 1 entries in 703.6 ms 11:17:12,904 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower759 updated: matchIndex: 0, nextIndex: 1 11:17:12,904 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): Checking sendAppendEntries for follower follower759: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 11:17:12,905 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader758: Persist data index=1 term=6 command=one 11:17:12,905 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader758: Append log entry and persist JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:12,905 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 11:17:12,905 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): Checking sendAppendEntries for follower follower759: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:12,905 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): sendAppendEntries: 1 is present for follower follower759 11:17:12,905 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): Sending AppendEntries to follower follower759: AppendEntries{term=6, leaderId=leader758, prevLogIndex=0, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=6, command=one, pending=true}]} 11:17:12,905 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): Checking sendAppendEntries for follower follower760: active: true, followerNextIndex: 0, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:12,905 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): sendAppendEntries: 0 is present for follower follower760 11:17:12,908 AM [leader758-writer-161] [DEBUG] EntryStoreCompleter - leader758: 1 completion(s) pending 11:17:12,908 AM [leader758-writer-161] [DEBUG] JournalWriteTask - leader758: persisted 1 entries in 4.122 ms 11:17:12,908 AM [leader758-writer-161] [DEBUG] JournalWriteTask - leader758: received 1 entries in 7.190 μs 11:17:12,908 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - leader758: running 1 completion(s) 11:17:12,908 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader758: persist complete JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:12,908 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 11:17:12,908 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader758 (Leader): Setting last applied to 0 11:17:12,908 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader758: Moving last applied index from -1 to 0 11:17:12,908 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader758: Applying state for log index 0 data zero 11:17:12,908 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader758: applyState called: zero 11:17:12,909 AM [follower759-writer-159] [DEBUG] EntryStoreCompleter - follower759: 1 completion(s) pending 11:17:12,909 AM [follower759-writer-159] [DEBUG] JournalWriteTask - follower759: persisted 1 entries in 4.973 ms 11:17:12,909 AM [follower759-writer-159] [DEBUG] JournalWriteTask - follower759: waiting for more work 11:17:12,909 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower759: running 1 completion(s) 11:17:12,909 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower759: persist complete JournaledLogEntry{index=0, term=6, command=zero, pending=false} 11:17:12,909 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower759: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@3155e80f 11:17:12,909 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower759 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader758, prevLogIndex=0, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=6, command=one, pending=true}]} 11:17:12,909 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower759 (Follower): Number of entries to be appended = 1 11:17:12,909 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower759 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 11:17:12,909 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower759 (Follower): Append entry to log one 11:17:12,909 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower759: Append log entry and persist JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:12,909 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower759 (Follower): Log size is now 2 11:17:12,909 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower759 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower759, logLastIndex=1, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:12,909 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower759: Lagging 0 entries behind leader leader758 and reached -1 (of expected -1) 11:17:12,909 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower759: awaiting more completions to resolve 1 deferred callback(s) 11:17:12,910 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader758 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower759 updated: matchIndex: 1, nextIndex: 2 11:17:12,910 AM [follower759-writer-159] [DEBUG] JournalWriteTask - follower759: received 1 entries in 486.5 μs 11:17:12,910 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader758 (Leader): Checking sendAppendEntries for follower follower759: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:12,910 AM [leader758-writer-161] [DEBUG] EntryStoreCompleter - leader758: 1 completion(s) pending 11:17:12,910 AM [leader758-writer-161] [DEBUG] JournalWriteTask - leader758: persisted 1 entries in 2.393 ms 11:17:12,910 AM [leader758-writer-161] [DEBUG] JournalWriteTask - leader758: received 1 entries in 6.150 μs 11:17:12,910 AM [leader758-writer-161] [DEBUG] JournalWriteTask - leader758: persisted 1 entries in 103.1 μs 11:17:12,910 AM [leader758-writer-161] [DEBUG] JournalWriteTask - leader758: waiting for more work 11:17:12,910 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - leader758: running 1 completion(s) 11:17:12,910 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader758: persist complete JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:12,911 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 11:17:12,911 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - leader758 (Leader): Setting last applied to 1 11:17:12,911 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - leader758: Moving last applied index from 0 to 1 11:17:12,911 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader758: Applying state for log index 1 data one 11:17:12,911 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader758: applyState called: one 11:17:12,911 AM [leader758-writer-161] [DEBUG] JournalWriteTask - leader758: received 1 entries in 387.6 μs 11:17:12,911 AM [leader758-writer-161] [DEBUG] JournalWriteTask - leader758: persisted 1 entries in 97.74 μs 11:17:12,911 AM [leader758-writer-161] [DEBUG] JournalWriteTask - leader758: waiting for more work 11:17:12,911 AM [follower759-writer-159] [DEBUG] EntryStoreCompleter - follower759: 1 completion(s) pending 11:17:12,911 AM [follower759-writer-159] [DEBUG] JournalWriteTask - follower759: persisted 1 entries in 1.682 ms 11:17:12,911 AM [follower759-writer-159] [DEBUG] JournalWriteTask - follower759: waiting for more work 11:17:12,911 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower759: running 1 completion(s) 11:17:12,911 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower759: persist complete JournaledLogEntry{index=1, term=6, command=one, pending=false} 11:17:12,911 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower759: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@7cd61abf 11:17:12,911 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower759 (Follower): Commit index set to 0 11:17:12,912 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower759: Lagging 0 entries behind leader leader758 and reached 0 (of expected -1) 11:17:12,912 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower759 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 11:17:12,912 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower759 (Follower): Setting last applied to 0 11:17:12,912 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower759: Moving last applied index from -1 to 0 11:17:12,912 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower759: Applying state for log index 0 data zero 11:17:12,912 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower759: applyState called: zero [WARN] [06/27/2025 11:17:12.912] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower759] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower759, initialSyncDone=true] 11:17:12,912 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower759 (Follower): Commit index set to 1 11:17:12,912 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower759: Lagging 0 entries behind leader leader758 and reached 1 (of expected -1) 11:17:12,912 AM [follower759-writer-159] [DEBUG] JournalWriteTask - follower759: received 1 entries in 710.3 μs 11:17:12,912 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower759 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1 11:17:12,912 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower759 (Follower): Setting last applied to 1 11:17:12,912 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower759: Moving last applied index from 0 to 1 11:17:12,912 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower759: Applying state for log index 1 data one 11:17:12,912 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower759: applyState called: one 11:17:12,912 AM [follower759-writer-159] [DEBUG] JournalWriteTask - follower759: persisted 1 entries in 159.5 μs 11:17:12,912 AM [follower759-writer-159] [DEBUG] JournalWriteTask - follower759: waiting for more work 11:17:12,912 AM [follower759-writer-159] [DEBUG] JournalWriteTask - follower759: received 1 entries in 224.2 μs 11:17:12,913 AM [follower759-writer-159] [DEBUG] JournalWriteTask - follower759: persisted 1 entries in 66.06 μs 11:17:12,913 AM [follower759-writer-159] [DEBUG] JournalWriteTask - follower759: waiting for more work [INFO] [pekkoDeadLetter][06/27/2025 11:17:12.913] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower759] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower759] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:12,913 AM [test-pekko.actor.default-dispatcher-17] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower759] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:12,979 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): sendAppendEntries: 0 is present for follower follower760 11:17:12,979 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): Sending AppendEntries to follower follower760: AppendEntries{term=6, leaderId=leader758, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=false}, JournaledLogEntry{index=1, term=6, command=one, pending=false}]} 11:17:13,99 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader758 (Leader): sendAppendEntries: 0 is present for follower follower760 11:17:13,99 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower759: Lagging 0 entries behind leader leader758 and reached 1 (of expected -1) 11:17:13,99 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader758 (Leader): Sending AppendEntries to follower follower760: AppendEntries{term=6, leaderId=leader758, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=false}, JournaledLogEntry{index=1, term=6, command=one, pending=false}]} 11:17:13,104 AM [main] [INFO] ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest - testReplicationsWithLaggingFollowerCaughtUpViaAppendEntries: new entries applied - resuming follower follower760 11:17:13,218 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): sendAppendEntries: 0 is present for follower follower760 11:17:13,218 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): Sending AppendEntries to follower follower760: AppendEntries{term=6, leaderId=leader758, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=false}, JournaledLogEntry{index=1, term=6, command=one, pending=false}]} 11:17:13,218 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower759: Lagging 0 entries behind leader leader758 and reached 1 (of expected -1) 11:17:13,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower760 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader758, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=false}, JournaledLogEntry{index=1, term=6, command=one, pending=false}]} 11:17:13,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower760 (Follower): Number of entries to be appended = 2 11:17:13,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower760 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 11:17:13,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower760 (Follower): Append entry to log zero 11:17:13,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower760: Append log entry and persist JournaledLogEntry{index=0, term=6, command=zero, pending=false} 11:17:13,219 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower760 (Follower): Append entry to log one 11:17:13,219 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower760: Append log entry and persist JournaledLogEntry{index=1, term=6, command=one, pending=false} 11:17:13,219 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower760 (Follower): Log size is now 2 11:17:13,219 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower760 (Follower): Commit index set to 1 11:17:13,219 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower760 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower760, logLastIndex=1, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:13,219 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower760: Lagging 0 entries behind leader leader758 and reached 1 (of expected -1) 11:17:13,219 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower760 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): -1, lastIndex(): 1 11:17:13,219 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower760 (Follower): Setting last applied to 0 11:17:13,219 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower760: Moving last applied index from -1 to 0 11:17:13,219 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower760: Applying state for log index 0 data zero 11:17:13,219 AM [follower760-writer-160] [DEBUG] JournalWriteTask - follower760: received 2 entries in 917.9 ms 11:17:13,219 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower760: applyState called: zero 11:17:13,219 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower760 (Follower): Setting last applied to 1 11:17:13,219 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower760: Moving last applied index from 0 to 1 11:17:13,219 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower760: Applying state for log index 1 data one 11:17:13,219 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower760: applyState called: one 11:17:13,219 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower760: awaiting more completions to resolve 2 deferred callback(s) 11:17:13,219 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower760 updated: matchIndex: 1, nextIndex: 2 11:17:13,219 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - leader758: fakeSnapshot purging log to 0 for term 6 11:17:13,219 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader758 (Leader): Checking sendAppendEntries for follower follower760: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: 0 11:17:13,225 AM [follower760-writer-160] [DEBUG] EntryStoreCompleter - follower760: 2 completion(s) pending 11:17:13,225 AM [follower760-writer-160] [DEBUG] JournalWriteTask - follower760: persisted 2 entries in 6.549 ms 11:17:13,225 AM [follower760-writer-160] [DEBUG] JournalWriteTask - follower760: received 1 entries in 6.520 μs 11:17:13,225 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower760: running 2 completion(s) 11:17:13,225 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower760: persist complete JournaledLogEntry{index=0, term=6, command=zero, pending=false} 11:17:13,225 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower760: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@796c115d 11:17:13,225 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower760: persist complete JournaledLogEntry{index=1, term=6, command=one, pending=false} 11:17:13,225 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower760: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@35bd8355 11:17:13,225 AM [follower760-writer-160] [DEBUG] JournalWriteTask - follower760: persisted 1 entries in 102.5 μs 11:17:13,225 AM [follower760-writer-160] [DEBUG] JournalWriteTask - follower760: waiting for more work [WARN] [06/27/2025 11:17:13.226] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower760] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower760, initialSyncDone=true] [INFO] [pekkoDeadLetter][06/27/2025 11:17:13.226] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower760] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower760] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:13,226 AM [test-pekko.actor.default-dispatcher-11] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower760] was unhandled. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:13,338 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower759: Lagging 0 entries behind leader leader758 and reached 1 (of expected -1) 11:17:13,338 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SnapshotManager - follower759: fakeSnapshot purging log to 0 for term 6 11:17:13,339 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower760: Lagging 0 entries behind leader leader758 and reached 1 (of expected -1) 11:17:13,339 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - follower760: fakeSnapshot purging log to 0 for term 6 11:17:13,356 AM [main] [INFO] ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest - testReplicationsWithLaggingFollowerCaughtUpViaAppendEntries complete 11:17:13,356 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower759-collector761#-1979865526] 11:17:13,368 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower759] 11:17:13,368 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - follower759: terminating thread VirtualThread[#894,follower759-writer-159]/waiting 11:17:13,368 AM [follower759-writer-159] [DEBUG] JournalWriteTask - follower759: received 1 entries in 455.3 ms 11:17:13,368 AM [follower759-writer-159] [DEBUG] JournalWriteTask - follower759: persisted 1 entries in 33.75 μs 11:17:13,368 AM [follower759-writer-159] [DEBUG] JournalWriteTask - follower759: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@bf6d97e stopped 11:17:13,368 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower759: journal closed 11:17:13,368 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower759: journal closed 11:17:13,368 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower759: stopped executor with 0 remaining tasks 11:17:13,368 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower759: stopped executor with 0 remaining tasks 11:17:13,368 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower760-collector762#-1594621150] 11:17:13,369 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower760] 11:17:13,369 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - follower760: terminating thread VirtualThread[#897,follower760-writer-160]/waiting 11:17:13,369 AM [follower760-writer-160] [DEBUG] JournalWriteTask - follower760: received 1 entries in 143.4 ms 11:17:13,369 AM [follower760-writer-160] [DEBUG] JournalWriteTask - follower760: persisted 1 entries in 20.93 μs 11:17:13,369 AM [follower760-writer-160] [DEBUG] JournalWriteTask - follower760: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@6d09ddf7 stopped 11:17:13,369 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower760: journal closed 11:17:13,369 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower760: journal closed 11:17:13,369 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower760: stopped executor with 0 remaining tasks 11:17:13,369 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower760: stopped executor with 0 remaining tasks 11:17:13,369 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader758-collector763#817500285] 11:17:13,369 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader758] 11:17:13,370 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - leader758: terminating thread VirtualThread[#898,leader758-writer-161]/waiting 11:17:13,370 AM [leader758-writer-161] [DEBUG] JournalWriteTask - leader758: received 1 entries in 458.8 ms 11:17:13,370 AM [leader758-writer-161] [DEBUG] JournalWriteTask - leader758: persisted 1 entries in 18.71 μs 11:17:13,370 AM [leader758-writer-161] [DEBUG] JournalWriteTask - leader758: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@40ea3ea3 stopped 11:17:13,370 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader758: journal closed 11:17:13,370 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader758: journal closed 11:17:13,370 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader758: stopped executor with 0 remaining tasks 11:17:13,370 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader758: stopped executor with 0 remaining tasks 11:17:13,372 AM [main] [INFO] ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest - testLeaderSnapshotWithLaggingFollowerCaughtUpViaInstallSnapshot starting [WARN] [06/27/2025 11:17:13.374] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower768]: org.opendaylight.controller.cluster.common.actor.Monitor@345a16ef [INFO] [pekkoDeadLetter][06/27/2025 11:17:13.374] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower768] to Actor[pekko://test/user/termination-monitor] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:13,374 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower768] to Actor[pekko://test/user/termination-monitor] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:13,374 AM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - follower768: Starting recovery with journal batch size 1000 11:17:13,375 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower768: started executor 11:17:13,375 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower768: started executor 11:17:13,375 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower768: metadata journal open: replayFrom=1 applyTo=0 11:17:13,376 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower768: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 11:17:13,376 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - follower768: journal open: applyTo=0 11:17:13,376 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@3414633c started 11:17:13,376 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: waiting for more work 11:17:13,378 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/follower768/TermInfo.properties does not exist 11:17:13,378 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower768: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/follower768/journal-v1-1.log 11:17:13,378 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower768: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/follower768/metadata-v1-1.log 11:17:13,378 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower768: no eligible files found 11:17:13,378 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower768: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:17:13,378 AM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - follower769: Starting recovery with journal batch size 1000 11:17:13,378 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower769: started executor 11:17:13,378 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower769: started executor [WARN] [06/27/2025 11:17:13.379] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower769]: org.opendaylight.controller.cluster.common.actor.Monitor@65a2b757 [INFO] [pekkoDeadLetter][06/27/2025 11:17:13.379] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower769] to Actor[pekko://test/user/termination-monitor] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:13,379 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower769] to Actor[pekko://test/user/termination-monitor] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:13,379 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower769: metadata journal open: replayFrom=1 applyTo=0 11:17:13,380 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower769: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 11:17:13,381 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - follower769: journal open: applyTo=0 11:17:13,381 AM [follower769-writer-163] [DEBUG] JournalWriteTask - follower769: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@453de252 started 11:17:13,381 AM [follower769-writer-163] [DEBUG] JournalWriteTask - follower769: waiting for more work 11:17:13,381 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower768: Set currentTerm=0, votedFor=null 11:17:13,381 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower768: Local TermInfo store seeded with TermInfo{term=0} 11:17:13,381 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower768: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@6647aed2 11:17:13,381 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower768: Moving last applied index from -1 to -1 11:17:13,382 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower768: journal recovery completedin 290.9 μs with journalIndex=1 11:17:13,382 AM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - leader767: Starting recovery with journal batch size 1000 11:17:13,382 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader767: started executor 11:17:13,382 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader767: started executor [WARN] [06/27/2025 11:17:13.382] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader767]: org.opendaylight.controller.cluster.common.actor.Monitor@190d5e1b 11:17:13,382 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader767] to Actor[pekko://test/user/termination-monitor] was not delivered. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:13,382 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader767: metadata journal open: replayFrom=1 applyTo=0 [INFO] [pekkoDeadLetter][06/27/2025 11:17:13.382] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader767] to Actor[pekko://test/user/termination-monitor] was not delivered. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 11:17:13,383 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/follower769/TermInfo.properties does not exist 11:17:13,383 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower769: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/follower769/journal-v1-1.log 11:17:13,383 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower769: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/follower769/metadata-v1-1.log 11:17:13,383 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader767: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 11:17:13,383 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower769: no eligible files found 11:17:13,383 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - leader767: journal open: applyTo=0 11:17:13,383 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower769: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:17:13,383 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@2f3b7c62 started 11:17:13,383 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: waiting for more work 11:17:13,384 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties does not exist 11:17:13,385 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:13,385 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:13,385 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:13,385 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader767: Set currentTerm=5, votedFor=leader767 11:17:13,385 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader767: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:17:13,389 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower769: Set currentTerm=0, votedFor=null 11:17:13,389 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower769: Local TermInfo store seeded with TermInfo{term=0} 11:17:13,389 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower769: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@502119f8 11:17:13,389 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower769: Moving last applied index from -1 to -1 11:17:13,389 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower769: journal recovery completedin 161.0 μs with journalIndex=1 11:17:13,390 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader767: Set currentTerm=5, votedFor=leader767 11:17:13,390 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader767: Local TermInfo store seeded with TermInfo{term=5, votedFor=leader767} 11:17:13,390 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader767: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@52f9a391 11:17:13,390 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader767: Moving last applied index from -1 to -1 11:17:13,390 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - leader767: journal recovery completedin 194.0 μs with journalIndex=1 11:17:13,908 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 11:17:13,908 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - leader767 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed) 11:17:13,909 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - leader767 (Follower): Received ElectionTimeout - switching to Candidate 11:17:13,909 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader767 (Candidate): Election: Candidate has following voting peers: [follower769, follower768] 11:17:13,912 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader767: Set currentTerm=6, votedFor=leader767 11:17:13,912 AM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - leader767 (Candidate): Starting new election term 6 11:17:13,912 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader767 (Candidate): Sending RequestVote{term=6, candidateId=leader767, lastLogIndex=-1, lastLogTerm=-1} to peer follower769 11:17:13,912 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader767 (Candidate): Sending RequestVote{term=6, candidateId=leader767, lastLogIndex=-1, lastLogTerm=-1} to peer follower768 11:17:13,912 AM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader767 (Follower) :- Switching from behavior Follower to Candidate, election term: 6 11:17:13,913 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower769 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:13,913 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower769 (Follower): Cluster state: [] 11:17:13,913 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower769 (Follower): Candidate in requestVote:RequestVote{term=6, candidateId=leader767, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 11:17:13,913 AM [test-pekko.actor.default-dispatcher-14] [INFO] Follower - follower769 (Follower): Term 6 in "RequestVote{term=6, candidateId=leader767, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 11:17:13,913 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower768 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:13,913 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower768 (Follower): Cluster state: [] 11:17:13,913 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower768 (Follower): Candidate in requestVote:RequestVote{term=6, candidateId=leader767, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 11:17:13,913 AM [test-pekko.actor.default-dispatcher-18] [INFO] Follower - follower768 (Follower): Term 6 in "RequestVote{term=6, candidateId=leader767, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 11:17:13,916 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower769: Set currentTerm=6, votedFor=null 11:17:13,916 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower769 (Follower): In requestVote: RequestVote{term=6, candidateId=leader767, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 6, votedFor: null, lastIndex: -1, lastTerm: -1 11:17:13,917 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower768: Set currentTerm=6, votedFor=null 11:17:13,917 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower768 (Follower): In requestVote: RequestVote{term=6, candidateId=leader767, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 6, votedFor: null, lastIndex: -1, lastTerm: -1 11:17:13,919 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower769: Set currentTerm=6, votedFor=leader767 11:17:13,919 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower769 (Follower): requestVote returning: RequestVoteReply{term=6, voteGranted=true} 11:17:13,919 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader767 (Candidate): RaftRPC message received RequestVoteReply{term=6, voteGranted=true}, my term is 6 11:17:13,919 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader767 (Candidate): handleRequestVoteReply: RequestVoteReply{term=6, voteGranted=true}, current voteCount: 1 11:17:13,920 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader767 (Leader): Election: Leader has following peers: [follower769, follower768] 11:17:13,920 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower769: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 11:17:13,920 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower768: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 11:17:13,920 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader767 (Candidate) :- Switching from behavior Candidate to Leader, election term: 6 11:17:13,920 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader767 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower769 updated: matchIndex: -1, nextIndex: 0 11:17:13,920 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower769: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 11:17:13,920 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower769: Last sync leader does not match current leader leader767, need to catch up to -1 [WARN] [06/27/2025 11:17:13.920] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower769] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower769, initialSyncDone=false] 11:17:13,921 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower768: Set currentTerm=6, votedFor=leader767 11:17:13,921 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower768 (Follower): requestVote returning: RequestVoteReply{term=6, voteGranted=true} 11:17:13,921 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower768: Last sync leader does not match current leader leader767, need to catch up to -1 11:17:13,921 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower768 updated: matchIndex: -1, nextIndex: 0 11:17:13,921 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [06/27/2025 11:17:13.921] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/follower768] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower768, initialSyncDone=false] 11:17:13,944 AM [main] [INFO] ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest - Leader created and elected 11:17:13,944 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader767: Persist data index=0 term=6 command=zero 11:17:13,944 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader767: Append log entry and persist JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:13,944 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 11:17:13,944 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower769: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 11:17:13,944 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): sendAppendEntries: 0 is present for follower follower769 11:17:13,944 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: received 1 entries in 561.0 ms 11:17:13,944 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): Sending AppendEntries to follower follower769: AppendEntries{term=6, leaderId=leader767, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:13,945 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower769 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader767, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:13,945 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower769 (Follower): Number of entries to be appended = 1 11:17:13,945 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower769 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 11:17:13,945 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower769 (Follower): Append entry to log zero 11:17:13,945 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower769: Append log entry and persist JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:13,945 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower769 (Follower): Log size is now 1 11:17:13,945 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower769 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower769, logLastIndex=0, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:13,945 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower769: Lagging 0 entries behind leader leader767 and reached -1 (of expected -1) 11:17:13,945 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower769: awaiting more completions to resolve 1 deferred callback(s) 11:17:13,945 AM [follower769-writer-163] [DEBUG] JournalWriteTask - follower769: received 1 entries in 564.1 ms 11:17:13,945 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 11:17:13,945 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): sendAppendEntries: 0 is present for follower follower768 11:17:13,945 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): Sending AppendEntries to follower follower768: AppendEntries{term=6, leaderId=leader767, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:13,945 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower769 updated: matchIndex: 0, nextIndex: 1 11:17:13,945 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower769: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 11:17:13,945 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader767: Persist data index=1 term=6 command=one 11:17:13,945 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader767: Append log entry and persist JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:13,945 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader767, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:13,945 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): Number of entries to be appended = 1 11:17:13,945 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 11:17:13,945 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 11:17:13,945 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): Append entry to log zero 11:17:13,945 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower768: Append log entry and persist JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:13,945 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower769: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:13,945 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): sendAppendEntries: 1 is present for follower follower769 11:17:13,945 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): Log size is now 1 11:17:13,945 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower768, logLastIndex=0, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:13,945 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: received 1 entries in 569.3 ms 11:17:13,945 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached -1 (of expected -1) 11:17:13,945 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower768: awaiting more completions to resolve 1 deferred callback(s) 11:17:13,945 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): Sending AppendEntries to follower follower769: AppendEntries{term=6, leaderId=leader767, prevLogIndex=0, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=6, command=one, pending=true}]} 11:17:13,946 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 0, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:13,946 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): sendAppendEntries: 0 is present for follower follower768 11:17:13,946 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower768 updated: matchIndex: 0, nextIndex: 1 11:17:13,946 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:13,946 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): sendAppendEntries: 1 is present for follower follower768 11:17:13,946 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): Sending AppendEntries to follower follower768: AppendEntries{term=6, leaderId=leader767, prevLogIndex=0, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=6, command=one, pending=true}]} 11:17:13,949 AM [leader767-writer-164] [DEBUG] EntryStoreCompleter - leader767: 1 completion(s) pending 11:17:13,949 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: persisted 1 entries in 5.004 ms 11:17:13,949 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: received 1 entries in 6.990 μs 11:17:13,949 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader767: running 1 completion(s) 11:17:13,950 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader767: persist complete JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:13,950 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 11:17:13,950 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader767 (Leader): Setting last applied to 0 11:17:13,950 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader767: Moving last applied index from -1 to 0 11:17:13,950 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader767: Applying state for log index 0 data zero 11:17:13,950 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader767: applyState called: zero 11:17:13,950 AM [follower768-writer-162] [DEBUG] EntryStoreCompleter - follower768: 1 completion(s) pending 11:17:13,951 AM [follower769-writer-163] [DEBUG] EntryStoreCompleter - follower769: 1 completion(s) pending 11:17:13,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower768: running 1 completion(s) 11:17:13,951 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: persisted 1 entries in 5.156 ms 11:17:13,951 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: waiting for more work 11:17:13,951 AM [follower769-writer-163] [DEBUG] JournalWriteTask - follower769: persisted 1 entries in 5.768 ms 11:17:13,951 AM [follower769-writer-163] [DEBUG] JournalWriteTask - follower769: waiting for more work 11:17:13,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower768: persist complete JournaledLogEntry{index=0, term=6, command=zero, pending=false} 11:17:13,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower768: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@58d4818 11:17:13,951 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower769: running 1 completion(s) 11:17:13,951 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower769: persist complete JournaledLogEntry{index=0, term=6, command=zero, pending=false} 11:17:13,951 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower769: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@1a0db053 11:17:13,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader767, prevLogIndex=0, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=6, command=one, pending=true}]} 11:17:13,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): Number of entries to be appended = 1 11:17:13,951 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower769 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader767, prevLogIndex=0, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=6, command=one, pending=true}]} 11:17:13,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 11:17:13,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): Append entry to log one 11:17:13,951 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower769 (Follower): Number of entries to be appended = 1 11:17:13,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower768: Append log entry and persist JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:13,951 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower769 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 11:17:13,951 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower769 (Follower): Append entry to log one 11:17:13,951 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower769: Append log entry and persist JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:13,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): Log size is now 2 11:17:13,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower768, logLastIndex=1, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:13,951 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower769 (Follower): Log size is now 2 11:17:13,951 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: received 1 entries in 373.3 μs 11:17:13,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached -1 (of expected -1) 11:17:13,951 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower769 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower769, logLastIndex=1, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:13,951 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower769: Lagging 0 entries behind leader leader767 and reached -1 (of expected -1) 11:17:13,951 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower768: awaiting more completions to resolve 1 deferred callback(s) 11:17:13,951 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower769: awaiting more completions to resolve 1 deferred callback(s) 11:17:13,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower768 updated: matchIndex: 1, nextIndex: 2 11:17:13,951 AM [follower769-writer-163] [DEBUG] JournalWriteTask - follower769: received 1 entries in 507.9 μs 11:17:13,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:13,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower769 updated: matchIndex: 1, nextIndex: 2 11:17:13,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower769: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:13,951 AM [leader767-writer-164] [DEBUG] EntryStoreCompleter - leader767: 1 completion(s) pending 11:17:13,952 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: persisted 1 entries in 2.049 ms 11:17:13,952 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader767: running 1 completion(s) 11:17:13,952 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader767: persist complete JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:13,952 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: received 1 entries in 7.550 μs 11:17:13,952 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 11:17:13,952 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader767 (Leader): Setting last applied to 1 11:17:13,952 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader767: Moving last applied index from 0 to 1 11:17:13,952 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader767: Applying state for log index 1 data one 11:17:13,952 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader767: applyState called: one 11:17:13,952 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: persisted 1 entries in 153.5 μs 11:17:13,952 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: waiting for more work 11:17:13,952 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - leader767: fakeSnapshot purging log to 0 for term 6 11:17:13,952 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: received 1 entries in 86.96 μs 11:17:13,952 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: persisted 1 entries in 61.61 μs 11:17:13,952 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: waiting for more work 11:17:13,953 AM [follower769-writer-163] [DEBUG] EntryStoreCompleter - follower769: 1 completion(s) pending 11:17:13,953 AM [follower768-writer-162] [DEBUG] EntryStoreCompleter - follower768: 1 completion(s) pending 11:17:13,953 AM [follower769-writer-163] [DEBUG] JournalWriteTask - follower769: persisted 1 entries in 1.451 ms 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower768: running 1 completion(s) 11:17:13,953 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: persisted 1 entries in 1.626 ms 11:17:13,953 AM [follower769-writer-163] [DEBUG] JournalWriteTask - follower769: waiting for more work 11:17:13,953 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: waiting for more work 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower768: persist complete JournaledLogEntry{index=1, term=6, command=one, pending=false} 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower768: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@31d42497 11:17:13,953 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower769: running 1 completion(s) 11:17:13,953 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - follower769: persist complete JournaledLogEntry{index=1, term=6, command=one, pending=false} 11:17:13,953 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryStoreCompleter - follower769: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@30d4929a 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): Commit index set to 0 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 0 (of expected -1) 11:17:13,953 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower769 (Follower): Commit index set to 0 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 11:17:13,953 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower769: Lagging 0 entries behind leader leader767 and reached 0 (of expected -1) 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower768 (Follower): Setting last applied to 0 11:17:13,953 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower769 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower768: Moving last applied index from -1 to 0 11:17:13,953 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower769 (Follower): Setting last applied to 0 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower768: Applying state for log index 0 data zero 11:17:13,953 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower769: Moving last applied index from -1 to 0 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower768: applyState called: zero 11:17:13,953 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower769: Applying state for log index 0 data zero 11:17:13,953 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower769: applyState called: zero 11:17:13,953 AM [follower769-writer-163] [DEBUG] JournalWriteTask - follower769: received 1 entries in 466.7 μs 11:17:13,953 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: received 1 entries in 519.4 μs 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): Commit index set to 1 11:17:13,953 AM [follower769-writer-163] [DEBUG] JournalWriteTask - follower769: persisted 1 entries in 104.9 μs 11:17:13,953 AM [follower769-writer-163] [DEBUG] JournalWriteTask - follower769: waiting for more work 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 1 (of expected -1) 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower768 (Follower): Setting last applied to 1 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower768: Moving last applied index from 0 to 1 [WARN] [06/27/2025 11:17:13.953] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower769] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower769, initialSyncDone=true] 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower768: Applying state for log index 1 data one 11:17:13,953 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: persisted 1 entries in 126.4 μs 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower768: applyState called: one 11:17:13,953 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: waiting for more work 11:17:13,953 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - follower768: fakeSnapshot purging log to 0 for term 6 11:17:13,953 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower769 (Follower): Commit index set to 1 11:17:13,953 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower769: Lagging 0 entries behind leader leader767 and reached 1 (of expected -1) 11:17:13,954 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - follower769 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1 11:17:13,954 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower769 (Follower): Setting last applied to 1 11:17:13,954 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower769: Moving last applied index from 0 to 1 11:17:13,954 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower769: Applying state for log index 1 data one 11:17:13,954 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - follower769: applyState called: one 11:17:13,954 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: received 1 entries in 181.7 μs 11:17:13,954 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - follower769: fakeSnapshot purging log to 0 for term 6 11:17:13,954 AM [follower769-writer-163] [DEBUG] JournalWriteTask - follower769: received 1 entries in 430.8 μs 11:17:13,954 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: persisted 1 entries in 118.9 μs 11:17:13,954 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: waiting for more work [WARN] [06/27/2025 11:17:13.954] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower768] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower768, initialSyncDone=true] 11:17:13,954 AM [follower769-writer-163] [DEBUG] JournalWriteTask - follower769: persisted 1 entries in 78.35 μs 11:17:13,954 AM [follower769-writer-163] [DEBUG] JournalWriteTask - follower769: waiting for more work 11:17:14,158 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 1 (of expected -1) 11:17:14,158 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower769: Lagging 0 entries behind leader leader767 and reached 1 (of expected -1) 11:17:14,279 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 1 (of expected -1) 11:17:14,399 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 1 (of expected -1) 11:17:14,518 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 1 (of expected -1) 11:17:14,601 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader767: Persist data index=2 term=6 command=two 11:17:14,601 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader767: Append log entry and persist JournaledLogEntry{index=2, term=6, command=two, pending=true} 11:17:14,601 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 11:17:14,601 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower769: active: false, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: 0 11:17:14,601 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: 0 11:17:14,601 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): sendAppendEntries: 2 is present for follower follower768 11:17:14,601 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: received 1 entries in 649.3 ms 11:17:14,601 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Sending AppendEntries to follower follower768: AppendEntries{term=6, leaderId=leader767, prevLogIndex=1, prevLogTerm=6, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=6, command=two, pending=true}]} 11:17:14,602 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader767, prevLogIndex=1, prevLogTerm=6, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=6, command=two, pending=true}]} 11:17:14,602 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): Number of entries to be appended = 1 11:17:14,602 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 11:17:14,602 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): Append entry to log two 11:17:14,602 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower768: Append log entry and persist JournaledLogEntry{index=2, term=6, command=two, pending=true} 11:17:14,602 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): Log size is now 2 11:17:14,602 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower768, logLastIndex=2, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:14,602 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 1 (of expected -1) 11:17:14,602 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower768: awaiting more completions to resolve 1 deferred callback(s) 11:17:14,602 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: received 1 entries in 647.9 ms 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower768 updated: matchIndex: 2, nextIndex: 3 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: 0 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader767: Persist data index=3 term=6 command=three 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader767: Append log entry and persist JournaledLogEntry{index=3, term=6, command=three, pending=true} 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower769: active: false, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: 0 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 3, leaderLastIndex: 3, leaderSnapShotIndex: 0 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): sendAppendEntries: 3 is present for follower follower768 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Sending AppendEntries to follower follower768: AppendEntries{term=6, leaderId=leader767, prevLogIndex=2, prevLogTerm=6, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=6, command=three, pending=true}]} 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader767: Persist data index=4 term=6 command=four 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader767: Append log entry and persist JournaledLogEntry{index=4, term=6, command=four, pending=true} 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 4, isSendImmediate: true 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower769: active: false, followerNextIndex: 2, leaderLastIndex: 4, leaderSnapShotIndex: 0 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 3, leaderLastIndex: 4, leaderSnapShotIndex: 0 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): sendAppendEntries: 3 is present for follower follower768 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader767: Persist data index=5 term=6 command=five 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader767: Append log entry and persist JournaledLogEntry{index=5, term=6, command=five, pending=true} 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Replicate message: identifier: MockIdentifier{value=five}, logIndex: 5, isSendImmediate: true 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower769: active: false, followerNextIndex: 2, leaderLastIndex: 5, leaderSnapShotIndex: 0 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 3, leaderLastIndex: 5, leaderSnapShotIndex: 0 11:17:14,602 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (Leader): sendAppendEntries: 3 is present for follower follower768 11:17:14,602 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader767: Persist data index=6 term=6 command=six 11:17:14,602 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader767: Append log entry and persist JournaledLogEntry{index=6, term=6, command=six, pending=true} 11:17:14,602 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader767 (Leader): Replicate message: identifier: MockIdentifier{value=six}, logIndex: 6, isSendImmediate: true 11:17:14,602 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower769: active: false, followerNextIndex: 2, leaderLastIndex: 6, leaderSnapShotIndex: 0 11:17:14,602 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 3, leaderLastIndex: 6, leaderSnapShotIndex: 0 11:17:14,602 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader767 (Leader): sendAppendEntries: 3 is present for follower follower768 11:17:14,604 AM [follower768-writer-162] [DEBUG] EntryStoreCompleter - follower768: 1 completion(s) pending 11:17:14,604 AM [leader767-writer-164] [DEBUG] EntryStoreCompleter - leader767: 1 completion(s) pending 11:17:14,605 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower768: running 1 completion(s) 11:17:14,605 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: persisted 1 entries in 2.754 ms 11:17:14,605 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower768: persist complete JournaledLogEntry{index=2, term=6, command=two, pending=false} 11:17:14,605 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: persisted 1 entries in 3.134 ms 11:17:14,605 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: waiting for more work 11:17:14,605 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower768: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@5fc42aaa 11:17:14,605 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader767: running 1 completion(s) 11:17:14,605 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: received 4 entries in 8.271 μs 11:17:14,605 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader767, prevLogIndex=2, prevLogTerm=6, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=6, command=three, pending=true}]} 11:17:14,605 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): Number of entries to be appended = 1 11:17:14,605 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader767: persist complete JournaledLogEntry{index=2, term=6, command=two, pending=true} 11:17:14,605 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): After cleanup, lastIndex: 2, entries to be added from: 0 11:17:14,605 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): Append entry to log three 11:17:14,605 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower768: Append log entry and persist JournaledLogEntry{index=3, term=6, command=three, pending=true} 11:17:14,605 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): Log size is now 3 11:17:14,605 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader767 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1 11:17:14,605 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower768, logLastIndex=3, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:14,605 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 1 (of expected -1) 11:17:14,605 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower768: awaiting more completions to resolve 1 deferred callback(s) 11:17:14,605 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader767 (Leader): Setting last applied to 2 11:17:14,605 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader767: Moving last applied index from 1 to 2 11:17:14,605 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader767: Applying state for log index 2 data two 11:17:14,605 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: received 1 entries in 179.2 μs 11:17:14,605 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader767: applyState called: two 11:17:14,605 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - leader767: fakeSnapshot purging log to 1 for term 6 11:17:14,605 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader767 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower768 updated: matchIndex: 3, nextIndex: 4 11:17:14,605 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 4, leaderLastIndex: 6, leaderSnapShotIndex: 1 11:17:14,605 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader767 (Leader): sendAppendEntries: 4 is present for follower follower768 11:17:14,605 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader767 (Leader): Sending AppendEntries to follower follower768: AppendEntries{term=6, leaderId=leader767, prevLogIndex=3, prevLogTerm=6, leaderCommit=2, replicatedToAllIndex=1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=6, command=four, pending=true}, JournaledLogEntry{index=5, term=6, command=five, pending=true}, JournaledLogEntry{index=6, term=6, command=six, pending=true}]} 11:17:14,607 AM [follower768-writer-162] [DEBUG] EntryStoreCompleter - follower768: 1 completion(s) pending 11:17:14,607 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: persisted 1 entries in 2.159 ms 11:17:14,607 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: waiting for more work 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower768: running 1 completion(s) 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower768: persist complete JournaledLogEntry{index=3, term=6, command=three, pending=false} 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower768: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@7c9592a0 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader767, prevLogIndex=3, prevLogTerm=6, leaderCommit=2, replicatedToAllIndex=1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=6, command=four, pending=true}, JournaledLogEntry{index=5, term=6, command=five, pending=true}, JournaledLogEntry{index=6, term=6, command=six, pending=true}]} 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): Number of entries to be appended = 3 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): After cleanup, lastIndex: 3, entries to be added from: 0 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): Append entry to log four 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower768: Append log entry and persist JournaledLogEntry{index=4, term=6, command=four, pending=true} 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): Append entry to log five 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower768: Append log entry and persist JournaledLogEntry{index=5, term=6, command=five, pending=true} 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): Append entry to log six 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower768: Append log entry and persist JournaledLogEntry{index=6, term=6, command=six, pending=true} 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): Log size is now 6 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): Commit index set to 2 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower768, logLastIndex=6, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 2 (of expected -1) 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): 1, lastIndex(): 6 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower768 (Follower): Setting last applied to 2 11:17:14,607 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: received 3 entries in 273.7 μs 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower768: Moving last applied index from 1 to 2 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower768: Applying state for log index 2 data two 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower768: applyState called: two 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - follower768: fakeSnapshot purging log to 1 for term 6 11:17:14,607 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower768: awaiting more completions to resolve 3 deferred callback(s) 11:17:14,607 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower768 updated: matchIndex: 6, nextIndex: 7 11:17:14,608 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 7, leaderLastIndex: 6, leaderSnapShotIndex: 1 11:17:14,610 AM [follower768-writer-162] [DEBUG] EntryStoreCompleter - follower768: 3 completion(s) pending 11:17:14,610 AM [leader767-writer-164] [DEBUG] EntryStoreCompleter - leader767: 4 completion(s) pending 11:17:14,610 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower768: running 3 completion(s) 11:17:14,611 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower768: persist complete JournaledLogEntry{index=4, term=6, command=four, pending=false} 11:17:14,610 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: persisted 4 entries in 5.865 ms 11:17:14,610 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: persisted 3 entries in 3.187 ms 11:17:14,611 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower768: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@123dccca 11:17:14,611 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower768: persist complete JournaledLogEntry{index=5, term=6, command=five, pending=false} 11:17:14,611 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower768: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@19e79e4 11:17:14,611 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: received 1 entries in 5.630 μs 11:17:14,611 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: received 1 entries in 4.640 μs 11:17:14,611 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower768: persist complete JournaledLogEntry{index=6, term=6, command=six, pending=false} 11:17:14,611 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower768: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@13617d01 11:17:14,611 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - leader767: running 4 completion(s) 11:17:14,611 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader767: persist complete JournaledLogEntry{index=3, term=6, command=three, pending=true} 11:17:14,611 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: persisted 1 entries in 86.51 μs 11:17:14,611 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: persisted 1 entries in 91.25 μs 11:17:14,611 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: waiting for more work 11:17:14,611 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: waiting for more work 11:17:14,611 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader767: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=2, lastAppliedTerm=6, lastIndex=3, lastTerm=6, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=4, mandatoryTrim=false] 11:17:14,611 AM [test-pekko.actor.default-dispatcher-14] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:308) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) [ERROR] [06/27/2025 11:17:14.611] [test-pekko.actor.internal-dispatcher-2] [pekko://test/user/leader767] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:308) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 11:17:14,611 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader767: terminating thread VirtualThread[#905,leader767-writer-164]/waiting 11:17:14,611 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: received 1 entries in 725.0 μs 11:17:14,611 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: persisted 1 entries in 29.86 μs 11:17:14,611 AM [leader767-writer-164] [DEBUG] JournalWriteTask - leader767: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@2f3b7c62 stopped 11:17:14,612 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader767: journal closed 11:17:14,612 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader767: journal closed 11:17:14,612 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader767: stopped executor with 0 remaining tasks 11:17:14,612 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader767: stopped executor with 0 remaining tasks 11:17:14,613 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader767: Starting recovery with journal batch size 1000 11:17:14,613 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader767: started executor 11:17:14,613 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader767: started executor 11:17:14,613 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader767: metadata journal open: replayFrom=1 applyTo=2 11:17:14,614 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader767: journal open: firstIndex=1 lastIndex=7 replayFrom=1 fileEntries=0 11:17:14,614 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader767: journal open: applyTo=2 11:17:14,614 AM [leader767-writer-165] [DEBUG] JournalWriteTask - leader767: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@23362df7 started [WARN] [06/27/2025 11:17:14.614] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader767]: org.opendaylight.controller.cluster.common.actor.Monitor@20bb449e 11:17:14,614 AM [leader767-writer-165] [DEBUG] JournalWriteTask - leader767: waiting for more work 11:17:14,615 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader767: Set currentTerm=6, votedFor=leader767 11:17:14,615 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:14,615 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:14,615 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:14,615 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:14,616 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader767: Set currentTerm=5, votedFor=leader767 11:17:14,616 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader767: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:17:14,616 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - leader767: restoring local TermInfo{term=6, votedFor=leader767} 11:17:14,616 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader767: Set currentTerm=6, votedFor=leader767 11:17:14,616 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader767: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@2f38c5b8 11:17:14,616 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader767: Moving last applied index from -1 to -1 11:17:14,616 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader767: recovered journal DefaultLogEntry[index=0, term=6, command=zero] 11:17:14,616 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader767: recovered journal DefaultLogEntry[index=1, term=6, command=one] 11:17:14,616 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader767: recovered journal DefaultLogEntry[index=2, term=6, command=two] 11:17:14,616 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader767: recovered journal DefaultLogEntry[index=3, term=6, command=three] 11:17:14,617 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader767: recovered journal DefaultLogEntry[index=4, term=6, command=four] 11:17:14,617 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader767: recovered journal DefaultLogEntry[index=5, term=6, command=five] 11:17:14,617 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader767: recovered journal DefaultLogEntry[index=6, term=6, command=six] 11:17:14,617 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader767: journal recovery completedin 1.262 ms with journalIndex=1 11:17:14,702 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:14,702 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:14,702 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:14,702 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:14,803 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:14,803 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:14,803 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:14,803 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:14,903 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:14,903 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:14,903 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:14,903 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:15,4 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:15,4 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:15,4 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:15,4 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:15,104 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:15,104 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:15,104 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:15,104 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:15,119 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader767 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed) 11:17:15,119 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader767 (Follower): Received ElectionTimeout - switching to Candidate 11:17:15,119 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader767 (Candidate): Election: Candidate has following voting peers: [follower769, follower768] 11:17:15,124 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader767: Set currentTerm=7, votedFor=leader767 11:17:15,124 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader767 (Candidate): Starting new election term 7 11:17:15,124 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader767 (Candidate): Sending RequestVote{term=7, candidateId=leader767, lastLogIndex=6, lastLogTerm=6} to peer follower769 11:17:15,124 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader767 (Candidate): Sending RequestVote{term=7, candidateId=leader767, lastLogIndex=6, lastLogTerm=6} to peer follower768 11:17:15,124 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader767 (Follower) :- Switching from behavior Follower to Candidate, election term: 7 11:17:15,124 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower769 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:15,124 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower768 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:15,124 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower769 (Follower): Cluster state: [] 11:17:15,124 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower768 (Follower): Cluster state: [] 11:17:15,124 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower769 (Follower): Candidate in requestVote:RequestVote{term=7, candidateId=leader767, lastLogIndex=6, lastLogTerm=6} with higher term appears reachable, updating term. 11:17:15,124 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower768 (Follower): Candidate in requestVote:RequestVote{term=7, candidateId=leader767, lastLogIndex=6, lastLogTerm=6} with higher term appears reachable, updating term. 11:17:15,124 AM [test-pekko.actor.default-dispatcher-14] [INFO] Follower - follower769 (Follower): Term 7 in "RequestVote{term=7, candidateId=leader767, lastLogIndex=6, lastLogTerm=6}" message is greater than follower's term 6 - updating term 11:17:15,124 AM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower768 (Follower): Term 7 in "RequestVote{term=7, candidateId=leader767, lastLogIndex=6, lastLogTerm=6}" message is greater than follower's term 6 - updating term 11:17:15,127 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower768: Set currentTerm=7, votedFor=null 11:17:15,127 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower769: Set currentTerm=7, votedFor=null 11:17:15,127 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower768 (Follower): In requestVote: RequestVote{term=7, candidateId=leader767, lastLogIndex=6, lastLogTerm=6} - currentTerm: 7, votedFor: null, lastIndex: 6, lastTerm: 6 11:17:15,127 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower769 (Follower): In requestVote: RequestVote{term=7, candidateId=leader767, lastLogIndex=6, lastLogTerm=6} - currentTerm: 7, votedFor: null, lastIndex: 1, lastTerm: 6 11:17:15,130 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower768: Set currentTerm=7, votedFor=leader767 11:17:15,130 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower768 (Follower): requestVote returning: RequestVoteReply{term=7, voteGranted=true} 11:17:15,130 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader767 (Candidate): RaftRPC message received RequestVoteReply{term=7, voteGranted=true}, my term is 7 11:17:15,130 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader767 (Candidate): handleRequestVoteReply: RequestVoteReply{term=7, voteGranted=true}, current voteCount: 1 11:17:15,130 AM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader767 (Candidate): LastApplied index -1 is behind last index 6 - switching to PreLeader 11:17:15,130 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Election: Leader has following peers: [follower769, follower768] 11:17:15,130 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Checking sendAppendEntries for follower follower769: active: false, followerNextIndex: -1, leaderLastIndex: 6, leaderSnapShotIndex: -1 11:17:15,130 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Checking sendAppendEntries for follower follower768: active: false, followerNextIndex: -1, leaderLastIndex: 6, leaderSnapShotIndex: -1 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader767 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 7 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader767: Persist data index=7 term=7 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader767: Append log entry and persist JournaledLogEntry{index=7, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true} 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Replicate message: identifier: null, logIndex: 7, isSendImmediate: true 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Checking sendAppendEntries for follower follower769: active: false, followerNextIndex: -1, leaderLastIndex: 7, leaderSnapShotIndex: -1 11:17:15,131 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower768: Lagging -3 entries behind leader leader767 and reached 2 (of expected -1) 11:17:15,131 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower769: Set currentTerm=7, votedFor=leader767 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Checking sendAppendEntries for follower follower768: active: false, followerNextIndex: -1, leaderLastIndex: 7, leaderSnapShotIndex: -1 11:17:15,131 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower769 (Follower): requestVote returning: RequestVoteReply{term=7, voteGranted=true} 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower768 updated: matchIndex: 6, nextIndex: 7 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 7 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 7 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 7 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 7 11:17:15,131 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower768: Lagging -3 entries behind leader leader767 and reached 2 (of expected -1) 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 4 - retrieved log entry with index 4, term 6 does not match the current term 7 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 5 - retrieved log entry with index 5, term 6 does not match the current term 7 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 6 - retrieved log entry with index 6, term 6 does not match the current term 7 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 7, leaderLastIndex: 7, leaderSnapShotIndex: -1 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): sendAppendEntries: 7 is present for follower follower768 11:17:15,131 AM [leader767-writer-165] [DEBUG] JournalWriteTask - leader767: received 1 entries in 517.0 ms 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Sending AppendEntries to follower follower768: AppendEntries{term=7, leaderId=leader767, prevLogIndex=6, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=7, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true}]} 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 7 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 7 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 7 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 7 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 4 - retrieved log entry with index 4, term 6 does not match the current term 7 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 5 - retrieved log entry with index 5, term 6 does not match the current term 7 11:17:15,131 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): handleAppendEntries: AppendEntries{term=7, leaderId=leader767, prevLogIndex=6, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=7, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true}]} 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 6 - retrieved log entry with index 6, term 6 does not match the current term 7 11:17:15,131 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): Number of entries to be appended = 1 11:17:15,131 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): After cleanup, lastIndex: 6, entries to be added from: 0 11:17:15,131 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): sendAppendEntries: 7 is present for follower follower768 11:17:15,131 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): Append entry to log org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:15,131 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower768: Append log entry and persist JournaledLogEntry{index=7, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true} 11:17:15,131 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): Log size is now 6 11:17:15,131 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower768 (Follower): handleAppendEntries returning : AppendEntriesReply{term=7, success=true, followerId=follower768, logLastIndex=7, logLastTerm=7, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:15,132 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader767 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower768 updated: matchIndex: 7, nextIndex: 8 11:17:15,132 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 7 11:17:15,132 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 7 11:17:15,132 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 7 11:17:15,132 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: received 1 entries in 520.9 ms 11:17:15,132 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 7 11:17:15,132 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 4 - retrieved log entry with index 4, term 6 does not match the current term 7 11:17:15,132 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 5 - retrieved log entry with index 5, term 6 does not match the current term 7 11:17:15,132 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 6 - retrieved log entry with index 6, term 6 does not match the current term 7 11:17:15,132 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader767 (PreLeader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 8, leaderLastIndex: 7, leaderSnapShotIndex: -1 11:17:15,132 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower768: Lagging -3 entries behind leader leader767 and reached 2 (of expected -1) 11:17:15,132 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower768: awaiting more completions to resolve 1 deferred callback(s) 11:17:15,133 AM [leader767-writer-165] [DEBUG] EntryStoreCompleter - leader767: 1 completion(s) pending 11:17:15,133 AM [follower768-writer-162] [DEBUG] EntryStoreCompleter - follower768: 1 completion(s) pending 11:17:15,133 AM [leader767-writer-165] [DEBUG] JournalWriteTask - leader767: persisted 1 entries in 2.161 ms 11:17:15,133 AM [leader767-writer-165] [DEBUG] JournalWriteTask - leader767: waiting for more work 11:17:15,133 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: persisted 1 entries in 1.618 ms 11:17:15,133 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: waiting for more work 11:17:15,133 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader767: running 1 completion(s) 11:17:15,133 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower768: running 1 completion(s) 11:17:15,133 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader767: persist complete JournaledLogEntry{index=7, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true} 11:17:15,133 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower768: persist complete JournaledLogEntry{index=7, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=false} 11:17:15,133 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower768: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@1d603f45 11:17:15,133 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader767: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=7, lastTerm=7, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=8, mandatoryTrim=false] 11:17:15,134 AM [test-pekko.actor.default-dispatcher-15] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:308) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 11:17:15,134 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - leader767: terminating thread VirtualThread[#906,leader767-writer-165]/waiting 11:17:15,134 AM [leader767-writer-165] [DEBUG] JournalWriteTask - leader767: received 1 entries in 1.069 ms 11:17:15,134 AM [leader767-writer-165] [DEBUG] JournalWriteTask - leader767: persisted 1 entries in 28.38 μs 11:17:15,134 AM [leader767-writer-165] [DEBUG] JournalWriteTask - leader767: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@23362df7 stopped [ERROR] [06/27/2025 11:17:15.134] [test-pekko.actor.internal-dispatcher-2] [pekko://test/user/leader767] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:308) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 11:17:15,135 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader767: journal closed 11:17:15,135 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader767: journal closed 11:17:15,135 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader767: stopped executor with 0 remaining tasks 11:17:15,135 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader767: stopped executor with 0 remaining tasks [WARN] [06/27/2025 11:17:15.136] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader767]: org.opendaylight.controller.cluster.common.actor.Monitor@28fa8e6f 11:17:15,136 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - leader767: Starting recovery with journal batch size 1000 11:17:15,136 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader767: started executor 11:17:15,136 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader767: started executor 11:17:15,137 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader767: metadata journal open: replayFrom=1 applyTo=2 11:17:15,139 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader767: journal open: firstIndex=1 lastIndex=8 replayFrom=1 fileEntries=0 11:17:15,139 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader767: journal open: applyTo=2 11:17:15,139 AM [leader767-writer-166] [DEBUG] JournalWriteTask - leader767: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@72009bd4 started 11:17:15,139 AM [leader767-writer-166] [DEBUG] JournalWriteTask - leader767: waiting for more work 11:17:15,141 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader767: Set currentTerm=7, votedFor=leader767 11:17:15,141 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:15,141 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:15,141 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:15,141 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:15,141 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader767: Set currentTerm=5, votedFor=leader767 11:17:15,141 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader767: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:17:15,141 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - leader767: restoring local TermInfo{term=7, votedFor=leader767} 11:17:15,141 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader767: Set currentTerm=7, votedFor=leader767 11:17:15,141 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader767: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@390d677d 11:17:15,141 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader767: Moving last applied index from -1 to -1 11:17:15,141 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader767: recovered journal DefaultLogEntry[index=0, term=6, command=zero] 11:17:15,141 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader767: recovered journal DefaultLogEntry[index=1, term=6, command=one] 11:17:15,142 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader767: recovered journal DefaultLogEntry[index=2, term=6, command=two] 11:17:15,142 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader767: recovered journal DefaultLogEntry[index=3, term=6, command=three] 11:17:15,142 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader767: recovered journal DefaultLogEntry[index=4, term=6, command=four] 11:17:15,143 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader767: recovered journal DefaultLogEntry[index=5, term=6, command=five] 11:17:15,143 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader767: recovered journal DefaultLogEntry[index=6, term=6, command=six] 11:17:15,143 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader767: recovered journal DefaultLogEntry[index=7, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781] 11:17:15,143 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader767: journal recovery completedin 2.252 ms with journalIndex=1 11:17:15,205 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:15,205 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:15,205 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:15,205 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:15,305 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:15,305 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:15,305 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:15,305 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:15,406 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:15,406 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:15,406 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:15,406 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:15,506 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:15,506 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:15,506 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:15,507 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:15,578 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - leader767 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed) 11:17:15,578 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - leader767 (Follower): Received ElectionTimeout - switching to Candidate 11:17:15,578 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader767 (Candidate): Election: Candidate has following voting peers: [follower769, follower768] 11:17:15,586 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader767: Set currentTerm=8, votedFor=leader767 11:17:15,586 AM [test-pekko.actor.default-dispatcher-17] [INFO] Candidate - leader767 (Candidate): Starting new election term 8 11:17:15,586 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader767 (Candidate): Sending RequestVote{term=8, candidateId=leader767, lastLogIndex=7, lastLogTerm=7} to peer follower769 11:17:15,586 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader767 (Candidate): Sending RequestVote{term=8, candidateId=leader767, lastLogIndex=7, lastLogTerm=7} to peer follower768 11:17:15,586 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader767 (Follower) :- Switching from behavior Follower to Candidate, election term: 8 11:17:15,586 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower768 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:15,586 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower768 (Follower): Cluster state: [] 11:17:15,586 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower768 (Follower): Candidate in requestVote:RequestVote{term=8, candidateId=leader767, lastLogIndex=7, lastLogTerm=7} with higher term appears reachable, updating term. 11:17:15,586 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower768 (Follower): Term 8 in "RequestVote{term=8, candidateId=leader767, lastLogIndex=7, lastLogTerm=7}" message is greater than follower's term 7 - updating term 11:17:15,587 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower769 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:15,587 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower769 (Follower): Cluster state: [] 11:17:15,587 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower769 (Follower): Candidate in requestVote:RequestVote{term=8, candidateId=leader767, lastLogIndex=7, lastLogTerm=7} with higher term appears reachable, updating term. 11:17:15,587 AM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower769 (Follower): Term 8 in "RequestVote{term=8, candidateId=leader767, lastLogIndex=7, lastLogTerm=7}" message is greater than follower's term 7 - updating term 11:17:15,589 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower768: Set currentTerm=8, votedFor=null 11:17:15,589 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower768 (Follower): In requestVote: RequestVote{term=8, candidateId=leader767, lastLogIndex=7, lastLogTerm=7} - currentTerm: 8, votedFor: null, lastIndex: 7, lastTerm: 7 11:17:15,590 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower769: Set currentTerm=8, votedFor=null 11:17:15,590 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower769 (Follower): In requestVote: RequestVote{term=8, candidateId=leader767, lastLogIndex=7, lastLogTerm=7} - currentTerm: 8, votedFor: null, lastIndex: 1, lastTerm: 6 11:17:15,592 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower768: Set currentTerm=8, votedFor=leader767 11:17:15,592 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower768 (Follower): requestVote returning: RequestVoteReply{term=8, voteGranted=true} 11:17:15,592 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader767 (Candidate): RaftRPC message received RequestVoteReply{term=8, voteGranted=true}, my term is 8 11:17:15,592 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader767 (Candidate): handleRequestVoteReply: RequestVoteReply{term=8, voteGranted=true}, current voteCount: 1 11:17:15,592 AM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - leader767 (Candidate): LastApplied index -1 is behind last index 7 - switching to PreLeader 11:17:15,592 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Election: Leader has following peers: [follower769, follower768] 11:17:15,592 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Checking sendAppendEntries for follower follower769: active: false, followerNextIndex: -1, leaderLastIndex: 7, leaderSnapShotIndex: -1 11:17:15,592 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Checking sendAppendEntries for follower follower768: active: false, followerNextIndex: -1, leaderLastIndex: 7, leaderSnapShotIndex: -1 11:17:15,592 AM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader767 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader767: Persist data index=8 term=8 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] ReplicatedLogImpl - leader767: Append log entry and persist JournaledLogEntry{index=8, term=8, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true} 11:17:15,593 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower768: Lagging -3 entries behind leader leader767 and reached 2 (of expected -1) 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Replicate message: identifier: null, logIndex: 8, isSendImmediate: true 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Checking sendAppendEntries for follower follower769: active: false, followerNextIndex: -1, leaderLastIndex: 8, leaderSnapShotIndex: -1 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Checking sendAppendEntries for follower follower768: active: false, followerNextIndex: -1, leaderLastIndex: 8, leaderSnapShotIndex: -1 11:17:15,593 AM [leader767-writer-166] [DEBUG] JournalWriteTask - leader767: received 1 entries in 453.6 ms 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower768 updated: matchIndex: 7, nextIndex: 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower768: Lagging -3 entries behind leader leader767 and reached 2 (of expected -1) 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 4 - retrieved log entry with index 4, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 5 - retrieved log entry with index 5, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 6 - retrieved log entry with index 6, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 7 - retrieved log entry with index 7, term 7 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 8, leaderLastIndex: 8, leaderSnapShotIndex: -1 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): sendAppendEntries: 8 is present for follower follower768 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Sending AppendEntries to follower follower768: AppendEntries{term=8, leaderId=leader767, prevLogIndex=7, prevLogTerm=7, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=8, term=8, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true}]} 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 4 - retrieved log entry with index 4, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 5 - retrieved log entry with index 5, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 6 - retrieved log entry with index 6, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 7 - retrieved log entry with index 7, term 7 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): handleAppendEntries: AppendEntries{term=8, leaderId=leader767, prevLogIndex=7, prevLogTerm=7, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=8, term=8, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true}]} 11:17:15,593 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader767 (PreLeader): sendAppendEntries: 8 is present for follower follower768 11:17:15,593 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): Number of entries to be appended = 1 11:17:15,593 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): After cleanup, lastIndex: 7, entries to be added from: 0 11:17:15,593 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): Append entry to log org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:15,593 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower768: Append log entry and persist JournaledLogEntry{index=8, term=8, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true} 11:17:15,593 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: received 1 entries in 459.8 ms 11:17:15,593 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): Log size is now 7 11:17:15,593 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): handleAppendEntries returning : AppendEntriesReply{term=8, success=true, followerId=follower768, logLastIndex=8, logLastTerm=8, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:15,593 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower768 updated: matchIndex: 8, nextIndex: 9 11:17:15,593 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 4 - retrieved log entry with index 4, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 5 - retrieved log entry with index 5, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 6 - retrieved log entry with index 6, term 6 does not match the current term 8 11:17:15,593 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 7 - retrieved log entry with index 7, term 7 does not match the current term 8 11:17:15,594 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader767 (PreLeader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 9, leaderLastIndex: 8, leaderSnapShotIndex: -1 11:17:15,594 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower768: Lagging -3 entries behind leader leader767 and reached 2 (of expected -1) 11:17:15,594 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower768: awaiting more completions to resolve 1 deferred callback(s) 11:17:15,594 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower769: Set currentTerm=8, votedFor=leader767 11:17:15,594 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower769 (Follower): requestVote returning: RequestVoteReply{term=8, voteGranted=true} 11:17:15,595 AM [leader767-writer-166] [DEBUG] EntryStoreCompleter - leader767: 1 completion(s) pending 11:17:15,595 AM [leader767-writer-166] [DEBUG] JournalWriteTask - leader767: persisted 1 entries in 1.858 ms 11:17:15,595 AM [leader767-writer-166] [DEBUG] JournalWriteTask - leader767: waiting for more work 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - leader767: running 1 completion(s) 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader767: persist complete JournaledLogEntry{index=8, term=8, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true} 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 8 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 8 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 8 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 8 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 4 - retrieved log entry with index 4, term 6 does not match the current term 8 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 5 - retrieved log entry with index 5, term 6 does not match the current term 8 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 6 - retrieved log entry with index 6, term 6 does not match the current term 8 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader767 (PreLeader): Not updating commit index to 7 - retrieved log entry with index 7, term 7 does not match the current term 8 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader767 (PreLeader): Applying to log - commitIndex: 8, lastAppliedIndex: -1 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader767 (PreLeader): Setting last applied to 0 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader767: Moving last applied index from -1 to 0 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader767: Applying state for log index 0 data zero 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader767: applyState called: zero 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader767 (PreLeader): Setting last applied to 1 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader767: Moving last applied index from 0 to 1 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader767: Applying state for log index 1 data one 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader767: applyState called: one 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader767 (PreLeader): Setting last applied to 2 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader767: Moving last applied index from 1 to 2 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader767: Applying state for log index 2 data two 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader767: applyState called: two 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader767 (PreLeader): Setting last applied to 3 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader767: Moving last applied index from 2 to 3 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader767: Applying state for log index 3 data three 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader767: applyState called: three 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader767 (PreLeader): Setting last applied to 4 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader767: Moving last applied index from 3 to 4 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader767: Applying state for log index 4 data four 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader767: applyState called: four 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader767 (PreLeader): Setting last applied to 5 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader767: Moving last applied index from 4 to 5 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader767: Applying state for log index 5 data five 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader767: applyState called: five 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader767 (PreLeader): Setting last applied to 6 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader767: Moving last applied index from 5 to 6 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader767: Applying state for log index 6 data six 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader767: applyState called: six 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader767 (PreLeader): Setting last applied to 7 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader767: Moving last applied index from 6 to 7 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader767: Applying state for log index 7 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader767 (PreLeader): Setting last applied to 8 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader767: Moving last applied index from 7 to 8 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader767: Applying state for log index 8 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:15,595 AM [follower768-writer-162] [DEBUG] EntryStoreCompleter - follower768: 1 completion(s) pending 11:17:15,595 AM [leader767-writer-166] [DEBUG] JournalWriteTask - leader767: received 1 entries in 462.5 μs 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PreLeader - leader767 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=0, term=6, command=zero, pending=false}] - lastApplied: 8, lastIndex: 8 11:17:15,595 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: persisted 1 entries in 1.916 ms 11:17:15,595 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: waiting for more work 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader767 (Leader): Election: Leader has following peers: [follower769, follower768] 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower769: active: false, followerNextIndex: -1, leaderLastIndex: 8, leaderSnapShotIndex: -1 11:17:15,595 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower768: running 1 completion(s) 11:17:15,595 AM [leader767-writer-166] [DEBUG] JournalWriteTask - leader767: persisted 1 entries in 82.48 μs 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader767 (Leader): Checking sendAppendEntries for follower follower768: active: true, followerNextIndex: 9, leaderLastIndex: 8, leaderSnapShotIndex: -1 11:17:15,595 AM [leader767-writer-166] [DEBUG] JournalWriteTask - leader767: waiting for more work 11:17:15,595 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower768: persist complete JournaledLogEntry{index=8, term=8, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=false} 11:17:15,595 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower768: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@7b0d2746 11:17:15,595 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader767 (PreLeader) :- Switching from behavior PreLeader to Leader, election term: 8 11:17:15,595 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): Commit index set to 8 11:17:15,595 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:15,595 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower768 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 8, context.getLastApplied(): 2, lastIndex(): 8 11:17:15,595 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower768 (Follower): Setting last applied to 3 11:17:15,595 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower768: Moving last applied index from 2 to 3 11:17:15,595 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower768: Applying state for log index 3 data three 11:17:15,595 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower768: applyState called: three 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower768 (Follower): Setting last applied to 4 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower768: Moving last applied index from 3 to 4 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower768: Applying state for log index 4 data four 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower768: applyState called: four 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower768 (Follower): Setting last applied to 5 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower768: Moving last applied index from 4 to 5 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower768: Applying state for log index 5 data five 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower768: applyState called: five 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower768 (Follower): Setting last applied to 6 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower768: Moving last applied index from 5 to 6 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower768: Applying state for log index 6 data six 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower768: applyState called: six 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower768 (Follower): Setting last applied to 7 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower768: Moving last applied index from 6 to 7 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower768: Applying state for log index 7 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower768 (Follower): Setting last applied to 8 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower768: Moving last applied index from 7 to 8 11:17:15,596 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower768: Applying state for log index 8 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:15,596 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: received 1 entries in 640.7 μs 11:17:15,596 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: persisted 1 entries in 50.35 μs 11:17:15,596 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: waiting for more work 11:17:15,607 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:15,607 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:15,607 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:15,607 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:15,707 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:15,707 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:15,707 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:15,707 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:15,708 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:15,808 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:15,808 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:15,808 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:15,808 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:15,828 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:15,908 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:15,908 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:15,908 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:15,908 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:15,948 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:16,9 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:16,9 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:16,9 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:16,9 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:16,69 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:16,110 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:16,110 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:16,110 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:16,110 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:16,189 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:16,210 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:16,210 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:16,210 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:16,210 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:16,308 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:16,311 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:16,311 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:16,311 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:16,311 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:16,411 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:16,411 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:16,411 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:16,411 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:16,429 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:16,512 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:16,512 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:16,512 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:16,512 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:16,548 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:16,613 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:16,613 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:16,613 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:16,613 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:16,669 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:16,713 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:16,713 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:16,713 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:16,713 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:16,789 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:16,814 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:16,814 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:16,814 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:16,814 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:16,908 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:16,914 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:16,914 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:16,914 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:16,914 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:17,15 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:17,15 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:17,15 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:17,15 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:17,29 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:17,115 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:17,115 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:17,115 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:17,115 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:17,139 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:17,216 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:17,216 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:17,216 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:17,216 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:17,258 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:17,316 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:17,316 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:17,316 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:17,316 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:17,379 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:17,417 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:17,417 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:17,417 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:17,417 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:17,499 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:17,518 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:17,518 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:17,518 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:17,518 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:17,618 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:17,618 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:17,618 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:17,618 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:17,618 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:17,719 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:17,719 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:17,719 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:17,719 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:17,739 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:17,819 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:17,819 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:17,819 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:17,819 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:17,859 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:17,920 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:17,920 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:17,920 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:17,920 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:17,979 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:18,20 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:18,20 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:18,20 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:18,20 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:18,98 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:18,121 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:18,121 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:18,121 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:18,121 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:18,219 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:18,221 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:18,221 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:18,221 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:18,221 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:18,321 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:18,321 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:18,321 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:18,322 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:18,338 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:18,422 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:18,422 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:18,422 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:18,422 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:18,459 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:18,522 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:18,522 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:18,522 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:18,522 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:18,579 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:18,623 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:18,623 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:18,623 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:18,623 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:18,698 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:18,723 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:18,723 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:18,723 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:18,723 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:18,819 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:18,824 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:18,824 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:18,824 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:18,824 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:18,924 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:18,924 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:18,924 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:18,924 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:18,939 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:19,25 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:19,25 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:19,25 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:19,25 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:19,59 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:19,125 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:19,125 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:19,125 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:19,125 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:19,178 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:19,225 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:19,226 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:19,226 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:19,226 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:19,299 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:19,326 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:19,326 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:19,326 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:19,326 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:19,419 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:19,426 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:19,426 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:19,426 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:19,426 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:19,527 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/TermInfo.properties 11:17:19,527 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/journal-v1-1.log 11:17:19,527 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest596633686708102375/leader767/metadata-v1-1.log 11:17:19,527 AM [awaitility-thread] [DEBUG] RaftStorage - leader767: no eligible files found 11:17:19,539 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower768: Lagging 0 entries behind leader leader767 and reached 8 (of expected -1) 11:17:19,628 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower768-collector770#-956099964] 11:17:19,639 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower768] 11:17:19,639 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - follower768: terminating thread VirtualThread[#902,follower768-writer-162]/waiting 11:17:19,639 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: received 1 entries in 4.044 s 11:17:19,640 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: persisted 1 entries in 42.95 μs 11:17:19,640 AM [follower768-writer-162] [DEBUG] JournalWriteTask - follower768: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@3414633c stopped 11:17:19,640 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower768: journal closed 11:17:19,640 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower768: journal closed 11:17:19,640 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower768: stopped executor with 0 remaining tasks 11:17:19,640 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower768: stopped executor with 0 remaining tasks 11:17:19,640 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower769-collector771#1260190803] 11:17:19,641 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower769] 11:17:19,641 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - follower769: terminating thread VirtualThread[#903,follower769-writer-163]/waiting 11:17:19,641 AM [follower769-writer-163] [DEBUG] JournalWriteTask - follower769: received 1 entries in 5.687 s 11:17:19,641 AM [follower769-writer-163] [DEBUG] JournalWriteTask - follower769: persisted 1 entries in 21.84 μs 11:17:19,641 AM [follower769-writer-163] [DEBUG] JournalWriteTask - follower769: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@453de252 stopped 11:17:19,642 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower769: journal closed 11:17:19,642 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower769: journal closed 11:17:19,642 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower769: stopped executor with 0 remaining tasks 11:17:19,642 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower769: stopped executor with 0 remaining tasks 11:17:19,642 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader767-collector772#463205787] 11:17:19,642 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader767] 11:17:19,643 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader767: terminating thread VirtualThread[#908,leader767-writer-166]/waiting 11:17:19,643 AM [leader767-writer-166] [DEBUG] JournalWriteTask - leader767: received 1 entries in 4.047 s 11:17:19,643 AM [leader767-writer-166] [DEBUG] JournalWriteTask - leader767: persisted 1 entries in 21.40 μs 11:17:19,643 AM [leader767-writer-166] [DEBUG] JournalWriteTask - leader767: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@72009bd4 stopped 11:17:19,643 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader767: journal closed 11:17:19,643 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader767: journal closed 11:17:19,643 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader767: stopped executor with 0 remaining tasks 11:17:19,643 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader767: stopped executor with 0 remaining tasks 11:17:19,646 AM [main] [INFO] ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest - testLeaderSnapshotWithLaggingFollowerCaughtUpViaAppendEntries starting [WARN] [06/27/2025 11:17:19.647] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower777]: org.opendaylight.controller.cluster.common.actor.Monitor@45706cca 11:17:19,649 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower777: Starting recovery with journal batch size 1000 11:17:19,650 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower777: started executor 11:17:19,650 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower777: started executor 11:17:19,650 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower777: metadata journal open: replayFrom=1 applyTo=0 11:17:19,650 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower777: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 11:17:19,650 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower777: journal open: applyTo=0 11:17:19,651 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@64af1de1 started 11:17:19,651 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: waiting for more work 11:17:19,652 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/follower777/TermInfo.properties does not exist 11:17:19,652 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower777: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/follower777/journal-v1-1.log 11:17:19,652 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower777: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/follower777/metadata-v1-1.log [WARN] [06/27/2025 11:17:19.652] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower778]: org.opendaylight.controller.cluster.common.actor.Monitor@6b3b4d65 11:17:19,652 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower777: no eligible files found 11:17:19,652 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower777: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:17:19,653 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower778: Starting recovery with journal batch size 1000 11:17:19,653 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower778: started executor 11:17:19,653 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower778: started executor 11:17:19,653 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower778: metadata journal open: replayFrom=1 applyTo=0 11:17:19,654 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower778: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 11:17:19,654 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower778: journal open: applyTo=0 11:17:19,655 AM [follower778-writer-168] [DEBUG] JournalWriteTask - follower778: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@3d8a6071 started 11:17:19,655 AM [follower778-writer-168] [DEBUG] JournalWriteTask - follower778: waiting for more work 11:17:19,655 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/follower778/TermInfo.properties does not exist 11:17:19,655 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower778: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/follower778/journal-v1-1.log 11:17:19,655 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower778: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/follower778/metadata-v1-1.log 11:17:19,656 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower778: no eligible files found 11:17:19,656 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower778: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [06/27/2025 11:17:19.656] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader776]: org.opendaylight.controller.cluster.common.actor.Monitor@6294d084 11:17:19,656 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - leader776: Starting recovery with journal batch size 1000 11:17:19,656 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader776: started executor 11:17:19,656 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader776: started executor 11:17:19,657 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader776: metadata journal open: replayFrom=1 applyTo=0 11:17:19,657 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader776: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 11:17:19,657 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - leader776: journal open: applyTo=0 11:17:19,657 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@3087e539 started 11:17:19,657 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: waiting for more work 11:17:19,659 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower777: Set currentTerm=0, votedFor=null 11:17:19,659 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower777: Local TermInfo store seeded with TermInfo{term=0} 11:17:19,659 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower777: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@1deaca6f 11:17:19,659 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower777: Moving last applied index from -1 to -1 11:17:19,659 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - follower777: journal recovery completedin 334.9 μs with journalIndex=1 11:17:19,660 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties does not exist 11:17:19,660 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:19,660 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:19,660 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:19,660 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader776: Set currentTerm=5, votedFor=leader776 11:17:19,660 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader776: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:17:19,661 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower778: Set currentTerm=0, votedFor=null 11:17:19,661 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower778: Local TermInfo store seeded with TermInfo{term=0} 11:17:19,661 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower778: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@43a9f4a3 11:17:19,661 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower778: Moving last applied index from -1 to -1 11:17:19,661 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - follower778: journal recovery completedin 541.1 μs with journalIndex=1 11:17:19,663 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader776: Set currentTerm=5, votedFor=leader776 11:17:19,663 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader776: Local TermInfo store seeded with TermInfo{term=5, votedFor=leader776} 11:17:19,663 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader776: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@1ac200ec 11:17:19,663 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader776: Moving last applied index from -1 to -1 11:17:19,663 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader776: journal recovery completedin 210.8 μs with journalIndex=1 11:17:20,168 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 11:17:20,168 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader776 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed) 11:17:20,168 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader776 (Follower): Received ElectionTimeout - switching to Candidate 11:17:20,168 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader776 (Candidate): Election: Candidate has following voting peers: [follower777, follower778] 11:17:20,172 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader776: Set currentTerm=6, votedFor=leader776 11:17:20,172 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - leader776 (Candidate): Starting new election term 6 11:17:20,172 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader776 (Candidate): Sending RequestVote{term=6, candidateId=leader776, lastLogIndex=-1, lastLogTerm=-1} to peer follower777 11:17:20,172 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader776 (Candidate): Sending RequestVote{term=6, candidateId=leader776, lastLogIndex=-1, lastLogTerm=-1} to peer follower778 11:17:20,172 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader776 (Follower) :- Switching from behavior Follower to Candidate, election term: 6 11:17:20,173 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower777 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:20,173 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower778 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:20,173 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower777 (Follower): Cluster state: [] 11:17:20,173 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower777 (Follower): Candidate in requestVote:RequestVote{term=6, candidateId=leader776, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 11:17:20,173 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower778 (Follower): Cluster state: [] 11:17:20,173 AM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower777 (Follower): Term 6 in "RequestVote{term=6, candidateId=leader776, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 11:17:20,173 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower778 (Follower): Candidate in requestVote:RequestVote{term=6, candidateId=leader776, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 11:17:20,173 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower778 (Follower): Term 6 in "RequestVote{term=6, candidateId=leader776, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 11:17:20,177 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower778: Set currentTerm=6, votedFor=null 11:17:20,177 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower778 (Follower): In requestVote: RequestVote{term=6, candidateId=leader776, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 6, votedFor: null, lastIndex: -1, lastTerm: -1 11:17:20,178 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower777: Set currentTerm=6, votedFor=null 11:17:20,178 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower777 (Follower): In requestVote: RequestVote{term=6, candidateId=leader776, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 6, votedFor: null, lastIndex: -1, lastTerm: -1 11:17:20,179 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower778: Set currentTerm=6, votedFor=leader776 11:17:20,179 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower778 (Follower): requestVote returning: RequestVoteReply{term=6, voteGranted=true} 11:17:20,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader776 (Candidate): RaftRPC message received RequestVoteReply{term=6, voteGranted=true}, my term is 6 11:17:20,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - leader776 (Candidate): handleRequestVoteReply: RequestVoteReply{term=6, voteGranted=true}, current voteCount: 1 11:17:20,179 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader776 (Leader): Election: Leader has following peers: [follower777, follower778] 11:17:20,180 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower777: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 11:17:20,180 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower778: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 11:17:20,180 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - leader776 (Candidate) :- Switching from behavior Candidate to Leader, election term: 6 11:17:20,180 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower778: Last sync leader does not match current leader leader776, need to catch up to -1 11:17:20,180 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader776 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower778 updated: matchIndex: -1, nextIndex: 0 11:17:20,180 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower778: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [06/27/2025 11:17:20.180] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/follower778] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower778, initialSyncDone=false] 11:17:20,181 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower777: Set currentTerm=6, votedFor=leader776 11:17:20,181 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower777 (Follower): requestVote returning: RequestVoteReply{term=6, voteGranted=true} 11:17:20,181 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Last sync leader does not match current leader leader776, need to catch up to -1 11:17:20,181 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower777 updated: matchIndex: -1, nextIndex: 0 11:17:20,181 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower777: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [06/27/2025 11:17:20.181] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower777] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower777, initialSyncDone=false] 11:17:20,217 AM [main] [INFO] ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest - Leader created and elected 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader776: Persist data index=0 term=6 command=zero 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader776: Append log entry and persist JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower777: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (Leader): sendAppendEntries: 0 is present for follower follower777 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (Leader): Sending AppendEntries to follower follower777: AppendEntries{term=6, leaderId=leader776, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:20,218 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: received 1 entries in 560.4 ms 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower778: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (Leader): sendAppendEntries: 0 is present for follower follower778 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (Leader): Sending AppendEntries to follower follower778: AppendEntries{term=6, leaderId=leader776, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader776: Persist data index=1 term=6 command=one 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader776: Append log entry and persist JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 11:17:20,218 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader776, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:20,218 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): Number of entries to be appended = 1 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower777: active: true, followerNextIndex: 0, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:20,218 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (Leader): sendAppendEntries: 0 is present for follower follower777 11:17:20,218 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): Append entry to log zero 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower778: active: true, followerNextIndex: 0, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:20,218 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower777: Append log entry and persist JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (Leader): sendAppendEntries: 0 is present for follower follower778 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower778 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader776, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:20,218 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): Log size is now 1 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower778 (Follower): Number of entries to be appended = 1 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower778 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower778 (Follower): Append entry to log zero 11:17:20,218 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower777, logLastIndex=0, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower778: Append log entry and persist JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:20,218 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached -1 (of expected -1) 11:17:20,218 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: received 1 entries in 567.6 ms 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower778 (Follower): Log size is now 1 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower778 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower778, logLastIndex=0, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower778: Lagging 0 entries behind leader leader776 and reached -1 (of expected -1) 11:17:20,218 AM [follower778-writer-168] [DEBUG] JournalWriteTask - follower778: received 1 entries in 563.8 ms 11:17:20,218 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower778: awaiting more completions to resolve 1 deferred callback(s) 11:17:20,218 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower777 updated: matchIndex: 0, nextIndex: 1 11:17:20,219 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower777: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:20,219 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): sendAppendEntries: 1 is present for follower follower777 11:17:20,219 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower777: awaiting more completions to resolve 1 deferred callback(s) 11:17:20,219 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Sending AppendEntries to follower follower777: AppendEntries{term=6, leaderId=leader776, prevLogIndex=0, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=6, command=one, pending=true}]} 11:17:20,219 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower778 updated: matchIndex: 0, nextIndex: 1 11:17:20,219 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower778: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:20,219 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): sendAppendEntries: 1 is present for follower follower778 11:17:20,219 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Sending AppendEntries to follower follower778: AppendEntries{term=6, leaderId=leader776, prevLogIndex=0, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=6, command=one, pending=true}]} 11:17:20,223 AM [leader776-writer-169] [DEBUG] EntryStoreCompleter - leader776: 1 completion(s) pending 11:17:20,223 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: persisted 1 entries in 5.001 ms 11:17:20,223 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: received 1 entries in 6.591 μs 11:17:20,223 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - leader776: running 1 completion(s) 11:17:20,223 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader776: persist complete JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:20,223 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 11:17:20,223 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader776 (Leader): Setting last applied to 0 11:17:20,223 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader776: Moving last applied index from -1 to 0 11:17:20,223 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader776: Applying state for log index 0 data zero 11:17:20,223 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader776: applyState called: zero 11:17:20,224 AM [follower777-writer-167] [DEBUG] EntryStoreCompleter - follower777: 1 completion(s) pending 11:17:20,224 AM [follower778-writer-168] [DEBUG] EntryStoreCompleter - follower778: 1 completion(s) pending 11:17:20,224 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: persisted 1 entries in 5.625 ms 11:17:20,224 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: waiting for more work 11:17:20,224 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower778: running 1 completion(s) 11:17:20,224 AM [follower778-writer-168] [DEBUG] JournalWriteTask - follower778: persisted 1 entries in 5.557 ms 11:17:20,224 AM [follower778-writer-168] [DEBUG] JournalWriteTask - follower778: waiting for more work 11:17:20,224 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower778: persist complete JournaledLogEntry{index=0, term=6, command=zero, pending=false} 11:17:20,224 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower778: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@2313515b 11:17:20,224 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower777: running 1 completion(s) 11:17:20,224 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower777: persist complete JournaledLogEntry{index=0, term=6, command=zero, pending=false} 11:17:20,224 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower777: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@75861e6f 11:17:20,224 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower778 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader776, prevLogIndex=0, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=6, command=one, pending=true}]} 11:17:20,224 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower778 (Follower): Number of entries to be appended = 1 11:17:20,224 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower778 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 11:17:20,224 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader776, prevLogIndex=0, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=6, command=one, pending=true}]} 11:17:20,224 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower778 (Follower): Append entry to log one 11:17:20,224 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower778: Append log entry and persist JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:20,224 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): Number of entries to be appended = 1 11:17:20,224 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 11:17:20,224 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower778 (Follower): Log size is now 2 11:17:20,224 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): Append entry to log one 11:17:20,224 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower777: Append log entry and persist JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:20,224 AM [follower778-writer-168] [DEBUG] JournalWriteTask - follower778: received 1 entries in 343.0 μs 11:17:20,224 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower778 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower778, logLastIndex=1, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:20,224 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: received 1 entries in 445.4 μs 11:17:20,224 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower778: Lagging 0 entries behind leader leader776 and reached -1 (of expected -1) 11:17:20,224 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower778: awaiting more completions to resolve 1 deferred callback(s) 11:17:20,225 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader776 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower778 updated: matchIndex: 1, nextIndex: 2 11:17:20,225 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower778: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:20,225 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): Log size is now 2 11:17:20,225 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower777, logLastIndex=1, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:20,225 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached -1 (of expected -1) 11:17:20,225 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower777 updated: matchIndex: 1, nextIndex: 2 11:17:20,225 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower777: awaiting more completions to resolve 1 deferred callback(s) 11:17:20,225 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower777: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:20,225 AM [leader776-writer-169] [DEBUG] EntryStoreCompleter - leader776: 1 completion(s) pending 11:17:20,225 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: persisted 1 entries in 2.286 ms 11:17:20,225 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - leader776: running 1 completion(s) 11:17:20,225 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: received 1 entries in 3.790 μs 11:17:20,225 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader776: persist complete JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:20,225 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 11:17:20,225 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader776 (Leader): Setting last applied to 1 11:17:20,225 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader776: Moving last applied index from 0 to 1 11:17:20,225 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader776: Applying state for log index 1 data one 11:17:20,225 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader776: applyState called: one 11:17:20,225 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader776: fakeSnapshot purging log to 0 for term 6 11:17:20,226 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: persisted 1 entries in 401.0 μs 11:17:20,226 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: received 1 entries in 4.100 μs 11:17:20,226 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: persisted 1 entries in 48.10 μs 11:17:20,226 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: waiting for more work 11:17:20,226 AM [follower778-writer-168] [DEBUG] EntryStoreCompleter - follower778: 1 completion(s) pending 11:17:20,226 AM [follower777-writer-167] [DEBUG] EntryStoreCompleter - follower777: 1 completion(s) pending 11:17:20,226 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower778: running 1 completion(s) 11:17:20,226 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower778: persist complete JournaledLogEntry{index=1, term=6, command=one, pending=false} 11:17:20,226 AM [follower778-writer-168] [DEBUG] JournalWriteTask - follower778: persisted 1 entries in 2.060 ms 11:17:20,226 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: persisted 1 entries in 1.983 ms 11:17:20,226 AM [follower778-writer-168] [DEBUG] JournalWriteTask - follower778: waiting for more work 11:17:20,226 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower778: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@4298fc30 11:17:20,226 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: waiting for more work 11:17:20,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower777: running 1 completion(s) 11:17:20,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower777: persist complete JournaledLogEntry{index=1, term=6, command=one, pending=false} 11:17:20,227 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower778 (Follower): Commit index set to 0 11:17:20,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower777: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@4185b466 11:17:20,227 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower778: Lagging 0 entries behind leader leader776 and reached 0 (of expected -1) 11:17:20,227 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower778 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 11:17:20,227 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower778 (Follower): Setting last applied to 0 11:17:20,227 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower778: Moving last applied index from -1 to 0 11:17:20,227 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower778: Applying state for log index 0 data zero 11:17:20,227 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower778: applyState called: zero 11:17:20,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): Commit index set to 0 11:17:20,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 0 (of expected -1) 11:17:20,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 11:17:20,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower777 (Follower): Setting last applied to 0 11:17:20,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower777: Moving last applied index from -1 to 0 11:17:20,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower777: Applying state for log index 0 data zero 11:17:20,227 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower777: applyState called: zero 11:17:20,227 AM [follower778-writer-168] [DEBUG] JournalWriteTask - follower778: received 1 entries in 300.4 μs 11:17:20,227 AM [follower778-writer-168] [DEBUG] JournalWriteTask - follower778: persisted 1 entries in 84.42 μs 11:17:20,227 AM [follower778-writer-168] [DEBUG] JournalWriteTask - follower778: waiting for more work 11:17:20,227 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: received 1 entries in 487.4 μs 11:17:20,227 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower778 (Follower): Commit index set to 1 11:17:20,227 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: persisted 1 entries in 40.25 μs 11:17:20,227 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: waiting for more work 11:17:20,227 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower778: Lagging 0 entries behind leader leader776 and reached 1 (of expected -1) 11:17:20,227 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower778 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1 11:17:20,227 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower778 (Follower): Setting last applied to 1 11:17:20,227 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower778: Moving last applied index from 0 to 1 11:17:20,227 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower778: Applying state for log index 1 data one 11:17:20,227 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower778: applyState called: one 11:17:20,227 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SnapshotManager - follower778: fakeSnapshot purging log to 0 for term 6 11:17:20,227 AM [follower778-writer-168] [DEBUG] JournalWriteTask - follower778: received 1 entries in 306.6 μs 11:17:20,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): Commit index set to 1 11:17:20,227 AM [follower778-writer-168] [DEBUG] JournalWriteTask - follower778: persisted 1 entries in 44.90 μs 11:17:20,227 AM [follower778-writer-168] [DEBUG] JournalWriteTask - follower778: waiting for more work 11:17:20,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 1 (of expected -1) 11:17:20,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1 11:17:20,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower777 (Follower): Setting last applied to 1 11:17:20,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - follower777: Moving last applied index from 0 to 1 11:17:20,227 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower777: Applying state for log index 1 data one 11:17:20,227 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - follower777: applyState called: one 11:17:20,228 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - follower777: fakeSnapshot purging log to 0 for term 6 [WARN] [06/27/2025 11:17:20.228] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower778] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower778, initialSyncDone=true] 11:17:20,228 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: received 1 entries in 591.4 μs 11:17:20,228 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: persisted 1 entries in 51.56 μs 11:17:20,228 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: waiting for more work [WARN] [06/27/2025 11:17:20.228] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower777] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower777, initialSyncDone=true] 11:17:20,418 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower778: Lagging 0 entries behind leader leader776 and reached 1 (of expected -1) 11:17:20,419 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 1 (of expected -1) 11:17:20,419 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader776: Persist data index=2 term=6 command=two 11:17:20,419 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader776: Append log entry and persist JournaledLogEntry{index=2, term=6, command=two, pending=true} 11:17:20,419 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 11:17:20,419 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower777: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: 0 11:17:20,419 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): sendAppendEntries: 2 is present for follower follower777 11:17:20,420 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Sending AppendEntries to follower follower777: AppendEntries{term=6, leaderId=leader776, prevLogIndex=1, prevLogTerm=6, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=6, command=two, pending=true}]} 11:17:20,419 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: received 1 entries in 193.8 ms 11:17:20,420 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower778: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: 0 11:17:20,420 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): sendAppendEntries: 2 is present for follower follower778 11:17:20,420 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Sending AppendEntries to follower follower778: AppendEntries{term=6, leaderId=leader776, prevLogIndex=1, prevLogTerm=6, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=6, command=two, pending=true}]} 11:17:20,420 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader776, prevLogIndex=1, prevLogTerm=6, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=6, command=two, pending=true}]} 11:17:20,420 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): Number of entries to be appended = 1 11:17:20,420 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 11:17:20,420 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): Append entry to log two 11:17:20,420 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower777: Append log entry and persist JournaledLogEntry{index=2, term=6, command=two, pending=true} 11:17:20,420 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: received 1 entries in 192.2 ms 11:17:20,420 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): Log size is now 2 11:17:20,420 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - follower777 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower777, logLastIndex=2, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:20,420 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 1 (of expected -1) 11:17:20,420 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower777: awaiting more completions to resolve 1 deferred callback(s) 11:17:20,420 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader776 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower777 updated: matchIndex: 2, nextIndex: 3 11:17:20,420 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower777: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: 0 11:17:20,422 AM [leader776-writer-169] [DEBUG] EntryStoreCompleter - leader776: 1 completion(s) pending 11:17:20,422 AM [follower777-writer-167] [DEBUG] EntryStoreCompleter - follower777: 1 completion(s) pending 11:17:20,422 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: persisted 1 entries in 2.220 ms 11:17:20,422 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: persisted 1 entries in 2.590 ms 11:17:20,422 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - leader776: running 1 completion(s) 11:17:20,422 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: waiting for more work 11:17:20,422 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader776: persist complete JournaledLogEntry{index=2, term=6, command=two, pending=true} 11:17:20,422 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: waiting for more work 11:17:20,422 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1 11:17:20,422 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower777: running 1 completion(s) 11:17:20,422 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader776 (Leader): Setting last applied to 2 11:17:20,422 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - follower777: persist complete JournaledLogEntry{index=2, term=6, command=two, pending=false} 11:17:20,422 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader776: Moving last applied index from 1 to 2 11:17:20,422 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader776: Applying state for log index 2 data two 11:17:20,422 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - follower777: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@e9940b2 11:17:20,422 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader776: applyState called: two 11:17:20,423 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader776: fakeSnapshot purging log to 1 for term 6 11:17:20,423 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: received 1 entries in 357.4 μs 11:17:20,423 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: persisted 1 entries in 157.4 μs 11:17:20,423 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: waiting for more work 11:17:20,539 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader776 (Leader): sendAppendEntries: 2 is present for follower follower778 11:17:20,539 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader776 (Leader): Sending AppendEntries to follower follower778: AppendEntries{term=6, leaderId=leader776, prevLogIndex=1, prevLogTerm=6, leaderCommit=2, replicatedToAllIndex=1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=6, command=two, pending=false}]} 11:17:20,539 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower777 (Follower): Commit index set to 2 11:17:20,539 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 2 (of expected -1) 11:17:20,539 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower777 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): 1, lastIndex(): 2 11:17:20,539 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower777 (Follower): Setting last applied to 2 11:17:20,539 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower777: Moving last applied index from 1 to 2 11:17:20,539 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower777: Applying state for log index 2 data two 11:17:20,539 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower777: applyState called: two 11:17:20,539 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - follower777: fakeSnapshot purging log to 1 for term 6 11:17:20,539 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: received 1 entries in 116.7 ms 11:17:20,539 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: persisted 1 entries in 117.6 μs 11:17:20,539 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: waiting for more work 11:17:20,571 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader776: Persist data index=3 term=6 command=three 11:17:20,571 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader776: Append log entry and persist JournaledLogEntry{index=3, term=6, command=three, pending=true} 11:17:20,571 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true 11:17:20,571 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower777: active: true, followerNextIndex: 3, leaderLastIndex: 3, leaderSnapShotIndex: 1 11:17:20,571 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): sendAppendEntries: 3 is present for follower follower777 11:17:20,571 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: received 1 entries in 147.9 ms 11:17:20,571 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Sending AppendEntries to follower follower777: AppendEntries{term=6, leaderId=leader776, prevLogIndex=2, prevLogTerm=6, leaderCommit=2, replicatedToAllIndex=1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=6, command=three, pending=true}]} 11:17:20,571 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower778: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: 1 11:17:20,571 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): sendAppendEntries: 2 is present for follower follower778 11:17:20,571 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower777 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader776, prevLogIndex=2, prevLogTerm=6, leaderCommit=2, replicatedToAllIndex=1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=6, command=three, pending=true}]} 11:17:20,571 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower777 (Follower): Number of entries to be appended = 1 11:17:20,571 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower777 (Follower): After cleanup, lastIndex: 2, entries to be added from: 0 11:17:20,571 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower777 (Follower): Append entry to log three 11:17:20,571 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower777: Append log entry and persist JournaledLogEntry{index=3, term=6, command=three, pending=true} 11:17:20,571 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: received 1 entries in 32.00 ms 11:17:20,571 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower777 (Follower): Log size is now 2 11:17:20,571 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower777 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower777, logLastIndex=3, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:20,572 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 2 (of expected -1) 11:17:20,572 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower777: awaiting more completions to resolve 1 deferred callback(s) 11:17:20,572 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower777 updated: matchIndex: 3, nextIndex: 4 11:17:20,572 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower777: active: true, followerNextIndex: 4, leaderLastIndex: 3, leaderSnapShotIndex: 1 11:17:20,573 AM [leader776-writer-169] [DEBUG] EntryStoreCompleter - leader776: 1 completion(s) pending 11:17:20,573 AM [follower777-writer-167] [DEBUG] EntryStoreCompleter - follower777: 1 completion(s) pending 11:17:20,573 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: persisted 1 entries in 2.269 ms 11:17:20,573 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: waiting for more work 11:17:20,573 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: persisted 1 entries in 1.918 ms 11:17:20,573 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: waiting for more work 11:17:20,573 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader776: running 1 completion(s) 11:17:20,573 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader776: persist complete JournaledLogEntry{index=3, term=6, command=three, pending=true} 11:17:20,573 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower777: running 1 completion(s) 11:17:20,573 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower777: persist complete JournaledLogEntry{index=3, term=6, command=three, pending=false} 11:17:20,573 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower777: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@2c6a38c3 11:17:20,573 AM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader776: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=2, lastAppliedTerm=6, lastIndex=3, lastTerm=6, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 11:17:20,574 AM [test-pekko.actor.default-dispatcher-11] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:308) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 11:17:20,574 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader776: terminating thread VirtualThread[#911,leader776-writer-169]/waiting [ERROR] [06/27/2025 11:17:20.574] [test-pekko.actor.internal-dispatcher-2] [pekko://test/user/leader776] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:308) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 11:17:20,574 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: received 1 entries in 1.265 ms 11:17:20,574 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: persisted 1 entries in 26.24 μs 11:17:20,575 AM [leader776-writer-169] [DEBUG] JournalWriteTask - leader776: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@3087e539 stopped 11:17:20,575 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader776: journal closed 11:17:20,575 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader776: journal closed 11:17:20,575 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader776: stopped executor with 0 remaining tasks 11:17:20,575 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader776: stopped executor with 0 remaining tasks [WARN] [06/27/2025 11:17:20.575] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader776]: org.opendaylight.controller.cluster.common.actor.Monitor@6a8b71ec 11:17:20,576 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader776: Starting recovery with journal batch size 1000 11:17:20,576 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader776: started executor 11:17:20,576 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader776: started executor 11:17:20,578 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader776: metadata journal open: replayFrom=1 applyTo=2 11:17:20,579 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader776: journal open: firstIndex=1 lastIndex=4 replayFrom=1 fileEntries=0 11:17:20,579 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader776: journal open: applyTo=2 11:17:20,580 AM [leader776-writer-170] [DEBUG] JournalWriteTask - leader776: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@4bf66c79 started 11:17:20,580 AM [leader776-writer-170] [DEBUG] JournalWriteTask - leader776: waiting for more work 11:17:20,581 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader776: Set currentTerm=6, votedFor=leader776 11:17:20,581 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:20,581 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:20,581 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:20,581 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:20,581 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader776: Set currentTerm=5, votedFor=leader776 11:17:20,582 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader776: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:17:20,582 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - leader776: restoring local TermInfo{term=6, votedFor=leader776} 11:17:20,582 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader776: Set currentTerm=6, votedFor=leader776 11:17:20,582 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader776: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@27fad195 11:17:20,582 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader776: Moving last applied index from -1 to -1 11:17:20,582 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader776: recovered journal DefaultLogEntry[index=0, term=6, command=zero] 11:17:20,582 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader776: recovered journal DefaultLogEntry[index=1, term=6, command=one] 11:17:20,582 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader776: recovered journal DefaultLogEntry[index=2, term=6, command=two] 11:17:20,583 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader776: recovered journal DefaultLogEntry[index=3, term=6, command=three] 11:17:20,583 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - leader776: journal recovery completedin 1.068 ms with journalIndex=1 11:17:20,672 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:20,672 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:20,672 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:20,672 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:20,772 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:20,772 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:20,772 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:20,772 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:20,873 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:20,873 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:20,873 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:20,873 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:20,973 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:20,973 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:20,973 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:20,973 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:21,69 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader776 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed) 11:17:21,69 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - leader776 (Follower): Received ElectionTimeout - switching to Candidate 11:17:21,69 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader776 (Candidate): Election: Candidate has following voting peers: [follower777, follower778] 11:17:21,73 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader776: Set currentTerm=7, votedFor=leader776 11:17:21,73 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - leader776 (Candidate): Starting new election term 7 11:17:21,73 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader776 (Candidate): Sending RequestVote{term=7, candidateId=leader776, lastLogIndex=3, lastLogTerm=6} to peer follower777 11:17:21,73 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - leader776 (Candidate): Sending RequestVote{term=7, candidateId=leader776, lastLogIndex=3, lastLogTerm=6} to peer follower778 11:17:21,73 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader776 (Follower) :- Switching from behavior Follower to Candidate, election term: 7 11:17:21,73 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower777 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:21,73 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower777 (Follower): Cluster state: [] 11:17:21,73 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower777 (Follower): Candidate in requestVote:RequestVote{term=7, candidateId=leader776, lastLogIndex=3, lastLogTerm=6} with higher term appears reachable, updating term. 11:17:21,73 AM [test-pekko.actor.default-dispatcher-11] [INFO] Follower - follower777 (Follower): Term 7 in "RequestVote{term=7, candidateId=leader776, lastLogIndex=3, lastLogTerm=6}" message is greater than follower's term 6 - updating term 11:17:21,74 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower778 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:21,74 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower778 (Follower): Cluster state: [] 11:17:21,74 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower778 (Follower): Candidate in requestVote:RequestVote{term=7, candidateId=leader776, lastLogIndex=3, lastLogTerm=6} with higher term appears reachable, updating term. 11:17:21,74 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower778 (Follower): Term 7 in "RequestVote{term=7, candidateId=leader776, lastLogIndex=3, lastLogTerm=6}" message is greater than follower's term 6 - updating term 11:17:21,74 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:21,74 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:21,74 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:21,74 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:21,77 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower777: Set currentTerm=7, votedFor=null 11:17:21,77 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower777 (Follower): In requestVote: RequestVote{term=7, candidateId=leader776, lastLogIndex=3, lastLogTerm=6} - currentTerm: 7, votedFor: null, lastIndex: 3, lastTerm: 6 11:17:21,79 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower778: Set currentTerm=7, votedFor=null 11:17:21,79 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower778 (Follower): In requestVote: RequestVote{term=7, candidateId=leader776, lastLogIndex=3, lastLogTerm=6} - currentTerm: 7, votedFor: null, lastIndex: 1, lastTerm: 6 11:17:21,80 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower777: Set currentTerm=7, votedFor=leader776 11:17:21,80 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower777 (Follower): requestVote returning: RequestVoteReply{term=7, voteGranted=true} 11:17:21,80 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader776 (Candidate): RaftRPC message received RequestVoteReply{term=7, voteGranted=true}, my term is 7 11:17:21,80 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader776 (Candidate): handleRequestVoteReply: RequestVoteReply{term=7, voteGranted=true}, current voteCount: 1 11:17:21,80 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - leader776 (Candidate): LastApplied index -1 is behind last index 3 - switching to PreLeader 11:17:21,80 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (PreLeader): Election: Leader has following peers: [follower777, follower778] 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (PreLeader): Checking sendAppendEntries for follower follower777: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (PreLeader): Checking sendAppendEntries for follower follower778: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader776 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 7 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader776: Persist data index=4 term=7 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:21,81 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging -3 entries behind leader leader776 and reached 2 (of expected -1) 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader776: Append log entry and persist JournaledLogEntry{index=4, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true} 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (PreLeader): Replicate message: identifier: null, logIndex: 4, isSendImmediate: true 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (PreLeader): Checking sendAppendEntries for follower follower777: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (PreLeader): Checking sendAppendEntries for follower follower778: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 11:17:21,81 AM [leader776-writer-170] [DEBUG] JournalWriteTask - leader776: received 1 entries in 501.2 ms 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower777 updated: matchIndex: 3, nextIndex: 4 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 7 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 7 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 7 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 7 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (PreLeader): Checking sendAppendEntries for follower follower777: active: true, followerNextIndex: 4, leaderLastIndex: 4, leaderSnapShotIndex: -1 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (PreLeader): sendAppendEntries: 4 is present for follower follower777 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader776 (PreLeader): Sending AppendEntries to follower follower777: AppendEntries{term=7, leaderId=leader776, prevLogIndex=3, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true}]} 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower777: Lagging -3 entries behind leader leader776 and reached 2 (of expected -1) 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower777 (Follower): handleAppendEntries: AppendEntries{term=7, leaderId=leader776, prevLogIndex=3, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=4, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true}]} 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower777 (Follower): Number of entries to be appended = 1 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower777 (Follower): After cleanup, lastIndex: 3, entries to be added from: 0 11:17:21,81 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower778: Set currentTerm=7, votedFor=leader776 11:17:21,81 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader776 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 7 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower777 (Follower): Append entry to log org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:21,81 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader776 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 7 11:17:21,81 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - follower778 (Follower): requestVote returning: RequestVoteReply{term=7, voteGranted=true} 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower777: Append log entry and persist JournaledLogEntry{index=4, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true} 11:17:21,81 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader776 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 7 11:17:21,81 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader776 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 7 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower777 (Follower): Log size is now 3 11:17:21,81 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader776 (PreLeader): sendAppendEntries: 4 is present for follower follower777 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower777 (Follower): handleAppendEntries returning : AppendEntriesReply{term=7, success=true, followerId=follower777, logLastIndex=4, logLastTerm=7, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower777: Lagging -3 entries behind leader leader776 and reached 2 (of expected -1) 11:17:21,81 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower777: awaiting more completions to resolve 1 deferred callback(s) 11:17:21,81 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader776 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower777 updated: matchIndex: 4, nextIndex: 5 11:17:21,81 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: received 1 entries in 508.2 ms 11:17:21,82 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader776 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 7 11:17:21,82 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader776 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 7 11:17:21,82 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader776 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 7 11:17:21,82 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader776 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 7 11:17:21,82 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader776 (PreLeader): Checking sendAppendEntries for follower follower777: active: true, followerNextIndex: 5, leaderLastIndex: 4, leaderSnapShotIndex: -1 11:17:21,83 AM [leader776-writer-170] [DEBUG] EntryStoreCompleter - leader776: 1 completion(s) pending 11:17:21,83 AM [leader776-writer-170] [DEBUG] JournalWriteTask - leader776: persisted 1 entries in 1.800 ms 11:17:21,83 AM [leader776-writer-170] [DEBUG] JournalWriteTask - leader776: waiting for more work 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - leader776: running 1 completion(s) 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader776: persist complete JournaledLogEntry{index=4, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true} 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 7 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 7 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 7 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 7 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (PreLeader): Applying to log - commitIndex: 4, lastAppliedIndex: -1 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader776 (PreLeader): Setting last applied to 0 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader776: Moving last applied index from -1 to 0 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader776: Applying state for log index 0 data zero 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader776: applyState called: zero 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader776 (PreLeader): Setting last applied to 1 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader776: Moving last applied index from 0 to 1 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader776: Applying state for log index 1 data one 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader776: applyState called: one 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader776 (PreLeader): Setting last applied to 2 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader776: Moving last applied index from 1 to 2 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader776: Applying state for log index 2 data two 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader776: applyState called: two 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader776 (PreLeader): Setting last applied to 3 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader776: Moving last applied index from 2 to 3 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader776: Applying state for log index 3 data three 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader776: applyState called: three 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader776 (PreLeader): Setting last applied to 4 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader776: Moving last applied index from 3 to 4 11:17:21,83 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader776: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:21,83 AM [leader776-writer-170] [DEBUG] JournalWriteTask - leader776: received 1 entries in 559.0 μs 11:17:21,84 AM [leader776-writer-170] [DEBUG] JournalWriteTask - leader776: persisted 1 entries in 141.4 μs 11:17:21,84 AM [leader776-writer-170] [DEBUG] JournalWriteTask - leader776: waiting for more work 11:17:21,84 AM [follower777-writer-167] [DEBUG] EntryStoreCompleter - follower777: 1 completion(s) pending 11:17:21,84 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PreLeader - leader776 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=0, term=6, command=zero, pending=false}] - lastApplied: 4, lastIndex: 4 11:17:21,84 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: persisted 1 entries in 2.151 ms 11:17:21,84 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: waiting for more work 11:17:21,84 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower777: running 1 completion(s) 11:17:21,84 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower777: persist complete JournaledLogEntry{index=4, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=false} 11:17:21,84 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Election: Leader has following peers: [follower777, follower778] 11:17:21,84 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower777: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@3c6fcf9c 11:17:21,84 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower777: active: true, followerNextIndex: 5, leaderLastIndex: 4, leaderSnapShotIndex: -1 11:17:21,84 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader776 (Leader): Checking sendAppendEntries for follower follower778: active: false, followerNextIndex: -1, leaderLastIndex: 4, leaderSnapShotIndex: -1 11:17:21,84 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower777 (Follower): Commit index set to 4 11:17:21,84 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:21,84 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower777 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 4, context.getLastApplied(): 2, lastIndex(): 4 11:17:21,84 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader776 (PreLeader) :- Switching from behavior PreLeader to Leader, election term: 7 11:17:21,84 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower777 (Follower): Setting last applied to 3 11:17:21,84 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower777: Moving last applied index from 2 to 3 11:17:21,84 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower777: Applying state for log index 3 data three 11:17:21,84 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower777: applyState called: three 11:17:21,84 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower777 (Follower): Setting last applied to 4 11:17:21,84 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower777: Moving last applied index from 3 to 4 11:17:21,84 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower777: Applying state for log index 4 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:21,84 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: received 1 entries in 473.0 μs 11:17:21,84 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: persisted 1 entries in 98.03 μs 11:17:21,84 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: waiting for more work 11:17:21,174 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:21,174 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:21,175 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:21,175 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:21,199 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:21,275 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:21,275 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:21,275 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:21,275 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:21,319 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:21,376 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:21,376 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:21,376 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:21,376 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:21,439 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:21,476 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:21,476 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:21,476 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:21,476 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:21,559 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:21,577 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:21,577 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:21,577 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:21,577 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:21,677 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:21,677 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:21,677 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:21,677 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:21,679 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:21,778 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:21,778 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:21,778 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:21,778 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:21,799 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:21,878 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:21,878 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:21,878 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:21,878 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:21,919 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:21,979 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:21,979 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:21,979 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:21,979 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:22,39 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:22,79 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:22,79 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:22,79 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:22,79 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:22,159 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:22,180 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:22,180 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:22,180 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:22,180 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:22,278 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:22,280 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:22,280 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:22,281 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:22,281 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:22,381 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:22,381 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:22,381 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:22,381 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:22,399 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:22,481 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:22,482 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:22,482 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:22,482 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:22,518 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:22,582 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:22,582 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:22,582 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:22,582 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:22,639 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:22,683 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:22,683 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:22,683 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:22,683 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:22,759 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:22,784 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:22,784 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:22,784 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:22,784 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:22,879 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:22,884 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:22,884 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:22,884 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:22,884 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:22,985 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:22,985 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:22,985 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:22,985 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:22,998 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:23,85 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:23,85 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:23,85 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:23,85 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:23,119 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:23,186 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:23,186 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:23,186 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:23,186 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:23,239 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:23,286 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:23,286 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:23,286 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:23,286 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:23,359 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:23,387 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:23,387 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:23,387 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:23,387 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:23,479 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:23,487 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:23,487 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:23,487 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:23,487 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:23,588 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:23,588 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:23,588 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:23,588 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:23,599 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:23,689 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:23,689 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:23,689 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:23,689 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:23,719 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:23,790 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:23,790 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:23,790 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:23,790 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:23,838 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:23,890 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:23,890 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:23,890 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:23,890 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:23,959 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:23,991 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:23,991 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:23,991 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:23,991 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:24,79 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:24,91 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:24,91 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:24,91 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:24,91 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:24,191 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:24,191 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:24,191 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:24,191 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:24,198 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:24,292 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:24,292 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:24,292 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:24,292 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:24,318 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:24,392 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:24,392 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:24,392 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:24,392 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:24,438 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:24,492 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:24,492 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:24,492 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:24,493 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:24,559 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:24,593 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:24,593 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:24,593 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:24,593 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:24,679 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:24,693 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:24,693 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:24,693 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:24,693 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:24,794 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:24,794 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:24,794 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:24,794 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:24,798 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:24,894 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:24,894 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:24,894 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:24,894 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:24,919 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:24,994 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:24,994 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:24,994 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:24,994 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:25,39 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:25,95 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:25,95 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:25,95 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:25,95 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:25,159 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:25,195 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:25,195 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:25,195 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:25,196 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:25,279 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:25,296 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:25,296 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:25,296 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:25,296 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:25,397 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:25,397 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:25,397 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:25,397 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:25,398 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:25,497 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/TermInfo.properties 11:17:25,497 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/journal-v1-1.log 11:17:25,497 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest12386462994523375466/leader776/metadata-v1-1.log 11:17:25,497 AM [awaitility-thread] [DEBUG] RaftStorage - leader776: no eligible files found 11:17:25,519 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower777: Lagging 0 entries behind leader leader776 and reached 4 (of expected -1) 11:17:25,598 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower777-collector779#-295721476] 11:17:25,609 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower777] 11:17:25,611 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - follower777: terminating thread VirtualThread[#909,follower777-writer-167]/waiting 11:17:25,611 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: received 1 entries in 4.527 s 11:17:25,611 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: persisted 1 entries in 36.89 μs 11:17:25,611 AM [follower777-writer-167] [DEBUG] JournalWriteTask - follower777: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@64af1de1 stopped 11:17:25,611 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower777: journal closed 11:17:25,611 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower777: journal closed 11:17:25,611 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower777: stopped executor with 0 remaining tasks 11:17:25,611 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower777: stopped executor with 0 remaining tasks 11:17:25,612 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower778-collector780#1111098549] 11:17:25,612 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower778] 11:17:25,612 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - follower778: terminating thread VirtualThread[#910,follower778-writer-168]/waiting 11:17:25,612 AM [follower778-writer-168] [DEBUG] JournalWriteTask - follower778: received 1 entries in 5.385 s 11:17:25,612 AM [follower778-writer-168] [DEBUG] JournalWriteTask - follower778: persisted 1 entries in 18.41 μs 11:17:25,612 AM [follower778-writer-168] [DEBUG] JournalWriteTask - follower778: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@3d8a6071 stopped 11:17:25,612 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower778: journal closed 11:17:25,612 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower778: journal closed 11:17:25,612 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower778: stopped executor with 0 remaining tasks 11:17:25,612 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower778: stopped executor with 0 remaining tasks 11:17:25,612 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader776-collector781#215920712] 11:17:25,613 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader776] 11:17:25,613 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader776: terminating thread VirtualThread[#912,leader776-writer-170]/waiting 11:17:25,613 AM [leader776-writer-170] [DEBUG] JournalWriteTask - leader776: received 1 entries in 4.529 s 11:17:25,613 AM [leader776-writer-170] [DEBUG] JournalWriteTask - leader776: persisted 1 entries in 17.02 μs 11:17:25,613 AM [leader776-writer-170] [DEBUG] JournalWriteTask - leader776: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@4bf66c79 stopped 11:17:25,613 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader776: journal closed 11:17:25,613 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader776: journal closed 11:17:25,613 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader776: stopped executor with 0 remaining tasks 11:17:25,613 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader776: stopped executor with 0 remaining tasks 11:17:25,616 AM [main] [INFO] ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest - testLeaderInstallsSnapshotWithRestartedFollowerDuringSnapshotInstallation starting [WARN] [06/27/2025 11:17:25.618] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower786]: org.opendaylight.controller.cluster.common.actor.Monitor@24981948 11:17:25,618 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower786: Starting recovery with journal batch size 1000 11:17:25,618 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower786: started executor 11:17:25,618 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower786: started executor 11:17:25,619 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower786: metadata journal open: replayFrom=1 applyTo=0 11:17:25,619 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower786: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 11:17:25,619 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower786: journal open: applyTo=0 11:17:25,619 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@2bee319a started 11:17:25,619 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: waiting for more work 11:17:25,621 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/follower786/TermInfo.properties does not exist 11:17:25,621 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower786: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/follower786/journal-v1-1.log 11:17:25,621 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower786: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/follower786/metadata-v1-1.log 11:17:25,621 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower786: no eligible files found 11:17:25,621 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower786: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [06/27/2025 11:17:25.621] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower787]: org.opendaylight.controller.cluster.common.actor.Monitor@23f9f769 11:17:25,622 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower787: Starting recovery with journal batch size 1000 11:17:25,622 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower787: started executor 11:17:25,622 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower787: started executor 11:17:25,622 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower787: metadata journal open: replayFrom=1 applyTo=0 11:17:25,623 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower787: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 11:17:25,623 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower787: journal open: applyTo=0 11:17:25,623 AM [follower787-writer-172] [DEBUG] JournalWriteTask - follower787: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@11920405 started 11:17:25,623 AM [follower787-writer-172] [DEBUG] JournalWriteTask - follower787: waiting for more work [WARN] [06/27/2025 11:17:25.624] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader785]: org.opendaylight.controller.cluster.common.actor.Monitor@516670b4 11:17:25,624 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/follower787/TermInfo.properties does not exist 11:17:25,624 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower787: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/follower787/journal-v1-1.log 11:17:25,624 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower787: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/follower787/metadata-v1-1.log 11:17:25,624 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower787: no eligible files found 11:17:25,624 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower787: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:17:25,625 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - leader785: Starting recovery with journal batch size 1000 11:17:25,625 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader785: started executor 11:17:25,625 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader785: started executor 11:17:25,625 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader785: metadata journal open: replayFrom=1 applyTo=0 11:17:25,626 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader785: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 11:17:25,626 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - leader785: journal open: applyTo=0 11:17:25,626 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@69df3c9e started 11:17:25,626 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: waiting for more work 11:17:25,627 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties does not exist 11:17:25,627 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:25,627 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:25,627 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:25,627 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader785: Set currentTerm=5, votedFor=leader785 11:17:25,627 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader785: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:17:25,627 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower786: Set currentTerm=0, votedFor=null 11:17:25,627 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower786: Local TermInfo store seeded with TermInfo{term=0} 11:17:25,627 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower786: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@269514df 11:17:25,627 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower786: Moving last applied index from -1 to -1 11:17:25,628 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower786: journal recovery completedin 194.9 μs with journalIndex=1 11:17:25,630 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower787: Set currentTerm=0, votedFor=null 11:17:25,630 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower787: Local TermInfo store seeded with TermInfo{term=0} 11:17:25,630 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower787: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@4653c68b 11:17:25,630 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower787: Moving last applied index from -1 to -1 11:17:25,630 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower787: journal recovery completedin 255.9 μs with journalIndex=1 11:17:25,631 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader785: Set currentTerm=5, votedFor=leader785 11:17:25,631 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader785: Local TermInfo store seeded with TermInfo{term=5, votedFor=leader785} 11:17:25,631 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader785: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@18d3b23f 11:17:25,631 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader785: Moving last applied index from -1 to -1 11:17:25,631 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] JournalRecovery - leader785: journal recovery completedin 169.8 μs with journalIndex=1 11:17:26,98 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 11:17:26,98 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader785 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed) 11:17:26,98 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader785 (Follower): Received ElectionTimeout - switching to Candidate 11:17:26,99 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader785 (Candidate): Election: Candidate has following voting peers: [follower787, follower786] 11:17:26,102 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader785: Set currentTerm=6, votedFor=leader785 11:17:26,102 AM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader785 (Candidate): Starting new election term 6 11:17:26,102 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader785 (Candidate): Sending RequestVote{term=6, candidateId=leader785, lastLogIndex=-1, lastLogTerm=-1} to peer follower787 11:17:26,102 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader785 (Candidate): Sending RequestVote{term=6, candidateId=leader785, lastLogIndex=-1, lastLogTerm=-1} to peer follower786 11:17:26,102 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader785 (Follower) :- Switching from behavior Follower to Candidate, election term: 6 11:17:26,102 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower787 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:26,102 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower787 (Follower): Cluster state: [] 11:17:26,102 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower786 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:26,102 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower787 (Follower): Candidate in requestVote:RequestVote{term=6, candidateId=leader785, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 11:17:26,102 AM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - follower787 (Follower): Term 6 in "RequestVote{term=6, candidateId=leader785, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 11:17:26,102 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower786 (Follower): Cluster state: [] 11:17:26,102 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower786 (Follower): Candidate in requestVote:RequestVote{term=6, candidateId=leader785, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 11:17:26,102 AM [test-pekko.actor.default-dispatcher-11] [INFO] Follower - follower786 (Follower): Term 6 in "RequestVote{term=6, candidateId=leader785, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 11:17:26,106 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower786: Set currentTerm=6, votedFor=null 11:17:26,106 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower786 (Follower): In requestVote: RequestVote{term=6, candidateId=leader785, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 6, votedFor: null, lastIndex: -1, lastTerm: -1 11:17:26,107 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower787: Set currentTerm=6, votedFor=null 11:17:26,107 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower787 (Follower): In requestVote: RequestVote{term=6, candidateId=leader785, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 6, votedFor: null, lastIndex: -1, lastTerm: -1 11:17:26,109 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower786: Set currentTerm=6, votedFor=leader785 11:17:26,109 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower786 (Follower): requestVote returning: RequestVoteReply{term=6, voteGranted=true} 11:17:26,109 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader785 (Candidate): RaftRPC message received RequestVoteReply{term=6, voteGranted=true}, my term is 6 11:17:26,109 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader785 (Candidate): handleRequestVoteReply: RequestVoteReply{term=6, voteGranted=true}, current voteCount: 1 11:17:26,109 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (Leader): Election: Leader has following peers: [follower787, follower786] 11:17:26,109 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower787: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 11:17:26,109 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower786: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 11:17:26,109 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader785 (Candidate) :- Switching from behavior Candidate to Leader, election term: 6 11:17:26,110 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower786: Last sync leader does not match current leader leader785, need to catch up to -1 11:17:26,110 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower786 updated: matchIndex: -1, nextIndex: 0 11:17:26,110 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower786: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [06/27/2025 11:17:26.110] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower786] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower786, initialSyncDone=false] 11:17:26,110 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower787: Set currentTerm=6, votedFor=leader785 11:17:26,111 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower787 (Follower): requestVote returning: RequestVoteReply{term=6, voteGranted=true} 11:17:26,111 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower787: Last sync leader does not match current leader leader785, need to catch up to -1 11:17:26,111 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower787 updated: matchIndex: -1, nextIndex: 0 11:17:26,111 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower787: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [06/27/2025 11:17:26.111] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower787] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower787, initialSyncDone=false] 11:17:26,135 AM [main] [INFO] ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest - Leader created and elected 11:17:26,135 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader785: Persist data index=0 term=6 command=zero 11:17:26,135 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader785: Append log entry and persist JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:26,135 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 11:17:26,135 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower787: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 11:17:26,135 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): sendAppendEntries: 0 is present for follower follower787 11:17:26,135 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): Sending AppendEntries to follower follower787: AppendEntries{term=6, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:26,135 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower786: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 11:17:26,135 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): sendAppendEntries: 0 is present for follower follower786 11:17:26,135 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): Sending AppendEntries to follower follower786: AppendEntries{term=6, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:26,135 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower787 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:26,135 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader785: Persist data index=1 term=6 command=one 11:17:26,135 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower787 (Follower): Number of entries to be appended = 1 11:17:26,135 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - leader785: Append log entry and persist JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:26,135 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower787 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 11:17:26,135 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: received 1 entries in 509.4 ms 11:17:26,135 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower787 (Follower): Append entry to log zero 11:17:26,135 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 11:17:26,135 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower787: Append log entry and persist JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:26,135 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower787: active: true, followerNextIndex: 0, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:26,135 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): sendAppendEntries: 0 is present for follower follower787 11:17:26,135 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower786: active: true, followerNextIndex: 0, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:26,135 AM [follower787-writer-172] [DEBUG] JournalWriteTask - follower787: received 1 entries in 512.4 ms 11:17:26,135 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower786 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:26,135 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower787 (Follower): Log size is now 1 11:17:26,136 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower786 (Follower): Number of entries to be appended = 1 11:17:26,136 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower786 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 11:17:26,136 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower787 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower787, logLastIndex=0, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:26,136 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower786 (Follower): Append entry to log zero 11:17:26,136 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower786: Append log entry and persist JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:26,136 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower787: Lagging 0 entries behind leader leader785 and reached -1 (of expected -1) 11:17:26,136 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower786 (Follower): Log size is now 1 11:17:26,136 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower786 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower786, logLastIndex=0, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:26,136 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached -1 (of expected -1) 11:17:26,136 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower786: awaiting more completions to resolve 1 deferred callback(s) 11:17:26,136 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: received 1 entries in 516.2 ms 11:17:26,136 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): sendAppendEntries: 0 is present for follower follower786 11:17:26,136 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower787 updated: matchIndex: 0, nextIndex: 1 11:17:26,136 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower787: awaiting more completions to resolve 1 deferred callback(s) 11:17:26,136 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower787: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:26,136 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): sendAppendEntries: 1 is present for follower follower787 11:17:26,136 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): Sending AppendEntries to follower follower787: AppendEntries{term=6, leaderId=leader785, prevLogIndex=0, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=6, command=one, pending=true}]} 11:17:26,136 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower786 updated: matchIndex: 0, nextIndex: 1 11:17:26,136 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower786: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:26,136 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): sendAppendEntries: 1 is present for follower follower786 11:17:26,136 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader785 (Leader): Sending AppendEntries to follower follower786: AppendEntries{term=6, leaderId=leader785, prevLogIndex=0, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=6, command=one, pending=true}]} 11:17:26,140 AM [leader785-writer-173] [DEBUG] EntryStoreCompleter - leader785: 1 completion(s) pending 11:17:26,140 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: persisted 1 entries in 4.522 ms 11:17:26,140 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: received 1 entries in 6.360 μs 11:17:26,140 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - leader785: running 1 completion(s) 11:17:26,140 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader785: persist complete JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:26,140 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 11:17:26,140 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader785 (Leader): Setting last applied to 0 11:17:26,140 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader785: Moving last applied index from -1 to 0 11:17:26,140 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader785: Applying state for log index 0 data zero 11:17:26,140 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader785: applyState called: zero 11:17:26,141 AM [follower787-writer-172] [DEBUG] EntryStoreCompleter - follower787: 1 completion(s) pending 11:17:26,141 AM [follower786-writer-171] [DEBUG] EntryStoreCompleter - follower786: 1 completion(s) pending 11:17:26,141 AM [follower787-writer-172] [DEBUG] JournalWriteTask - follower787: persisted 1 entries in 5.188 ms 11:17:26,141 AM [follower787-writer-172] [DEBUG] JournalWriteTask - follower787: waiting for more work 11:17:26,141 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower786: running 1 completion(s) 11:17:26,141 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: persisted 1 entries in 4.974 ms 11:17:26,141 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower786: persist complete JournaledLogEntry{index=0, term=6, command=zero, pending=false} 11:17:26,141 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: waiting for more work 11:17:26,141 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower787: running 1 completion(s) 11:17:26,141 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower786: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@2f72e3d1 11:17:26,141 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower787: persist complete JournaledLogEntry{index=0, term=6, command=zero, pending=false} 11:17:26,141 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower787: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@1679416 11:17:26,141 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower787 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader785, prevLogIndex=0, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=6, command=one, pending=true}]} 11:17:26,141 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower787 (Follower): Number of entries to be appended = 1 11:17:26,141 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower787 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 11:17:26,141 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower786 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader785, prevLogIndex=0, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=6, command=one, pending=true}]} 11:17:26,141 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower787 (Follower): Append entry to log one 11:17:26,141 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower787: Append log entry and persist JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:26,141 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower786 (Follower): Number of entries to be appended = 1 11:17:26,141 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower786 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 11:17:26,141 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower786 (Follower): Append entry to log one 11:17:26,141 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower786: Append log entry and persist JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:26,141 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower787 (Follower): Log size is now 2 11:17:26,141 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower787 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower787, logLastIndex=1, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:26,141 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower786 (Follower): Log size is now 2 11:17:26,141 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower786 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower786, logLastIndex=1, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:26,141 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached -1 (of expected -1) 11:17:26,141 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: received 1 entries in 319.0 μs 11:17:26,141 AM [follower787-writer-172] [DEBUG] JournalWriteTask - follower787: received 1 entries in 370.2 μs 11:17:26,141 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower786: awaiting more completions to resolve 1 deferred callback(s) 11:17:26,141 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader785 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower787 updated: matchIndex: 1, nextIndex: 2 11:17:26,141 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower787: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:26,141 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader785 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower786 updated: matchIndex: 1, nextIndex: 2 11:17:26,142 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower786: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:26,142 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower787: Lagging 0 entries behind leader leader785 and reached -1 (of expected -1) 11:17:26,142 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower787: awaiting more completions to resolve 1 deferred callback(s) 11:17:26,142 AM [leader785-writer-173] [DEBUG] EntryStoreCompleter - leader785: 1 completion(s) pending 11:17:26,142 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: persisted 1 entries in 2.094 ms 11:17:26,142 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader785: running 1 completion(s) 11:17:26,142 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: received 1 entries in 5.240 μs 11:17:26,142 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader785: persist complete JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:26,142 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader785 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 11:17:26,142 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader785 (Leader): Setting last applied to 1 11:17:26,142 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader785: Moving last applied index from 0 to 1 11:17:26,142 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader785: Applying state for log index 1 data one 11:17:26,142 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader785: applyState called: one 11:17:26,142 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - leader785: fakeSnapshot purging log to 0 for term 6 11:17:26,142 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: persisted 1 entries in 190.8 μs 11:17:26,142 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: received 1 entries in 4.110 μs 11:17:26,142 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: persisted 1 entries in 56.48 μs 11:17:26,142 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: waiting for more work 11:17:26,143 AM [follower786-writer-171] [DEBUG] EntryStoreCompleter - follower786: 1 completion(s) pending 11:17:26,143 AM [follower787-writer-172] [DEBUG] EntryStoreCompleter - follower787: 1 completion(s) pending 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower786: running 1 completion(s) 11:17:26,143 AM [follower787-writer-172] [DEBUG] JournalWriteTask - follower787: persisted 1 entries in 1.641 ms 11:17:26,143 AM [follower787-writer-172] [DEBUG] JournalWriteTask - follower787: waiting for more work 11:17:26,143 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: persisted 1 entries in 1.656 ms 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower786: persist complete JournaledLogEntry{index=1, term=6, command=one, pending=false} 11:17:26,143 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: waiting for more work 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower786: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@177719bc 11:17:26,143 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower787: running 1 completion(s) 11:17:26,143 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower787: persist complete JournaledLogEntry{index=1, term=6, command=one, pending=false} 11:17:26,143 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower787: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@68fe2886 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower786 (Follower): Commit index set to 0 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 0 (of expected -1) 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower786 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower786 (Follower): Setting last applied to 0 11:17:26,143 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower787 (Follower): Commit index set to 0 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower786: Moving last applied index from -1 to 0 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower786: Applying state for log index 0 data zero 11:17:26,143 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower787: Lagging 0 entries behind leader leader785 and reached 0 (of expected -1) 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower786: applyState called: zero 11:17:26,143 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower787 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 11:17:26,143 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower787 (Follower): Setting last applied to 0 11:17:26,143 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower787: Moving last applied index from -1 to 0 11:17:26,143 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower787: Applying state for log index 0 data zero 11:17:26,143 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - follower787: applyState called: zero 11:17:26,143 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: received 1 entries in 314.9 μs 11:17:26,143 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: persisted 1 entries in 101.5 μs 11:17:26,143 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: waiting for more work 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower786 (Follower): Commit index set to 1 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 1 (of expected -1) 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower786 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower786 (Follower): Setting last applied to 1 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower786: Moving last applied index from 0 to 1 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower786: Applying state for log index 1 data one 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower786: applyState called: one 11:17:26,143 AM [follower787-writer-172] [DEBUG] JournalWriteTask - follower787: received 1 entries in 574.0 μs 11:17:26,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SnapshotManager - follower786: fakeSnapshot purging log to 0 for term 6 11:17:26,143 AM [follower787-writer-172] [DEBUG] JournalWriteTask - follower787: persisted 1 entries in 63.63 μs 11:17:26,143 AM [follower787-writer-172] [DEBUG] JournalWriteTask - follower787: waiting for more work 11:17:26,143 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: received 1 entries in 201.0 μs 11:17:26,144 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: persisted 1 entries in 86.57 μs 11:17:26,144 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: waiting for more work 11:17:26,144 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower787 (Follower): Commit index set to 1 11:17:26,144 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - follower787: Lagging 0 entries behind leader leader785 and reached 1 (of expected -1) 11:17:26,144 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - follower787 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1 11:17:26,144 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActorBehavior - follower787 (Follower): Setting last applied to 1 11:17:26,144 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - follower787: Moving last applied index from 0 to 1 11:17:26,144 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower787: Applying state for log index 1 data one 11:17:26,144 AM [test-pekko.actor.default-dispatcher-14] [INFO] MockRaftActor - follower787: applyState called: one 11:17:26,144 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SnapshotManager - follower787: fakeSnapshot purging log to 0 for term 6 [WARN] [06/27/2025 11:17:26.144] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower787] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower787, initialSyncDone=true] 11:17:26,144 AM [follower787-writer-172] [DEBUG] JournalWriteTask - follower787: received 1 entries in 715.0 μs [WARN] [06/27/2025 11:17:26.144] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower786] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower786, initialSyncDone=true] 11:17:26,144 AM [follower787-writer-172] [DEBUG] JournalWriteTask - follower787: persisted 1 entries in 84.66 μs 11:17:26,144 AM [follower787-writer-172] [DEBUG] JournalWriteTask - follower787: waiting for more work 11:17:26,349 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower787: Lagging 0 entries behind leader leader785 and reached 1 (of expected -1) 11:17:26,349 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 1 (of expected -1) 11:17:26,386 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - follower787: terminating thread VirtualThread[#915,follower787-writer-172]/waiting 11:17:26,386 AM [follower787-writer-172] [DEBUG] JournalWriteTask - follower787: received 1 entries in 242.1 ms 11:17:26,386 AM [follower787-writer-172] [DEBUG] JournalWriteTask - follower787: persisted 1 entries in 27.93 μs 11:17:26,387 AM [follower787-writer-172] [DEBUG] JournalWriteTask - follower787: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@11920405 stopped 11:17:26,387 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower787: journal closed 11:17:26,387 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower787: journal closed 11:17:26,387 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower787: stopped executor with 0 remaining tasks 11:17:26,387 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower787: stopped executor with 0 remaining tasks 11:17:26,469 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 1 (of expected -1) [WARN] [06/27/2025 11:17:26.469] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=6, leaderId=leader785, prevLogIndex=1, prevLogTerm=6, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} [WARN] [06/27/2025 11:17:26.589] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=6, leaderId=leader785, prevLogIndex=1, prevLogTerm=6, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 11:17:26,589 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 1 (of expected -1) 11:17:26,709 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 1 (of expected -1) [WARN] [06/27/2025 11:17:26.709] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=6, leaderId=leader785, prevLogIndex=1, prevLogTerm=6, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 11:17:26,791 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader785: Persist data index=2 term=6 command=two 11:17:26,792 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader785: Append log entry and persist JournaledLogEntry{index=2, term=6, command=two, pending=true} 11:17:26,792 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: received 1 entries in 649.6 ms 11:17:26,792 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Replicate message: identifier: MockIdentifier{value=two}, logIndex: 2, isSendImmediate: true 11:17:26,792 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower787: active: false, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: 0 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower786: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: 0 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): sendAppendEntries: 2 is present for follower follower786 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Sending AppendEntries to follower follower786: AppendEntries{term=6, leaderId=leader785, prevLogIndex=1, prevLogTerm=6, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=6, command=two, pending=true}]} [WARN] [06/27/2025 11:17:26.793] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=6, leaderId=leader785, prevLogIndex=1, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader785: Persist data index=3 term=6 command=three 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader785: Append log entry and persist JournaledLogEntry{index=3, term=6, command=three, pending=true} 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Replicate message: identifier: MockIdentifier{value=three}, logIndex: 3, isSendImmediate: true 11:17:26,793 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader785, prevLogIndex=1, prevLogTerm=6, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=6, command=two, pending=true}]} 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower787: active: false, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: 0 11:17:26,793 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): Number of entries to be appended = 1 11:17:26,793 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0 11:17:26,793 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): Append entry to log two 11:17:26,793 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower786: Append log entry and persist JournaledLogEntry{index=2, term=6, command=two, pending=true} 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower786: active: true, followerNextIndex: 2, leaderLastIndex: 3, leaderSnapShotIndex: 0 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): sendAppendEntries: 2 is present for follower follower786 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader785: Persist data index=4 term=6 command=four 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader785: Append log entry and persist JournaledLogEntry{index=4, term=6, command=four, pending=true} 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Replicate message: identifier: MockIdentifier{value=four}, logIndex: 4, isSendImmediate: true [WARN] [06/27/2025 11:17:26.793] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=6, leaderId=leader785, prevLogIndex=1, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 11:17:26,793 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: received 1 entries in 649.3 ms 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower787: active: false, followerNextIndex: 2, leaderLastIndex: 4, leaderSnapShotIndex: 0 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower786: active: true, followerNextIndex: 2, leaderLastIndex: 4, leaderSnapShotIndex: 0 [WARN] [06/27/2025 11:17:26.793] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=6, leaderId=leader785, prevLogIndex=1, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): sendAppendEntries: 2 is present for follower follower786 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader785: Persist data index=5 term=6 command=five 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader785: Append log entry and persist JournaledLogEntry{index=5, term=6, command=five, pending=true} 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Replicate message: identifier: MockIdentifier{value=five}, logIndex: 5, isSendImmediate: true 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower787: active: false, followerNextIndex: 2, leaderLastIndex: 5, leaderSnapShotIndex: 0 11:17:26,793 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): Log size is now 2 11:17:26,793 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower786, logLastIndex=2, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:26,793 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 1 (of expected -1) 11:17:26,793 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower786: awaiting more completions to resolve 1 deferred callback(s) [WARN] [06/27/2025 11:17:26.793] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=6, leaderId=leader785, prevLogIndex=1, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 11:17:26,793 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower786: active: true, followerNextIndex: 2, leaderLastIndex: 5, leaderSnapShotIndex: 0 11:17:26,794 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): sendAppendEntries: 2 is present for follower follower786 11:17:26,794 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower786 updated: matchIndex: 2, nextIndex: 3 11:17:26,794 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower786: active: true, followerNextIndex: 3, leaderLastIndex: 5, leaderSnapShotIndex: 0 11:17:26,794 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): sendAppendEntries: 3 is present for follower follower786 11:17:26,794 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Sending AppendEntries to follower follower786: AppendEntries{term=6, leaderId=leader785, prevLogIndex=2, prevLogTerm=6, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=6, command=three, pending=true}, JournaledLogEntry{index=4, term=6, command=four, pending=true}, JournaledLogEntry{index=5, term=6, command=five, pending=true}]} 11:17:26,794 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader785: Persist data index=6 term=6 command=six 11:17:26,794 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader785: Append log entry and persist JournaledLogEntry{index=6, term=6, command=six, pending=true} 11:17:26,794 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader785 (Leader): Replicate message: identifier: MockIdentifier{value=six}, logIndex: 6, isSendImmediate: true 11:17:26,794 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower787: active: false, followerNextIndex: 2, leaderLastIndex: 6, leaderSnapShotIndex: 0 11:17:26,794 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower786: active: true, followerNextIndex: 3, leaderLastIndex: 6, leaderSnapShotIndex: 0 11:17:26,794 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader785 (Leader): sendAppendEntries: 3 is present for follower follower786 [WARN] [06/27/2025 11:17:26.794] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=6, leaderId=leader785, prevLogIndex=1, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]} 11:17:26,795 AM [leader785-writer-173] [DEBUG] EntryStoreCompleter - leader785: 1 completion(s) pending 11:17:26,795 AM [follower786-writer-171] [DEBUG] EntryStoreCompleter - follower786: 1 completion(s) pending 11:17:26,795 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: persisted 1 entries in 1.936 ms 11:17:26,795 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: waiting for more work 11:17:26,795 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: persisted 1 entries in 3.093 ms 11:17:26,795 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - leader785: running 1 completion(s) 11:17:26,795 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: received 4 entries in 6.810 μs 11:17:26,795 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader785: persist complete JournaledLogEntry{index=2, term=6, command=two, pending=true} 11:17:26,795 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower786: running 1 completion(s) 11:17:26,795 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower786: persist complete JournaledLogEntry{index=2, term=6, command=two, pending=false} 11:17:26,795 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1 11:17:26,795 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower786: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@5014ad78 11:17:26,795 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader785 (Leader): Setting last applied to 2 11:17:26,795 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader785: Moving last applied index from 1 to 2 11:17:26,795 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader785: Applying state for log index 2 data two 11:17:26,795 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - leader785: applyState called: two 11:17:26,795 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader785, prevLogIndex=2, prevLogTerm=6, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=6, command=three, pending=true}, JournaledLogEntry{index=4, term=6, command=four, pending=true}, JournaledLogEntry{index=5, term=6, command=five, pending=true}]} 11:17:26,795 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): Number of entries to be appended = 3 11:17:26,795 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): After cleanup, lastIndex: 2, entries to be added from: 0 11:17:26,795 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): Append entry to log three 11:17:26,795 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower786: Append log entry and persist JournaledLogEntry{index=3, term=6, command=three, pending=true} 11:17:26,795 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SnapshotManager - leader785: fakeSnapshot purging log to 1 for term 6 11:17:26,795 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: received 1 entries in 367.7 μs 11:17:26,796 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): Append entry to log four 11:17:26,796 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower786: Append log entry and persist JournaledLogEntry{index=4, term=6, command=four, pending=true} 11:17:26,796 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): Append entry to log five 11:17:26,796 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower786: Append log entry and persist JournaledLogEntry{index=5, term=6, command=five, pending=true} 11:17:26,796 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): Log size is now 5 11:17:26,796 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower786, logLastIndex=5, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:26,796 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 1 (of expected -1) 11:17:26,796 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower786: awaiting more completions to resolve 3 deferred callback(s) 11:17:26,796 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower786 updated: matchIndex: 5, nextIndex: 6 11:17:26,796 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower786: active: true, followerNextIndex: 6, leaderLastIndex: 6, leaderSnapShotIndex: 1 11:17:26,796 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): sendAppendEntries: 6 is present for follower follower786 11:17:26,796 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (Leader): Sending AppendEntries to follower follower786: AppendEntries{term=6, leaderId=leader785, prevLogIndex=5, prevLogTerm=6, leaderCommit=2, replicatedToAllIndex=1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=6, term=6, command=six, pending=true}]} 11:17:26,796 AM [follower786-writer-171] [DEBUG] EntryStoreCompleter - follower786: 1 completion(s) pending 11:17:26,796 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: persisted 1 entries in 902.4 μs 11:17:26,796 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: received 2 entries in 5.590 μs 11:17:26,797 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower786: running 1 completion(s) 11:17:26,797 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower786: persist complete JournaledLogEntry{index=3, term=6, command=three, pending=false} 11:17:26,797 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower786: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@16dfab4 11:17:26,797 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower786: awaiting more completions to resolve 2 deferred callback(s) 11:17:26,799 AM [follower786-writer-171] [DEBUG] EntryStoreCompleter - follower786: 2 completion(s) pending 11:17:26,799 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: persisted 2 entries in 2.539 ms 11:17:26,799 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: waiting for more work 11:17:26,799 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower786: running 2 completion(s) 11:17:26,799 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower786: persist complete JournaledLogEntry{index=4, term=6, command=four, pending=false} 11:17:26,799 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower786: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@50037b33 11:17:26,799 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower786: persist complete JournaledLogEntry{index=5, term=6, command=five, pending=false} 11:17:26,799 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower786: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@6d762a32 11:17:26,799 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader785, prevLogIndex=5, prevLogTerm=6, leaderCommit=2, replicatedToAllIndex=1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=6, term=6, command=six, pending=true}]} 11:17:26,799 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): Number of entries to be appended = 1 11:17:26,799 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): After cleanup, lastIndex: 5, entries to be added from: 0 11:17:26,799 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): Append entry to log six 11:17:26,799 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower786: Append log entry and persist JournaledLogEntry{index=6, term=6, command=six, pending=true} 11:17:26,799 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: received 1 entries in 325.4 μs 11:17:26,799 AM [leader785-writer-173] [DEBUG] EntryStoreCompleter - leader785: 4 completion(s) pending 11:17:26,799 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: persisted 4 entries in 4.376 ms 11:17:26,799 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): Log size is now 6 11:17:26,799 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: received 1 entries in 3.740 μs 11:17:26,799 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): Commit index set to 2 11:17:26,799 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - leader785: running 4 completion(s) 11:17:26,799 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower786, logLastIndex=6, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:26,799 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader785: persist complete JournaledLogEntry{index=3, term=6, command=three, pending=true} 11:17:26,800 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: persisted 1 entries in 77.57 μs 11:17:26,800 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: waiting for more work 11:17:26,800 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 2 (of expected -1) 11:17:26,800 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): 1, lastIndex(): 6 11:17:26,800 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower786 (Follower): Setting last applied to 2 11:17:26,800 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower786: Moving last applied index from 1 to 2 11:17:26,800 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower786: Applying state for log index 2 data two 11:17:26,800 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - follower786: applyState called: two 11:17:26,800 AM [test-pekko.actor.default-dispatcher-11] [INFO] SnapshotManager - leader785: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=2, lastAppliedTerm=6, lastIndex=3, lastTerm=6, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=4, mandatoryTrim=false] 11:17:26,800 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - follower786: fakeSnapshot purging log to 1 for term 6 11:17:26,800 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower786: awaiting more completions to resolve 1 deferred callback(s) 11:17:26,800 AM [test-pekko.actor.default-dispatcher-17] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:308) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) [ERROR] [06/27/2025 11:17:26.800] [test-pekko.actor.internal-dispatcher-3] [pekko://test/user/leader785] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:308) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 11:17:26,801 AM [follower786-writer-171] [DEBUG] EntryStoreCompleter - follower786: 1 completion(s) pending 11:17:26,801 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: persisted 1 entries in 1.260 ms 11:17:26,801 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - leader785: terminating thread VirtualThread[#916,leader785-writer-173]/waiting 11:17:26,801 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: received 1 entries in 5.800 μs 11:17:26,801 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: received 1 entries in 1.061 ms 11:17:26,801 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower786: running 1 completion(s) 11:17:26,801 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: persisted 1 entries in 16.31 μs 11:17:26,801 AM [leader785-writer-173] [DEBUG] JournalWriteTask - leader785: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@69df3c9e stopped 11:17:26,801 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower786: persist complete JournaledLogEntry{index=6, term=6, command=six, pending=false} 11:17:26,801 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: persisted 1 entries in 86.85 μs 11:17:26,801 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower786: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@483d990c 11:17:26,801 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: waiting for more work 11:17:26,801 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader785: journal closed 11:17:26,801 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - leader785: journal closed 11:17:26,801 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader785: stopped executor with 0 remaining tasks 11:17:26,801 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader785: stopped executor with 0 remaining tasks [WARN] [06/27/2025 11:17:26.801] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader785]: org.opendaylight.controller.cluster.common.actor.Monitor@7676c4e2 11:17:26,802 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - leader785: Starting recovery with journal batch size 1000 11:17:26,802 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader785: started executor 11:17:26,802 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader785: started executor 11:17:26,802 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader785: metadata journal open: replayFrom=1 applyTo=2 11:17:26,803 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - leader785: journal open: firstIndex=1 lastIndex=7 replayFrom=1 fileEntries=0 11:17:26,803 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - leader785: journal open: applyTo=2 11:17:26,804 AM [leader785-writer-174] [DEBUG] JournalWriteTask - leader785: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@73b4c3dc started 11:17:26,804 AM [leader785-writer-174] [DEBUG] JournalWriteTask - leader785: waiting for more work 11:17:26,805 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader785: Set currentTerm=6, votedFor=leader785 11:17:26,805 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:26,805 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:26,805 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:26,805 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:26,805 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader785: Set currentTerm=5, votedFor=leader785 11:17:26,805 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader785: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:17:26,805 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - leader785: restoring local TermInfo{term=6, votedFor=leader785} 11:17:26,805 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader785: Set currentTerm=6, votedFor=leader785 11:17:26,805 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader785: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@1e4ba62c 11:17:26,805 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader785: Moving last applied index from -1 to -1 11:17:26,805 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader785: recovered journal DefaultLogEntry[index=0, term=6, command=zero] 11:17:26,806 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader785: recovered journal DefaultLogEntry[index=1, term=6, command=one] 11:17:26,806 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader785: recovered journal DefaultLogEntry[index=2, term=6, command=two] 11:17:26,806 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader785: recovered journal DefaultLogEntry[index=3, term=6, command=three] 11:17:26,806 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader785: recovered journal DefaultLogEntry[index=4, term=6, command=four] 11:17:26,806 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader785: recovered journal DefaultLogEntry[index=5, term=6, command=five] 11:17:26,806 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader785: recovered journal DefaultLogEntry[index=6, term=6, command=six] 11:17:26,807 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader785: journal recovery completedin 1.473 ms with journalIndex=1 11:17:26,893 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:26,893 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:26,893 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:26,893 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:26,993 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:26,993 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:26,993 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:26,993 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:27,94 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:27,94 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:27,94 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:27,94 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:27,194 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:27,194 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:27,194 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:27,194 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:27,278 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader785 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed) 11:17:27,278 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - leader785 (Follower): Received ElectionTimeout - switching to Candidate 11:17:27,278 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader785 (Candidate): Election: Candidate has following voting peers: [follower787, follower786] 11:17:27,283 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader785: Set currentTerm=7, votedFor=leader785 11:17:27,283 AM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - leader785 (Candidate): Starting new election term 7 11:17:27,283 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader785 (Candidate): Sending RequestVote{term=7, candidateId=leader785, lastLogIndex=6, lastLogTerm=6} to peer follower787 11:17:27,284 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader785 (Candidate): Sending RequestVote{term=7, candidateId=leader785, lastLogIndex=6, lastLogTerm=6} to peer follower786 11:17:27,284 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader785 (Follower) :- Switching from behavior Follower to Candidate, election term: 7 [WARN] [06/27/2025 11:17:27.284] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: RequestVote{term=7, candidateId=leader785, lastLogIndex=6, lastLogTerm=6} 11:17:27,284 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower786 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:27,284 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower786 (Follower): Cluster state: [] 11:17:27,284 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower786 (Follower): Candidate in requestVote:RequestVote{term=7, candidateId=leader785, lastLogIndex=6, lastLogTerm=6} with higher term appears reachable, updating term. 11:17:27,284 AM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower786 (Follower): Term 7 in "RequestVote{term=7, candidateId=leader785, lastLogIndex=6, lastLogTerm=6}" message is greater than follower's term 6 - updating term 11:17:27,287 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower786: Set currentTerm=7, votedFor=null 11:17:27,287 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower786 (Follower): In requestVote: RequestVote{term=7, candidateId=leader785, lastLogIndex=6, lastLogTerm=6} - currentTerm: 7, votedFor: null, lastIndex: 6, lastTerm: 6 11:17:27,290 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower786: Set currentTerm=7, votedFor=leader785 11:17:27,290 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - follower786 (Follower): requestVote returning: RequestVoteReply{term=7, voteGranted=true} 11:17:27,290 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader785 (Candidate): RaftRPC message received RequestVoteReply{term=7, voteGranted=true}, my term is 7 11:17:27,290 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader785 (Candidate): handleRequestVoteReply: RequestVoteReply{term=7, voteGranted=true}, current voteCount: 1 11:17:27,290 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - leader785 (Candidate): LastApplied index -1 is behind last index 6 - switching to PreLeader 11:17:27,290 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Election: Leader has following peers: [follower787, follower786] 11:17:27,290 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Checking sendAppendEntries for follower follower787: active: false, followerNextIndex: -1, leaderLastIndex: 6, leaderSnapShotIndex: -1 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Checking sendAppendEntries for follower follower786: active: false, followerNextIndex: -1, leaderLastIndex: 6, leaderSnapShotIndex: -1 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader785 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 7 11:17:27,291 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower786: Lagging -3 entries behind leader leader785 and reached 2 (of expected -1) 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader785: Persist data index=7 term=7 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 [WARN] [06/27/2025 11:17:27.291] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=7, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader785: Append log entry and persist JournaledLogEntry{index=7, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true} 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Replicate message: identifier: null, logIndex: 7, isSendImmediate: true 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Checking sendAppendEntries for follower follower787: active: false, followerNextIndex: -1, leaderLastIndex: 7, leaderSnapShotIndex: -1 11:17:27,291 AM [leader785-writer-174] [DEBUG] JournalWriteTask - leader785: received 1 entries in 487.3 ms 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Checking sendAppendEntries for follower follower786: active: false, followerNextIndex: -1, leaderLastIndex: 7, leaderSnapShotIndex: -1 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower786 updated: matchIndex: 6, nextIndex: 7 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 7 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 7 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 7 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 7 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 4 - retrieved log entry with index 4, term 6 does not match the current term 7 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 5 - retrieved log entry with index 5, term 6 does not match the current term 7 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 6 - retrieved log entry with index 6, term 6 does not match the current term 7 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Checking sendAppendEntries for follower follower786: active: true, followerNextIndex: 7, leaderLastIndex: 7, leaderSnapShotIndex: -1 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): sendAppendEntries: 7 is present for follower follower786 11:17:27,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Sending AppendEntries to follower follower786: AppendEntries{term=7, leaderId=leader785, prevLogIndex=6, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=7, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true}]} 11:17:27,291 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower786: Lagging -3 entries behind leader leader785 and reached 2 (of expected -1) 11:17:27,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 7 11:17:27,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 7 11:17:27,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 7 11:17:27,291 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): handleAppendEntries: AppendEntries{term=7, leaderId=leader785, prevLogIndex=6, prevLogTerm=6, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=7, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true}]} 11:17:27,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 7 11:17:27,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 4 - retrieved log entry with index 4, term 6 does not match the current term 7 11:17:27,292 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): Number of entries to be appended = 1 11:17:27,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 5 - retrieved log entry with index 5, term 6 does not match the current term 7 11:17:27,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 6 - retrieved log entry with index 6, term 6 does not match the current term 7 11:17:27,292 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): After cleanup, lastIndex: 6, entries to be added from: 0 11:17:27,292 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): Append entry to log org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:27,292 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower786: Append log entry and persist JournaledLogEntry{index=7, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true} 11:17:27,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): sendAppendEntries: 7 is present for follower follower786 11:17:27,292 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): Log size is now 6 11:17:27,292 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower786 (Follower): handleAppendEntries returning : AppendEntriesReply{term=7, success=true, followerId=follower786, logLastIndex=7, logLastTerm=7, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:27,292 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower786: Lagging -3 entries behind leader leader785 and reached 2 (of expected -1) 11:17:27,292 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower786: awaiting more completions to resolve 1 deferred callback(s) 11:17:27,292 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: received 1 entries in 491.2 ms 11:17:27,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower786 updated: matchIndex: 7, nextIndex: 8 11:17:27,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 7 11:17:27,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 7 11:17:27,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 7 11:17:27,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 7 11:17:27,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 4 - retrieved log entry with index 4, term 6 does not match the current term 7 11:17:27,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 5 - retrieved log entry with index 5, term 6 does not match the current term 7 11:17:27,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 6 - retrieved log entry with index 6, term 6 does not match the current term 7 11:17:27,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Checking sendAppendEntries for follower follower786: active: true, followerNextIndex: 8, leaderLastIndex: 7, leaderSnapShotIndex: -1 [WARN] [06/27/2025 11:17:27.292] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=7, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:27,293 AM [leader785-writer-174] [DEBUG] EntryStoreCompleter - leader785: 1 completion(s) pending 11:17:27,293 AM [leader785-writer-174] [DEBUG] JournalWriteTask - leader785: persisted 1 entries in 2.116 ms 11:17:27,293 AM [leader785-writer-174] [DEBUG] JournalWriteTask - leader785: waiting for more work 11:17:27,293 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - leader785: running 1 completion(s) 11:17:27,293 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader785: persist complete JournaledLogEntry{index=7, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true} 11:17:27,293 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader785: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=7, lastTerm=7, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=8, mandatoryTrim=false] 11:17:27,294 AM [test-pekko.actor.default-dispatcher-11] [ERROR] OneForOneStrategy - null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:308) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) [ERROR] [06/27/2025 11:17:27.294] [test-pekko.actor.internal-dispatcher-3] [pekko://test/user/leader785] null java.lang.UnsupportedOperationException at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.PekkoRaftStorage.lastSequenceNumber(PekkoRaftStorage.java:141) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:342) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.capture(SnapshotManager.java:337) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.captureSnapshotIfReady(ReplicatedLogImpl.java:93) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.RaftActor.lambda$submitCommand$0(RaftActor.java:747) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$2(ReplicatedLogImpl.java:147) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.invokeSync(ReplicatedLogImpl.java:160) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$appendSubmitted$3(ReplicatedLogImpl.java:145) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:37) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$UncheckedPersistCallback.invoke(ReplicatedLogImpl.java:32) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.JournalWriteTask.lambda$runBatch$0(JournalWriteTask.java:308) at java.base/java.lang.Iterable.forEach(Iterable.java:75) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.runCompletions(EntryStoreCompleter.java:167) at org.opendaylight.controller.cluster.raft@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.spi.EntryStoreCompleter.completeWhilePending(EntryStoreCompleter.java:135) at org.opendaylight.controller.cluster.commons@11.0.0-SNAPSHOT/org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:25) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.library@2.13.16/scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29) at scala.library@2.13.16/scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.org$apache$pekko$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:931) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive(Eventsourced.scala:256) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:255) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:305) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241) at org.opendaylight.controller.repackaged.pekko@11.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188) 11:17:27,294 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - leader785: terminating thread VirtualThread[#917,leader785-writer-174]/waiting 11:17:27,294 AM [follower786-writer-171] [DEBUG] EntryStoreCompleter - follower786: 1 completion(s) pending 11:17:27,294 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: persisted 1 entries in 2.474 ms 11:17:27,294 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: waiting for more work 11:17:27,294 AM [leader785-writer-174] [DEBUG] JournalWriteTask - leader785: received 1 entries in 1.300 ms 11:17:27,294 AM [leader785-writer-174] [DEBUG] JournalWriteTask - leader785: persisted 1 entries in 25.08 μs 11:17:27,294 AM [leader785-writer-174] [DEBUG] JournalWriteTask - leader785: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@73b4c3dc stopped 11:17:27,295 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower786: running 1 completion(s) 11:17:27,295 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader785: journal closed 11:17:27,295 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader785: journal closed 11:17:27,295 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower786: persist complete JournaledLogEntry{index=7, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=false} 11:17:27,295 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader785: stopped executor with 0 remaining tasks 11:17:27,295 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - follower786: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@6e9a246 11:17:27,295 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader785: stopped executor with 0 remaining tasks 11:17:27,295 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:27,295 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:27,295 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:27,295 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:27.295] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader785]: org.opendaylight.controller.cluster.common.actor.Monitor@606db121 11:17:27,296 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - leader785: Starting recovery with journal batch size 1000 11:17:27,296 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader785: started executor 11:17:27,296 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader785: started executor 11:17:27,297 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader785: metadata journal open: replayFrom=1 applyTo=2 11:17:27,298 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader785: journal open: firstIndex=1 lastIndex=8 replayFrom=1 fileEntries=0 11:17:27,298 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader785: journal open: applyTo=2 11:17:27,298 AM [leader785-writer-175] [DEBUG] JournalWriteTask - leader785: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@15d2ce83 started 11:17:27,298 AM [leader785-writer-175] [DEBUG] JournalWriteTask - leader785: waiting for more work 11:17:27,299 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader785: Set currentTerm=7, votedFor=leader785 11:17:27,299 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:27,299 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:27,299 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:27,299 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:27,299 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader785: Set currentTerm=5, votedFor=leader785 11:17:27,299 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader785: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:17:27,299 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - leader785: restoring local TermInfo{term=7, votedFor=leader785} 11:17:27,299 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader785: Set currentTerm=7, votedFor=leader785 11:17:27,299 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader785: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@2ac55fc5 11:17:27,300 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader785: Moving last applied index from -1 to -1 11:17:27,300 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader785: recovered journal DefaultLogEntry[index=0, term=6, command=zero] 11:17:27,300 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader785: recovered journal DefaultLogEntry[index=1, term=6, command=one] 11:17:27,300 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader785: recovered journal DefaultLogEntry[index=2, term=6, command=two] 11:17:27,300 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader785: recovered journal DefaultLogEntry[index=3, term=6, command=three] 11:17:27,301 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader785: recovered journal DefaultLogEntry[index=4, term=6, command=four] 11:17:27,301 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader785: recovered journal DefaultLogEntry[index=5, term=6, command=five] 11:17:27,301 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader785: recovered journal DefaultLogEntry[index=6, term=6, command=six] 11:17:27,301 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader785: recovered journal DefaultLogEntry[index=7, term=7, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781] 11:17:27,301 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - leader785: journal recovery completedin 1.566 ms with journalIndex=1 11:17:27,395 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:27,395 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:27,395 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:27,395 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:27,496 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:27,496 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:27,496 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:27,496 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:27,597 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:27,597 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:27,597 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:27,597 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:27,697 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:27,697 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:27,697 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:27,697 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:27,798 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:27,798 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:27,798 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:27,798 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:27,798 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader785 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed) 11:17:27,798 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader785 (Follower): Received ElectionTimeout - switching to Candidate 11:17:27,798 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader785 (Candidate): Election: Candidate has following voting peers: [follower787, follower786] 11:17:27,804 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader785: Set currentTerm=8, votedFor=leader785 11:17:27,804 AM [test-pekko.actor.default-dispatcher-6] [INFO] Candidate - leader785 (Candidate): Starting new election term 8 11:17:27,804 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader785 (Candidate): Sending RequestVote{term=8, candidateId=leader785, lastLogIndex=7, lastLogTerm=7} to peer follower787 11:17:27,805 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader785 (Candidate): Sending RequestVote{term=8, candidateId=leader785, lastLogIndex=7, lastLogTerm=7} to peer follower786 11:17:27,805 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader785 (Follower) :- Switching from behavior Follower to Candidate, election term: 8 [WARN] [06/27/2025 11:17:27.805] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: RequestVote{term=8, candidateId=leader785, lastLogIndex=7, lastLogTerm=7} 11:17:27,805 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower786 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:27,805 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower786 (Follower): Cluster state: [] 11:17:27,805 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower786 (Follower): Candidate in requestVote:RequestVote{term=8, candidateId=leader785, lastLogIndex=7, lastLogTerm=7} with higher term appears reachable, updating term. 11:17:27,805 AM [test-pekko.actor.default-dispatcher-11] [INFO] Follower - follower786 (Follower): Term 8 in "RequestVote{term=8, candidateId=leader785, lastLogIndex=7, lastLogTerm=7}" message is greater than follower's term 7 - updating term 11:17:27,807 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower786: Set currentTerm=8, votedFor=null 11:17:27,807 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower786 (Follower): In requestVote: RequestVote{term=8, candidateId=leader785, lastLogIndex=7, lastLogTerm=7} - currentTerm: 8, votedFor: null, lastIndex: 7, lastTerm: 7 11:17:27,810 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower786: Set currentTerm=8, votedFor=leader785 11:17:27,810 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower786 (Follower): requestVote returning: RequestVoteReply{term=8, voteGranted=true} 11:17:27,810 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader785 (Candidate): RaftRPC message received RequestVoteReply{term=8, voteGranted=true}, my term is 8 11:17:27,810 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader785 (Candidate): handleRequestVoteReply: RequestVoteReply{term=8, voteGranted=true}, current voteCount: 1 11:17:27,810 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - leader785 (Candidate): LastApplied index -1 is behind last index 7 - switching to PreLeader 11:17:27,810 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Election: Leader has following peers: [follower787, follower786] 11:17:27,810 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Checking sendAppendEntries for follower follower787: active: false, followerNextIndex: -1, leaderLastIndex: 7, leaderSnapShotIndex: -1 11:17:27,810 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Checking sendAppendEntries for follower follower786: active: false, followerNextIndex: -1, leaderLastIndex: 7, leaderSnapShotIndex: -1 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader785 (Candidate) :- Switching from behavior Candidate to PreLeader, election term: 8 [WARN] [06/27/2025 11:17:27.811] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:27,811 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower786: Lagging -3 entries behind leader leader785 and reached 2 (of expected -1) 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader785: Persist data index=8 term=8 command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader785: Append log entry and persist JournaledLogEntry{index=8, term=8, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true} 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Replicate message: identifier: null, logIndex: 8, isSendImmediate: true 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Checking sendAppendEntries for follower follower787: active: false, followerNextIndex: -1, leaderLastIndex: 8, leaderSnapShotIndex: -1 11:17:27,811 AM [leader785-writer-175] [DEBUG] JournalWriteTask - leader785: received 1 entries in 512.7 ms 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Checking sendAppendEntries for follower follower786: active: false, followerNextIndex: -1, leaderLastIndex: 8, leaderSnapShotIndex: -1 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower786 updated: matchIndex: 7, nextIndex: 8 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 8 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 8 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 8 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 8 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 4 - retrieved log entry with index 4, term 6 does not match the current term 8 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 5 - retrieved log entry with index 5, term 6 does not match the current term 8 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 6 - retrieved log entry with index 6, term 6 does not match the current term 8 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 7 - retrieved log entry with index 7, term 7 does not match the current term 8 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Checking sendAppendEntries for follower follower786: active: true, followerNextIndex: 8, leaderLastIndex: 8, leaderSnapShotIndex: -1 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): sendAppendEntries: 8 is present for follower follower786 11:17:27,811 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader785 (PreLeader): Sending AppendEntries to follower follower786: AppendEntries{term=8, leaderId=leader785, prevLogIndex=7, prevLogTerm=7, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=8, term=8, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true}]} [WARN] [06/27/2025 11:17:27.811] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:27,811 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower786: Lagging -3 entries behind leader leader785 and reached 2 (of expected -1) 11:17:27,811 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 8 11:17:27,811 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower786 (Follower): handleAppendEntries: AppendEntries{term=8, leaderId=leader785, prevLogIndex=7, prevLogTerm=7, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=8, term=8, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true}]} 11:17:27,811 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 8 11:17:27,811 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower786 (Follower): Number of entries to be appended = 1 11:17:27,811 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 8 11:17:27,812 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 8 11:17:27,812 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower786 (Follower): After cleanup, lastIndex: 7, entries to be added from: 0 11:17:27,812 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 4 - retrieved log entry with index 4, term 6 does not match the current term 8 11:17:27,812 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 5 - retrieved log entry with index 5, term 6 does not match the current term 8 11:17:27,812 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower786 (Follower): Append entry to log org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:27,812 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 6 - retrieved log entry with index 6, term 6 does not match the current term 8 11:17:27,812 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 7 - retrieved log entry with index 7, term 7 does not match the current term 8 11:17:27,812 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower786: Append log entry and persist JournaledLogEntry{index=8, term=8, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true} 11:17:27,812 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader785 (PreLeader): sendAppendEntries: 8 is present for follower follower786 11:17:27,812 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: received 1 entries in 517.3 ms 11:17:27,812 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower786 (Follower): Log size is now 7 11:17:27,812 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower786 (Follower): handleAppendEntries returning : AppendEntriesReply{term=8, success=true, followerId=follower786, logLastIndex=8, logLastTerm=8, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:27,812 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower786: Lagging -3 entries behind leader leader785 and reached 2 (of expected -1) 11:17:27,812 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower786: awaiting more completions to resolve 1 deferred callback(s) 11:17:27,812 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): handleAppendEntriesReply - FollowerLogInformation for follower786 updated: matchIndex: 8, nextIndex: 9 11:17:27,812 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 8 11:17:27,812 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 8 11:17:27,812 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 8 11:17:27,812 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 8 11:17:27,812 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 4 - retrieved log entry with index 4, term 6 does not match the current term 8 11:17:27,812 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 5 - retrieved log entry with index 5, term 6 does not match the current term 8 11:17:27,812 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 6 - retrieved log entry with index 6, term 6 does not match the current term 8 11:17:27,812 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 7 - retrieved log entry with index 7, term 7 does not match the current term 8 11:17:27,812 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Checking sendAppendEntries for follower follower786: active: true, followerNextIndex: 9, leaderLastIndex: 8, leaderSnapShotIndex: -1 11:17:27,813 AM [leader785-writer-175] [DEBUG] EntryStoreCompleter - leader785: 1 completion(s) pending 11:17:27,813 AM [leader785-writer-175] [DEBUG] JournalWriteTask - leader785: persisted 1 entries in 1.949 ms 11:17:27,813 AM [leader785-writer-175] [DEBUG] JournalWriteTask - leader785: waiting for more work 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryStoreCompleter - leader785: running 1 completion(s) 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader785: persist complete JournaledLogEntry{index=8, term=8, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=true} 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 0 - retrieved log entry with index 0, term 6 does not match the current term 8 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 1 - retrieved log entry with index 1, term 6 does not match the current term 8 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 2 - retrieved log entry with index 2, term 6 does not match the current term 8 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 3 - retrieved log entry with index 3, term 6 does not match the current term 8 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 4 - retrieved log entry with index 4, term 6 does not match the current term 8 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 5 - retrieved log entry with index 5, term 6 does not match the current term 8 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 6 - retrieved log entry with index 6, term 6 does not match the current term 8 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Not updating commit index to 7 - retrieved log entry with index 7, term 7 does not match the current term 8 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (PreLeader): Applying to log - commitIndex: 8, lastAppliedIndex: -1 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader785 (PreLeader): Setting last applied to 0 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader785: Moving last applied index from -1 to 0 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader785: Applying state for log index 0 data zero 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader785: applyState called: zero 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader785 (PreLeader): Setting last applied to 1 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader785: Moving last applied index from 0 to 1 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader785: Applying state for log index 1 data one 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader785: applyState called: one 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader785 (PreLeader): Setting last applied to 2 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader785: Moving last applied index from 1 to 2 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader785: Applying state for log index 2 data two 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader785: applyState called: two 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader785 (PreLeader): Setting last applied to 3 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader785: Moving last applied index from 2 to 3 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader785: Applying state for log index 3 data three 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader785: applyState called: three 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader785 (PreLeader): Setting last applied to 4 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader785: Moving last applied index from 3 to 4 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader785: Applying state for log index 4 data four 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader785: applyState called: four 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader785 (PreLeader): Setting last applied to 5 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader785: Moving last applied index from 4 to 5 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader785: Applying state for log index 5 data five 11:17:27,813 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader785: applyState called: five 11:17:27,814 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader785 (PreLeader): Setting last applied to 6 11:17:27,814 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader785: Moving last applied index from 5 to 6 11:17:27,814 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader785: Applying state for log index 6 data six 11:17:27,814 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader785: applyState called: six 11:17:27,814 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader785 (PreLeader): Setting last applied to 7 11:17:27,814 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader785: Moving last applied index from 6 to 7 11:17:27,814 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader785: Applying state for log index 7 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:27,814 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader785 (PreLeader): Setting last applied to 8 11:17:27,814 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader785: Moving last applied index from 7 to 8 11:17:27,814 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader785: Applying state for log index 8 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:27,814 AM [leader785-writer-175] [DEBUG] JournalWriteTask - leader785: received 1 entries in 799.1 μs 11:17:27,814 AM [follower786-writer-171] [DEBUG] EntryStoreCompleter - follower786: 1 completion(s) pending 11:17:27,814 AM [leader785-writer-175] [DEBUG] JournalWriteTask - leader785: persisted 1 entries in 105.5 μs 11:17:27,814 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: persisted 1 entries in 2.098 ms 11:17:27,814 AM [leader785-writer-175] [DEBUG] JournalWriteTask - leader785: waiting for more work 11:17:27,814 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: waiting for more work 11:17:27,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower786: running 1 completion(s) 11:17:27,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower786: persist complete JournaledLogEntry{index=8, term=8, command=org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781, pending=false} 11:17:27,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower786: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@20c6fbef 11:17:27,814 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PreLeader - leader785 (PreLeader): Received ApplyState[identifier=null, entry=JournaledLogEntry{index=0, term=6, command=zero, pending=false}] - lastApplied: 8, lastIndex: 8 11:17:27,814 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (Leader): Election: Leader has following peers: [follower787, follower786] 11:17:27,814 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower787: active: false, followerNextIndex: -1, leaderLastIndex: 8, leaderSnapShotIndex: -1 11:17:27,814 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader785 (Leader): Checking sendAppendEntries for follower follower786: active: true, followerNextIndex: 9, leaderLastIndex: 8, leaderSnapShotIndex: -1 11:17:27,814 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - leader785 (PreLeader) :- Switching from behavior PreLeader to Leader, election term: 8 [WARN] [06/27/2025 11:17:27.814] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:27,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower786 (Follower): Commit index set to 8 11:17:27,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:27,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower786 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 8, context.getLastApplied(): 2, lastIndex(): 8 11:17:27,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower786 (Follower): Setting last applied to 3 11:17:27,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower786: Moving last applied index from 2 to 3 11:17:27,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower786: Applying state for log index 3 data three 11:17:27,814 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower786: applyState called: three 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower786 (Follower): Setting last applied to 4 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower786: Moving last applied index from 3 to 4 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower786: Applying state for log index 4 data four 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower786: applyState called: four 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower786 (Follower): Setting last applied to 5 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower786: Moving last applied index from 4 to 5 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower786: Applying state for log index 5 data five 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower786: applyState called: five 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower786 (Follower): Setting last applied to 6 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower786: Moving last applied index from 5 to 6 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower786: Applying state for log index 6 data six 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower786: applyState called: six 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower786 (Follower): Setting last applied to 7 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower786: Moving last applied index from 6 to 7 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower786: Applying state for log index 7 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower786 (Follower): Setting last applied to 8 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower786: Moving last applied index from 7 to 8 11:17:27,815 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower786: Applying state for log index 8 data org.opendaylight.controller.cluster.raft.persisted.NoopPayload@f13781 11:17:27,815 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: received 1 entries in 1.090 ms 11:17:27,815 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: persisted 1 entries in 107.1 μs 11:17:27,815 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: waiting for more work 11:17:27,898 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:27,898 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:27,898 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:27,898 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:27.929] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:27,929 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:27,999 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:27,999 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:27,999 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:27,999 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:28.048] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:28,48 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:28,99 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:28,99 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:28,99 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:28,99 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:28.169] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:28,169 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:28,200 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:28,200 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:28,200 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:28,200 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:28,289 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) [WARN] [06/27/2025 11:17:28.289] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:28,300 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:28,300 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:28,300 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:28,300 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:28,401 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:28,401 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:28,401 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:28,401 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:28.408] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:28,409 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:28,501 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:28,501 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:28,501 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:28,501 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:28.529] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:28,529 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:28,602 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:28,602 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:28,602 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:28,602 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:28.648] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:28,648 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:28,702 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:28,702 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:28,702 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:28,702 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:28.769] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:28,769 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:28,803 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:28,803 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:28,803 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:28,803 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:28.888] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:28,888 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:28,903 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:28,903 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:28,903 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:28,903 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:29,4 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:29,4 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:29,4 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:29,4 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:29.009] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:29,9 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:29,104 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:29,104 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:29,104 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:29,104 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:29.129] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:29,129 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:29,205 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:29,205 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:29,205 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:29,205 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:29.248] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:29,248 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:29,305 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:29,305 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:29,305 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:29,305 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:29.369] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:29,369 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:29,406 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:29,406 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:29,406 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:29,406 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:29.489] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:29,489 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:29,506 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:29,506 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:29,506 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:29,506 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:29,607 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:29,607 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:29,607 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:29,607 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:29.608] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:29,608 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:29,707 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:29,707 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:29,707 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:29,707 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:29.729] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:29,729 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:29,808 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:29,808 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:29,808 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:29,808 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:29.849] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:29,849 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:29,908 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:29,908 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:29,908 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:29,908 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:29.969] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:29,969 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:30,9 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:30,9 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:30,9 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:30,9 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:30,89 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) [WARN] [06/27/2025 11:17:30.089] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:30,109 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:30,109 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:30,109 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:30,109 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:30,209 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) [WARN] [06/27/2025 11:17:30.209] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:30,210 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:30,210 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:30,210 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:30,210 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:30,310 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:30,310 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:30,310 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:30,310 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:30.329] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:30,329 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:30,411 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:30,411 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:30,411 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:30,411 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:30,439 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) [WARN] [06/27/2025 11:17:30.439] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:30,511 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:30,511 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:30,511 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:30,511 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:30.558] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:30,559 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:30,612 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:30,612 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:30,612 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:30,612 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:30.678] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:30,678 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:30,712 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:30,712 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:30,712 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:30,712 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:30.788] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:30,788 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:30,812 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:30,812 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:30,812 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:30,812 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:30,909 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) [WARN] [06/27/2025 11:17:30.909] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:30,913 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:30,913 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:30,913 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:30,913 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:31,13 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:31,14 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:31,14 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:31,14 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:31.029] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:31,29 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:31,114 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:31,114 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:31,114 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:31,114 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:31.149] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:31,149 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:31,214 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:31,214 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:31,215 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:31,215 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:31.268] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:31,268 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:31,315 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:31,315 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:31,315 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:31,315 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:31,389 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) [WARN] [06/27/2025 11:17:31.389] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:31,415 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:31,416 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:31,416 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:31,416 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found [WARN] [06/27/2025 11:17:31.509] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:31,509 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) 11:17:31,516 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:31,516 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:31,516 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:31,516 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:31,617 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:31,617 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:31,617 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:31,617 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:31,629 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) [WARN] [06/27/2025 11:17:31.629] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:31,717 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/TermInfo.properties 11:17:31,717 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/journal-v1-1.log 11:17:31,717 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest9167528525269942290/leader785/metadata-v1-1.log 11:17:31,717 AM [awaitility-thread] [DEBUG] RaftStorage - leader785: no eligible files found 11:17:31,749 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower786: Lagging 0 entries behind leader leader785 and reached 8 (of expected -1) [WARN] [06/27/2025 11:17:31.749] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower787] received dead letter from TestActor[pekko://test/user/leader785]: AppendEntries{term=8, leaderId=leader785, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 11:17:31,818 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower786-collector788#1197360170] 11:17:31,829 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower786] 11:17:31,830 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - follower786: terminating thread VirtualThread[#914,follower786-writer-171]/waiting 11:17:31,830 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: received 1 entries in 4.015 s 11:17:31,830 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: persisted 1 entries in 31.67 μs 11:17:31,830 AM [follower786-writer-171] [DEBUG] JournalWriteTask - follower786: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@2bee319a stopped 11:17:31,830 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower786: journal closed 11:17:31,830 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower786: journal closed 11:17:31,830 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower786: stopped executor with 0 remaining tasks 11:17:31,830 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower786: stopped executor with 0 remaining tasks 11:17:31,830 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower787-collector789#-1411889187] 11:17:31,830 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower787] 11:17:31,831 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader785-collector790#-954106350] 11:17:31,831 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader785] 11:17:31,831 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRaftStorage - leader785: terminating thread VirtualThread[#919,leader785-writer-175]/waiting 11:17:31,831 AM [leader785-writer-175] [DEBUG] JournalWriteTask - leader785: received 1 entries in 4.017 s 11:17:31,831 AM [leader785-writer-175] [DEBUG] JournalWriteTask - leader785: persisted 1 entries in 18.61 μs 11:17:31,831 AM [leader785-writer-175] [DEBUG] JournalWriteTask - leader785: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@15d2ce83 stopped 11:17:31,831 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader785: journal closed 11:17:31,831 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - leader785: journal closed 11:17:31,831 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader785: stopped executor with 0 remaining tasks 11:17:31,831 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader785: stopped executor with 0 remaining tasks 11:17:31,834 AM [main] [INFO] ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest - testLeaderSnapshotTriggeredByMemoryThresholdExceededWithLaggingFollower starting [WARN] [06/27/2025 11:17:31.835] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower795]: org.opendaylight.controller.cluster.common.actor.Monitor@2863920a 11:17:31,836 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower795: Starting recovery with journal batch size 1000 11:17:31,836 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower795: started executor 11:17:31,836 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower795: started executor 11:17:31,837 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower795: metadata journal open: replayFrom=1 applyTo=0 11:17:31,837 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower795: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 11:17:31,837 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRaftStorage - follower795: journal open: applyTo=0 11:17:31,838 AM [follower795-writer-176] [DEBUG] JournalWriteTask - follower795: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@64d88206 started 11:17:31,838 AM [follower795-writer-176] [DEBUG] JournalWriteTask - follower795: waiting for more work 11:17:31,839 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest1061350212690292576/follower795/TermInfo.properties does not exist 11:17:31,839 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower795: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest1061350212690292576/follower795/journal-v1-1.log 11:17:31,839 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower795: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest1061350212690292576/follower795/metadata-v1-1.log 11:17:31,839 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower795: no eligible files found 11:17:31,839 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower795: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [06/27/2025 11:17:31.839] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower796]: org.opendaylight.controller.cluster.common.actor.Monitor@442e714 11:17:31,840 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower796: Starting recovery with journal batch size 1000 11:17:31,841 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower796: started executor 11:17:31,841 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower796: started executor 11:17:31,841 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower796: metadata journal open: replayFrom=1 applyTo=0 11:17:31,842 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower796: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 11:17:31,842 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - follower796: journal open: applyTo=0 11:17:31,842 AM [follower796-writer-177] [DEBUG] JournalWriteTask - follower796: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@50d1a4fa started 11:17:31,842 AM [follower796-writer-177] [DEBUG] JournalWriteTask - follower796: waiting for more work 11:17:31,842 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower795: Set currentTerm=0, votedFor=null 11:17:31,842 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower795: Local TermInfo store seeded with TermInfo{term=0} 11:17:31,842 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower795: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@206a0dfd 11:17:31,842 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower795: Moving last applied index from -1 to -1 11:17:31,842 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower795: journal recovery completedin 207.3 μs with journalIndex=1 11:17:31,843 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest1061350212690292576/follower796/TermInfo.properties does not exist 11:17:31,843 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower796: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest1061350212690292576/follower796/journal-v1-1.log 11:17:31,843 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower796: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest1061350212690292576/follower796/metadata-v1-1.log 11:17:31,843 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - follower796: no eligible files found 11:17:31,843 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower796: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [06/27/2025 11:17:31.843] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader794]: org.opendaylight.controller.cluster.common.actor.Monitor@e1dd4cf 11:17:31,844 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader794: Starting recovery with journal batch size 1000 11:17:31,844 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader794: started executor 11:17:31,844 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader794: started executor 11:17:31,844 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader794: metadata journal open: replayFrom=1 applyTo=0 11:17:31,845 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader794: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 11:17:31,845 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader794: journal open: applyTo=0 11:17:31,845 AM [leader794-writer-178] [DEBUG] JournalWriteTask - leader794: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@3ee7694c started 11:17:31,845 AM [leader794-writer-178] [DEBUG] JournalWriteTask - leader794: waiting for more work 11:17:31,846 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower796: Set currentTerm=0, votedFor=null 11:17:31,846 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower796: Local TermInfo store seeded with TermInfo{term=0} 11:17:31,846 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower796: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@774ada7e 11:17:31,846 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - follower796: Moving last applied index from -1 to -1 11:17:31,846 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest1061350212690292576/leader794/TermInfo.properties does not exist 11:17:31,846 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - follower796: journal recovery completedin 230.0 μs with journalIndex=1 11:17:31,846 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader794: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest1061350212690292576/leader794/journal-v1-1.log 11:17:31,846 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader794: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest1061350212690292576/leader794/metadata-v1-1.log 11:17:31,846 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - leader794: no eligible files found 11:17:31,846 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader794: Set currentTerm=5, votedFor=leader794 11:17:31,846 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader794: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:17:31,849 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader794: Set currentTerm=5, votedFor=leader794 11:17:31,849 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader794: Local TermInfo store seeded with TermInfo{term=5, votedFor=leader794} 11:17:31,849 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader794: Pekko recovery completed with org.opendaylight.controller.cluster.raft.RecoveryLog@7dbb0ef3 11:17:31,849 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader794: Moving last applied index from -1 to -1 11:17:31,849 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - leader794: journal recovery completedin 222.4 μs with journalIndex=1 11:17:32,299 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 11:17:32,299 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader794 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.170.168:17355, Removed) 11:17:32,299 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader794 (Follower): Received ElectionTimeout - switching to Candidate 11:17:32,299 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader794 (Candidate): Election: Candidate has following voting peers: [follower795, follower796] 11:17:32,305 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader794: Set currentTerm=6, votedFor=leader794 11:17:32,305 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - leader794 (Candidate): Starting new election term 6 11:17:32,305 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader794 (Candidate): Sending RequestVote{term=6, candidateId=leader794, lastLogIndex=-1, lastLogTerm=-1} to peer follower795 11:17:32,305 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader794 (Candidate): Sending RequestVote{term=6, candidateId=leader794, lastLogIndex=-1, lastLogTerm=-1} to peer follower796 11:17:32,306 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader794 (Follower) :- Switching from behavior Follower to Candidate, election term: 6 11:17:32,306 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower795 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:32,306 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower795 (Follower): Cluster state: [] 11:17:32,306 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower795 (Follower): Candidate in requestVote:RequestVote{term=6, candidateId=leader794, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 11:17:32,306 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower795 (Follower): Term 6 in "RequestVote{term=6, candidateId=leader794, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 11:17:32,306 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower796 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:17:32,306 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower796 (Follower): Cluster state: [] 11:17:32,306 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower796 (Follower): Candidate in requestVote:RequestVote{term=6, candidateId=leader794, lastLogIndex=-1, lastLogTerm=-1} with higher term appears reachable, updating term. 11:17:32,306 AM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - follower796 (Follower): Term 6 in "RequestVote{term=6, candidateId=leader794, lastLogIndex=-1, lastLogTerm=-1}" message is greater than follower's term 0 - updating term 11:17:32,309 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower795: Set currentTerm=6, votedFor=null 11:17:32,309 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower795 (Follower): In requestVote: RequestVote{term=6, candidateId=leader794, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 6, votedFor: null, lastIndex: -1, lastTerm: -1 11:17:32,310 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower796: Set currentTerm=6, votedFor=null 11:17:32,310 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower796 (Follower): In requestVote: RequestVote{term=6, candidateId=leader794, lastLogIndex=-1, lastLogTerm=-1} - currentTerm: 6, votedFor: null, lastIndex: -1, lastTerm: -1 11:17:32,312 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower795: Set currentTerm=6, votedFor=leader794 11:17:32,312 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower795 (Follower): requestVote returning: RequestVoteReply{term=6, voteGranted=true} 11:17:32,312 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader794 (Candidate): RaftRPC message received RequestVoteReply{term=6, voteGranted=true}, my term is 6 11:17:32,312 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - leader794 (Candidate): handleRequestVoteReply: RequestVoteReply{term=6, voteGranted=true}, current voteCount: 1 11:17:32,312 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): Election: Leader has following peers: [follower795, follower796] 11:17:32,312 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): Checking sendAppendEntries for follower follower795: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 11:17:32,312 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): Checking sendAppendEntries for follower follower796: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 11:17:32,313 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - leader794 (Candidate) :- Switching from behavior Candidate to Leader, election term: 6 11:17:32,313 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Last sync leader does not match current leader leader794, need to catch up to -1 [WARN] [06/27/2025 11:17:32.313] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/follower795] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower795, initialSyncDone=false] 11:17:32,313 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower796: Set currentTerm=6, votedFor=leader794 11:17:32,313 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - follower796 (Follower): requestVote returning: RequestVoteReply{term=6, voteGranted=true} 11:17:32,313 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower796: Last sync leader does not match current leader leader794, need to catch up to -1 [WARN] [06/27/2025 11:17:32.313] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/follower796] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower796, initialSyncDone=false] 11:17:32,313 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower795 updated: matchIndex: -1, nextIndex: 0 11:17:32,313 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): Checking sendAppendEntries for follower follower795: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 11:17:32,314 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower796 updated: matchIndex: -1, nextIndex: 0 11:17:32,314 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): Checking sendAppendEntries for follower follower796: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 11:17:32,356 AM [main] [INFO] ReplicationAndSnapshotsWithLaggingFollowerIntegrationTest - Leader created and elected 11:17:32,356 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader794: Persist data index=0 term=6 command=zero 11:17:32,356 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader794: Append log entry and persist JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:32,356 AM [leader794-writer-178] [DEBUG] JournalWriteTask - leader794: received 1 entries in 511.6 ms 11:17:32,357 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): Replicate message: identifier: MockIdentifier{value=zero}, logIndex: 0, isSendImmediate: true 11:17:32,357 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): Checking sendAppendEntries for follower follower795: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 11:17:32,357 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): sendAppendEntries: 0 is present for follower follower795 11:17:32,357 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): Sending AppendEntries to follower follower795: AppendEntries{term=6, leaderId=leader794, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:32,357 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower795 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader794, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:32,357 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower795 (Follower): Number of entries to be appended = 1 11:17:32,357 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower795 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 11:17:32,357 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower795 (Follower): Append entry to log zero 11:17:32,357 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower795: Append log entry and persist JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:32,357 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower795 (Follower): Log size is now 1 11:17:32,357 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower795 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower795, logLastIndex=0, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:32,357 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached -1 (of expected -1) 11:17:32,357 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower795: awaiting more completions to resolve 1 deferred callback(s) 11:17:32,357 AM [follower795-writer-176] [DEBUG] JournalWriteTask - follower795: received 1 entries in 519.7 ms 11:17:32,357 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): Checking sendAppendEntries for follower follower796: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 11:17:32,357 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): sendAppendEntries: 0 is present for follower follower796 11:17:32,357 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): Sending AppendEntries to follower follower796: AppendEntries{term=6, leaderId=leader794, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:32,358 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower795 updated: matchIndex: 0, nextIndex: 1 11:17:32,358 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): Checking sendAppendEntries for follower follower795: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 11:17:32,358 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower796 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader794, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=6, command=zero, pending=true}]} 11:17:32,358 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower796 (Follower): Number of entries to be appended = 1 11:17:32,358 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower796 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 11:17:32,358 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower796 (Follower): Append entry to log zero 11:17:32,358 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower796: Append log entry and persist JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:32,358 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower796 (Follower): Log size is now 1 11:17:32,358 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower796 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower796, logLastIndex=0, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:32,358 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower796: Lagging 0 entries behind leader leader794 and reached -1 (of expected -1) 11:17:32,358 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower796: awaiting more completions to resolve 1 deferred callback(s) 11:17:32,358 AM [follower796-writer-177] [DEBUG] JournalWriteTask - follower796: received 1 entries in 515.8 ms 11:17:32,358 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader794 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower796 updated: matchIndex: 0, nextIndex: 1 11:17:32,358 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader794 (Leader): Checking sendAppendEntries for follower follower796: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 11:17:32,361 AM [leader794-writer-178] [DEBUG] EntryStoreCompleter - leader794: 1 completion(s) pending 11:17:32,362 AM [leader794-writer-178] [DEBUG] JournalWriteTask - leader794: persisted 1 entries in 5.046 ms 11:17:32,362 AM [leader794-writer-178] [DEBUG] JournalWriteTask - leader794: waiting for more work 11:17:32,362 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - leader794: running 1 completion(s) 11:17:32,362 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - leader794: persist complete JournaledLogEntry{index=0, term=6, command=zero, pending=true} 11:17:32,362 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader794 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 11:17:32,362 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - leader794 (Leader): Setting last applied to 0 11:17:32,362 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - leader794: Moving last applied index from -1 to 0 11:17:32,362 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader794: Applying state for log index 0 data zero 11:17:32,362 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - leader794: applyState called: zero 11:17:32,362 AM [leader794-writer-178] [DEBUG] JournalWriteTask - leader794: received 1 entries in 545.3 μs 11:17:32,362 AM [leader794-writer-178] [DEBUG] JournalWriteTask - leader794: persisted 1 entries in 113.8 μs 11:17:32,362 AM [leader794-writer-178] [DEBUG] JournalWriteTask - leader794: waiting for more work 11:17:32,363 AM [follower795-writer-176] [DEBUG] EntryStoreCompleter - follower795: 1 completion(s) pending 11:17:32,363 AM [follower795-writer-176] [DEBUG] JournalWriteTask - follower795: persisted 1 entries in 5.669 ms 11:17:32,363 AM [follower795-writer-176] [DEBUG] JournalWriteTask - follower795: waiting for more work 11:17:32,363 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower795: running 1 completion(s) 11:17:32,363 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - follower795: persist complete JournaledLogEntry{index=0, term=6, command=zero, pending=false} 11:17:32,363 AM [follower796-writer-177] [DEBUG] EntryStoreCompleter - follower796: 1 completion(s) pending 11:17:32,363 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryStoreCompleter - follower795: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@4c76c856 11:17:32,363 AM [follower796-writer-177] [DEBUG] JournalWriteTask - follower796: persisted 1 entries in 5.364 ms 11:17:32,363 AM [follower796-writer-177] [DEBUG] JournalWriteTask - follower796: waiting for more work 11:17:32,363 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower796: running 1 completion(s) 11:17:32,363 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower796: persist complete JournaledLogEntry{index=0, term=6, command=zero, pending=false} 11:17:32,363 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryStoreCompleter - follower796: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@2df323d8 [WARN] [06/27/2025 11:17:32.363] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower795] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower795, initialSyncDone=true] [WARN] [06/27/2025 11:17:32.363] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower796] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower796, initialSyncDone=true] 11:17:32,549 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower795 (Follower): Commit index set to 0 11:17:32,549 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower796 (Follower): Commit index set to 0 11:17:32,549 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower796: Lagging 0 entries behind leader leader794 and reached 0 (of expected -1) 11:17:32,549 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 0 (of expected -1) 11:17:32,549 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower796 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0 11:17:32,549 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower795 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0 11:17:32,549 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower795 (Follower): Setting last applied to 0 11:17:32,549 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorBehavior - follower796 (Follower): Setting last applied to 0 11:17:32,549 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower795: Moving last applied index from -1 to 0 11:17:32,549 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower795: Applying state for log index 0 data zero 11:17:32,549 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower795: applyState called: zero 11:17:32,549 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower796: Moving last applied index from -1 to 0 11:17:32,549 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower796: Applying state for log index 0 data zero 11:17:32,549 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower796: applyState called: zero 11:17:32,549 AM [follower795-writer-176] [DEBUG] JournalWriteTask - follower795: received 1 entries in 186.2 ms 11:17:32,549 AM [follower796-writer-177] [DEBUG] JournalWriteTask - follower796: received 1 entries in 186.2 ms 11:17:32,549 AM [follower795-writer-176] [DEBUG] JournalWriteTask - follower795: persisted 1 entries in 115.7 μs 11:17:32,549 AM [follower795-writer-176] [DEBUG] JournalWriteTask - follower795: waiting for more work 11:17:32,549 AM [follower796-writer-177] [DEBUG] JournalWriteTask - follower796: persisted 1 entries in 103.9 μs 11:17:32,550 AM [follower796-writer-177] [DEBUG] JournalWriteTask - follower796: waiting for more work 11:17:32,668 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower796: Lagging 0 entries behind leader leader794 and reached 0 (of expected -1) 11:17:32,668 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 0 (of expected -1) 11:17:32,789 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 0 (of expected -1) 11:17:32,909 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 0 (of expected -1) 11:17:33,29 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 0 (of expected -1) 11:17:33,115 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader794: Persist data index=1 term=6 command=one 11:17:33,115 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader794: Append log entry and persist JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:33,115 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): Replicate message: identifier: MockIdentifier{value=one}, logIndex: 1, isSendImmediate: true 11:17:33,115 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): Checking sendAppendEntries for follower follower795: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:33,115 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): sendAppendEntries: 1 is present for follower follower795 11:17:33,115 AM [leader794-writer-178] [DEBUG] JournalWriteTask - leader794: received 1 entries in 752.9 ms 11:17:33,115 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): Sending AppendEntries to follower follower795: AppendEntries{term=6, leaderId=leader794, prevLogIndex=0, prevLogTerm=6, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=6, command=one, pending=true}]} 11:17:33,115 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader794 (Leader): Checking sendAppendEntries for follower follower796: active: false, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:33,116 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower795 (Follower): handleAppendEntries: AppendEntries{term=6, leaderId=leader794, prevLogIndex=0, prevLogTerm=6, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=6, command=one, pending=true}]} 11:17:33,116 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower795 (Follower): Number of entries to be appended = 1 11:17:33,116 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower795 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 11:17:33,116 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower795 (Follower): Append entry to log one 11:17:33,116 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower795: Append log entry and persist JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:33,116 AM [follower795-writer-176] [DEBUG] JournalWriteTask - follower795: received 1 entries in 566.3 ms 11:17:33,116 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower795 (Follower): Log size is now 2 11:17:33,116 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - follower795 (Follower): handleAppendEntries returning : AppendEntriesReply{term=6, success=true, followerId=follower795, logLastIndex=1, logLastTerm=6, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 11:17:33,116 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 0 (of expected -1) 11:17:33,116 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower795: awaiting more completions to resolve 1 deferred callback(s) 11:17:33,116 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader794 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower795 updated: matchIndex: 1, nextIndex: 2 11:17:33,116 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader794 (Leader): Checking sendAppendEntries for follower follower795: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:17:33,121 AM [follower795-writer-176] [DEBUG] EntryStoreCompleter - follower795: 1 completion(s) pending 11:17:33,121 AM [leader794-writer-178] [DEBUG] EntryStoreCompleter - leader794: 1 completion(s) pending 11:17:33,121 AM [leader794-writer-178] [DEBUG] JournalWriteTask - leader794: persisted 1 entries in 5.506 ms 11:17:33,121 AM [follower795-writer-176] [DEBUG] JournalWriteTask - follower795: persisted 1 entries in 4.938 ms 11:17:33,121 AM [leader794-writer-178] [DEBUG] JournalWriteTask - leader794: waiting for more work 11:17:33,121 AM [follower795-writer-176] [DEBUG] JournalWriteTask - follower795: waiting for more work 11:17:33,121 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryStoreCompleter - leader794: running 1 completion(s) 11:17:33,121 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - leader794: persist complete JournaledLogEntry{index=1, term=6, command=one, pending=true} 11:17:33,121 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader794 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 11:17:33,121 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorBehavior - leader794 (Leader): Setting last applied to 1 11:17:33,121 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader794: Moving last applied index from 0 to 1 11:17:33,121 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader794: Applying state for log index 1 data one 11:17:33,121 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader794: applyState called: one 11:17:33,121 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - leader794: fakeSnapshot purging log to 0 for term 6 11:17:33,121 AM [leader794-writer-178] [DEBUG] JournalWriteTask - leader794: received 1 entries in 572.1 μs 11:17:33,121 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower795: running 1 completion(s) 11:17:33,121 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] ReplicatedLogImpl - follower795: persist complete JournaledLogEntry{index=1, term=6, command=one, pending=false} 11:17:33,121 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryStoreCompleter - follower795: completed deferred callback org.opendaylight.controller.cluster.raft.ReplicatedLogImpl$$Lambda/0x00000007c087b3c8@15918dc7 11:17:33,122 AM [leader794-writer-178] [DEBUG] JournalWriteTask - leader794: persisted 1 entries in 102.4 μs 11:17:33,122 AM [leader794-writer-178] [DEBUG] JournalWriteTask - leader794: waiting for more work 11:17:33,269 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower795 (Follower): Commit index set to 1 11:17:33,269 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:33,269 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower795 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1 11:17:33,269 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower795 (Follower): Setting last applied to 1 11:17:33,269 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower795: Moving last applied index from 0 to 1 11:17:33,269 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower795: Applying state for log index 1 data one 11:17:33,269 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - follower795: applyState called: one 11:17:33,269 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotManager - follower795: fakeSnapshot purging log to 0 for term 6 11:17:33,269 AM [follower795-writer-176] [DEBUG] JournalWriteTask - follower795: received 1 entries in 148.4 ms 11:17:33,269 AM [follower795-writer-176] [DEBUG] JournalWriteTask - follower795: persisted 1 entries in 128.1 μs 11:17:33,269 AM [follower795-writer-176] [DEBUG] JournalWriteTask - follower795: waiting for more work 11:17:33,388 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:33,509 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:33,628 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:33,749 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:33,868 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:33,989 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:34,109 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:34,229 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:34,349 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:34,469 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:34,588 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:34,709 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:34,829 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:34,948 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:35,69 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:35,189 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:35,309 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:35,429 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:35,548 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:35,668 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:35,789 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:35,909 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:36,29 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:36,148 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:36,269 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:36,389 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:36,509 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:36,628 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:36,749 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:36,869 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:36,978 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:37,99 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:37,219 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:37,339 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:37,459 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:37,569 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:37,689 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:37,809 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:37,929 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:38,39 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:38,159 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] SyncStatusTracker - follower795: Lagging 0 entries behind leader leader794 and reached 1 (of expected -1) 11:17:38,166 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower795-collector797#-1839195182] 11:17:38,177 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower795] 11:17:38,177 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - follower795: terminating thread VirtualThread[#920,follower795-writer-176]/waiting 11:17:38,177 AM [follower795-writer-176] [DEBUG] JournalWriteTask - follower795: received 1 entries in 4.908 s 11:17:38,177 AM [follower795-writer-176] [DEBUG] JournalWriteTask - follower795: persisted 1 entries in 35.61 μs 11:17:38,177 AM [follower795-writer-176] [DEBUG] JournalWriteTask - follower795: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@64d88206 stopped 11:17:38,177 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower795: journal closed 11:17:38,177 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower795: journal closed 11:17:38,177 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower795: stopped executor with 0 remaining tasks 11:17:38,178 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower795: stopped executor with 0 remaining tasks 11:17:38,178 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower796-collector798#124610514] 11:17:38,178 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower796] 11:17:38,178 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - follower796: terminating thread VirtualThread[#921,follower796-writer-177]/waiting 11:17:38,178 AM [follower796-writer-177] [DEBUG] JournalWriteTask - follower796: received 1 entries in 5.629 s 11:17:38,178 AM [follower796-writer-177] [DEBUG] JournalWriteTask - follower796: persisted 1 entries in 17.73 μs 11:17:38,178 AM [follower796-writer-177] [DEBUG] JournalWriteTask - follower796: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@50d1a4fa stopped 11:17:38,178 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower796: journal closed 11:17:38,178 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower796: journal closed 11:17:38,178 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower796: stopped executor with 0 remaining tasks 11:17:38,178 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower796: stopped executor with 0 remaining tasks 11:17:38,178 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader794-collector799#713306725] 11:17:38,179 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader794] 11:17:38,179 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader794: terminating thread VirtualThread[#922,leader794-writer-178]/waiting 11:17:38,179 AM [leader794-writer-178] [DEBUG] JournalWriteTask - leader794: received 1 entries in 5.057 s 11:17:38,179 AM [leader794-writer-178] [DEBUG] JournalWriteTask - leader794: persisted 1 entries in 20.57 μs 11:17:38,179 AM [leader794-writer-178] [DEBUG] JournalWriteTask - leader794: task org.opendaylight.controller.cluster.raft.spi.JournalWriteTask@3ee7694c stopped 11:17:38,179 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader794: journal closed 11:17:38,179 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader794: journal closed 11:17:38,179 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader794: stopped executor with 0 remaining tasks 11:17:38,179 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader794: stopped executor with 0 remaining tasks [INFO] [06/27/2025 11:17:38.183] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 11:17:38,183 AM [test-pekko.actor.default-dispatcher-11] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [WARN] [06/27/2025 11:17:38.184] [test-pekko.actor.default-dispatcher-11] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.170.168:17355) 11:17:38,185 AM [test-pekko.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Exiting completed 11:17:38,185 AM [test-pekko.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Shutting down... 11:17:38,185 AM [test-pekko.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.168:17355] - Successfully shut down 11:17:38,186 AM [test-pekko.actor.default-dispatcher-15] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 11:17:38,186 AM [test-pekko.actor.default-dispatcher-15] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [INFO] [06/27/2025 11:17:38.185] [test-pekko.actor.internal-dispatcher-4] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Exiting completed [INFO] [06/27/2025 11:17:38.185] [test-pekko.actor.internal-dispatcher-4] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Shutting down... [INFO] [06/27/2025 11:17:38.185] [test-pekko.actor.internal-dispatcher-4] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.168:17355] - Successfully shut down [INFO] [06/27/2025 11:17:38.186] [test-pekko.remote.default-remote-dispatcher-8] [pekko://test@10.30.170.168:17355/system/remoting-terminator] Shutting down remote daemon. [INFO] [06/27/2025 11:17:38.186] [test-pekko.remote.default-remote-dispatcher-8] [pekko://test@10.30.170.168:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports. [INFO] [06/27/2025 11:17:38.189] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.170.168:17355/system/remoting-terminator] Remoting shut down. 11:17:38,189 AM [test-pekko.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down. [DEBUG] [06/27/2025 11:17:38.189] [test-pekko.actor.internal-dispatcher-3] [EventStream] shutting down: StandardOutLogger