[DEBUG] [07/27/2025 01:14:32.068] [main] [EventStream(pekko://test)] logger log1-TestEventListener started 01:14:32,68 AM [test-pekko.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [07/27/2025 01:14:32.068] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started [DEBUG] [07/27/2025 01:14:32.069] [main] [EventStream(pekko://test)] Default Loggers started [INFO] [07/27/2025 01:14:32.083] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.171.97:17355] with UID [-7871256530708146819] 01:14:32,83 AM [test-pekko.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.171.97:17355] with UID [-7871256530708146819] [INFO] [07/27/2025 01:14:32.083] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.97:17355] - Starting up, Pekko version [1.1.4] ... 01:14:32,84 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.97:17355] - Starting up, Pekko version [1.1.4] ... [INFO] [07/27/2025 01:14:32.085] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.97:17355] - Registered cluster JMX MBean [pekko:type=Cluster] [INFO] [07/27/2025 01:14:32.085] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.97:17355] - Started up successfully 01:14:32,86 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.97:17355] - Registered cluster JMX MBean [pekko:type=Cluster] 01:14:32,86 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.97:17355] - Started up successfully [INFO] [07/27/2025 01:14:32.086] [test-pekko.actor.internal-dispatcher-4] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.97:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing 01:14:32,86 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.97:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing 01:14:32,86 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.97:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining [INFO] [07/27/2025 01:14:32.086] [test-pekko.actor.internal-dispatcher-4] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.97:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 01:14:32,99 AM [main] [INFO] RaftActorTest - testRestoreFromSnapshotWithRecoveredData starting [WARN] [07/27/2025 01:14:32.102] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/test-actor-250]: org.opendaylight.controller.cluster.common.actor.Monitor@5049960 [INFO] [pekkoDeadLetter][07/27/2025 01:14:32.102] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/test-actor-250] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:32,102 AM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/test-actor-250] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:32,105 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - test-actor-250: Starting recovery with journal batch size 1000 01:14:32,105 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - test-actor-250: started executor 01:14:32,105 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - test-actor-250: started executor 01:14:32,106 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - test-actor-250: metadata journal open: replayFrom=1 applyTo=0 01:14:32,106 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - test-actor-250: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:14:32,106 AM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - test-actor-250: journal open: applyTo=0 01:14:32,107 AM [test-actor-250-writer-103] [DEBUG] JournalWriteTask - test-actor-250: journal writer started 01:14:32,107 AM [test-actor-250-writer-103] [DEBUG] JournalWriteTask - test-actor-250: waiting to receive commands 01:14:32,108 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest544313812282617681/test-actor-250/TermInfo.properties does not exist 01:14:32,108 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest544313812282617681/test-actor-250/journal-v1-1.log 01:14:32,108 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest544313812282617681/test-actor-250/metadata-v1-1.log 01:14:32,108 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: no eligible files found 01:14:32,108 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - test-actor-250: Received ReplicatedLogEntry for recovery: index: 0, size: 1 01:14:32,109 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - test-actor-250: Recovery completed - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1 01:14:32,112 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - test-actor-250: Set currentTerm=0, votedFor=null 01:14:32,112 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - test-actor-250: Local TermInfo store seeded with TermInfo{term=0} 01:14:32,112 AM [test-pekko.actor.default-dispatcher-5] [WARN] PekkoRecovery - test-actor-250: The provided restore snapshot was not applied because the persistence store is not empty 01:14:32,112 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - test-actor-250: taking snapshot to clear Pekko persistence to 1 01:14:32,112 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Recovery - test-actor-250: no applied entries in recovery log, re-snapshotting EntryInfo[index=-1, term=-1] 01:14:32,112 AM [test-pekko.actor.default-dispatcher-5] [INFO] Recovery - test-actor-250: Taking snapshot on entry with index -1 01:14:32,112 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - test-actor-250: support() called 01:14:32,113 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest544313812282617681/test-actor-250/snapshot-0000000068857D78-06BF0871.tmp 01:14:32,116 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest544313812282617681/test-actor-250/snapshot-0000000068857D78-06BF0871.v1 01:14:32,116 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest544313812282617681/test-actor-250/snapshot-0000000068857D78-06BF0871.v1 01:14:32,116 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest544313812282617681/test-actor-250/TermInfo.properties 01:14:32,116 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest544313812282617681/test-actor-250/journal-v1-1.log 01:14:32,116 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest544313812282617681/test-actor-250/metadata-v1-1.log 01:14:32,116 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-27T01:14:32.113182833Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorTest544313812282617681/test-actor-250/snapshot-0000000068857D78-06BF0871.v1, size=196, entryCompress=NONE, stateCompress=NONE} 01:14:32,116 AM [test-pekko.actor.default-dispatcher-5] [INFO] Recovery - test-actor-250: Snapshot completed in 4.449 ms, resetting timer for the next recovery snapshot 01:14:32,116 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - test-actor-250: Pekko recovery completed and can restore from snapshot 01:14:32,117 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - test-actor-250: starting journal recovery 01:14:32,117 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - test-actor-250: Moving last applied index from -1 to -1 01:14:32,117 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - test-actor-250: empty journal: appending 1 entries 01:14:32,117 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - test-actor-250: updated meta to JournalMeta[replayFrom=1, applyTo=0] 01:14:32,120 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - test-actor-250: journal recovery completedin 3.261 ms with journalIndex=1 01:14:32,120 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - test-actor-250: ignoring DeleteMessagesSuccess(1) 01:14:32,120 AM [test-pekko.actor.default-dispatcher-5] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 01:14:32,621 AM [main] [INFO] RaftActorTest - testRestoreFromSnapshotWithRecoveredData ending 01:14:32,621 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/test-actor-250] 01:14:32,633 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EnabledRaftStorage - test-actor-250: terminating thread VirtualThread[#715,test-actor-250-writer-103]/waiting 01:14:32,633 AM [test-actor-250-writer-103] [DEBUG] JournalWriteTask - test-actor-250: received 1 commands after 526.3 ms 01:14:32,633 AM [test-actor-250-writer-103] [DEBUG] JournalWriteTask - test-actor-250: completed 1 commands in 17.25 μs 01:14:32,633 AM [test-actor-250-writer-103] [DEBUG] JournalWriteTask - test-actor-250: journal writer stopped 01:14:32,633 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - test-actor-250: journal closed 01:14:32,633 AM [test-pekko.actor.default-dispatcher-5] [INFO] EnabledRaftStorage - test-actor-250: journal closed 01:14:32,633 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: stopped executor with 0 remaining tasks 01:14:32,633 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: stopped executor with 0 remaining tasks [WARN] [07/27/2025 01:14:32.638] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader-251]: org.opendaylight.controller.cluster.common.actor.Monitor@4e60021 [INFO] [pekkoDeadLetter][07/27/2025 01:14:32.638] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader-251] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:32,638 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader-251] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:32,640 AM [main] [INFO] RaftActor - leader-251: Starting recovery with journal batch size 1000 01:14:32,640 AM [main] [DEBUG] RaftStorage - leader-251: started executor 01:14:32,640 AM [main] [DEBUG] RaftStorage - leader-251: started executor 01:14:32,641 AM [main] [DEBUG] EntryJournalV1 - leader-251: metadata journal open: replayFrom=1 applyTo=0 01:14:32,641 AM [main] [DEBUG] EntryJournalV1 - leader-251: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:14:32,641 AM [main] [INFO] EnabledRaftStorage - leader-251: journal open: applyTo=0 01:14:32,642 AM [leader-251-writer-104] [DEBUG] JournalWriteTask - leader-251: journal writer started 01:14:32,642 AM [leader-251-writer-104] [DEBUG] JournalWriteTask - leader-251: waiting to receive commands 01:14:32,643 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest14229743627307911739/leader-251/TermInfo.properties does not exist 01:14:32,643 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader-251: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:14:32,647 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader-251: Set currentTerm=0, votedFor=null 01:14:32,648 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader-251: Local TermInfo store seeded with TermInfo{term=0} 01:14:32,648 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader-251: Pekko recovery completed and can restore from snapshot 01:14:32,648 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader-251: no journal: skipping journal recovery 01:14:32,648 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:14:32,648 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - leader-251 (Follower): Received TimeoutNow - switching to Candidate 01:14:32,648 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader-251 (Candidate): Election: Candidate has following voting peers: [] 01:14:32,652 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader-251: Set currentTerm=1, votedFor=leader-251 01:14:32,652 AM [test-pekko.actor.default-dispatcher-6] [INFO] Candidate - leader-251 (Candidate): Starting new election term 1 01:14:32,652 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader-251 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:14:32,652 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - leader-251 (Candidate): Received ElectionTimeout 01:14:32,652 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader-251 (Leader): Election: Leader has following peers: [] 01:14:32,652 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - leader-251 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:14:32,748 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader-251] 01:14:32,749 AM [main] [DEBUG] EnabledRaftStorage - leader-251: terminating thread VirtualThread[#716,leader-251-writer-104]/waiting 01:14:32,750 AM [leader-251-writer-104] [DEBUG] JournalWriteTask - leader-251: received 1 commands after 107.9 ms 01:14:32,750 AM [leader-251-writer-104] [DEBUG] JournalWriteTask - leader-251: completed 1 commands in 15.04 μs 01:14:32,750 AM [leader-251-writer-104] [DEBUG] JournalWriteTask - leader-251: journal writer stopped 01:14:32,750 AM [main] [DEBUG] EntryJournalV1 - leader-251: journal closed 01:14:32,750 AM [main] [INFO] EnabledRaftStorage - leader-251: journal closed 01:14:32,750 AM [main] [DEBUG] RaftStorage - leader-251: stopped executor with 0 remaining tasks 01:14:32,750 AM [main] [DEBUG] RaftStorage - leader-251: stopped executor with 0 remaining tasks [WARN] [07/27/2025 01:14:32.753] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from Actor[pekko://test/user/testFindLeader#-609137708]: org.opendaylight.controller.cluster.common.actor.Monitor@7f605d2d [INFO] [pekkoDeadLetter][07/27/2025 01:14:32.753] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[pekko://test/user/testFindLeader#-609137708] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:32,753 AM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[pekko://test/user/testFindLeader#-609137708] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:32,754 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - testFindLeader: Starting recovery with journal batch size 1000 01:14:32,754 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - testFindLeader: started executor 01:14:32,754 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - testFindLeader: started executor 01:14:32,755 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - testFindLeader: metadata journal open: replayFrom=1 applyTo=0 01:14:32,755 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - testFindLeader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:14:32,755 AM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - testFindLeader: journal open: applyTo=0 01:14:32,756 AM [testFindLeader-writer-105] [DEBUG] JournalWriteTask - testFindLeader: journal writer started 01:14:32,756 AM [testFindLeader-writer-105] [DEBUG] JournalWriteTask - testFindLeader: waiting to receive commands 01:14:32,757 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest10041796127241540317/testFindLeader/TermInfo.properties does not exist 01:14:32,757 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - testFindLeader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest10041796127241540317/testFindLeader/journal-v1-1.log 01:14:32,757 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - testFindLeader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest10041796127241540317/testFindLeader/metadata-v1-1.log 01:14:32,757 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - testFindLeader: no eligible files found 01:14:32,757 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - testFindLeader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:14:32,760 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - testFindLeader: Set currentTerm=0, votedFor=null 01:14:32,760 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - testFindLeader: Local TermInfo store seeded with TermInfo{term=0} 01:14:32,761 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - testFindLeader: Pekko recovery completed and can restore from snapshot 01:14:32,761 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - testFindLeader: starting journal recovery 01:14:32,761 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - testFindLeader: Moving last applied index from -1 to -1 01:14:32,761 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - testFindLeader: empty journal: appending 0 entries 01:14:32,761 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - testFindLeader: updated meta to JournalMeta[replayFrom=1, applyTo=0] 01:14:32,761 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - testFindLeader: journal recovery completedin 255.7 μs with journalIndex=1 01:14:32,761 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:14:32,761 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - testFindLeader (Follower): Received TimeoutNow - switching to Candidate 01:14:32,761 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - testFindLeader (Candidate): Election: Candidate has following voting peers: [] 01:14:32,764 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - testFindLeader: Set currentTerm=1, votedFor=testFindLeader 01:14:32,764 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - testFindLeader (Candidate): Starting new election term 1 01:14:32,764 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - testFindLeader (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:14:32,764 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - testFindLeader (Candidate): Received ElectionTimeout 01:14:32,765 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - testFindLeader (Leader): Election: Leader has following peers: [] 01:14:32,765 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - testFindLeader (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:14:32,813 AM [main] [INFO] RaftActorTest - testLeaderTransitioning starting 01:14:32,816 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - test-actor-252: Starting recovery with journal batch size 1000 01:14:32,816 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-252: started executor 01:14:32,816 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-252: started executor [WARN] [07/27/2025 01:14:32.816] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/test-actor-252]: org.opendaylight.controller.cluster.common.actor.Monitor@7bcb2820 [INFO] [pekkoDeadLetter][07/27/2025 01:14:32.817] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/test-actor-252] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:32,817 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/test-actor-252] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:32,817 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - test-actor-252: metadata journal open: replayFrom=1 applyTo=0 01:14:32,818 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - test-actor-252: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:14:32,818 AM [test-pekko.actor.default-dispatcher-5] [INFO] EnabledRaftStorage - test-actor-252: journal open: applyTo=0 01:14:32,818 AM [test-actor-252-writer-106] [DEBUG] JournalWriteTask - test-actor-252: journal writer started 01:14:32,818 AM [test-actor-252-writer-106] [DEBUG] JournalWriteTask - test-actor-252: waiting to receive commands 01:14:32,819 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest3833714769373722922/test-actor-252/TermInfo.properties does not exist 01:14:32,820 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-252: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest3833714769373722922/test-actor-252/journal-v1-1.log 01:14:32,820 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-252: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest3833714769373722922/test-actor-252/metadata-v1-1.log 01:14:32,820 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-252: no eligible files found 01:14:32,820 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - test-actor-252: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:14:32,822 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - test-actor-252: Set currentTerm=0, votedFor=null 01:14:32,822 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - test-actor-252: Local TermInfo store seeded with TermInfo{term=0} 01:14:32,822 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - test-actor-252: Pekko recovery completed and can restore from snapshot 01:14:32,822 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - test-actor-252: starting journal recovery 01:14:32,822 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - test-actor-252: Moving last applied index from -1 to -1 01:14:32,822 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - test-actor-252: empty journal: appending 0 entries 01:14:32,822 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - test-actor-252: updated meta to JournalMeta[replayFrom=1, applyTo=0] 01:14:32,822 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - test-actor-252: journal recovery completedin 227.7 μs with journalIndex=1 01:14:32,823 AM [test-pekko.actor.default-dispatcher-14] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 01:14:32,824 AM [test-pekko.actor.default-dispatcher-14] [INFO] Follower - test-actor-252 (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=1, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term 01:14:32,825 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - test-actor-252: Set currentTerm=1, votedFor=null 01:14:32,825 AM [test-pekko.actor.default-dispatcher-14] [INFO] Follower - test-actor-252 (Follower): The followers log is empty and the senders prevLogIndex is 0 01:14:32,825 AM [test-pekko.actor.default-dispatcher-14] [INFO] Follower - test-actor-252 (Follower): Follower is out-of-sync so sending negative reply: AppendEntriesReply{term=1, success=false, followerId=test-actor-252, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 01:14:32,825 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] SyncStatusTracker - test-actor-252: Last sync leader does not match current leader leader, need to catch up to 0 [WARN] [07/27/2025 01:14:32.826] [test-pekko.actor.default-dispatcher-5] [pekko://test/deadLetters] received dead letter from TestActor[pekko://test/user/test-actor-252]: AppendEntriesReply{term=1, success=false, followerId=test-actor-252, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} [WARN] [07/27/2025 01:14:32.826] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/test-actor-252] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=test-actor-252, initialSyncDone=false] [INFO] [pekkoDeadLetter][07/27/2025 01:14:32.826] [test-pekko.actor.default-dispatcher-6] [pekko://test/deadLetters] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntriesReply] from TestActor[pekko://test/user/test-actor-252] to Actor[pekko://test/deadLetters] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/deadLetters] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:32,826 AM [test-pekko.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemoteDeadLetterActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntriesReply] from TestActor[pekko://test/user/test-actor-252] to Actor[pekko://test/deadLetters] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/deadLetters] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][07/27/2025 01:14:32.826] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/test-actor-252] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/test-actor-252] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:32,826 AM [test-pekko.actor.default-dispatcher-11] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/test-actor-252] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:32,874 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - test-actor-252: onLeaderTransitioning: LeaderTransitioning [leaderId=leader] 01:14:32,924 AM [main] [INFO] RaftActorTest - testLeaderTransitioning ending 01:14:32,924 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$a#1350918543] 01:14:32,935 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/test-actor-252] 01:14:32,936 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EnabledRaftStorage - test-actor-252: terminating thread VirtualThread[#719,test-actor-252-writer-106]/waiting 01:14:32,936 AM [test-actor-252-writer-106] [DEBUG] JournalWriteTask - test-actor-252: received 1 commands after 118.2 ms 01:14:32,936 AM [test-actor-252-writer-106] [DEBUG] JournalWriteTask - test-actor-252: completed 1 commands in 18.94 μs 01:14:32,936 AM [test-actor-252-writer-106] [DEBUG] JournalWriteTask - test-actor-252: journal writer stopped 01:14:32,936 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - test-actor-252: journal closed 01:14:32,937 AM [test-pekko.actor.default-dispatcher-14] [INFO] EnabledRaftStorage - test-actor-252: journal closed 01:14:32,937 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-252: stopped executor with 0 remaining tasks 01:14:32,937 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-252: stopped executor with 0 remaining tasks [WARN] [07/27/2025 01:14:32.940] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from Actor[pekko://test/user/$c#-1775117248]: org.opendaylight.controller.cluster.common.actor.Monitor@16371984 [INFO] [pekkoDeadLetter][07/27/2025 01:14:32.941] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[pekko://test/user/$c#-1775117248] to Actor[pekko://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:32,941 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[pekko://test/user/$c#-1775117248] to Actor[pekko://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:32,942 AM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - notifier-253: Starting recovery with journal batch size 1000 01:14:32,942 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - notifier-253: started executor 01:14:32,942 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - notifier-253: started executor 01:14:32,943 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - notifier-253: metadata journal open: replayFrom=1 applyTo=0 01:14:32,944 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - notifier-253: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:14:32,944 AM [test-pekko.actor.default-dispatcher-14] [INFO] EnabledRaftStorage - notifier-253: journal open: applyTo=0 01:14:32,944 AM [notifier-253-writer-107] [DEBUG] JournalWriteTask - notifier-253: journal writer started 01:14:32,944 AM [notifier-253-writer-107] [DEBUG] JournalWriteTask - notifier-253: waiting to receive commands 01:14:32,945 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest14299869475988282489/notifier-253/TermInfo.properties does not exist 01:14:32,945 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - notifier-253: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest14299869475988282489/notifier-253/journal-v1-1.log 01:14:32,945 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - notifier-253: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest14299869475988282489/notifier-253/metadata-v1-1.log 01:14:32,945 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - notifier-253: no eligible files found 01:14:32,945 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - notifier-253: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:14:32,950 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=0, votedFor=null 01:14:32,950 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - notifier-253: Local TermInfo store seeded with TermInfo{term=0} 01:14:32,950 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - notifier-253: Pekko recovery completed and can restore from snapshot 01:14:32,950 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - notifier-253: starting journal recovery 01:14:32,950 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - notifier-253: Moving last applied index from -1 to -1 01:14:32,950 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - notifier-253: empty journal: appending 0 entries 01:14:32,950 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - notifier-253: updated meta to JournalMeta[replayFrom=1, applyTo=0] 01:14:32,950 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - notifier-253: journal recovery completedin 342.8 μs with journalIndex=1 01:14:33,93 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:14:33,93 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - notifier-253 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.97:17355, Removed) 01:14:33,94 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - notifier-253 (Follower): Received ElectionTimeout - switching to Candidate 01:14:33,94 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - notifier-253 (Candidate): Election: Candidate has following voting peers: [leader] 01:14:33,97 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=1, votedFor=notifier-253 01:14:33,97 AM [test-pekko.actor.default-dispatcher-6] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 1 01:14:33,97 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=1, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader 01:14:33,98 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorBehavior - notifier-253 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:14:33,98 AM [test-pekko.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#-1775117248] to Actor[pekko://test/user/$c/fake/path] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [07/27/2025 01:14:33.098] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=1, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} [INFO] [pekkoDeadLetter][07/27/2025 01:14:33.098] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#-1775117248] to Actor[pekko://test/user/$c/fake/path] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:33,293 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:33,296 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=2, votedFor=notifier-253 01:14:33,296 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 2 01:14:33,296 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=2, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:33.297] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=2, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} [INFO] [pekkoDeadLetter][07/27/2025 01:14:33.297] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#-1775117248] to Actor[pekko://test/user/$c/fake/path] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:33,297 AM [test-pekko.actor.default-dispatcher-14] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#-1775117248] to Actor[pekko://test/user/$c/fake/path] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:33,473 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:33,477 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=3, votedFor=notifier-253 01:14:33,477 AM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 3 01:14:33,477 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=3, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:33.477] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=3, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} [INFO] [pekkoDeadLetter][07/27/2025 01:14:33.477] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/$c/fake/path] Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#-1775117248] to Actor[pekko://test/user/$c/fake/path] was not delivered. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:33,478 AM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#-1775117248] to Actor[pekko://test/user/$c/fake/path] was not delivered. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:14:33,623 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:33,627 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=4, votedFor=notifier-253 01:14:33,627 AM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 4 01:14:33,627 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=4, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:33.628] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=4, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:33,833 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:33,836 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=5, votedFor=notifier-253 01:14:33,836 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 5 01:14:33,837 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=5, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:33.837] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=5, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:34,44 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:34,48 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=6, votedFor=notifier-253 01:14:34,48 AM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 6 01:14:34,48 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=6, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:34.048] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=6, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:34,224 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:34,226 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=7, votedFor=notifier-253 01:14:34,226 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 7 01:14:34,226 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=7, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:34.227] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=7, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:34,383 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:34,386 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=8, votedFor=notifier-253 01:14:34,386 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 8 01:14:34,386 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=8, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:34.386] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=8, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:34,523 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:34,526 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=9, votedFor=notifier-253 01:14:34,526 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 9 01:14:34,526 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=9, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:34.526] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=9, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:34,663 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:34,666 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=10, votedFor=notifier-253 01:14:34,666 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 10 01:14:34,666 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=10, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:34.666] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=10, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:34,873 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:34,876 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=11, votedFor=notifier-253 01:14:34,876 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 11 01:14:34,876 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=11, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:34.876] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=11, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:35,63 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:35,66 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=12, votedFor=notifier-253 01:14:35,66 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 12 01:14:35,66 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=12, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:35.066] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=12, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:35,273 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:35,276 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=13, votedFor=notifier-253 01:14:35,276 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 13 01:14:35,276 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=13, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:35.276] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=13, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:35,463 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:35,468 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=14, votedFor=notifier-253 01:14:35,468 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 14 01:14:35,468 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=14, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:35.469] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=14, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:35,673 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:35,676 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=15, votedFor=notifier-253 01:14:35,676 AM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 15 01:14:35,676 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=15, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:35.676] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=15, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:35,853 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:35,855 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=16, votedFor=notifier-253 01:14:35,855 AM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 16 01:14:35,855 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=16, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:35.856] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=16, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:36,23 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:36,27 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=17, votedFor=notifier-253 01:14:36,27 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 17 01:14:36,27 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=17, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:36.027] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=17, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:36,233 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:36,236 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=18, votedFor=notifier-253 01:14:36,236 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 18 01:14:36,236 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=18, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:36.237] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=18, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:36,413 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:36,416 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=19, votedFor=notifier-253 01:14:36,417 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 19 01:14:36,417 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=19, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:36.417] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=19, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:36,563 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:36,566 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=20, votedFor=notifier-253 01:14:36,566 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 20 01:14:36,566 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=20, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:36.566] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=20, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:36,743 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:36,748 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=21, votedFor=notifier-253 01:14:36,748 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 21 01:14:36,748 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=21, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:36.749] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=21, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:36,894 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:36,897 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=22, votedFor=notifier-253 01:14:36,897 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 22 01:14:36,897 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=22, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:36.897] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=22, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:37,73 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:37,77 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=23, votedFor=notifier-253 01:14:37,77 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 23 01:14:37,77 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=23, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:37.077] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=23, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:37,284 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:37,287 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=24, votedFor=notifier-253 01:14:37,287 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 24 01:14:37,287 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=24, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:37.287] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=24, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:37,413 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:37,416 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=25, votedFor=notifier-253 01:14:37,416 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 25 01:14:37,417 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=25, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:37.417] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=25, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:37,623 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:37,627 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=26, votedFor=notifier-253 01:14:37,627 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 26 01:14:37,627 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=26, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:37.627] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=26, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:37,763 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:37,766 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=27, votedFor=notifier-253 01:14:37,767 AM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 27 01:14:37,767 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=27, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:37.767] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=27, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:37,923 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:14:37,925 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=28, votedFor=notifier-253 01:14:37,925 AM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 28 01:14:37,925 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=28, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/27/2025 01:14:37.926] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-1775117248]: RequestVote{term=28, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:14:37,961 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$b#2015560576] 01:14:37,972 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$c#-1775117248] 01:14:37,972 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EnabledRaftStorage - notifier-253: terminating thread VirtualThread[#720,notifier-253-writer-107]/waiting 01:14:37,972 AM [notifier-253-writer-107] [DEBUG] JournalWriteTask - notifier-253: received 1 commands after 5.029 s 01:14:37,973 AM [notifier-253-writer-107] [DEBUG] JournalWriteTask - notifier-253: completed 1 commands in 20.22 μs 01:14:37,973 AM [notifier-253-writer-107] [DEBUG] JournalWriteTask - notifier-253: journal writer stopped 01:14:37,973 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - notifier-253: journal closed 01:14:37,973 AM [test-pekko.actor.default-dispatcher-14] [INFO] EnabledRaftStorage - notifier-253: journal closed 01:14:37,973 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - notifier-253: stopped executor with 0 remaining tasks 01:14:37,973 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - notifier-253: stopped executor with 0 remaining tasks [WARN] [07/27/2025 01:14:37.976] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader-254]: org.opendaylight.controller.cluster.common.actor.Monitor@540445ee 01:14:37,977 AM [main] [INFO] RaftActor - leader-254: Starting recovery with journal batch size 1000 01:14:37,977 AM [main] [DEBUG] RaftStorage - leader-254: started executor 01:14:37,977 AM [main] [DEBUG] RaftStorage - leader-254: started executor 01:14:37,978 AM [main] [DEBUG] EntryJournalV1 - leader-254: metadata journal open: replayFrom=1 applyTo=0 01:14:37,979 AM [main] [DEBUG] EntryJournalV1 - leader-254: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:14:37,979 AM [main] [INFO] EnabledRaftStorage - leader-254: journal open: applyTo=0 01:14:37,979 AM [leader-254-writer-108] [DEBUG] JournalWriteTask - leader-254: journal writer started 01:14:37,979 AM [leader-254-writer-108] [DEBUG] JournalWriteTask - leader-254: waiting to receive commands 01:14:37,980 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest6431030238764418731/leader-254/TermInfo.properties does not exist 01:14:37,981 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader-254: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:14:37,983 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader-254: Set currentTerm=0, votedFor=null 01:14:37,983 AM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader-254: Local TermInfo store seeded with TermInfo{term=0} 01:14:37,984 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader-254: Pekko recovery completed and can restore from snapshot 01:14:37,984 AM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader-254: no journal: skipping journal recovery 01:14:37,984 AM [test-pekko.actor.default-dispatcher-14] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 01:14:37,987 AM [main] [DEBUG] PropertiesTermInfoStore - leader-254: Set currentTerm=100, votedFor= 01:14:37,990 AM [main] [DEBUG] PropertiesTermInfoStore - leader-254: Set currentTerm=110, votedFor= 01:14:37,990 AM [main] [DEBUG] AbstractLeader - leader-254 (Leader): Election: Leader has following peers: [] 01:14:37,990 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader-254] 01:14:38,1 AM [main] [DEBUG] EnabledRaftStorage - leader-254: terminating thread VirtualThread[#721,leader-254-writer-108]/waiting 01:14:38,1 AM [leader-254-writer-108] [DEBUG] JournalWriteTask - leader-254: received 1 commands after 22.12 ms 01:14:38,1 AM [leader-254-writer-108] [DEBUG] JournalWriteTask - leader-254: completed 1 commands in 17.87 μs 01:14:38,1 AM [leader-254-writer-108] [DEBUG] JournalWriteTask - leader-254: journal writer stopped 01:14:38,1 AM [main] [DEBUG] EntryJournalV1 - leader-254: journal closed 01:14:38,1 AM [main] [INFO] EnabledRaftStorage - leader-254: journal closed 01:14:38,1 AM [main] [DEBUG] RaftStorage - leader-254: stopped executor with 0 remaining tasks 01:14:38,1 AM [main] [DEBUG] RaftStorage - leader-254: stopped executor with 0 remaining tasks [WARN] [07/27/2025 01:14:38.004] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from Actor[pekko://test/user/testConstruction#-17900850]: org.opendaylight.controller.cluster.common.actor.Monitor@6732b8c3 01:14:38,5 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - testConstruction: Starting recovery with journal batch size 1000 01:14:38,5 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - testConstruction: started executor 01:14:38,5 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - testConstruction: started executor 01:14:38,6 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - testConstruction: metadata journal open: replayFrom=1 applyTo=0 01:14:38,7 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - testConstruction: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:14:38,7 AM [test-pekko.actor.default-dispatcher-5] [INFO] EnabledRaftStorage - testConstruction: journal open: applyTo=0 01:14:38,7 AM [testConstruction-writer-109] [DEBUG] JournalWriteTask - testConstruction: journal writer started 01:14:38,7 AM [testConstruction-writer-109] [DEBUG] JournalWriteTask - testConstruction: waiting to receive commands 01:14:38,9 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest6447950747954999553/testConstruction/TermInfo.properties does not exist 01:14:38,9 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - testConstruction: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest6447950747954999553/testConstruction/journal-v1-1.log 01:14:38,9 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - testConstruction: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest6447950747954999553/testConstruction/metadata-v1-1.log 01:14:38,9 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - testConstruction: no eligible files found 01:14:38,9 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - testConstruction: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:14:38,12 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - testConstruction: Set currentTerm=0, votedFor=null 01:14:38,12 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - testConstruction: Local TermInfo store seeded with TermInfo{term=0} 01:14:38,12 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - testConstruction: Pekko recovery completed and can restore from snapshot 01:14:38,12 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - testConstruction: starting journal recovery 01:14:38,12 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - testConstruction: Moving last applied index from -1 to -1 01:14:38,12 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - testConstruction: empty journal: appending 0 entries 01:14:38,12 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - testConstruction: updated meta to JournalMeta[replayFrom=1, applyTo=0] 01:14:38,12 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - testConstruction: journal recovery completedin 172.5 μs with journalIndex=1 01:14:38,12 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:14:38,12 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - testConstruction (Follower): Received TimeoutNow - switching to Candidate 01:14:38,12 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - testConstruction (Candidate): Election: Candidate has following voting peers: [] 01:14:38,14 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - testConstruction: Set currentTerm=1, votedFor=testConstruction 01:14:38,15 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - testConstruction (Candidate): Starting new election term 1 01:14:38,15 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - testConstruction (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:14:38,15 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - testConstruction (Candidate): Received ElectionTimeout 01:14:38,15 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - testConstruction (Leader): Election: Leader has following peers: [] 01:14:38,15 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - testConstruction (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 [WARN] [07/27/2025 01:14:38.068] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader-255]: org.opendaylight.controller.cluster.common.actor.Monitor@173166af 01:14:38,69 AM [main] [INFO] RaftActor - leader-255: Starting recovery with journal batch size 1000 01:14:38,69 AM [main] [DEBUG] RaftStorage - leader-255: started executor 01:14:38,69 AM [main] [DEBUG] RaftStorage - leader-255: started executor 01:14:38,70 AM [main] [DEBUG] EntryJournalV1 - leader-255: metadata journal open: replayFrom=1 applyTo=0 01:14:38,71 AM [main] [DEBUG] EntryJournalV1 - leader-255: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:14:38,71 AM [main] [INFO] EnabledRaftStorage - leader-255: journal open: applyTo=0 01:14:38,71 AM [leader-255-writer-110] [DEBUG] JournalWriteTask - leader-255: journal writer started 01:14:38,71 AM [leader-255-writer-110] [DEBUG] JournalWriteTask - leader-255: waiting to receive commands 01:14:38,73 AM [main] [DEBUG] AbstractReplicatedLog - leader-255: Moving last applied index from -1 to 4 01:14:38,73 AM [main] [DEBUG] PropertiesTermInfoStore - leader-255: Set currentTerm=1, votedFor=leader-255 01:14:38,74 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest9242440540641969953/leader-255/TermInfo.properties does not exist 01:14:38,74 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader-255: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:14:38,79 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader-255: Set currentTerm=1, votedFor=leader-255 01:14:38,79 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader-255: Local TermInfo store seeded with TermInfo{term=1, votedFor=leader-255} 01:14:38,79 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader-255: Pekko recovery completed and can restore from snapshot 01:14:38,79 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader-255: no journal: skipping journal recovery 01:14:38,80 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): Election: Leader has following peers: [follower-256] 01:14:38,80 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): Checking sendAppendEntries for follower follower-256: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:14:38,82 AM [main] [INFO] SnapshotManager - leader-255: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=6, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=4, replicatedToAllTerm=1, unAppliedEntries size=8, mandatoryTrim=false] to install on xyzzy 01:14:38,82 AM [main] [DEBUG] SnapshotManager - leader-255: last applied journal index prior to capture: 0 01:14:38,82 AM [main] [INFO] MockRaftActor - leader-255: support() called 01:14:38,83 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower-256 updated: matchIndex: 5, nextIndex: 6 01:14:38,83 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): Applying to log - commitIndex: 5, lastAppliedIndex: -1 01:14:38,83 AM [main] [DEBUG] RaftActorBehavior - leader-255 (Leader): Setting last applied to 0 01:14:38,83 AM [main] [DEBUG] AbstractReplicatedLog - leader-255: Moving last applied index from -1 to 0 01:14:38,83 AM [main] [DEBUG] RaftActor - leader-255: Applying state for log index 0 data 0 01:14:38,83 AM [main] [INFO] MockRaftActor - leader-255: applyState called: 0 01:14:38,83 AM [main] [DEBUG] RaftActorBehavior - leader-255 (Leader): Setting last applied to 1 01:14:38,83 AM [main] [DEBUG] AbstractReplicatedLog - leader-255: Moving last applied index from 0 to 1 01:14:38,83 AM [main] [DEBUG] RaftActor - leader-255: Applying state for log index 1 data 1 01:14:38,83 AM [main] [INFO] MockRaftActor - leader-255: applyState called: 1 01:14:38,83 AM [main] [DEBUG] RaftActorBehavior - leader-255 (Leader): Setting last applied to 2 01:14:38,83 AM [main] [DEBUG] AbstractReplicatedLog - leader-255: Moving last applied index from 1 to 2 01:14:38,83 AM [main] [DEBUG] RaftActor - leader-255: Applying state for log index 2 data 2 01:14:38,83 AM [main] [INFO] MockRaftActor - leader-255: applyState called: 2 01:14:38,84 AM [main] [DEBUG] RaftActorBehavior - leader-255 (Leader): Setting last applied to 3 01:14:38,84 AM [main] [DEBUG] AbstractReplicatedLog - leader-255: Moving last applied index from 2 to 3 01:14:38,84 AM [main] [DEBUG] RaftActor - leader-255: Applying state for log index 3 data 3 01:14:38,84 AM [main] [INFO] MockRaftActor - leader-255: applyState called: 3 01:14:38,84 AM [main] [DEBUG] RaftActorBehavior - leader-255 (Leader): Setting last applied to 4 01:14:38,84 AM [main] [DEBUG] AbstractReplicatedLog - leader-255: Moving last applied index from 3 to 4 01:14:38,84 AM [main] [DEBUG] RaftActor - leader-255: Applying state for log index 4 data 4 01:14:38,84 AM [main] [INFO] MockRaftActor - leader-255: applyState called: 4 01:14:38,84 AM [main] [DEBUG] RaftActorBehavior - leader-255 (Leader): Setting last applied to 5 01:14:38,84 AM [main] [DEBUG] AbstractReplicatedLog - leader-255: Moving last applied index from 4 to 5 01:14:38,84 AM [main] [DEBUG] RaftActor - leader-255: Applying state for log index 5 data 5 01:14:38,84 AM [main] [INFO] MockRaftActor - leader-255: applyState called: 5 01:14:38,84 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): Checking sendAppendEntries for follower follower-256: active: true, followerNextIndex: 6, leaderLastIndex: 7, leaderSnapShotIndex: -1 01:14:38,84 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): sendAppendEntries: 6 is present for follower follower-256 01:14:38,84 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): Sending AppendEntries to follower follower-256: AppendEntries{term=1, leaderId=leader-255, prevLogIndex=5, prevLogTerm=1, leaderCommit=5, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=6, term=1, command=6, pending=false}, JournaledLogEntry{index=7, term=1, command=7, pending=false}]} 01:14:38,84 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower-256 updated: matchIndex: 6, nextIndex: 7 01:14:38,84 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): Applying to log - commitIndex: 6, lastAppliedIndex: 5 01:14:38,84 AM [main] [DEBUG] RaftActorBehavior - leader-255 (Leader): Setting last applied to 6 01:14:38,84 AM [main] [DEBUG] AbstractReplicatedLog - leader-255: Moving last applied index from 5 to 6 01:14:38,84 AM [main] [DEBUG] RaftActor - leader-255: Applying state for log index 6 data 6 01:14:38,84 AM [main] [INFO] MockRaftActor - leader-255: applyState called: 6 01:14:38,84 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): Checking sendAppendEntries for follower follower-256: active: true, followerNextIndex: 7, leaderLastIndex: 7, leaderSnapShotIndex: -1 01:14:38,84 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): sendAppendEntries: 7 is present for follower follower-256 01:14:38,84 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): Sending AppendEntries to follower follower-256: AppendEntries{term=1, leaderId=leader-255, prevLogIndex=6, prevLogTerm=1, leaderCommit=6, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=7, term=1, command=7, pending=false}]} 01:14:38,85 AM [main] [INFO] SnapshotManager - leader-255: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=6, term=1] 01:14:38,85 AM [main] [INFO] MockRaftActor - leader-255: support() called 01:14:38,85 AM [main] [INFO] SnapshotManager - leader-255: Removed in-memory snapshotted entries, adjusted snapshotIndex: 4 and term: 1 01:14:38,85 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): sendInstallSnapshot 01:14:38,85 AM [main] [DEBUG] SnapshotManager - leader-255: Snapshot success, discarding journal entries up to 0 01:14:38,85 AM [main] [DEBUG] RaftActorSnapshotMessageSupport - leader-255: SnapshotComplete received 01:14:38,85 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower-256 updated: matchIndex: 7, nextIndex: 8 01:14:38,85 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): Applying to log - commitIndex: 7, lastAppliedIndex: 6 01:14:38,85 AM [main] [DEBUG] RaftActorBehavior - leader-255 (Leader): Setting last applied to 7 01:14:38,85 AM [main] [DEBUG] AbstractReplicatedLog - leader-255: Moving last applied index from 6 to 7 01:14:38,85 AM [main] [DEBUG] RaftActor - leader-255: Applying state for log index 7 data 7 01:14:38,85 AM [main] [INFO] MockRaftActor - leader-255: applyState called: 7 01:14:38,86 AM [main] [DEBUG] SnapshotManager - leader-255: fakeSnapshot purging log to 6 for term 1 01:14:38,86 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): Checking sendAppendEntries for follower follower-256: active: true, followerNextIndex: 8, leaderLastIndex: 8, leaderSnapShotIndex: 6 01:14:38,86 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): sendAppendEntries: 8 is present for follower follower-256 01:14:38,86 AM [main] [DEBUG] AbstractLeader - leader-255 (Leader): Sending AppendEntries to follower follower-256: AppendEntries{term=1, leaderId=leader-255, prevLogIndex=7, prevLogTerm=1, leaderCommit=7, replicatedToAllIndex=6, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=8, term=1, command=foo-8, pending=false}]} 01:14:38,86 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$d#1420856793] 01:14:38,97 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader-255] 01:14:38,97 AM [main] [DEBUG] EnabledRaftStorage - leader-255: terminating thread VirtualThread[#723,leader-255-writer-110]/waiting 01:14:38,97 AM [leader-255-writer-110] [DEBUG] JournalWriteTask - leader-255: received 1 commands after 25.99 ms 01:14:38,97 AM [leader-255-writer-110] [DEBUG] JournalWriteTask - leader-255: completed 1 commands in 17.04 μs 01:14:38,97 AM [leader-255-writer-110] [DEBUG] JournalWriteTask - leader-255: journal writer stopped 01:14:38,97 AM [main] [DEBUG] EntryJournalV1 - leader-255: journal closed 01:14:38,97 AM [main] [INFO] EnabledRaftStorage - leader-255: journal closed 01:14:38,97 AM [main] [DEBUG] RaftStorage - leader-255: stopped executor with 0 remaining tasks 01:14:38,97 AM [main] [DEBUG] RaftStorage - leader-255: stopped executor with 0 remaining tasks [WARN] [07/27/2025 01:14:38.100] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader-257]: org.opendaylight.controller.cluster.common.actor.Monitor@11c9bdf3 01:14:38,100 AM [main] [INFO] RaftActor - leader-257: Starting recovery with journal batch size 1000 01:14:38,100 AM [main] [DEBUG] RaftStorage - leader-257: started executor 01:14:38,101 AM [main] [DEBUG] RaftStorage - leader-257: started executor 01:14:38,101 AM [main] [DEBUG] EntryJournalV1 - leader-257: metadata journal open: replayFrom=1 applyTo=0 01:14:38,102 AM [main] [DEBUG] EntryJournalV1 - leader-257: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:14:38,102 AM [main] [INFO] EnabledRaftStorage - leader-257: journal open: applyTo=0 01:14:38,102 AM [leader-257-writer-111] [DEBUG] JournalWriteTask - leader-257: journal writer started 01:14:38,102 AM [leader-257-writer-111] [DEBUG] JournalWriteTask - leader-257: waiting to receive commands 01:14:38,103 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest13217645464881778439/leader-257/TermInfo.properties does not exist 01:14:38,104 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader-257: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:14:38,107 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader-257: Set currentTerm=0, votedFor=null 01:14:38,107 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader-257: Local TermInfo store seeded with TermInfo{term=0} 01:14:38,107 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader-257: Pekko recovery completed and can restore from snapshot 01:14:38,107 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader-257: no journal: skipping journal recovery 01:14:38,107 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:14:38,107 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader-257 (Follower): Received TimeoutNow - switching to Candidate 01:14:38,107 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader-257 (Candidate): Election: Candidate has following voting peers: [] 01:14:38,107 AM [main] [DEBUG] RaftActor - leader-257: Applying state for log index 5 data F 01:14:38,107 AM [main] [INFO] MockRaftActor - leader-257: applyState called: F 01:14:38,109 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader-257: Set currentTerm=1, votedFor=leader-257 01:14:38,109 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - leader-257 (Candidate): Starting new election term 1 01:14:38,109 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader-257 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:14:38,109 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader-257 (Candidate): Received ElectionTimeout 01:14:38,109 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader-257 (Leader): Election: Leader has following peers: [] 01:14:38,109 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader-257 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:14:38,110 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader-257] 01:14:38,120 AM [main] [DEBUG] EnabledRaftStorage - leader-257: terminating thread VirtualThread[#724,leader-257-writer-111]/waiting 01:14:38,121 AM [leader-257-writer-111] [DEBUG] JournalWriteTask - leader-257: received 1 commands after 18.89 ms 01:14:38,121 AM [leader-257-writer-111] [DEBUG] JournalWriteTask - leader-257: completed 1 commands in 17.58 μs 01:14:38,121 AM [leader-257-writer-111] [DEBUG] JournalWriteTask - leader-257: journal writer stopped 01:14:38,121 AM [main] [DEBUG] EntryJournalV1 - leader-257: journal closed 01:14:38,121 AM [main] [INFO] EnabledRaftStorage - leader-257: journal closed 01:14:38,121 AM [main] [DEBUG] RaftStorage - leader-257: stopped executor with 0 remaining tasks 01:14:38,121 AM [main] [DEBUG] RaftStorage - leader-257: stopped executor with 0 remaining tasks [WARN] [07/27/2025 01:14:38.124] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower-258]: org.opendaylight.controller.cluster.common.actor.Monitor@28b582f6 01:14:38,125 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower-258: Starting recovery with journal batch size 1000 01:14:38,125 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-258: started executor 01:14:38,125 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-258: started executor 01:14:38,126 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower-258: metadata journal open: replayFrom=1 applyTo=0 01:14:38,126 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower-258: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:14:38,126 AM [test-pekko.actor.default-dispatcher-11] [INFO] EnabledRaftStorage - follower-258: journal open: applyTo=0 01:14:38,127 AM [follower-258-writer-112] [DEBUG] JournalWriteTask - follower-258: journal writer started 01:14:38,127 AM [follower-258-writer-112] [DEBUG] JournalWriteTask - follower-258: waiting to receive commands 01:14:38,128 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest5299259825063968889/follower-258/TermInfo.properties does not exist 01:14:38,128 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower-258: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:14:38,130 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower-258: Set currentTerm=0, votedFor=null 01:14:38,130 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower-258: Local TermInfo store seeded with TermInfo{term=0} 01:14:38,130 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower-258: Pekko recovery completed and can restore from snapshot 01:14:38,130 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower-258: no journal: skipping journal recovery 01:14:38,131 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower-258] 01:14:38,141 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EnabledRaftStorage - follower-258: terminating thread VirtualThread[#725,follower-258-writer-112]/waiting 01:14:38,141 AM [follower-258-writer-112] [DEBUG] JournalWriteTask - follower-258: received 1 commands after 14.60 ms 01:14:38,141 AM [follower-258-writer-112] [DEBUG] JournalWriteTask - follower-258: completed 1 commands in 16.37 μs 01:14:38,141 AM [follower-258-writer-112] [DEBUG] JournalWriteTask - follower-258: journal writer stopped 01:14:38,141 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower-258: journal closed 01:14:38,141 AM [test-pekko.actor.default-dispatcher-11] [INFO] EnabledRaftStorage - follower-258: journal closed 01:14:38,142 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-258: stopped executor with 0 remaining tasks 01:14:38,142 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-258: stopped executor with 0 remaining tasks [WARN] [07/27/2025 01:14:38.142] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower-259]: org.opendaylight.controller.cluster.common.actor.Monitor@7d968cfa 01:14:38,143 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower-258: Starting recovery with journal batch size 1000 01:14:38,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-258: started executor 01:14:38,143 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-258: started executor 01:14:38,144 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower-258: metadata journal open: replayFrom=1 applyTo=0 01:14:38,144 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower-258: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:14:38,144 AM [test-pekko.actor.default-dispatcher-11] [INFO] EnabledRaftStorage - follower-258: journal open: applyTo=0 01:14:38,144 AM [follower-258-writer-113] [DEBUG] JournalWriteTask - follower-258: journal writer started 01:14:38,144 AM [follower-258-writer-113] [DEBUG] JournalWriteTask - follower-258: waiting to receive commands 01:14:38,146 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower-258: Set currentTerm=0, votedFor=null 01:14:38,146 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - follower-258: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:14:38,146 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - follower-258: restoring local TermInfo{term=0} 01:14:38,146 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - follower-258: Set currentTerm=0, votedFor=null 01:14:38,146 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower-258: Pekko recovery completed and can restore from snapshot 01:14:38,146 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - follower-258: no journal: skipping journal recovery 01:14:38,146 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower-259] 01:14:38,157 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EnabledRaftStorage - follower-258: terminating thread VirtualThread[#726,follower-258-writer-113]/waiting 01:14:38,157 AM [follower-258-writer-113] [DEBUG] JournalWriteTask - follower-258: received 1 commands after 12.25 ms 01:14:38,157 AM [follower-258-writer-113] [DEBUG] JournalWriteTask - follower-258: completed 1 commands in 11.28 μs 01:14:38,157 AM [follower-258-writer-113] [DEBUG] JournalWriteTask - follower-258: journal writer stopped 01:14:38,157 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower-258: journal closed 01:14:38,157 AM [test-pekko.actor.default-dispatcher-11] [INFO] EnabledRaftStorage - follower-258: journal closed 01:14:38,157 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-258: stopped executor with 0 remaining tasks 01:14:38,157 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-258: stopped executor with 0 remaining tasks 01:14:38,159 AM [main] [INFO] RaftActorTest - testNonVotingOnRecovery starting [WARN] [07/27/2025 01:14:38.160] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/test-actor-260]: org.opendaylight.controller.cluster.common.actor.Monitor@a7cd4ee 01:14:38,161 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - test-actor-260: Starting recovery with journal batch size 1000 01:14:38,161 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-260: started executor 01:14:38,161 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-260: started executor 01:14:38,162 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - test-actor-260: metadata journal open: replayFrom=1 applyTo=0 01:14:38,162 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - test-actor-260: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:14:38,162 AM [test-pekko.actor.default-dispatcher-11] [INFO] EnabledRaftStorage - test-actor-260: journal open: applyTo=0 01:14:38,163 AM [test-actor-260-writer-114] [DEBUG] JournalWriteTask - test-actor-260: journal writer started 01:14:38,163 AM [test-actor-260-writer-114] [DEBUG] JournalWriteTask - test-actor-260: waiting to receive commands 01:14:38,164 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest7570489220488762395/test-actor-260/TermInfo.properties does not exist 01:14:38,165 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-260: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest7570489220488762395/test-actor-260/journal-v1-1.log 01:14:38,165 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-260: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest7570489220488762395/test-actor-260/metadata-v1-1.log 01:14:38,165 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-260: no eligible files found 01:14:38,165 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - test-actor-260: Received ReplicatedLogEntry for recovery: index: 0, size: 131 01:14:38,165 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PeerInfos - test-actor-260: Updated server config: isVoting: false, peers: [] 01:14:38,165 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - test-actor-260: Recovery completed - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1 01:14:38,168 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - test-actor-260: Set currentTerm=0, votedFor=null 01:14:38,168 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - test-actor-260: Local TermInfo store seeded with TermInfo{term=0} 01:14:38,168 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - test-actor-260: taking snapshot to clear Pekko persistence to 1 01:14:38,168 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Recovery - test-actor-260: no applied entries in recovery log, re-snapshotting EntryInfo[index=-1, term=-1] 01:14:38,168 AM [test-pekko.actor.default-dispatcher-11] [INFO] Recovery - test-actor-260: Taking snapshot on entry with index -1 01:14:38,168 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - test-actor-260: support() called 01:14:38,168 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-260: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest7570489220488762395/test-actor-260/snapshot-0000000068857D7E-0A0D129F.tmp 01:14:38,170 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-260: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest7570489220488762395/test-actor-260/snapshot-0000000068857D7E-0A0D129F.v1 01:14:38,170 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-260: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest7570489220488762395/test-actor-260/snapshot-0000000068857D7E-0A0D129F.v1 01:14:38,170 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-260: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest7570489220488762395/test-actor-260/TermInfo.properties 01:14:38,170 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-260: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest7570489220488762395/test-actor-260/journal-v1-1.log 01:14:38,170 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-260: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest7570489220488762395/test-actor-260/metadata-v1-1.log 01:14:38,170 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-260: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-27T01:14:38.168628895Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorTest7570489220488762395/test-actor-260/snapshot-0000000068857D7E-0A0D129F.v1, size=222, entryCompress=NONE, stateCompress=NONE} 01:14:38,170 AM [test-pekko.actor.default-dispatcher-11] [INFO] Recovery - test-actor-260: Snapshot completed in 2.732 ms, resetting timer for the next recovery snapshot 01:14:38,171 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - test-actor-260: Pekko recovery completed and can restore from snapshot 01:14:38,171 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - test-actor-260: starting journal recovery 01:14:38,171 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - test-actor-260: Moving last applied index from -1 to -1 01:14:38,171 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - test-actor-260: empty journal: appending 1 entries 01:14:38,171 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - test-actor-260: updated meta to JournalMeta[replayFrom=1, applyTo=0] 01:14:38,174 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - test-actor-260: journal recovery completedin 3.054 ms with journalIndex=1 01:14:38,174 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - test-actor-260: ignoring DeleteMessagesSuccess(1) 01:14:38,174 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:14:38,574 AM [main] [INFO] RaftActorTest - testNonVotingOnRecovery ending 01:14:38,574 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/test-actor-260] 01:14:38,575 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EnabledRaftStorage - test-actor-260: terminating thread VirtualThread[#727,test-actor-260-writer-114]/waiting 01:14:38,576 AM [test-actor-260-writer-114] [DEBUG] JournalWriteTask - test-actor-260: received 1 commands after 412.9 ms 01:14:38,576 AM [test-actor-260-writer-114] [DEBUG] JournalWriteTask - test-actor-260: completed 1 commands in 16.47 μs 01:14:38,576 AM [test-actor-260-writer-114] [DEBUG] JournalWriteTask - test-actor-260: journal writer stopped 01:14:38,576 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - test-actor-260: journal closed 01:14:38,576 AM [test-pekko.actor.default-dispatcher-11] [INFO] EnabledRaftStorage - test-actor-260: journal closed 01:14:38,576 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-260: stopped executor with 0 remaining tasks 01:14:38,576 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-260: stopped executor with 0 remaining tasks 01:14:38,578 AM [main] [INFO] RaftActorTest - testRaftActorRecoveryWithPersistenceEnabled starting [WARN] [07/27/2025 01:14:38.579] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from Actor[pekko://test/user/follower-261#-697906621]: org.opendaylight.controller.cluster.common.actor.Monitor@302f8542 01:14:38,580 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - follower-261: Starting recovery with journal batch size 1000 01:14:38,580 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-261: started executor 01:14:38,580 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-261: started executor 01:14:38,581 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower-261: metadata journal open: replayFrom=1 applyTo=0 01:14:38,581 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower-261: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:14:38,581 AM [test-pekko.actor.default-dispatcher-11] [INFO] EnabledRaftStorage - follower-261: journal open: applyTo=0 01:14:38,582 AM [follower-261-writer-115] [DEBUG] JournalWriteTask - follower-261: journal writer started 01:14:38,582 AM [follower-261-writer-115] [DEBUG] JournalWriteTask - follower-261: waiting to receive commands 01:14:38,583 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/TermInfo.properties does not exist 01:14:38,583 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-261: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/journal-v1-1.log 01:14:38,583 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-261: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/metadata-v1-1.log 01:14:38,583 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-261: no eligible files found 01:14:38,583 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower-261: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:14:38,586 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower-261: Set currentTerm=0, votedFor=null 01:14:38,586 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower-261: Local TermInfo store seeded with TermInfo{term=0} 01:14:38,586 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower-261: Pekko recovery completed and can restore from snapshot 01:14:38,586 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower-261: starting journal recovery 01:14:38,586 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower-261: Moving last applied index from -1 to -1 01:14:38,586 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower-261: empty journal: appending 0 entries 01:14:38,586 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower-261: updated meta to JournalMeta[replayFrom=1, applyTo=0] 01:14:38,586 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower-261: journal recovery completedin 188.1 μs with journalIndex=1 01:14:38,587 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EnabledRaftStorage - follower-261: terminating thread VirtualThread[#728,follower-261-writer-115]/waiting 01:14:38,587 AM [follower-261-writer-115] [DEBUG] JournalWriteTask - follower-261: received 1 commands after 5.098 ms 01:14:38,587 AM [follower-261-writer-115] [DEBUG] JournalWriteTask - follower-261: completed 1 commands in 14.00 μs 01:14:38,587 AM [follower-261-writer-115] [DEBUG] JournalWriteTask - follower-261: journal writer stopped 01:14:38,587 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower-261: journal closed 01:14:38,587 AM [test-pekko.actor.default-dispatcher-11] [INFO] EnabledRaftStorage - follower-261: journal closed 01:14:38,587 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-261: stopped executor with 0 remaining tasks 01:14:38,587 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-261: stopped executor with 0 remaining tasks [WARN] [07/27/2025 01:14:38.588] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/$$a]: org.opendaylight.controller.cluster.common.actor.Monitor@31a9b41d 01:14:38,589 AM [main] [INFO] RaftActor - follower-261: Starting recovery with journal batch size 1000 01:14:38,589 AM [main] [DEBUG] RaftStorage - follower-261: started executor 01:14:38,589 AM [main] [DEBUG] RaftStorage - follower-261: started executor 01:14:38,590 AM [main] [DEBUG] EntryJournalV1 - follower-261: metadata journal open: replayFrom=1 applyTo=0 01:14:38,590 AM [main] [DEBUG] EntryJournalV1 - follower-261: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:14:38,590 AM [main] [INFO] EnabledRaftStorage - follower-261: journal open: applyTo=0 01:14:38,590 AM [follower-261-writer-116] [DEBUG] JournalWriteTask - follower-261: journal writer started 01:14:38,590 AM [follower-261-writer-116] [DEBUG] JournalWriteTask - follower-261: waiting to receive commands 01:14:38,591 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] PropertiesTermInfoStore - follower-261: Set currentTerm=0, votedFor=null 01:14:38,591 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-261: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/TermInfo.properties 01:14:38,591 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-261: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/journal-v1-1.log 01:14:38,591 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-261: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/metadata-v1-1.log 01:14:38,592 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-261: no eligible files found 01:14:38,592 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] PekkoRecovery - follower-261: SnapshotOffer called. 01:14:38,592 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] PekkoRecovery - follower-261: initializing from snapshot taken at 2025-07-27T01:14:38.584Z 01:14:38,592 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] PropertiesTermInfoStore - follower-261: Set currentTerm=-1, votedFor=null 01:14:38,592 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [INFO] PekkoRecovery - Recovery snapshot applied for follower-261 in 346.6 μs: snapshotIndex=3, snapshotTerm=1, journal-size=1 01:14:38,592 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [INFO] PekkoRecovery - follower-261: migrating from Pekko persistent-snapshot taken at 2025-07-27T01:14:38.584Z 01:14:38,592 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [INFO] MockRaftActor - follower-261: support() called 01:14:38,592 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-261: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/snapshot-0000000068857D7E-22CF2200.tmp 01:14:38,597 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-261: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/snapshot-0000000068857D7E-22CF2200.v1 01:14:38,597 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-261: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/snapshot-0000000068857D7E-22CF2200.v1 01:14:38,597 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-261: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/TermInfo.properties 01:14:38,597 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-261: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/journal-v1-1.log 01:14:38,597 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-261: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/metadata-v1-1.log 01:14:38,597 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-261: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=3, term=1], timestamp=2025-07-27T01:14:38.584Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/snapshot-0000000068857D7E-22CF2200.v1, size=513, entryCompress=NONE, stateCompress=NONE} 01:14:38,597 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [INFO] PekkoRecovery - follower-261: local snapshot saved in 5.188 ms, deleting Pekko-persisted snapshots 01:14:38,600 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower-261: Received ReplicatedLogEntry for recovery: index: 5, size: 2 01:14:38,601 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower-261: Received apply journal entries for recovery, applying to state: 4 to 5 01:14:38,601 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower-261: Moving last applied index from 3 to 5 01:14:38,601 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower-261: Received ReplicatedLogEntry for recovery: index: 6, size: 3 01:14:38,601 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower-261: Received ReplicatedLogEntry for recovery: index: 7, size: 4 01:14:38,601 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower-261: Recovery completed in 9.077 ms - Switching actor to Follower - last log index = 7, last log term = 1, snapshot index = 3, snapshot term = 1, journal size = 4 01:14:38,601 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - follower-261: restoring local TermInfo{term=0} 01:14:38,601 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - follower-261: Set currentTerm=0, votedFor=null 01:14:38,601 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - follower-261: taking snapshot to clear Pekko persistence to 8 01:14:38,601 AM [test-pekko.actor.default-dispatcher-11] [INFO] Recovery - follower-261: Taking snapshot on entry with index 5 01:14:38,601 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - follower-261: support() called 01:14:38,601 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-261: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/snapshot-0000000068857D7E-23DE3F5B.tmp 01:14:38,604 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-261: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/snapshot-0000000068857D7E-23DE3F5B.v1 01:14:38,604 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-261: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/snapshot-0000000068857D7E-22CF2200.v1 01:14:38,604 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-261: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/TermInfo.properties 01:14:38,604 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-261: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/journal-v1-1.log 01:14:38,604 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-261: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/snapshot-0000000068857D7E-23DE3F5B.v1 01:14:38,604 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-261: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/metadata-v1-1.log 01:14:38,604 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-261: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=3, term=1], timestamp=2025-07-27T01:14:38.584Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/snapshot-0000000068857D7E-22CF2200.v1, size=513, entryCompress=NONE, stateCompress=NONE} 01:14:38,605 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - follower-261: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=5, term=1], timestamp=2025-07-27T01:14:38.601767771Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12830936934132145180/follower-261/snapshot-0000000068857D7E-23DE3F5B.v1, size=220, entryCompress=NONE, stateCompress=NONE} 01:14:38,605 AM [test-pekko.actor.default-dispatcher-11] [INFO] Recovery - follower-261: Snapshot completed in 3.855 ms, resetting timer for the next recovery snapshot 01:14:38,605 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower-261: Pekko recovery completed and can restore from snapshot 01:14:38,605 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - follower-261: starting journal recovery 01:14:38,605 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - follower-261: Moving last applied index from -1 to 5 01:14:38,605 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower-261: empty journal: appending 2 entries 01:14:38,605 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - follower-261: updated meta to JournalMeta[replayFrom=1, applyTo=0] 01:14:38,609 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - follower-261: journal recovery completedin 4.323 ms with journalIndex=1 01:14:38,610 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftActor - follower-261: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0)) 01:14:38,610 AM [main] [INFO] RaftActorTest - testRaftActorRecoveryWithPersistenceEnabled ending 01:14:38,610 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower-261#-697906621] 01:14:38,610 AM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-12] [DEBUG] RaftActor - follower-261: ignoring DeleteMessagesSuccess(8) 01:14:38,611 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/$$a] 01:14:38,611 AM [main] [DEBUG] EnabledRaftStorage - follower-261: terminating thread VirtualThread[#729,follower-261-writer-116]/waiting 01:14:38,611 AM [follower-261-writer-116] [DEBUG] JournalWriteTask - follower-261: received 1 commands after 21.03 ms 01:14:38,611 AM [follower-261-writer-116] [DEBUG] JournalWriteTask - follower-261: completed 1 commands in 12.81 μs 01:14:38,611 AM [follower-261-writer-116] [DEBUG] JournalWriteTask - follower-261: journal writer stopped 01:14:38,612 AM [main] [DEBUG] EntryJournalV1 - follower-261: journal closed 01:14:38,612 AM [main] [INFO] EnabledRaftStorage - follower-261: journal closed 01:14:38,612 AM [main] [DEBUG] RaftStorage - follower-261: stopped executor with 0 remaining tasks 01:14:38,612 AM [main] [DEBUG] RaftStorage - follower-261: stopped executor with 0 remaining tasks [WARN] [07/27/2025 01:14:38.614] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader-262]: org.opendaylight.controller.cluster.common.actor.Monitor@6bb3a0ce 01:14:38,615 AM [main] [INFO] RaftActor - leader-262: Starting recovery with journal batch size 1000 01:14:38,615 AM [main] [DEBUG] RaftStorage - leader-262: started executor 01:14:38,615 AM [main] [DEBUG] RaftStorage - leader-262: started executor 01:14:38,616 AM [main] [DEBUG] EntryJournalV1 - leader-262: metadata journal open: replayFrom=1 applyTo=0 01:14:38,616 AM [main] [DEBUG] EntryJournalV1 - leader-262: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:14:38,616 AM [main] [INFO] EnabledRaftStorage - leader-262: journal open: applyTo=0 01:14:38,617 AM [leader-262-writer-117] [DEBUG] JournalWriteTask - leader-262: journal writer started 01:14:38,617 AM [leader-262-writer-117] [DEBUG] JournalWriteTask - leader-262: waiting to receive commands 01:14:38,618 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest15418815074219404420/leader-262/TermInfo.properties does not exist 01:14:38,618 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader-262: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:14:38,620 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader-262: Set currentTerm=0, votedFor=null 01:14:38,620 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader-262: Local TermInfo store seeded with TermInfo{term=0} 01:14:38,620 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader-262: Pekko recovery completed and can restore from snapshot 01:14:38,620 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader-262: no journal: skipping journal recovery 01:14:38,620 AM [main] [DEBUG] AbstractReplicatedLog - leader-262: Moving last applied index from -1 to 3 01:14:38,620 AM [main] [DEBUG] PropertiesTermInfoStore - leader-262: Set currentTerm=1, votedFor=leader-262 01:14:38,620 AM [main] [DEBUG] AbstractLeader - leader-262 (Leader): Election: Leader has following peers: [member1] 01:14:38,620 AM [main] [DEBUG] AbstractLeader - leader-262 (Leader): Checking sendAppendEntries for follower member1: active: false, followerNextIndex: 3, leaderLastIndex: 3, leaderSnapShotIndex: 3 [WARN] [07/27/2025 01:14:38.620] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/leader-262/address] received dead letter from TestActor[pekko://test/user/leader-262]: AppendEntries{term=1, leaderId=leader-262, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 01:14:38,621 AM [main] [DEBUG] RaftActor - leader-262: Persist data index=4 term=1 command=duh 01:14:38,621 AM [main] [DEBUG] ReplicatedLogImpl - leader-262: Append log entry and persist JournaledLogEntry{index=4, term=1, command=duh, pending=true} 01:14:38,621 AM [main] [DEBUG] RaftStorageCompleter - test: 1 completion(s) pending 01:14:38,621 AM [main] [DEBUG] RaftStorageCompleter - test: running 1 completion(s) 01:14:38,621 AM [main] [DEBUG] ReplicatedLogImpl - leader-262: persist complete JournaledLogEntry{index=4, term=1, command=duh, pending=true} 01:14:38,621 AM [main] [INFO] SnapshotManager - leader-262: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=3, lastAppliedTerm=-1, lastIndex=4, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 01:14:38,621 AM [main] [DEBUG] SnapshotManager - leader-262: captured snapshot at lastSequenceNumber: 0 01:14:38,621 AM [main] [INFO] SnapshotManager - leader-262: Persising snapshot at EntryInfo[index=3, term=-1]/EntryInfo[index=4, term=1] 01:14:38,621 AM [main] [INFO] MockRaftActor - leader-262: support() called 01:14:38,621 AM [main] [INFO] SnapshotManager - leader-262: Removed in-memory snapshotted entries, adjusted snapshotIndex: 3 and term: -1 01:14:38,621 AM [main] [DEBUG] AbstractLeader - leader-262 (Leader): Replicate message: identifier: MockIdentifier{value=x}, logIndex: 4, isSendImmediate: true 01:14:38,621 AM [main] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:14:38,621 AM [main] [DEBUG] AbstractLeader - leader-262 (Leader): Checking sendAppendEntries for follower member1: active: false, followerNextIndex: 3, leaderLastIndex: 4, leaderSnapShotIndex: 3 [WARN] [07/27/2025 01:14:38.621] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/leader-262/address] received dead letter from TestActor[pekko://test/user/leader-262]: AppendEntries{term=1, leaderId=leader-262, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=3, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 01:14:38,621 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader-262] 01:14:38,622 AM [main] [DEBUG] EnabledRaftStorage - leader-262: terminating thread VirtualThread[#730,leader-262-writer-117]/waiting 01:14:38,622 AM [leader-262-writer-117] [DEBUG] JournalWriteTask - leader-262: received 1 commands after 5.704 ms 01:14:38,622 AM [leader-262-writer-117] [DEBUG] JournalWriteTask - leader-262: completed 1 commands in 9.540 μs 01:14:38,622 AM [leader-262-writer-117] [DEBUG] JournalWriteTask - leader-262: journal writer stopped 01:14:38,623 AM [main] [DEBUG] EntryJournalV1 - leader-262: journal closed 01:14:38,623 AM [main] [INFO] EnabledRaftStorage - leader-262: journal closed 01:14:38,623 AM [main] [DEBUG] RaftStorage - leader-262: stopped executor with 0 remaining tasks 01:14:38,623 AM [main] [DEBUG] RaftStorage - leader-262: stopped executor with 0 remaining tasks [WARN] [07/27/2025 01:14:38.625] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/notifier-263]: org.opendaylight.controller.cluster.common.actor.Monitor@220e5375 01:14:38,626 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - notifier-263: Starting recovery with journal batch size 1000 01:14:38,626 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - notifier-263: started executor 01:14:38,626 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - notifier-263: started executor 01:14:38,626 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - notifier-263: metadata journal open: replayFrom=1 applyTo=0 01:14:38,627 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - notifier-263: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:14:38,627 AM [test-pekko.actor.default-dispatcher-11] [INFO] EnabledRaftStorage - notifier-263: journal open: applyTo=0 01:14:38,627 AM [notifier-263-writer-118] [DEBUG] JournalWriteTask - notifier-263: journal writer started 01:14:38,627 AM [notifier-263-writer-118] [DEBUG] JournalWriteTask - notifier-263: waiting to receive commands 01:14:38,628 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest16348188242835535688/notifier-263/TermInfo.properties does not exist 01:14:38,628 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - notifier-263: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:14:38,631 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - notifier-263: Set currentTerm=0, votedFor=null 01:14:38,631 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - notifier-263: Local TermInfo store seeded with TermInfo{term=0} 01:14:38,631 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - notifier-263: Pekko recovery completed and can restore from snapshot 01:14:38,631 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - notifier-263: no journal: skipping journal recovery