[DEBUG] [07/03/2025 15:26:51.532] [main] [EventStream(pekko://test)] logger log1-TestEventListener started 03:26:51,533 PM [test-pekko.actor.default-dispatcher-4] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [07/03/2025 15:26:51.533] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started [DEBUG] [07/03/2025 15:26:51.533] [main] [EventStream(pekko://test)] Default Loggers started [INFO] [07/03/2025 15:26:51.548] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.171.171:17355] with UID [-4804027967324665634] [INFO] [07/03/2025 15:26:51.549] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.171:17355] - Starting up, Pekko version [1.0.3] ... 03:26:51,549 PM [test-pekko.actor.default-dispatcher-4] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.171.171:17355] with UID [-4804027967324665634] 03:26:51,549 PM [test-pekko.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.171:17355] - Starting up, Pekko version [1.0.3] ... [INFO] [07/03/2025 15:26:51.552] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.171:17355] - Registered cluster JMX MBean [pekko:type=Cluster] [INFO] [07/03/2025 15:26:51.552] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.171:17355] - Started up successfully 03:26:51,553 PM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.171:17355] - Registered cluster JMX MBean [pekko:type=Cluster] 03:26:51,553 PM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.171:17355] - Started up successfully 03:26:51,558 PM [test-pekko.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.171:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing 03:26:51,558 PM [test-pekko.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.171:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining [INFO] [07/03/2025 15:26:51.557] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.171:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing [INFO] [07/03/2025 15:26:51.558] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.171:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 03:26:51,577 PM [main] [INFO] RaftActorTest - testRestoreFromSnapshotWithRecoveredData starting [WARN] [07/03/2025 15:26:51.579] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/test-actor-249]: org.opendaylight.controller.cluster.common.actor.Monitor@2b761277 [INFO] [pekkoDeadLetter][07/03/2025 15:26:51.579] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/test-actor-249] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:51,580 PM [test-pekko.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/test-actor-249] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:51,582 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - test-actor-249: Starting recovery with journal batch size 1000 03:26:51,582 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-249: started executor 03:26:51,583 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-249: started executor 03:26:51,583 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - test-actor-249: metadata journal open: replayFrom=1 applyTo=0 03:26:51,584 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - test-actor-249: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:51,584 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - test-actor-249: journal open: applyTo=0 03:26:51,584 PM [test-actor-249-writer-102] [DEBUG] JournalWriteTask - test-actor-249: journal writer started 03:26:51,584 PM [test-actor-249-writer-102] [DEBUG] JournalWriteTask - test-actor-249: waiting to receive commands 03:26:51,589 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest10265624260544606365/test-actor-249/TermInfo.properties does not exist 03:26:51,589 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-249: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest10265624260544606365/test-actor-249/journal-v1-1.log 03:26:51,589 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-249: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest10265624260544606365/test-actor-249/metadata-v1-1.log 03:26:51,589 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-249: no eligible files found 03:26:51,589 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - test-actor-249: Received ReplicatedLogEntry for recovery: index: 0, size: 1 03:26:51,589 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - test-actor-249: Recovery completed - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1 03:26:51,592 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - test-actor-249: Set currentTerm=0, votedFor=null 03:26:51,592 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - test-actor-249: Local TermInfo store seeded with TermInfo{term=0} 03:26:51,592 PM [test-pekko.actor.default-dispatcher-11] [WARN] PekkoRecovery - test-actor-249: The provided restore snapshot was not applied because the persistence store is not empty 03:26:51,592 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - test-actor-249: Pekko recovery completed 03:26:51,592 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - test-actor-249: starting journal recovery 03:26:51,592 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - test-actor-249: Moving last applied index from -1 to -1 03:26:51,592 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - test-actor-249: empty journal: appending 1 entries 03:26:51,592 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - test-actor-249: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:26:51,596 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - test-actor-249: journal recovery completedin 3.855 ms with journalIndex=1 03:26:51,597 PM [test-pekko.actor.default-dispatcher-11] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 03:26:52,97 PM [main] [INFO] RaftActorTest - testRestoreFromSnapshotWithRecoveredData ending 03:26:52,97 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/test-actor-249] 03:26:52,109 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - test-actor-249: terminating thread VirtualThread[#671,test-actor-249-writer-102]/waiting 03:26:52,109 PM [test-actor-249-writer-102] [DEBUG] JournalWriteTask - test-actor-249: received 1 commands after 524.6 ms 03:26:52,109 PM [test-actor-249-writer-102] [DEBUG] JournalWriteTask - test-actor-249: completed 1 commands in 30.58 μs 03:26:52,109 PM [test-actor-249-writer-102] [DEBUG] JournalWriteTask - test-actor-249: journal writer stopped 03:26:52,109 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - test-actor-249: journal closed 03:26:52,109 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - test-actor-249: journal closed 03:26:52,109 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-249: stopped executor with 0 remaining tasks 03:26:52,109 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - test-actor-249: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:26:52.112] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader-250]: org.opendaylight.controller.cluster.common.actor.Monitor@2724ec7e 03:26:52,112 PM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader-250] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][07/03/2025 15:26:52.112] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader-250] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:52,113 PM [main] [INFO] RaftActor - leader-250: Starting recovery with journal batch size 1000 03:26:52,113 PM [main] [DEBUG] RaftStorage - leader-250: started executor 03:26:52,114 PM [main] [DEBUG] RaftStorage - leader-250: started executor 03:26:52,114 PM [main] [DEBUG] EntryJournalV1 - leader-250: metadata journal open: replayFrom=1 applyTo=0 03:26:52,114 PM [main] [DEBUG] EntryJournalV1 - leader-250: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:52,114 PM [main] [INFO] PekkoRaftStorage - leader-250: journal open: applyTo=0 03:26:52,115 PM [leader-250-writer-103] [DEBUG] JournalWriteTask - leader-250: journal writer started 03:26:52,115 PM [leader-250-writer-103] [DEBUG] JournalWriteTask - leader-250: waiting to receive commands 03:26:52,116 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest7327549008902076475/leader-250/TermInfo.properties does not exist 03:26:52,116 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader-250: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:52,119 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader-250: Set currentTerm=0, votedFor=null 03:26:52,119 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - leader-250: Local TermInfo store seeded with TermInfo{term=0} 03:26:52,119 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader-250: Pekko recovery completed 03:26:52,119 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - leader-250: no journal: skipping journal recovery 03:26:52,119 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 03:26:52,119 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - leader-250 (Follower): Received TimeoutNow - switching to Candidate 03:26:52,119 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader-250 (Candidate): Election: Candidate has following voting peers: [] 03:26:52,123 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - leader-250: Set currentTerm=1, votedFor=leader-250 03:26:52,123 PM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - leader-250 (Candidate): Starting new election term 1 03:26:52,123 PM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader-250 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:26:52,123 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - leader-250 (Candidate): Received ElectionTimeout 03:26:52,123 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractLeader - leader-250 (Leader): Election: Leader has following peers: [] 03:26:52,124 PM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - leader-250 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:26:52,220 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader-250] 03:26:52,231 PM [main] [DEBUG] PekkoRaftStorage - leader-250: terminating thread VirtualThread[#672,leader-250-writer-103]/waiting 03:26:52,231 PM [leader-250-writer-103] [DEBUG] JournalWriteTask - leader-250: received 1 commands after 116.6 ms 03:26:52,231 PM [leader-250-writer-103] [DEBUG] JournalWriteTask - leader-250: completed 1 commands in 41.71 μs 03:26:52,231 PM [leader-250-writer-103] [DEBUG] JournalWriteTask - leader-250: journal writer stopped 03:26:52,232 PM [main] [DEBUG] EntryJournalV1 - leader-250: journal closed 03:26:52,232 PM [main] [INFO] PekkoRaftStorage - leader-250: journal closed 03:26:52,232 PM [main] [DEBUG] RaftStorage - leader-250: stopped executor with 0 remaining tasks 03:26:52,232 PM [main] [DEBUG] RaftStorage - leader-250: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:26:52.236] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from Actor[pekko://test/user/testFindLeader#-165105127]: org.opendaylight.controller.cluster.common.actor.Monitor@3044ad3c [INFO] [pekkoDeadLetter][07/03/2025 15:26:52.236] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[pekko://test/user/testFindLeader#-165105127] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:52,236 PM [test-pekko.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[pekko://test/user/testFindLeader#-165105127] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:52,237 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - testFindLeader: Starting recovery with journal batch size 1000 03:26:52,237 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - testFindLeader: started executor 03:26:52,237 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - testFindLeader: started executor 03:26:52,238 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - testFindLeader: metadata journal open: replayFrom=1 applyTo=0 03:26:52,239 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - testFindLeader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:52,239 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRaftStorage - testFindLeader: journal open: applyTo=0 03:26:52,239 PM [testFindLeader-writer-104] [DEBUG] JournalWriteTask - testFindLeader: journal writer started 03:26:52,239 PM [testFindLeader-writer-104] [DEBUG] JournalWriteTask - testFindLeader: waiting to receive commands 03:26:52,240 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest10715449748747534486/testFindLeader/TermInfo.properties does not exist 03:26:52,240 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - testFindLeader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest10715449748747534486/testFindLeader/journal-v1-1.log 03:26:52,240 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - testFindLeader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest10715449748747534486/testFindLeader/metadata-v1-1.log 03:26:52,240 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - testFindLeader: no eligible files found 03:26:52,240 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - testFindLeader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:52,243 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - testFindLeader: Set currentTerm=0, votedFor=null 03:26:52,243 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - testFindLeader: Local TermInfo store seeded with TermInfo{term=0} 03:26:52,243 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - testFindLeader: Pekko recovery completed 03:26:52,243 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - testFindLeader: starting journal recovery 03:26:52,243 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - testFindLeader: Moving last applied index from -1 to -1 03:26:52,243 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - testFindLeader: empty journal: appending 0 entries 03:26:52,243 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - testFindLeader: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:26:52,243 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - testFindLeader: journal recovery completedin 163.2 μs with journalIndex=1 03:26:52,244 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 03:26:52,244 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - testFindLeader (Follower): Received TimeoutNow - switching to Candidate 03:26:52,244 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - testFindLeader (Candidate): Election: Candidate has following voting peers: [] 03:26:52,246 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - testFindLeader: Set currentTerm=1, votedFor=testFindLeader 03:26:52,246 PM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - testFindLeader (Candidate): Starting new election term 1 03:26:52,246 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - testFindLeader (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:26:52,246 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - testFindLeader (Candidate): Received ElectionTimeout 03:26:52,246 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - testFindLeader (Leader): Election: Leader has following peers: [] 03:26:52,246 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - testFindLeader (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:26:52,296 PM [main] [INFO] RaftActorTest - testLeaderTransitioning starting [WARN] [07/03/2025 15:26:52.298] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/test-actor-251]: org.opendaylight.controller.cluster.common.actor.Monitor@483c3d8 [INFO] [pekkoDeadLetter][07/03/2025 15:26:52.298] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/test-actor-251] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:52,298 PM [test-pekko.actor.default-dispatcher-4] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/test-actor-251] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:52,298 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - test-actor-251: Starting recovery with journal batch size 1000 03:26:52,299 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-251: started executor 03:26:52,299 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-251: started executor 03:26:52,300 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - test-actor-251: metadata journal open: replayFrom=1 applyTo=0 03:26:52,300 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - test-actor-251: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:52,300 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - test-actor-251: journal open: applyTo=0 03:26:52,300 PM [test-actor-251-writer-105] [DEBUG] JournalWriteTask - test-actor-251: journal writer started 03:26:52,300 PM [test-actor-251-writer-105] [DEBUG] JournalWriteTask - test-actor-251: waiting to receive commands 03:26:52,302 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest3632428274807007457/test-actor-251/TermInfo.properties does not exist 03:26:52,302 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-251: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest3632428274807007457/test-actor-251/journal-v1-1.log 03:26:52,302 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-251: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest3632428274807007457/test-actor-251/metadata-v1-1.log 03:26:52,302 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-251: no eligible files found 03:26:52,302 PM [test-pekko.actor.default-dispatcher-4] [INFO] PekkoRecovery - test-actor-251: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:52,305 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - test-actor-251: Set currentTerm=0, votedFor=null 03:26:52,305 PM [test-pekko.actor.default-dispatcher-4] [INFO] PekkoRecovery - test-actor-251: Local TermInfo store seeded with TermInfo{term=0} 03:26:52,305 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - test-actor-251: Pekko recovery completed 03:26:52,305 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - test-actor-251: starting journal recovery 03:26:52,305 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractReplicatedLog - test-actor-251: Moving last applied index from -1 to -1 03:26:52,306 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] JournalRecovery - test-actor-251: empty journal: appending 0 entries 03:26:52,306 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] EntryJournalV1 - test-actor-251: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:26:52,306 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] JournalRecovery - test-actor-251: journal recovery completedin 284.1 μs with journalIndex=1 03:26:52,306 PM [test-pekko.actor.default-dispatcher-4] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 03:26:52,307 PM [test-pekko.actor.default-dispatcher-4] [INFO] Follower - test-actor-251 (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=1, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term 03:26:52,309 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - test-actor-251: Set currentTerm=1, votedFor=null 03:26:52,309 PM [test-pekko.actor.default-dispatcher-4] [INFO] Follower - test-actor-251 (Follower): The followers log is empty and the senders prevLogIndex is 0 03:26:52,309 PM [test-pekko.actor.default-dispatcher-4] [INFO] Follower - test-actor-251 (Follower): Follower is out-of-sync so sending negative reply: AppendEntriesReply{term=1, success=false, followerId=test-actor-251, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 03:26:52,309 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] SyncStatusTracker - test-actor-251: Last sync leader does not match current leader leader, need to catch up to 0 [WARN] [07/03/2025 15:26:52.309] [test-pekko.actor.default-dispatcher-5] [pekko://test/deadLetters] received dead letter from TestActor[pekko://test/user/test-actor-251]: AppendEntriesReply{term=1, success=false, followerId=test-actor-251, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} [WARN] [07/03/2025 15:26:52.309] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/test-actor-251] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=test-actor-251, initialSyncDone=false] [INFO] [pekkoDeadLetter][07/03/2025 15:26:52.309] [test-pekko.actor.default-dispatcher-14] [pekko://test/deadLetters] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntriesReply] from TestActor[pekko://test/user/test-actor-251] to Actor[pekko://test/deadLetters] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/deadLetters] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][07/03/2025 15:26:52.309] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/test-actor-251] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/test-actor-251] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:52,309 PM [test-pekko.actor.default-dispatcher-4] [INFO] RemoteActorRefProvider$RemoteDeadLetterActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntriesReply] from TestActor[pekko://test/user/test-actor-251] to Actor[pekko://test/deadLetters] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/deadLetters] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:52,309 PM [test-pekko.actor.default-dispatcher-4] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/test-actor-251] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:52,357 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - test-actor-251: onLeaderTransitioning: LeaderTransitioning [leaderId=leader] 03:26:52,407 PM [main] [INFO] RaftActorTest - testLeaderTransitioning ending 03:26:52,408 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$a#-115593926] 03:26:52,410 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/test-actor-251] 03:26:52,410 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PekkoRaftStorage - test-actor-251: terminating thread VirtualThread[#675,test-actor-251-writer-105]/waiting 03:26:52,410 PM [test-actor-251-writer-105] [DEBUG] JournalWriteTask - test-actor-251: received 1 commands after 109.6 ms 03:26:52,410 PM [test-actor-251-writer-105] [DEBUG] JournalWriteTask - test-actor-251: completed 1 commands in 48.00 μs 03:26:52,410 PM [test-actor-251-writer-105] [DEBUG] JournalWriteTask - test-actor-251: journal writer stopped 03:26:52,411 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] EntryJournalV1 - test-actor-251: journal closed 03:26:52,411 PM [test-pekko.actor.default-dispatcher-4] [INFO] PekkoRaftStorage - test-actor-251: journal closed 03:26:52,411 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-251: stopped executor with 0 remaining tasks 03:26:52,411 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-251: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:26:52.414] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from Actor[pekko://test/user/$c#-994987715]: org.opendaylight.controller.cluster.common.actor.Monitor@160aadd3 [INFO] [pekkoDeadLetter][07/03/2025 15:26:52.414] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[pekko://test/user/$c#-994987715] to Actor[pekko://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:52,414 PM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[pekko://test/user/$c#-994987715] to Actor[pekko://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:52,415 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActor - notifier-252: Starting recovery with journal batch size 1000 03:26:52,415 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - notifier-252: started executor 03:26:52,415 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - notifier-252: started executor 03:26:52,416 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] EntryJournalV1 - notifier-252: metadata journal open: replayFrom=1 applyTo=0 03:26:52,417 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] EntryJournalV1 - notifier-252: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:52,417 PM [test-pekko.actor.default-dispatcher-4] [INFO] PekkoRaftStorage - notifier-252: journal open: applyTo=0 03:26:52,417 PM [notifier-252-writer-106] [DEBUG] JournalWriteTask - notifier-252: journal writer started 03:26:52,417 PM [notifier-252-writer-106] [DEBUG] JournalWriteTask - notifier-252: waiting to receive commands 03:26:52,418 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest697979689804913881/notifier-252/TermInfo.properties does not exist 03:26:52,418 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - notifier-252: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest697979689804913881/notifier-252/journal-v1-1.log 03:26:52,418 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - notifier-252: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest697979689804913881/notifier-252/metadata-v1-1.log 03:26:52,418 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - notifier-252: no eligible files found 03:26:52,418 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - notifier-252: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:52,422 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=0, votedFor=null 03:26:52,422 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - notifier-252: Local TermInfo store seeded with TermInfo{term=0} 03:26:52,422 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - notifier-252: Pekko recovery completed 03:26:52,422 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - notifier-252: starting journal recovery 03:26:52,422 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - notifier-252: Moving last applied index from -1 to -1 03:26:52,423 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - notifier-252: empty journal: appending 0 entries 03:26:52,423 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - notifier-252: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:26:52,423 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - notifier-252: journal recovery completedin 294.2 μs with journalIndex=1 03:26:52,545 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 03:26:52,545 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - notifier-252 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.171:17355, Removed) 03:26:52,546 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - notifier-252 (Follower): Received ElectionTimeout - switching to Candidate 03:26:52,546 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Election: Candidate has following voting peers: [leader] 03:26:52,549 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=1, votedFor=notifier-252 03:26:52,549 PM [test-pekko.actor.default-dispatcher-4] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 1 03:26:52,549 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=1, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader 03:26:52,549 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorBehavior - notifier-252 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 [WARN] [07/03/2025 15:26:52.549] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=1, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} [INFO] [pekkoDeadLetter][07/03/2025 15:26:52.549] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#-994987715] to Actor[pekko://test/user/$c/fake/path] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:52,549 PM [test-pekko.actor.default-dispatcher-4] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#-994987715] to Actor[pekko://test/user/$c/fake/path] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:52,746 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:52,749 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=2, votedFor=notifier-252 03:26:52,749 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 2 03:26:52,749 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=2, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:52.750] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=2, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} [INFO] [pekkoDeadLetter][07/03/2025 15:26:52.750] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/$c/fake/path] Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#-994987715] to Actor[pekko://test/user/$c/fake/path] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:52,750 PM [test-pekko.actor.default-dispatcher-15] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#-994987715] to Actor[pekko://test/user/$c/fake/path] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:52,875 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:52,880 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=3, votedFor=notifier-252 03:26:52,880 PM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 3 03:26:52,880 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=3, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:52.880] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=3, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} [INFO] [pekkoDeadLetter][07/03/2025 15:26:52.880] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#-994987715] to Actor[pekko://test/user/$c/fake/path] was not delivered. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:52,881 PM [test-pekko.actor.default-dispatcher-14] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#-994987715] to Actor[pekko://test/user/$c/fake/path] was not delivered. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:26:53,96 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:53,99 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=4, votedFor=notifier-252 03:26:53,99 PM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 4 03:26:53,99 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=4, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:53.099] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=4, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:53,226 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:53,229 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=5, votedFor=notifier-252 03:26:53,229 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 5 03:26:53,229 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=5, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:53.229] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=5, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:53,365 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:53,368 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=6, votedFor=notifier-252 03:26:53,368 PM [test-pekko.actor.default-dispatcher-4] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 6 03:26:53,368 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=6, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:53.369] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=6, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:53,586 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:53,589 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=7, votedFor=notifier-252 03:26:53,589 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 7 03:26:53,590 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=7, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:53.590] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=7, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:53,776 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:53,781 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=8, votedFor=notifier-252 03:26:53,781 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 8 03:26:53,781 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=8, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:53.781] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=8, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:53,936 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:53,940 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=9, votedFor=notifier-252 03:26:53,940 PM [test-pekko.actor.default-dispatcher-4] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 9 03:26:53,940 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=9, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:53.940] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=9, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:54,76 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:54,79 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=10, votedFor=notifier-252 03:26:54,79 PM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 10 03:26:54,79 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=10, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:54.080] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=10, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:54,295 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:54,300 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=11, votedFor=notifier-252 03:26:54,300 PM [test-pekko.actor.default-dispatcher-4] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 11 03:26:54,300 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=11, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:54.300] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=11, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:54,485 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:54,489 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=12, votedFor=notifier-252 03:26:54,489 PM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 12 03:26:54,489 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=12, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:54.490] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=12, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:54,686 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:54,690 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=13, votedFor=notifier-252 03:26:54,690 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 13 03:26:54,690 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=13, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:54.690] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=13, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:54,885 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:54,889 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=14, votedFor=notifier-252 03:26:54,889 PM [test-pekko.actor.default-dispatcher-4] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 14 03:26:54,889 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=14, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:54.889] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=14, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:55,76 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:55,80 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=15, votedFor=notifier-252 03:26:55,80 PM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 15 03:26:55,80 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=15, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:55.080] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=15, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:55,266 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:55,269 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=16, votedFor=notifier-252 03:26:55,269 PM [test-pekko.actor.default-dispatcher-4] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 16 03:26:55,269 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=16, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:55.270] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=16, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:55,445 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:55,450 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=17, votedFor=notifier-252 03:26:55,450 PM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 17 03:26:55,450 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=17, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:55.450] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=17, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:55,606 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:55,610 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=18, votedFor=notifier-252 03:26:55,610 PM [test-pekko.actor.default-dispatcher-4] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 18 03:26:55,610 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=18, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:55.612] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=18, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:55,746 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:55,750 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=19, votedFor=notifier-252 03:26:55,750 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 19 03:26:55,750 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=19, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:55.751] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=19, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:55,926 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:55,929 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=20, votedFor=notifier-252 03:26:55,929 PM [test-pekko.actor.default-dispatcher-4] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 20 03:26:55,929 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=20, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:55.930] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=20, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:56,136 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:56,139 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=21, votedFor=notifier-252 03:26:56,139 PM [test-pekko.actor.default-dispatcher-4] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 21 03:26:56,139 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=21, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:56.139] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=21, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:56,316 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:56,319 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=22, votedFor=notifier-252 03:26:56,319 PM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 22 03:26:56,320 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=22, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:56.320] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=22, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:56,446 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:56,449 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=23, votedFor=notifier-252 03:26:56,449 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 23 03:26:56,450 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=23, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:56.450] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=23, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:56,666 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:56,669 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=24, votedFor=notifier-252 03:26:56,669 PM [test-pekko.actor.default-dispatcher-4] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 24 03:26:56,670 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=24, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:56.670] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=24, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:56,866 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:56,869 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=25, votedFor=notifier-252 03:26:56,869 PM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 25 03:26:56,869 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=25, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:56.869] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=25, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:57,6 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:57,9 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=26, votedFor=notifier-252 03:26:57,9 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 26 03:26:57,9 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=26, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:57.009] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=26, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:57,156 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:57,159 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=27, votedFor=notifier-252 03:26:57,159 PM [test-pekko.actor.default-dispatcher-4] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 27 03:26:57,159 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=27, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:57.159] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=27, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:57,296 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:57,299 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=28, votedFor=notifier-252 03:26:57,299 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 28 03:26:57,299 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=28, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:57.299] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=28, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:57,416 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Received ElectionTimeout 03:26:57,419 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - notifier-252: Set currentTerm=29, votedFor=notifier-252 03:26:57,419 PM [test-pekko.actor.default-dispatcher-4] [INFO] Candidate - notifier-252 (Candidate): Starting new election term 29 03:26:57,419 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - notifier-252 (Candidate): Sending RequestVote{term=29, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/03/2025 15:26:57.419] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#-994987715]: RequestVote{term=29, candidateId=notifier-252, lastLogIndex=-1, lastLogTerm=-1} 03:26:57,436 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$b#-1228094709] 03:26:57,447 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$c#-994987715] 03:26:57,447 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRaftStorage - notifier-252: terminating thread VirtualThread[#676,notifier-252-writer-106]/waiting 03:26:57,447 PM [notifier-252-writer-106] [DEBUG] JournalWriteTask - notifier-252: received 1 commands after 5.031 s 03:26:57,447 PM [notifier-252-writer-106] [DEBUG] JournalWriteTask - notifier-252: completed 1 commands in 36.53 μs 03:26:57,447 PM [notifier-252-writer-106] [DEBUG] JournalWriteTask - notifier-252: journal writer stopped 03:26:57,448 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - notifier-252: journal closed 03:26:57,448 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - notifier-252: journal closed 03:26:57,448 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - notifier-252: stopped executor with 0 remaining tasks 03:26:57,448 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - notifier-252: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:26:57.451] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader-253]: org.opendaylight.controller.cluster.common.actor.Monitor@77bdde40 03:26:57,452 PM [main] [INFO] RaftActor - leader-253: Starting recovery with journal batch size 1000 03:26:57,452 PM [main] [DEBUG] RaftStorage - leader-253: started executor 03:26:57,452 PM [main] [DEBUG] RaftStorage - leader-253: started executor 03:26:57,452 PM [main] [DEBUG] EntryJournalV1 - leader-253: metadata journal open: replayFrom=1 applyTo=0 03:26:57,453 PM [main] [DEBUG] EntryJournalV1 - leader-253: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:57,453 PM [main] [INFO] PekkoRaftStorage - leader-253: journal open: applyTo=0 03:26:57,453 PM [leader-253-writer-107] [DEBUG] JournalWriteTask - leader-253: journal writer started 03:26:57,453 PM [leader-253-writer-107] [DEBUG] JournalWriteTask - leader-253: waiting to receive commands 03:26:57,455 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest16994632390385035452/leader-253/TermInfo.properties does not exist 03:26:57,455 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader-253: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:57,458 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader-253: Set currentTerm=0, votedFor=null 03:26:57,458 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader-253: Local TermInfo store seeded with TermInfo{term=0} 03:26:57,458 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader-253: Pekko recovery completed 03:26:57,458 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader-253: no journal: skipping journal recovery 03:26:57,458 PM [test-pekko.actor.default-dispatcher-15] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 03:26:57,461 PM [main] [DEBUG] PropertiesTermInfoStore - leader-253: Set currentTerm=100, votedFor= 03:26:57,464 PM [main] [DEBUG] PropertiesTermInfoStore - leader-253: Set currentTerm=110, votedFor= 03:26:57,464 PM [main] [DEBUG] AbstractLeader - leader-253 (Leader): Election: Leader has following peers: [] 03:26:57,464 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader-253] 03:26:57,475 PM [main] [DEBUG] PekkoRaftStorage - leader-253: terminating thread VirtualThread[#678,leader-253-writer-107]/waiting 03:26:57,475 PM [leader-253-writer-107] [DEBUG] JournalWriteTask - leader-253: received 1 commands after 21.47 ms 03:26:57,475 PM [leader-253-writer-107] [DEBUG] JournalWriteTask - leader-253: completed 1 commands in 20.94 μs 03:26:57,475 PM [leader-253-writer-107] [DEBUG] JournalWriteTask - leader-253: journal writer stopped 03:26:57,475 PM [main] [DEBUG] EntryJournalV1 - leader-253: journal closed 03:26:57,475 PM [main] [INFO] PekkoRaftStorage - leader-253: journal closed 03:26:57,475 PM [main] [DEBUG] RaftStorage - leader-253: stopped executor with 0 remaining tasks 03:26:57,475 PM [main] [DEBUG] RaftStorage - leader-253: stopped executor with 0 remaining tasks 03:26:57,479 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - testConstruction: Starting recovery with journal batch size 1000 03:26:57,479 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - testConstruction: started executor 03:26:57,479 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - testConstruction: started executor [WARN] [07/03/2025 15:26:57.480] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from Actor[pekko://test/user/testConstruction#1772958674]: org.opendaylight.controller.cluster.common.actor.Monitor@4f5e66e4 03:26:57,480 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - testConstruction: metadata journal open: replayFrom=1 applyTo=0 03:26:57,481 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - testConstruction: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:57,481 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - testConstruction: journal open: applyTo=0 03:26:57,481 PM [testConstruction-writer-108] [DEBUG] JournalWriteTask - testConstruction: journal writer started 03:26:57,481 PM [testConstruction-writer-108] [DEBUG] JournalWriteTask - testConstruction: waiting to receive commands 03:26:57,482 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest7318409870342067891/testConstruction/TermInfo.properties does not exist 03:26:57,482 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - testConstruction: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest7318409870342067891/testConstruction/journal-v1-1.log 03:26:57,482 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - testConstruction: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest7318409870342067891/testConstruction/metadata-v1-1.log 03:26:57,482 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - testConstruction: no eligible files found 03:26:57,482 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - testConstruction: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:57,484 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - testConstruction: Set currentTerm=0, votedFor=null 03:26:57,484 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - testConstruction: Local TermInfo store seeded with TermInfo{term=0} 03:26:57,484 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - testConstruction: Pekko recovery completed 03:26:57,484 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - testConstruction: starting journal recovery 03:26:57,484 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - testConstruction: Moving last applied index from -1 to -1 03:26:57,484 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - testConstruction: empty journal: appending 0 entries 03:26:57,485 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - testConstruction: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:26:57,485 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - testConstruction: journal recovery completedin 312.8 μs with journalIndex=1 03:26:57,485 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 03:26:57,485 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - testConstruction (Follower): Received TimeoutNow - switching to Candidate 03:26:57,486 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - testConstruction (Candidate): Election: Candidate has following voting peers: [] 03:26:57,488 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - testConstruction: Set currentTerm=1, votedFor=testConstruction 03:26:57,488 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - testConstruction (Candidate): Starting new election term 1 03:26:57,488 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - testConstruction (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:26:57,488 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - testConstruction (Candidate): Received ElectionTimeout 03:26:57,488 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - testConstruction (Leader): Election: Leader has following peers: [] 03:26:57,488 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - testConstruction (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 [WARN] [07/03/2025 15:26:57.540] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader-254]: org.opendaylight.controller.cluster.common.actor.Monitor@556c1cdc 03:26:57,541 PM [main] [INFO] RaftActor - leader-254: Starting recovery with journal batch size 1000 03:26:57,542 PM [main] [DEBUG] RaftStorage - leader-254: started executor 03:26:57,542 PM [main] [DEBUG] RaftStorage - leader-254: started executor 03:26:57,543 PM [main] [DEBUG] EntryJournalV1 - leader-254: metadata journal open: replayFrom=1 applyTo=0 03:26:57,543 PM [main] [DEBUG] EntryJournalV1 - leader-254: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:57,543 PM [main] [INFO] PekkoRaftStorage - leader-254: journal open: applyTo=0 03:26:57,543 PM [leader-254-writer-109] [DEBUG] JournalWriteTask - leader-254: journal writer started 03:26:57,543 PM [leader-254-writer-109] [DEBUG] JournalWriteTask - leader-254: waiting to receive commands 03:26:57,545 PM [main] [DEBUG] AbstractReplicatedLog - leader-254: Moving last applied index from -1 to 4 03:26:57,545 PM [main] [DEBUG] PropertiesTermInfoStore - leader-254: Set currentTerm=1, votedFor=leader-254 03:26:57,545 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12956978209396245790/leader-254/TermInfo.properties does not exist 03:26:57,545 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader-254: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:57,548 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader-254: Set currentTerm=1, votedFor=leader-254 03:26:57,548 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader-254: Local TermInfo store seeded with TermInfo{term=1, votedFor=leader-254} 03:26:57,548 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader-254: Pekko recovery completed 03:26:57,548 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader-254: no journal: skipping journal recovery 03:26:57,548 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): Election: Leader has following peers: [follower-255] 03:26:57,549 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): Checking sendAppendEntries for follower follower-255: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 03:26:57,549 PM [main] [INFO] SnapshotManager - leader-254: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=6, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=4, replicatedToAllTerm=1, unAppliedEntries size=8, mandatoryTrim=false] to install on xyzzy 03:26:57,550 PM [main] [DEBUG] SnapshotManager - leader-254: last applied journal index prior to capture: 0 03:26:57,550 PM [main] [INFO] MockRaftActor - leader-254: support() called 03:26:57,551 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower-255 updated: matchIndex: 5, nextIndex: 6 03:26:57,551 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): Applying to log - commitIndex: 5, lastAppliedIndex: -1 03:26:57,551 PM [main] [DEBUG] RaftActorBehavior - leader-254 (Leader): Setting last applied to 0 03:26:57,551 PM [main] [DEBUG] AbstractReplicatedLog - leader-254: Moving last applied index from -1 to 0 03:26:57,551 PM [main] [DEBUG] RaftActor - leader-254: Applying state for log index 0 data 0 03:26:57,551 PM [main] [INFO] MockRaftActor - leader-254: applyState called: 0 03:26:57,551 PM [main] [DEBUG] RaftActorBehavior - leader-254 (Leader): Setting last applied to 1 03:26:57,551 PM [main] [DEBUG] AbstractReplicatedLog - leader-254: Moving last applied index from 0 to 1 03:26:57,551 PM [main] [DEBUG] RaftActor - leader-254: Applying state for log index 1 data 1 03:26:57,551 PM [main] [INFO] MockRaftActor - leader-254: applyState called: 1 03:26:57,551 PM [main] [DEBUG] RaftActorBehavior - leader-254 (Leader): Setting last applied to 2 03:26:57,551 PM [main] [DEBUG] AbstractReplicatedLog - leader-254: Moving last applied index from 1 to 2 03:26:57,551 PM [main] [DEBUG] RaftActor - leader-254: Applying state for log index 2 data 2 03:26:57,551 PM [main] [INFO] MockRaftActor - leader-254: applyState called: 2 03:26:57,551 PM [main] [DEBUG] RaftActorBehavior - leader-254 (Leader): Setting last applied to 3 03:26:57,551 PM [main] [DEBUG] AbstractReplicatedLog - leader-254: Moving last applied index from 2 to 3 03:26:57,551 PM [main] [DEBUG] RaftActor - leader-254: Applying state for log index 3 data 3 03:26:57,551 PM [main] [INFO] MockRaftActor - leader-254: applyState called: 3 03:26:57,551 PM [main] [DEBUG] RaftActorBehavior - leader-254 (Leader): Setting last applied to 4 03:26:57,551 PM [main] [DEBUG] AbstractReplicatedLog - leader-254: Moving last applied index from 3 to 4 03:26:57,551 PM [main] [DEBUG] RaftActor - leader-254: Applying state for log index 4 data 4 03:26:57,551 PM [main] [INFO] MockRaftActor - leader-254: applyState called: 4 03:26:57,551 PM [main] [DEBUG] RaftActorBehavior - leader-254 (Leader): Setting last applied to 5 03:26:57,551 PM [main] [DEBUG] AbstractReplicatedLog - leader-254: Moving last applied index from 4 to 5 03:26:57,551 PM [main] [DEBUG] RaftActor - leader-254: Applying state for log index 5 data 5 03:26:57,551 PM [main] [INFO] MockRaftActor - leader-254: applyState called: 5 03:26:57,551 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): Checking sendAppendEntries for follower follower-255: active: true, followerNextIndex: 6, leaderLastIndex: 7, leaderSnapShotIndex: -1 03:26:57,551 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): sendAppendEntries: 6 is present for follower follower-255 03:26:57,551 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): Sending AppendEntries to follower follower-255: AppendEntries{term=1, leaderId=leader-254, prevLogIndex=5, prevLogTerm=1, leaderCommit=5, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=6, term=1, command=6, pending=false}, JournaledLogEntry{index=7, term=1, command=7, pending=false}]} 03:26:57,552 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower-255 updated: matchIndex: 6, nextIndex: 7 03:26:57,552 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): Applying to log - commitIndex: 6, lastAppliedIndex: 5 03:26:57,552 PM [main] [DEBUG] RaftActorBehavior - leader-254 (Leader): Setting last applied to 6 03:26:57,552 PM [main] [DEBUG] AbstractReplicatedLog - leader-254: Moving last applied index from 5 to 6 03:26:57,552 PM [main] [DEBUG] RaftActor - leader-254: Applying state for log index 6 data 6 03:26:57,552 PM [main] [INFO] MockRaftActor - leader-254: applyState called: 6 03:26:57,552 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): Checking sendAppendEntries for follower follower-255: active: true, followerNextIndex: 7, leaderLastIndex: 7, leaderSnapShotIndex: -1 03:26:57,552 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): sendAppendEntries: 7 is present for follower follower-255 03:26:57,552 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): Sending AppendEntries to follower follower-255: AppendEntries{term=1, leaderId=leader-254, prevLogIndex=6, prevLogTerm=1, leaderCommit=6, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=7, term=1, command=7, pending=false}]} 03:26:57,552 PM [main] [INFO] SnapshotManager - leader-254: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=6, term=1] 03:26:57,552 PM [main] [INFO] MockRaftActor - leader-254: support() called 03:26:57,553 PM [main] [INFO] SnapshotManager - leader-254: Removed in-memory snapshotted entries, adjusted snapshotIndex: 4 and term: 1 03:26:57,553 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): sendInstallSnapshot 03:26:57,553 PM [main] [DEBUG] SnapshotManager - leader-254: Snapshot success, discarding journal entries up to 0 03:26:57,553 PM [main] [DEBUG] RaftActorSnapshotMessageSupport - leader-254: SnapshotComplete received 03:26:57,553 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower-255 updated: matchIndex: 7, nextIndex: 8 03:26:57,553 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): Applying to log - commitIndex: 7, lastAppliedIndex: 6 03:26:57,553 PM [main] [DEBUG] RaftActorBehavior - leader-254 (Leader): Setting last applied to 7 03:26:57,553 PM [main] [DEBUG] AbstractReplicatedLog - leader-254: Moving last applied index from 6 to 7 03:26:57,553 PM [main] [DEBUG] RaftActor - leader-254: Applying state for log index 7 data 7 03:26:57,553 PM [main] [INFO] MockRaftActor - leader-254: applyState called: 7 03:26:57,553 PM [main] [DEBUG] SnapshotManager - leader-254: fakeSnapshot purging log to 6 for term 1 03:26:57,553 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): Checking sendAppendEntries for follower follower-255: active: true, followerNextIndex: 8, leaderLastIndex: 8, leaderSnapShotIndex: 6 03:26:57,553 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): sendAppendEntries: 8 is present for follower follower-255 03:26:57,553 PM [main] [DEBUG] AbstractLeader - leader-254 (Leader): Sending AppendEntries to follower follower-255: AppendEntries{term=1, leaderId=leader-254, prevLogIndex=7, prevLogTerm=1, leaderCommit=7, replicatedToAllIndex=6, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=8, term=1, command=foo-8, pending=false}]} 03:26:57,553 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$d#-1393167613] 03:26:57,554 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader-254] 03:26:57,555 PM [main] [DEBUG] PekkoRaftStorage - leader-254: terminating thread VirtualThread[#680,leader-254-writer-109]/waiting 03:26:57,555 PM [leader-254-writer-109] [DEBUG] JournalWriteTask - leader-254: received 1 commands after 11.32 ms 03:26:57,555 PM [leader-254-writer-109] [DEBUG] JournalWriteTask - leader-254: completed 1 commands in 11.32 μs 03:26:57,555 PM [leader-254-writer-109] [DEBUG] JournalWriteTask - leader-254: journal writer stopped 03:26:57,555 PM [main] [DEBUG] EntryJournalV1 - leader-254: journal closed 03:26:57,555 PM [main] [INFO] PekkoRaftStorage - leader-254: journal closed 03:26:57,555 PM [main] [DEBUG] RaftStorage - leader-254: stopped executor with 0 remaining tasks 03:26:57,555 PM [main] [DEBUG] RaftStorage - leader-254: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:26:57.557] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader-256]: org.opendaylight.controller.cluster.common.actor.Monitor@5615bf41 03:26:57,558 PM [main] [INFO] RaftActor - leader-256: Starting recovery with journal batch size 1000 03:26:57,558 PM [main] [DEBUG] RaftStorage - leader-256: started executor 03:26:57,558 PM [main] [DEBUG] RaftStorage - leader-256: started executor 03:26:57,558 PM [main] [DEBUG] EntryJournalV1 - leader-256: metadata journal open: replayFrom=1 applyTo=0 03:26:57,559 PM [main] [DEBUG] EntryJournalV1 - leader-256: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:57,559 PM [main] [INFO] PekkoRaftStorage - leader-256: journal open: applyTo=0 03:26:57,559 PM [leader-256-writer-110] [DEBUG] JournalWriteTask - leader-256: journal writer started 03:26:57,559 PM [leader-256-writer-110] [DEBUG] JournalWriteTask - leader-256: waiting to receive commands 03:26:57,560 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest1012302728819775679/leader-256/TermInfo.properties does not exist 03:26:57,560 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader-256: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:57,563 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader-256: Set currentTerm=0, votedFor=null 03:26:57,563 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader-256: Local TermInfo store seeded with TermInfo{term=0} 03:26:57,563 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader-256: Pekko recovery completed 03:26:57,563 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader-256: no journal: skipping journal recovery 03:26:57,563 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 03:26:57,563 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - leader-256 (Follower): Received TimeoutNow - switching to Candidate 03:26:57,563 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader-256 (Candidate): Election: Candidate has following voting peers: [] 03:26:57,563 PM [main] [DEBUG] RaftActor - leader-256: Applying state for log index 5 data F 03:26:57,563 PM [main] [INFO] MockRaftActor - leader-256: applyState called: F 03:26:57,565 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader-256: Set currentTerm=1, votedFor=leader-256 03:26:57,565 PM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - leader-256 (Candidate): Starting new election term 1 03:26:57,565 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader-256 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:26:57,565 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader-256 (Candidate): Received ElectionTimeout 03:26:57,565 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader-256 (Leader): Election: Leader has following peers: [] 03:26:57,565 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader-256 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:26:57,566 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader-256] 03:26:57,566 PM [main] [DEBUG] PekkoRaftStorage - leader-256: terminating thread VirtualThread[#681,leader-256-writer-110]/waiting 03:26:57,566 PM [leader-256-writer-110] [DEBUG] JournalWriteTask - leader-256: received 1 commands after 7.355 ms 03:26:57,566 PM [leader-256-writer-110] [DEBUG] JournalWriteTask - leader-256: completed 1 commands in 22.03 μs 03:26:57,566 PM [leader-256-writer-110] [DEBUG] JournalWriteTask - leader-256: journal writer stopped 03:26:57,566 PM [main] [DEBUG] EntryJournalV1 - leader-256: journal closed 03:26:57,567 PM [main] [INFO] PekkoRaftStorage - leader-256: journal closed 03:26:57,567 PM [main] [DEBUG] RaftStorage - leader-256: stopped executor with 0 remaining tasks 03:26:57,567 PM [main] [DEBUG] RaftStorage - leader-256: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:26:57.569] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower-257]: org.opendaylight.controller.cluster.common.actor.Monitor@70bef223 03:26:57,569 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - follower-257: Starting recovery with journal batch size 1000 03:26:57,569 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower-257: started executor 03:26:57,569 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower-257: started executor 03:26:57,570 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower-257: metadata journal open: replayFrom=1 applyTo=0 03:26:57,570 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower-257: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:57,570 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - follower-257: journal open: applyTo=0 03:26:57,571 PM [follower-257-writer-111] [DEBUG] JournalWriteTask - follower-257: journal writer started 03:26:57,571 PM [follower-257-writer-111] [DEBUG] JournalWriteTask - follower-257: waiting to receive commands 03:26:57,572 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest14746925567912762058/follower-257/TermInfo.properties does not exist 03:26:57,572 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower-257: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:57,574 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower-257: Set currentTerm=0, votedFor=null 03:26:57,574 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower-257: Local TermInfo store seeded with TermInfo{term=0} 03:26:57,574 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower-257: Pekko recovery completed 03:26:57,574 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower-257: no journal: skipping journal recovery 03:26:57,574 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower-257] 03:26:57,575 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - follower-257: terminating thread VirtualThread[#682,follower-257-writer-111]/waiting 03:26:57,575 PM [follower-257-writer-111] [DEBUG] JournalWriteTask - follower-257: received 1 commands after 4.300 ms 03:26:57,575 PM [follower-257-writer-111] [DEBUG] JournalWriteTask - follower-257: completed 1 commands in 12.94 μs 03:26:57,575 PM [follower-257-writer-111] [DEBUG] JournalWriteTask - follower-257: journal writer stopped 03:26:57,575 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower-257: journal closed 03:26:57,575 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower-257: journal closed 03:26:57,575 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower-257: stopped executor with 0 remaining tasks 03:26:57,575 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower-257: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:26:57.576] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower-258]: org.opendaylight.controller.cluster.common.actor.Monitor@73b66cfc 03:26:57,576 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower-257: Starting recovery with journal batch size 1000 03:26:57,577 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower-257: started executor 03:26:57,577 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower-257: started executor 03:26:57,577 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower-257: metadata journal open: replayFrom=1 applyTo=0 03:26:57,578 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower-257: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:57,578 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower-257: journal open: applyTo=0 03:26:57,578 PM [follower-257-writer-112] [DEBUG] JournalWriteTask - follower-257: journal writer started 03:26:57,578 PM [follower-257-writer-112] [DEBUG] JournalWriteTask - follower-257: waiting to receive commands 03:26:57,579 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower-257: Set currentTerm=0, votedFor=null 03:26:57,579 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - follower-257: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:57,579 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRecovery - follower-257: restoring local TermInfo{term=0} 03:26:57,579 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower-257: Set currentTerm=0, votedFor=null 03:26:57,579 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower-257: Pekko recovery completed 03:26:57,579 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower-257: no journal: skipping journal recovery 03:26:57,579 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower-258] 03:26:57,590 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - follower-257: terminating thread VirtualThread[#683,follower-257-writer-112]/waiting 03:26:57,590 PM [follower-257-writer-112] [DEBUG] JournalWriteTask - follower-257: received 1 commands after 12.21 ms 03:26:57,590 PM [follower-257-writer-112] [DEBUG] JournalWriteTask - follower-257: completed 1 commands in 18.13 μs 03:26:57,590 PM [follower-257-writer-112] [DEBUG] JournalWriteTask - follower-257: journal writer stopped 03:26:57,590 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower-257: journal closed 03:26:57,590 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower-257: journal closed 03:26:57,590 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower-257: stopped executor with 0 remaining tasks 03:26:57,590 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower-257: stopped executor with 0 remaining tasks 03:26:57,593 PM [main] [INFO] RaftActorTest - testNonVotingOnRecovery starting [WARN] [07/03/2025 15:26:57.593] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/test-actor-259]: org.opendaylight.controller.cluster.common.actor.Monitor@e8d341 03:26:57,594 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - test-actor-259: Starting recovery with journal batch size 1000 03:26:57,594 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - test-actor-259: started executor 03:26:57,594 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - test-actor-259: started executor 03:26:57,595 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - test-actor-259: metadata journal open: replayFrom=1 applyTo=0 03:26:57,596 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - test-actor-259: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:57,596 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - test-actor-259: journal open: applyTo=0 03:26:57,596 PM [test-actor-259-writer-113] [DEBUG] JournalWriteTask - test-actor-259: journal writer started 03:26:57,596 PM [test-actor-259-writer-113] [DEBUG] JournalWriteTask - test-actor-259: waiting to receive commands 03:26:57,597 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12039178746423073327/test-actor-259/TermInfo.properties does not exist 03:26:57,597 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-259: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12039178746423073327/test-actor-259/journal-v1-1.log 03:26:57,597 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-259: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12039178746423073327/test-actor-259/metadata-v1-1.log 03:26:57,597 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-259: no eligible files found 03:26:57,597 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRecovery - test-actor-259: Received ReplicatedLogEntry for recovery: index: 0, size: 131 03:26:57,597 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PeerInfos - test-actor-259: Updated server config: isVoting: false, peers: [] 03:26:57,598 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - test-actor-259: Recovery completed - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1 03:26:57,600 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - test-actor-259: Set currentTerm=0, votedFor=null 03:26:57,600 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - test-actor-259: Local TermInfo store seeded with TermInfo{term=0} 03:26:57,600 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - test-actor-259: Pekko recovery completed 03:26:57,600 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - test-actor-259: starting journal recovery 03:26:57,600 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - test-actor-259: Moving last applied index from -1 to -1 03:26:57,600 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - test-actor-259: empty journal: appending 1 entries 03:26:57,600 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - test-actor-259: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:26:57,603 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - test-actor-259: journal recovery completedin 2.907 ms with journalIndex=1 03:26:57,603 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 03:26:58,4 PM [main] [INFO] RaftActorTest - testNonVotingOnRecovery ending 03:26:58,4 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/test-actor-259] 03:26:58,15 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRaftStorage - test-actor-259: terminating thread VirtualThread[#684,test-actor-259-writer-113]/waiting 03:26:58,15 PM [test-actor-259-writer-113] [DEBUG] JournalWriteTask - test-actor-259: received 1 commands after 419.4 ms 03:26:58,15 PM [test-actor-259-writer-113] [DEBUG] JournalWriteTask - test-actor-259: completed 1 commands in 22.44 μs 03:26:58,15 PM [test-actor-259-writer-113] [DEBUG] JournalWriteTask - test-actor-259: journal writer stopped 03:26:58,16 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - test-actor-259: journal closed 03:26:58,16 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - test-actor-259: journal closed 03:26:58,16 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-259: stopped executor with 0 remaining tasks 03:26:58,16 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-259: stopped executor with 0 remaining tasks 03:26:58,18 PM [main] [INFO] RaftActorTest - testRaftActorRecoveryWithPersistenceEnabled starting [WARN] [07/03/2025 15:26:58.020] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from Actor[pekko://test/user/follower-260#-2078998558]: org.opendaylight.controller.cluster.common.actor.Monitor@45ed0951 03:26:58,21 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - follower-260: Starting recovery with journal batch size 1000 03:26:58,21 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower-260: started executor 03:26:58,21 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower-260: started executor 03:26:58,22 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower-260: metadata journal open: replayFrom=1 applyTo=0 03:26:58,22 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower-260: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:58,22 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - follower-260: journal open: applyTo=0 03:26:58,23 PM [follower-260-writer-114] [DEBUG] JournalWriteTask - follower-260: journal writer started 03:26:58,23 PM [follower-260-writer-114] [DEBUG] JournalWriteTask - follower-260: waiting to receive commands 03:26:58,23 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest16821179776853208141/follower-260/TermInfo.properties does not exist 03:26:58,24 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower-260: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest16821179776853208141/follower-260/journal-v1-1.log 03:26:58,24 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower-260: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest16821179776853208141/follower-260/metadata-v1-1.log 03:26:58,24 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower-260: no eligible files found 03:26:58,24 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower-260: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:58,26 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower-260: Set currentTerm=0, votedFor=null 03:26:58,26 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower-260: Local TermInfo store seeded with TermInfo{term=0} 03:26:58,26 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower-260: Pekko recovery completed 03:26:58,26 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower-260: starting journal recovery 03:26:58,26 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - follower-260: Moving last applied index from -1 to -1 03:26:58,26 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower-260: empty journal: appending 0 entries 03:26:58,26 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower-260: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:26:58,26 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - follower-260: journal recovery completedin 125.5 μs with journalIndex=1 03:26:58,35 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRaftStorage - follower-260: terminating thread VirtualThread[#685,follower-260-writer-114]/waiting 03:26:58,36 PM [follower-260-writer-114] [DEBUG] JournalWriteTask - follower-260: received 1 commands after 13.00 ms 03:26:58,36 PM [follower-260-writer-114] [DEBUG] JournalWriteTask - follower-260: completed 1 commands in 23.56 μs 03:26:58,36 PM [follower-260-writer-114] [DEBUG] JournalWriteTask - follower-260: journal writer stopped 03:26:58,36 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower-260: journal closed 03:26:58,36 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - follower-260: journal closed 03:26:58,36 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower-260: stopped executor with 0 remaining tasks 03:26:58,36 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - follower-260: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:26:58.037] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/$$a]: org.opendaylight.controller.cluster.common.actor.Monitor@70d4b027 03:26:58,39 PM [main] [INFO] RaftActor - follower-260: Starting recovery with journal batch size 1000 03:26:58,39 PM [main] [DEBUG] RaftStorage - follower-260: started executor 03:26:58,39 PM [main] [DEBUG] RaftStorage - follower-260: started executor 03:26:58,40 PM [main] [DEBUG] EntryJournalV1 - follower-260: metadata journal open: replayFrom=1 applyTo=0 03:26:58,41 PM [main] [DEBUG] EntryJournalV1 - follower-260: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:58,41 PM [main] [INFO] PekkoRaftStorage - follower-260: journal open: applyTo=0 03:26:58,41 PM [follower-260-writer-115] [DEBUG] JournalWriteTask - follower-260: journal writer started 03:26:58,41 PM [follower-260-writer-115] [DEBUG] JournalWriteTask - follower-260: waiting to receive commands 03:26:58,42 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] PropertiesTermInfoStore - follower-260: Set currentTerm=0, votedFor=null 03:26:58,42 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-260: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest16821179776853208141/follower-260/TermInfo.properties 03:26:58,42 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-260: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest16821179776853208141/follower-260/journal-v1-1.log 03:26:58,42 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-260: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest16821179776853208141/follower-260/metadata-v1-1.log 03:26:58,42 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-260: no eligible files found 03:26:58,43 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] PekkoRecovery - follower-260: SnapshotOffer called. 03:26:58,43 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] PekkoRecovery - follower-260: initializing from snapshot taken at 2025-07-03T15:26:58.035Z 03:26:58,43 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] PropertiesTermInfoStore - follower-260: Set currentTerm=-1, votedFor=null 03:26:58,43 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [INFO] PekkoRecovery - Recovery snapshot applied for follower-260 in 384.4 μs: snapshotIndex=3, snapshotTerm=1, journal-size=1 03:26:58,43 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [INFO] PekkoRecovery - follower-260: migrating from Pekko persistent-snapshot taken at 2025-07-03T15:26:58.035Z 03:26:58,43 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [INFO] MockRaftActor - follower-260: support() called 03:26:58,43 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-260: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest16821179776853208141/follower-260/snapshot-000000006866A142-02160EC0.tmp 03:26:58,47 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-260: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest16821179776853208141/follower-260/snapshot-000000006866A142-02160EC0.v1 03:26:58,47 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-260: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest16821179776853208141/follower-260/snapshot-000000006866A142-02160EC0.v1 03:26:58,47 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-260: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest16821179776853208141/follower-260/TermInfo.properties 03:26:58,48 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-260: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest16821179776853208141/follower-260/journal-v1-1.log 03:26:58,48 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-260: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest16821179776853208141/follower-260/metadata-v1-1.log 03:26:58,48 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [DEBUG] RaftStorage - follower-260: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=3, term=1], timestamp=2025-07-03T15:26:58.035Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorTest16821179776853208141/follower-260/snapshot-000000006866A142-02160EC0.v1, size=513, entryCompress=NONE, stateCompress=NONE} 03:26:58,48 PM [test-pekko.persistence.dispatchers.default-plugin-dispatcher-13] [INFO] PekkoRecovery - follower-260: local snapshot saved in 4.422 ms, deleting Pekko-persisted snapshots 03:26:58,53 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRecovery - follower-260: Received ReplicatedLogEntry for recovery: index: 5, size: 2 03:26:58,54 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRecovery - follower-260: Received apply journal entries for recovery, applying to state: 4 to 5 03:26:58,54 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - follower-260: Moving last applied index from 3 to 5 03:26:58,54 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRecovery - follower-260: Received ReplicatedLogEntry for recovery: index: 6, size: 3 03:26:58,54 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRecovery - follower-260: Received ReplicatedLogEntry for recovery: index: 7, size: 4 03:26:58,54 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - follower-260: Recovery completed in 11.09 ms - Switching actor to Follower - last log index = 7, last log term = 1, snapshot index = 3, snapshot term = 1, journal size = 4 03:26:58,54 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRecovery - follower-260: restoring local TermInfo{term=0} 03:26:58,54 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower-260: Set currentTerm=0, votedFor=null 03:26:58,54 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower-260: Pekko recovery completed 03:26:58,54 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower-260: starting journal recovery 03:26:58,54 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - follower-260: Moving last applied index from -1 to 5 03:26:58,54 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - follower-260: empty journal: appending 4 entries 03:26:58,54 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - follower-260: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:26:58,60 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - follower-260: journal recovery completedin 6.042 ms with journalIndex=1 03:26:58,60 PM [main] [INFO] RaftActorTest - testRaftActorRecoveryWithPersistenceEnabled ending 03:26:58,60 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower-260#-2078998558] 03:26:58,71 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/$$a] 03:26:58,72 PM [main] [DEBUG] RaftActor - follower-260: ignoring DeleteSnapshotsSuccess(SnapshotSelectionCriteria(9223372036854775807,9223372036854775807,0,0)) 03:26:58,72 PM [main] [DEBUG] PekkoRaftStorage - follower-260: terminating thread VirtualThread[#686,follower-260-writer-115]/waiting 03:26:58,72 PM [follower-260-writer-115] [DEBUG] JournalWriteTask - follower-260: received 1 commands after 31.07 ms 03:26:58,72 PM [follower-260-writer-115] [DEBUG] JournalWriteTask - follower-260: completed 1 commands in 26.16 μs 03:26:58,72 PM [follower-260-writer-115] [DEBUG] JournalWriteTask - follower-260: journal writer stopped 03:26:58,72 PM [main] [DEBUG] EntryJournalV1 - follower-260: journal closed 03:26:58,72 PM [main] [INFO] PekkoRaftStorage - follower-260: journal closed 03:26:58,72 PM [main] [DEBUG] RaftStorage - follower-260: stopped executor with 0 remaining tasks 03:26:58,72 PM [main] [DEBUG] RaftStorage - follower-260: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:26:58.076] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader-261]: org.opendaylight.controller.cluster.common.actor.Monitor@46ad7e2e 03:26:58,77 PM [main] [INFO] RaftActor - leader-261: Starting recovery with journal batch size 1000 03:26:58,77 PM [main] [DEBUG] RaftStorage - leader-261: started executor 03:26:58,77 PM [main] [DEBUG] RaftStorage - leader-261: started executor 03:26:58,78 PM [main] [DEBUG] EntryJournalV1 - leader-261: metadata journal open: replayFrom=1 applyTo=0 03:26:58,78 PM [main] [DEBUG] EntryJournalV1 - leader-261: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:58,78 PM [main] [INFO] PekkoRaftStorage - leader-261: journal open: applyTo=0 03:26:58,78 PM [leader-261-writer-116] [DEBUG] JournalWriteTask - leader-261: journal writer started 03:26:58,79 PM [leader-261-writer-116] [DEBUG] JournalWriteTask - leader-261: waiting to receive commands 03:26:58,80 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest6702333540905602614/leader-261/TermInfo.properties does not exist 03:26:58,80 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader-261: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:58,83 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader-261: Set currentTerm=0, votedFor=null 03:26:58,83 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader-261: Local TermInfo store seeded with TermInfo{term=0} 03:26:58,83 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader-261: Pekko recovery completed 03:26:58,83 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader-261: no journal: skipping journal recovery 03:26:58,83 PM [main] [DEBUG] AbstractReplicatedLog - leader-261: Moving last applied index from -1 to 3 03:26:58,83 PM [main] [DEBUG] PropertiesTermInfoStore - leader-261: Set currentTerm=1, votedFor=leader-261 03:26:58,83 PM [main] [DEBUG] AbstractLeader - leader-261 (Leader): Election: Leader has following peers: [member1] 03:26:58,84 PM [main] [DEBUG] AbstractLeader - leader-261 (Leader): Checking sendAppendEntries for follower member1: active: false, followerNextIndex: 3, leaderLastIndex: 3, leaderSnapShotIndex: 3 [WARN] [07/03/2025 15:26:58.084] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/leader-261/address] received dead letter from TestActor[pekko://test/user/leader-261]: AppendEntries{term=1, leaderId=leader-261, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 03:26:58,84 PM [main] [DEBUG] RaftActor - leader-261: Persist data index=4 term=1 command=duh 03:26:58,84 PM [main] [DEBUG] ReplicatedLogImpl - leader-261: Append log entry and persist JournaledLogEntry{index=4, term=1, command=duh, pending=true} 03:26:58,84 PM [main] [DEBUG] RaftStorageCompleter - test: 1 completion(s) pending 03:26:58,84 PM [main] [DEBUG] RaftStorageCompleter - test: running 1 completion(s) 03:26:58,84 PM [main] [DEBUG] ReplicatedLogImpl - leader-261: persist complete JournaledLogEntry{index=4, term=1, command=duh, pending=true} 03:26:58,84 PM [main] [INFO] SnapshotManager - leader-261: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=3, lastAppliedTerm=-1, lastIndex=4, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 03:26:58,84 PM [main] [DEBUG] SnapshotManager - leader-261: captured snapshot at lastSequenceNumber: 0 03:26:58,84 PM [main] [INFO] SnapshotManager - leader-261: Persising snapshot at EntryInfo[index=3, term=-1]/EntryInfo[index=4, term=1] 03:26:58,84 PM [main] [INFO] MockRaftActor - leader-261: support() called 03:26:58,85 PM [main] [INFO] SnapshotManager - leader-261: Removed in-memory snapshotted entries, adjusted snapshotIndex: 3 and term: -1 03:26:58,85 PM [main] [DEBUG] AbstractLeader - leader-261 (Leader): Replicate message: identifier: MockIdentifier{value=x}, logIndex: 4, isSendImmediate: true 03:26:58,85 PM [main] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 03:26:58,85 PM [main] [DEBUG] AbstractLeader - leader-261 (Leader): Checking sendAppendEntries for follower member1: active: false, followerNextIndex: 3, leaderLastIndex: 4, leaderSnapShotIndex: 3 [WARN] [07/03/2025 15:26:58.085] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/leader-261/address] received dead letter from TestActor[pekko://test/user/leader-261]: AppendEntries{term=1, leaderId=leader-261, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=3, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 03:26:58,85 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader-261] 03:26:58,96 PM [main] [DEBUG] PekkoRaftStorage - leader-261: terminating thread VirtualThread[#687,leader-261-writer-116]/waiting 03:26:58,96 PM [leader-261-writer-116] [DEBUG] JournalWriteTask - leader-261: received 1 commands after 17.18 ms 03:26:58,96 PM [leader-261-writer-116] [DEBUG] JournalWriteTask - leader-261: completed 1 commands in 50.38 μs 03:26:58,96 PM [leader-261-writer-116] [DEBUG] JournalWriteTask - leader-261: journal writer stopped 03:26:58,96 PM [main] [DEBUG] EntryJournalV1 - leader-261: journal closed 03:26:58,96 PM [main] [INFO] PekkoRaftStorage - leader-261: journal closed 03:26:58,96 PM [main] [DEBUG] RaftStorage - leader-261: stopped executor with 0 remaining tasks 03:26:58,96 PM [main] [DEBUG] RaftStorage - leader-261: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:26:58.099] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/notifier-262]: org.opendaylight.controller.cluster.common.actor.Monitor@6079264e 03:26:58,100 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - notifier-262: Starting recovery with journal batch size 1000 03:26:58,100 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - notifier-262: started executor 03:26:58,100 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - notifier-262: started executor 03:26:58,101 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - notifier-262: metadata journal open: replayFrom=1 applyTo=0 03:26:58,102 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - notifier-262: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:58,102 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - notifier-262: journal open: applyTo=0 03:26:58,102 PM [notifier-262-writer-117] [DEBUG] JournalWriteTask - notifier-262: journal writer started 03:26:58,102 PM [notifier-262-writer-117] [DEBUG] JournalWriteTask - notifier-262: waiting to receive commands 03:26:58,103 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest8502167247626954082/notifier-262/TermInfo.properties does not exist 03:26:58,103 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - notifier-262: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:58,106 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - notifier-262: Set currentTerm=0, votedFor=null 03:26:58,106 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - notifier-262: Local TermInfo store seeded with TermInfo{term=0} 03:26:58,106 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - notifier-262: Pekko recovery completed 03:26:58,106 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - notifier-262: no journal: skipping journal recovery 03:26:58,107 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 03:26:58,107 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - notifier-262 (Follower): Received TimeoutNow - switching to Candidate 03:26:58,107 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-262 (Candidate): Election: Candidate has following voting peers: [] 03:26:58,109 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - notifier-262: Set currentTerm=1, votedFor=notifier-262 03:26:58,109 PM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - notifier-262 (Candidate): Starting new election term 1 03:26:58,109 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - notifier-262 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:26:58,109 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - notifier-262 (Candidate): Received ElectionTimeout 03:26:58,109 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - notifier-262 (Leader): Election: Leader has following peers: [] 03:26:58,109 PM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - notifier-262 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 [WARN] [07/03/2025 15:26:58.153] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/notifier-262] unhandled message from TestActor[pekko://test/user/notifier-262]: org.opendaylight.controller.cluster.raft.base.messages.TimeoutNow@113e13f9 03:26:58,709 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$e#723623273] 03:26:58,720 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/notifier-262] 03:26:58,720 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PekkoRaftStorage - notifier-262: terminating thread VirtualThread[#688,notifier-262-writer-117]/waiting 03:26:58,721 PM [notifier-262-writer-117] [DEBUG] JournalWriteTask - notifier-262: received 1 commands after 618.8 ms 03:26:58,721 PM [notifier-262-writer-117] [DEBUG] JournalWriteTask - notifier-262: completed 1 commands in 40.27 μs 03:26:58,721 PM [notifier-262-writer-117] [DEBUG] JournalWriteTask - notifier-262: journal writer stopped 03:26:58,721 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] EntryJournalV1 - notifier-262: journal closed 03:26:58,721 PM [test-pekko.actor.default-dispatcher-4] [INFO] PekkoRaftStorage - notifier-262: journal closed 03:26:58,721 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - notifier-262: stopped executor with 0 remaining tasks 03:26:58,721 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - notifier-262: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:26:58.724] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower-263]: org.opendaylight.controller.cluster.common.actor.Monitor@1540757 03:26:58,725 PM [main] [INFO] RaftActor - follower-263: Starting recovery with journal batch size 1000 03:26:58,725 PM [main] [DEBUG] RaftStorage - follower-263: started executor 03:26:58,725 PM [main] [DEBUG] RaftStorage - follower-263: started executor 03:26:58,726 PM [main] [DEBUG] EntryJournalV1 - follower-263: metadata journal open: replayFrom=1 applyTo=0 03:26:58,727 PM [main] [DEBUG] EntryJournalV1 - follower-263: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:58,727 PM [main] [INFO] PekkoRaftStorage - follower-263: journal open: applyTo=0 03:26:58,727 PM [follower-263-writer-118] [DEBUG] JournalWriteTask - follower-263: journal writer started 03:26:58,727 PM [follower-263-writer-118] [DEBUG] JournalWriteTask - follower-263: waiting to receive commands 03:26:58,729 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest762024797657906910/follower-263/TermInfo.properties does not exist 03:26:58,729 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - follower-263: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:58,732 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower-263: Set currentTerm=0, votedFor=null 03:26:58,732 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - follower-263: Local TermInfo store seeded with TermInfo{term=0} 03:26:58,732 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower-263: Pekko recovery completed 03:26:58,732 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower-263: no journal: skipping journal recovery 03:26:58,733 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower-263] 03:26:58,744 PM [main] [DEBUG] PekkoRaftStorage - follower-263: terminating thread VirtualThread[#689,follower-263-writer-118]/waiting 03:26:58,744 PM [follower-263-writer-118] [DEBUG] JournalWriteTask - follower-263: received 1 commands after 16.68 ms 03:26:58,744 PM [follower-263-writer-118] [DEBUG] JournalWriteTask - follower-263: completed 1 commands in 34.09 μs 03:26:58,744 PM [follower-263-writer-118] [DEBUG] JournalWriteTask - follower-263: journal writer stopped 03:26:58,744 PM [main] [DEBUG] EntryJournalV1 - follower-263: journal closed 03:26:58,744 PM [main] [INFO] PekkoRaftStorage - follower-263: journal closed 03:26:58,744 PM [main] [DEBUG] RaftStorage - follower-263: stopped executor with 0 remaining tasks 03:26:58,744 PM [main] [DEBUG] RaftStorage - follower-263: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:26:58.747] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader-264]: org.opendaylight.controller.cluster.common.actor.Monitor@4090bfdf 03:26:58,748 PM [main] [INFO] RaftActor - leader-264: Starting recovery with journal batch size 1000 03:26:58,748 PM [main] [DEBUG] RaftStorage - leader-264: started executor 03:26:58,748 PM [main] [DEBUG] RaftStorage - leader-264: started executor 03:26:58,749 PM [main] [DEBUG] EntryJournalV1 - leader-264: metadata journal open: replayFrom=1 applyTo=0 03:26:58,750 PM [main] [DEBUG] EntryJournalV1 - leader-264: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:58,750 PM [main] [INFO] PekkoRaftStorage - leader-264: journal open: applyTo=0 03:26:58,750 PM [leader-264-writer-119] [DEBUG] JournalWriteTask - leader-264: journal writer started 03:26:58,750 PM [leader-264-writer-119] [DEBUG] JournalWriteTask - leader-264: waiting to receive commands 03:26:58,750 PM [main] [DEBUG] AbstractReplicatedLog - leader-264: Moving last applied index from -1 to 3 03:26:58,750 PM [main] [DEBUG] PropertiesTermInfoStore - leader-264: Set currentTerm=1, votedFor=leader-264 03:26:58,751 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest13843094105907243682/leader-264/TermInfo.properties does not exist 03:26:58,751 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader-264: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:58,753 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader-264: Set currentTerm=1, votedFor=leader-264 03:26:58,753 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader-264: Local TermInfo store seeded with TermInfo{term=1, votedFor=leader-264} 03:26:58,753 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader-264: Pekko recovery completed 03:26:58,753 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader-264: no journal: skipping journal recovery 03:26:58,754 PM [main] [DEBUG] AbstractLeader - leader-264 (Leader): Election: Leader has following peers: [member1] 03:26:58,754 PM [main] [DEBUG] AbstractLeader - leader-264 (Leader): Checking sendAppendEntries for follower member1: active: false, followerNextIndex: -1, leaderLastIndex: 3, leaderSnapShotIndex: -1 [WARN] [07/03/2025 15:26:58.754] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/leader-264/address] received dead letter from TestActor[pekko://test/user/leader-264]: AppendEntries{term=1, leaderId=leader-264, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]} 03:26:58,755 PM [main] [INFO] SnapshotManager - leader-264: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=3, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=4, mandatoryTrim=false] to install on member1 03:26:58,755 PM [main] [DEBUG] SnapshotManager - leader-264: last applied journal index prior to capture: 0 03:26:58,755 PM [main] [DEBUG] RaftStorageCompleter - test: 1 completion(s) pending 03:26:58,755 PM [main] [DEBUG] RaftStorageCompleter - test: running 1 completion(s) 03:26:58,755 PM [main] [INFO] SnapshotManager - leader-264: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=3, term=1] 03:26:58,755 PM [main] [INFO] SnapshotManager - leader-264: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1 03:26:58,755 PM [main] [DEBUG] AbstractLeader - leader-264 (Leader): sendInstallSnapshot 03:26:58,755 PM [main] [DEBUG] LeaderInstallSnapshotState - leader-264 (Leader): Snapshot 14 bytes, total chunks to send: 1 03:26:58,755 PM [main] [DEBUG] LeaderInstallSnapshotState - leader-264 (Leader): Next chunk: total length=14, offset=0, size=14, hashCode=-804174656 03:26:58,755 PM [main] [DEBUG] AbstractLeader - leader-264 (Leader): next snapshot chunk size for follower member1: 14 03:26:58,755 PM [main] [DEBUG] AbstractLeader - leader-264 (Leader): InstallSnapshot sent to follower Vector(address), Chunk: 1/1 03:26:58,755 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader-264] [WARN] [07/03/2025 15:26:58.755] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/leader-264/address] received dead letter from TestActor[pekko://test/user/leader-264]: InstallSnapshot{term=1, leaderId=leader-264, lastIncludedIndex=-1, lastIncludedTerm=-1, datasize=14, chunk=1/1, lastChunkHashCode=OptionalInt[-1]} 03:26:58,766 PM [main] [DEBUG] PekkoRaftStorage - leader-264: terminating thread VirtualThread[#690,leader-264-writer-119]/waiting 03:26:58,766 PM [leader-264-writer-119] [DEBUG] JournalWriteTask - leader-264: received 1 commands after 16.27 ms 03:26:58,766 PM [leader-264-writer-119] [DEBUG] JournalWriteTask - leader-264: completed 1 commands in 32.48 μs 03:26:58,766 PM [leader-264-writer-119] [DEBUG] JournalWriteTask - leader-264: journal writer stopped 03:26:58,766 PM [main] [DEBUG] EntryJournalV1 - leader-264: journal closed 03:26:58,766 PM [main] [INFO] PekkoRaftStorage - leader-264: journal closed 03:26:58,766 PM [main] [DEBUG] RaftStorage - leader-264: stopped executor with 0 remaining tasks 03:26:58,766 PM [main] [DEBUG] RaftStorage - leader-264: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:26:58.771] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader-265]: org.opendaylight.controller.cluster.common.actor.Monitor@30e66812 03:26:58,771 PM [main] [INFO] RaftActor - leader-265: Starting recovery with journal batch size 1000 03:26:58,771 PM [main] [DEBUG] RaftStorage - leader-265: started executor 03:26:58,771 PM [main] [DEBUG] RaftStorage - leader-265: started executor 03:26:58,772 PM [main] [DEBUG] EntryJournalV1 - leader-265: metadata journal open: replayFrom=1 applyTo=0 03:26:58,772 PM [main] [DEBUG] EntryJournalV1 - leader-265: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:58,772 PM [main] [INFO] PekkoRaftStorage - leader-265: journal open: applyTo=0 03:26:58,772 PM [leader-265-writer-120] [DEBUG] JournalWriteTask - leader-265: journal writer started 03:26:58,772 PM [leader-265-writer-120] [DEBUG] JournalWriteTask - leader-265: waiting to receive commands 03:26:58,773 PM [main] [DEBUG] AbstractReplicatedLog - leader-265: Moving last applied index from -1 to 9 03:26:58,773 PM [main] [DEBUG] PropertiesTermInfoStore - leader-265: Set currentTerm=1, votedFor=leader-265 03:26:58,776 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest6502058343726733877/leader-265/TermInfo.properties does not exist 03:26:58,776 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader-265: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:58,779 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader-265: Set currentTerm=1, votedFor=leader-265 03:26:58,779 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader-265: Local TermInfo store seeded with TermInfo{term=1, votedFor=leader-265} 03:26:58,779 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader-265: Pekko recovery completed 03:26:58,779 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader-265: no journal: skipping journal recovery 03:26:58,780 PM [main] [DEBUG] AbstractLeader - leader-265 (Leader): Election: Leader has following peers: [follower-266, follower-267] 03:26:58,780 PM [main] [DEBUG] AbstractLeader - leader-265 (Leader): Checking sendAppendEntries for follower follower-266: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 03:26:58,780 PM [main] [DEBUG] AbstractLeader - leader-265 (Leader): Checking sendAppendEntries for follower follower-267: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 03:26:58,780 PM [main] [DEBUG] AbstractLeader - leader-265 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower-266 updated: matchIndex: 9, nextIndex: 10 03:26:58,780 PM [main] [DEBUG] AbstractLeader - leader-265 (Leader): Checking sendAppendEntries for follower follower-266: active: true, followerNextIndex: 10, leaderLastIndex: 9, leaderSnapShotIndex: 4 03:26:58,781 PM [main] [DEBUG] AbstractLeader - leader-265 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower-267 updated: matchIndex: 0, nextIndex: 1 03:26:58,781 PM [main] [DEBUG] AbstractLeader - leader-265 (Leader): Checking sendAppendEntries for follower follower-267: active: true, followerNextIndex: 1, leaderLastIndex: 9, leaderSnapShotIndex: 4 03:26:58,781 PM [main] [INFO] AbstractLeader - leader-265 (Leader): Initiating install snapshot to follower follower-267: follower nextIndex: 1, leader snapshotIndex: 4, leader lastIndex: 9, leader log size: 5 03:26:58,781 PM [main] [INFO] SnapshotManager - leader-265: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=4, lastAppliedTerm=-1, lastIndex=9, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=9, replicatedToAllTerm=1, unAppliedEntries size=5, mandatoryTrim=false] to install on follower-267 03:26:58,781 PM [main] [DEBUG] SnapshotManager - leader-265: last applied journal index prior to capture: -5 03:26:58,781 PM [main] [INFO] MockRaftActor - leader-265: support() called 03:26:58,781 PM [main] [DEBUG] RaftStorageCompleter - test: 1 completion(s) pending 03:26:58,782 PM [main] [DEBUG] AbstractLeader - leader-265 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower-267 updated: matchIndex: 9, nextIndex: 10 03:26:58,782 PM [main] [DEBUG] RaftStorageCompleter - test: running 1 completion(s) 03:26:58,782 PM [main] [INFO] SnapshotManager - leader-265: Persising snapshot at EntryInfo[index=4, term=-1]/EntryInfo[index=9, term=1] 03:26:58,782 PM [main] [INFO] MockRaftActor - leader-265: support() called 03:26:58,782 PM [main] [INFO] SnapshotManager - leader-265: Removed in-memory snapshotted entries, adjusted snapshotIndex: 9 and term: 1 03:26:58,782 PM [main] [DEBUG] AbstractLeader - leader-265 (Leader): sendInstallSnapshot 03:26:58,783 PM [main] [DEBUG] LeaderInstallSnapshotState - leader-265 (Leader): Snapshot 351 bytes, total chunks to send: 1 03:26:58,783 PM [main] [DEBUG] LeaderInstallSnapshotState - leader-265 (Leader): Next chunk: total length=351, offset=0, size=351, hashCode=1011228180 03:26:58,783 PM [main] [DEBUG] AbstractLeader - leader-265 (Leader): next snapshot chunk size for follower follower-267: 351 03:26:58,783 PM [main] [DEBUG] AbstractLeader - leader-265 (Leader): InstallSnapshot sent to follower Vector(user, follower-267), Chunk: 1/1 03:26:58,783 PM [main] [DEBUG] AbstractLeader - leader-265 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower-267 updated: matchIndex: 5, nextIndex: 6 03:26:58,783 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower-266#-1542358655] 03:26:58,794 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/follower-267#-1500834259] 03:26:58,794 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader-265] 03:26:58,794 PM [main] [DEBUG] PekkoRaftStorage - leader-265: terminating thread VirtualThread[#691,leader-265-writer-120]/waiting 03:26:58,794 PM [leader-265-writer-120] [DEBUG] JournalWriteTask - leader-265: received 1 commands after 21.48 ms 03:26:58,794 PM [leader-265-writer-120] [DEBUG] JournalWriteTask - leader-265: completed 1 commands in 22.66 μs 03:26:58,794 PM [leader-265-writer-120] [DEBUG] JournalWriteTask - leader-265: journal writer stopped 03:26:58,794 PM [main] [DEBUG] EntryJournalV1 - leader-265: journal closed 03:26:58,794 PM [main] [INFO] PekkoRaftStorage - leader-265: journal closed 03:26:58,794 PM [main] [DEBUG] RaftStorage - leader-265: stopped executor with 0 remaining tasks 03:26:58,794 PM [main] [DEBUG] RaftStorage - leader-265: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:26:58.797] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower-268]: org.opendaylight.controller.cluster.common.actor.Monitor@25b3edcd 03:26:58,798 PM [main] [INFO] RaftActor - follower-268: Starting recovery with journal batch size 1000 03:26:58,798 PM [main] [DEBUG] RaftStorage - follower-268: started executor 03:26:58,798 PM [main] [DEBUG] RaftStorage - follower-268: started executor 03:26:58,798 PM [main] [DEBUG] EntryJournalV1 - follower-268: metadata journal open: replayFrom=1 applyTo=0 03:26:58,799 PM [main] [DEBUG] EntryJournalV1 - follower-268: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:58,799 PM [main] [INFO] PekkoRaftStorage - follower-268: journal open: applyTo=0 03:26:58,799 PM [follower-268-writer-121] [DEBUG] JournalWriteTask - follower-268: journal writer started 03:26:58,799 PM [follower-268-writer-121] [DEBUG] JournalWriteTask - follower-268: waiting to receive commands 03:26:58,800 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest15576662923758476315/follower-268/TermInfo.properties does not exist 03:26:58,800 PM [test-pekko.actor.default-dispatcher-4] [INFO] PekkoRecovery - follower-268: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:58,803 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - follower-268: Set currentTerm=0, votedFor=null 03:26:58,803 PM [test-pekko.actor.default-dispatcher-4] [INFO] PekkoRecovery - follower-268: Local TermInfo store seeded with TermInfo{term=0} 03:26:58,803 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - follower-268: Pekko recovery completed 03:26:58,803 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - follower-268: no journal: skipping journal recovery 03:26:58,803 PM [main] [DEBUG] RaftActor - follower-268: RaftPolicy used with prev.config null, RaftPolicy used with newConfig null 03:26:58,803 PM [main] [DEBUG] RaftActor - follower-268: RaftPolicy used with prev.config null, RaftPolicy used with newConfig org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 03:26:58,803 PM [main] [DEBUG] RaftActor - follower-268: Re-initializing to Follower with previous leaderId null 03:26:58,803 PM [main] [DEBUG] RaftActor - follower-268: RaftPolicy used with prev.config org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy, RaftPolicy used with newConfig org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 03:26:58,804 PM [main] [DEBUG] RaftActor - follower-268: RaftPolicy used with prev.config org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy, RaftPolicy used with newConfig org.opendaylight.controller.cluster.raft.policy.DefaultRaftPolicy 03:26:58,804 PM [main] [DEBUG] RaftActor - follower-268: Re-initializing to Follower with previous leaderId null 03:26:58,804 PM [main] [DEBUG] RaftActor - follower-268: RaftPolicy used with prev.config org.opendaylight.controller.cluster.raft.policy.DefaultRaftPolicy, RaftPolicy used with newConfig org.opendaylight.controller.cluster.raft.policy.DefaultRaftPolicy 03:26:58,804 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower-268] 03:26:58,814 PM [main] [DEBUG] PekkoRaftStorage - follower-268: terminating thread VirtualThread[#692,follower-268-writer-121]/waiting 03:26:58,814 PM [follower-268-writer-121] [DEBUG] JournalWriteTask - follower-268: received 1 commands after 15.68 ms 03:26:58,815 PM [follower-268-writer-121] [DEBUG] JournalWriteTask - follower-268: completed 1 commands in 39.23 μs 03:26:58,815 PM [follower-268-writer-121] [DEBUG] JournalWriteTask - follower-268: journal writer stopped 03:26:58,815 PM [main] [DEBUG] EntryJournalV1 - follower-268: journal closed 03:26:58,815 PM [main] [INFO] PekkoRaftStorage - follower-268: journal closed 03:26:58,815 PM [main] [DEBUG] RaftStorage - follower-268: stopped executor with 0 remaining tasks 03:26:58,815 PM [main] [DEBUG] RaftStorage - follower-268: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:26:58.895] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/$$b]: org.opendaylight.controller.cluster.common.actor.Monitor@7a13a7d5 03:26:58,896 PM [main] [INFO] RaftActor - leader-269: Starting recovery with journal batch size 1000 03:26:58,896 PM [main] [DEBUG] RaftStorage - leader-269: started executor 03:26:58,896 PM [main] [DEBUG] RaftStorage - leader-269: started executor 03:26:58,897 PM [main] [DEBUG] EntryJournalV1 - leader-269: metadata journal open: replayFrom=1 applyTo=0 03:26:58,898 PM [main] [DEBUG] EntryJournalV1 - leader-269: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:58,898 PM [main] [INFO] PekkoRaftStorage - leader-269: journal open: applyTo=0 03:26:58,898 PM [leader-269-writer-122] [DEBUG] JournalWriteTask - leader-269: journal writer started 03:26:58,898 PM [leader-269-writer-122] [DEBUG] JournalWriteTask - leader-269: waiting to receive commands 03:26:58,899 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest14789709696787641002/leader-269/TermInfo.properties does not exist 03:26:58,900 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader-269: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest14789709696787641002/leader-269/journal-v1-1.log 03:26:58,900 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader-269: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest14789709696787641002/leader-269/metadata-v1-1.log 03:26:58,900 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader-269: no eligible files found 03:26:58,900 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader-269: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:58,903 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader-269: Set currentTerm=0, votedFor=null 03:26:58,903 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader-269: Local TermInfo store seeded with TermInfo{term=0} 03:26:58,903 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader-269: Pekko recovery completed 03:26:58,903 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader-269: starting journal recovery 03:26:58,903 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - leader-269: Moving last applied index from -1 to -1 03:26:58,903 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - leader-269: empty journal: appending 0 entries 03:26:58,903 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader-269: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:26:58,903 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - leader-269: journal recovery completedin 240.7 μs with journalIndex=1 03:26:58,904 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 03:26:58,904 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - leader-269 (Follower): Received TimeoutNow - switching to Candidate 03:26:58,904 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader-269 (Candidate): Election: Candidate has following voting peers: [] 03:26:58,906 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader-269: Set currentTerm=1, votedFor=leader-269 03:26:58,906 PM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - leader-269 (Candidate): Starting new election term 1 03:26:58,906 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader-269 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:26:58,906 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader-269 (Candidate): Received ElectionTimeout 03:26:58,907 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader-269 (Leader): Election: Leader has following peers: [] 03:26:58,907 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader-269 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:26:58,907 PM [main] [DEBUG] RaftActor - leader-269: ignoring SaveSnapshotSuccess(SnapshotMetadata(, 0, 0, None)) 03:26:58,909 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/$$b] 03:26:58,910 PM [main] [DEBUG] PekkoRaftStorage - leader-269: terminating thread VirtualThread[#693,leader-269-writer-122]/waiting 03:26:58,910 PM [leader-269-writer-122] [DEBUG] JournalWriteTask - leader-269: received 1 commands after 12.26 ms 03:26:58,910 PM [leader-269-writer-122] [DEBUG] JournalWriteTask - leader-269: completed 1 commands in 24.17 μs 03:26:58,910 PM [leader-269-writer-122] [DEBUG] JournalWriteTask - leader-269: journal writer stopped 03:26:58,910 PM [main] [DEBUG] EntryJournalV1 - leader-269: journal closed 03:26:58,910 PM [main] [INFO] PekkoRaftStorage - leader-269: journal closed 03:26:58,910 PM [main] [DEBUG] RaftStorage - leader-269: stopped executor with 0 remaining tasks 03:26:58,911 PM [main] [DEBUG] RaftStorage - leader-269: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:26:58.913] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader-270]: org.opendaylight.controller.cluster.common.actor.Monitor@521c32b7 03:26:58,914 PM [main] [INFO] RaftActor - leader-270: Starting recovery with journal batch size 1000 03:26:58,914 PM [main] [DEBUG] RaftStorage - leader-270: started executor 03:26:58,914 PM [main] [DEBUG] RaftStorage - leader-270: started executor 03:26:58,915 PM [main] [DEBUG] EntryJournalV1 - leader-270: metadata journal open: replayFrom=1 applyTo=0 03:26:58,915 PM [main] [DEBUG] EntryJournalV1 - leader-270: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:58,915 PM [main] [INFO] PekkoRaftStorage - leader-270: journal open: applyTo=0 03:26:58,915 PM [leader-270-writer-123] [DEBUG] JournalWriteTask - leader-270: journal writer started 03:26:58,915 PM [leader-270-writer-123] [DEBUG] JournalWriteTask - leader-270: waiting to receive commands 03:26:58,916 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest14203894724955008969/leader-270/TermInfo.properties does not exist 03:26:58,916 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader-270: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest14203894724955008969/leader-270/journal-v1-1.log 03:26:58,916 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader-270: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest14203894724955008969/leader-270/metadata-v1-1.log 03:26:58,916 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - leader-270: no eligible files found 03:26:58,916 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader-270: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:58,919 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader-270: Set currentTerm=0, votedFor=null 03:26:58,919 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader-270: Local TermInfo store seeded with TermInfo{term=0} 03:26:58,919 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader-270: Pekko recovery completed 03:26:58,919 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader-270: starting journal recovery 03:26:58,919 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractReplicatedLog - leader-270: Moving last applied index from -1 to -1 03:26:58,919 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - leader-270: empty journal: appending 0 entries 03:26:58,919 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - leader-270: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:26:58,919 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] JournalRecovery - leader-270: journal recovery completedin 229.0 μs with journalIndex=1 03:26:58,919 PM [main] [DEBUG] PropertiesTermInfoStore - leader-270: Set currentTerm=1, votedFor=leader-270 03:26:58,920 PM [main] [DEBUG] AbstractLeader - leader-270 (Leader): Election: Leader has following peers: [follower-271] 03:26:58,920 PM [main] [DEBUG] AbstractLeader - leader-270 (Leader): Checking sendAppendEntries for follower follower-271: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 03:26:58,920 PM [main] [DEBUG] AbstractLeader - leader-270 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower-271 updated: matchIndex: -1, nextIndex: 0 03:26:58,920 PM [main] [DEBUG] AbstractLeader - leader-270 (Leader): Checking sendAppendEntries for follower follower-271: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 03:26:58,920 PM [main] [DEBUG] RaftActor - leader-270: Persist data index=0 term=1 command=1 03:26:58,920 PM [main] [DEBUG] ReplicatedLogImpl - leader-270: Append log entry and persist JournaledLogEntry{index=0, term=1, command=1, pending=true} 03:26:58,920 PM [main] [DEBUG] AbstractLeader - leader-270 (Leader): Replicate message: identifier: MockIdentifier{value=1}, logIndex: 0, isSendImmediate: false 03:26:58,920 PM [main] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 03:26:58,920 PM [leader-270-writer-123] [DEBUG] JournalWriteTask - leader-270: received 1 commands after 5.332 ms 03:26:58,923 PM [leader-270-writer-123] [DEBUG] RaftStorageCompleter - leader-270: 1 completion(s) pending 03:26:58,923 PM [leader-270-writer-123] [DEBUG] RaftStorageCompleter - leader-270: running 1 completion(s) 03:26:58,923 PM [leader-270-writer-123] [DEBUG] ReplicatedLogImpl - leader-270: persist complete JournaledLogEntry{index=0, term=1, command=1, pending=true} 03:26:58,923 PM [leader-270-writer-123] [DEBUG] RaftStorageCompleter - leader-270: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=0, term=1, command=1, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c0884270@777bed9a} 03:26:58,923 PM [leader-270-writer-123] [DEBUG] JournalWriteTask - leader-270: completed 1 commands in 2.795 ms 03:26:58,923 PM [leader-270-writer-123] [DEBUG] JournalWriteTask - leader-270: waiting to receive commands 03:26:59,423 PM [main] [DEBUG] RaftActor - leader-270: Persist data index=1 term=1 command=2 03:26:59,423 PM [main] [DEBUG] ReplicatedLogImpl - leader-270: Append log entry and persist JournaledLogEntry{index=1, term=1, command=2, pending=true} 03:26:59,423 PM [main] [DEBUG] AbstractLeader - leader-270 (Leader): Replicate message: identifier: MockIdentifier{value=2}, logIndex: 1, isSendImmediate: false 03:26:59,423 PM [leader-270-writer-123] [DEBUG] JournalWriteTask - leader-270: received 1 commands after 499.9 ms 03:26:59,425 PM [leader-270-writer-123] [DEBUG] RaftStorageCompleter - leader-270: 1 completion(s) pending 03:26:59,425 PM [leader-270-writer-123] [DEBUG] RaftStorageCompleter - leader-270: running 1 completion(s) 03:26:59,425 PM [leader-270-writer-123] [DEBUG] ReplicatedLogImpl - leader-270: persist complete JournaledLogEntry{index=1, term=1, command=2, pending=true} 03:26:59,425 PM [leader-270-writer-123] [DEBUG] RaftStorageCompleter - leader-270: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=1, term=1, command=2, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c0884270@77ee2d24} 03:26:59,425 PM [leader-270-writer-123] [DEBUG] JournalWriteTask - leader-270: completed 1 commands in 1.589 ms 03:26:59,425 PM [leader-270-writer-123] [DEBUG] JournalWriteTask - leader-270: waiting to receive commands 03:26:59,925 PM [main] [DEBUG] RaftActor - leader-270: Persist data index=2 term=1 command=3 03:26:59,925 PM [main] [DEBUG] ReplicatedLogImpl - leader-270: Append log entry and persist JournaledLogEntry{index=2, term=1, command=3, pending=true} 03:26:59,926 PM [main] [DEBUG] AbstractLeader - leader-270 (Leader): Replicate message: identifier: MockIdentifier{value=3}, logIndex: 2, isSendImmediate: true 03:26:59,926 PM [main] [DEBUG] AbstractLeader - leader-270 (Leader): Checking sendAppendEntries for follower follower-271: active: true, followerNextIndex: 0, leaderLastIndex: 2, leaderSnapShotIndex: -1 03:26:59,926 PM [main] [DEBUG] AbstractLeader - leader-270 (Leader): sendAppendEntries: 0 is present for follower follower-271 03:26:59,926 PM [main] [DEBUG] AbstractLeader - leader-270 (Leader): Sending AppendEntries to follower follower-271: AppendEntries{term=1, leaderId=leader-270, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=1, pending=false}, JournaledLogEntry{index=1, term=1, command=2, pending=false}, JournaledLogEntry{index=2, term=1, command=3, pending=true}]} 03:26:59,926 PM [leader-270-writer-123] [DEBUG] JournalWriteTask - leader-270: received 1 commands after 500.7 ms 03:26:59,926 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$f#1565211690] 03:26:59,927 PM [leader-270-writer-123] [DEBUG] RaftStorageCompleter - leader-270: 1 completion(s) pending 03:26:59,928 PM [leader-270-writer-123] [DEBUG] RaftStorageCompleter - leader-270: running 1 completion(s) 03:26:59,928 PM [leader-270-writer-123] [DEBUG] ReplicatedLogImpl - leader-270: persist complete JournaledLogEntry{index=2, term=1, command=3, pending=true} 03:26:59,928 PM [leader-270-writer-123] [DEBUG] RaftStorageCompleter - leader-270: completed synchronized callback AppendSubmittedCallback{entry=JournaledLogEntry{index=2, term=1, command=3, pending=false}, callback=org.opendaylight.controller.cluster.raft.RaftActor$$Lambda/0x00000007c0884270@2e3b15c0} 03:26:59,928 PM [leader-270-writer-123] [DEBUG] JournalWriteTask - leader-270: completed 1 commands in 1.847 ms 03:26:59,928 PM [leader-270-writer-123] [DEBUG] JournalWriteTask - leader-270: waiting to receive commands 03:26:59,937 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader-270] 03:26:59,937 PM [main] [DEBUG] PekkoRaftStorage - leader-270: terminating thread VirtualThread[#694,leader-270-writer-123]/waiting 03:26:59,937 PM [leader-270-writer-123] [DEBUG] JournalWriteTask - leader-270: received 1 commands after 9.699 ms 03:26:59,938 PM [leader-270-writer-123] [DEBUG] JournalWriteTask - leader-270: completed 1 commands in 22.48 μs 03:26:59,938 PM [leader-270-writer-123] [DEBUG] JournalWriteTask - leader-270: journal writer stopped 03:26:59,938 PM [main] [DEBUG] EntryJournalV1 - leader-270: journal closed 03:26:59,938 PM [main] [INFO] PekkoRaftStorage - leader-270: journal closed 03:26:59,938 PM [main] [DEBUG] RaftStorage - leader-270: stopped executor with 0 remaining tasks 03:26:59,938 PM [main] [DEBUG] RaftStorage - leader-270: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:26:59.943] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader-272]: org.opendaylight.controller.cluster.common.actor.Monitor@59c79095 03:26:59,944 PM [main] [INFO] RaftActor - leader-272: Starting recovery with journal batch size 1000 03:26:59,944 PM [main] [DEBUG] RaftStorage - leader-272: started executor 03:26:59,944 PM [main] [DEBUG] RaftStorage - leader-272: started executor 03:26:59,945 PM [main] [DEBUG] EntryJournalV1 - leader-272: metadata journal open: replayFrom=1 applyTo=0 03:26:59,945 PM [main] [DEBUG] EntryJournalV1 - leader-272: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:26:59,945 PM [main] [INFO] PekkoRaftStorage - leader-272: journal open: applyTo=0 03:26:59,946 PM [leader-272-writer-124] [DEBUG] JournalWriteTask - leader-272: journal writer started 03:26:59,946 PM [leader-272-writer-124] [DEBUG] JournalWriteTask - leader-272: waiting to receive commands 03:26:59,947 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest8889082057950229706/leader-272/TermInfo.properties does not exist 03:26:59,947 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - leader-272: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest8889082057950229706/leader-272/journal-v1-1.log 03:26:59,947 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - leader-272: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest8889082057950229706/leader-272/metadata-v1-1.log 03:26:59,947 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - leader-272: no eligible files found 03:26:59,947 PM [test-pekko.actor.default-dispatcher-4] [INFO] PekkoRecovery - leader-272: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:26:59,950 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - leader-272: Set currentTerm=0, votedFor=null 03:26:59,950 PM [test-pekko.actor.default-dispatcher-4] [INFO] PekkoRecovery - leader-272: Local TermInfo store seeded with TermInfo{term=0} 03:26:59,950 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - leader-272: Pekko recovery completed 03:26:59,950 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - leader-272: starting journal recovery 03:26:59,950 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractReplicatedLog - leader-272: Moving last applied index from -1 to -1 03:26:59,950 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] JournalRecovery - leader-272: empty journal: appending 0 entries 03:26:59,950 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] EntryJournalV1 - leader-272: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:26:59,950 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] JournalRecovery - leader-272: journal recovery completedin 156.0 μs with journalIndex=1 03:26:59,951 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 03:26:59,951 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Follower - leader-272 (Follower): Received TimeoutNow - switching to Candidate 03:26:59,951 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - leader-272 (Candidate): Election: Candidate has following voting peers: [] 03:26:59,954 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - leader-272: Set currentTerm=1, votedFor=leader-272 03:26:59,954 PM [test-pekko.actor.default-dispatcher-4] [INFO] Candidate - leader-272 (Candidate): Starting new election term 1 03:26:59,954 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorBehavior - leader-272 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:26:59,954 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] Candidate - leader-272 (Candidate): Received ElectionTimeout 03:26:59,954 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractLeader - leader-272 (Leader): Election: Leader has following peers: [] 03:26:59,954 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActorBehavior - leader-272 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:27:00,116 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader-272] 03:27:00,117 PM [main] [DEBUG] PekkoRaftStorage - leader-272: terminating thread VirtualThread[#695,leader-272-writer-124]/waiting 03:27:00,117 PM [leader-272-writer-124] [DEBUG] JournalWriteTask - leader-272: received 1 commands after 171.9 ms 03:27:00,118 PM [leader-272-writer-124] [DEBUG] JournalWriteTask - leader-272: completed 1 commands in 40.23 μs 03:27:00,118 PM [leader-272-writer-124] [DEBUG] JournalWriteTask - leader-272: journal writer stopped 03:27:00,118 PM [main] [DEBUG] EntryJournalV1 - leader-272: journal closed 03:27:00,118 PM [main] [INFO] PekkoRaftStorage - leader-272: journal closed 03:27:00,118 PM [main] [DEBUG] RaftStorage - leader-272: stopped executor with 0 remaining tasks 03:27:00,118 PM [main] [DEBUG] RaftStorage - leader-272: stopped executor with 0 remaining tasks 03:27:00,122 PM [main] [INFO] RaftActor - follower-273: Starting recovery with journal batch size 1000 [WARN] [07/03/2025 15:27:00.122] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower-273]: org.opendaylight.controller.cluster.common.actor.Monitor@160a5464 03:27:00,122 PM [main] [DEBUG] RaftStorage - follower-273: started executor 03:27:00,122 PM [main] [DEBUG] RaftStorage - follower-273: started executor 03:27:00,123 PM [main] [DEBUG] EntryJournalV1 - follower-273: metadata journal open: replayFrom=1 applyTo=0 03:27:00,123 PM [main] [DEBUG] EntryJournalV1 - follower-273: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:27:00,123 PM [main] [INFO] PekkoRaftStorage - follower-273: journal open: applyTo=0 03:27:00,123 PM [follower-273-writer-125] [DEBUG] JournalWriteTask - follower-273: journal writer started 03:27:00,123 PM [follower-273-writer-125] [DEBUG] JournalWriteTask - follower-273: waiting to receive commands 03:27:00,123 PM [main] [DEBUG] AbstractReplicatedLog - follower-273: Moving last applied index from -1 to 4 03:27:00,124 PM [main] [DEBUG] PropertiesTermInfoStore - follower-273: Set currentTerm=1, votedFor=follower-273 03:27:00,125 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest11850506116103911079/follower-273/TermInfo.properties does not exist 03:27:00,125 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - follower-273: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:27:00,128 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - follower-273: Set currentTerm=1, votedFor=follower-273 03:27:00,128 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - follower-273: Local TermInfo store seeded with TermInfo{term=1, votedFor=follower-273} 03:27:00,128 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower-273: Pekko recovery completed 03:27:00,128 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - follower-273: no journal: skipping journal recovery 03:27:00,129 PM [main] [INFO] SnapshotManager - follower-273: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=5, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=4, replicatedToAllTerm=1, unAppliedEntries size=6, mandatoryTrim=false] to install on xyzzy 03:27:00,130 PM [main] [DEBUG] SnapshotManager - follower-273: last applied journal index prior to capture: 0 03:27:00,130 PM [main] [INFO] MockRaftActor - follower-273: support() called 03:27:00,130 PM [main] [DEBUG] RaftStorageCompleter - test: 1 completion(s) pending 03:27:00,130 PM [main] [DEBUG] Follower - follower-273 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader-274, prevLogIndex=5, prevLogTerm=1, leaderCommit=5, replicatedToAllIndex=5, payloadVersion=0, recipientRaftVersion=5, leaderRaftVersion=5, entries==[DefaultLogEntry[index=6, term=1, command=foo-6]]} 03:27:00,131 PM [main] [DEBUG] Follower - follower-273 (Follower): Number of entries to be appended = 1 03:27:00,131 PM [main] [DEBUG] Follower - follower-273 (Follower): After cleanup, lastIndex: 5, entries to be added from: 0 03:27:00,131 PM [main] [DEBUG] Follower - follower-273 (Follower): Append entry to log foo-6 03:27:00,131 PM [main] [DEBUG] ReplicatedLogImpl - follower-273: Append log entry and persist DefaultLogEntry[index=6, term=1, command=foo-6] 03:27:00,131 PM [main] [DEBUG] RaftStorageCompleter - test: 1 completion(s) pending 03:27:00,131 PM [main] [DEBUG] RaftStorageCompleter - test: running 1 completion(s) 03:27:00,131 PM [main] [DEBUG] ReplicatedLogImpl - follower-273: persist complete JournaledLogEntry{index=6, term=1, command=foo-6, pending=false} 03:27:00,131 PM [main] [DEBUG] RaftStorageCompleter - test: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=6, term=1, command=foo-6, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c08828a8@6203846e} 03:27:00,131 PM [main] [DEBUG] Follower - follower-273 (Follower): Log size is now 7 03:27:00,131 PM [main] [DEBUG] Follower - follower-273 (Follower): Commit index set to 5 03:27:00,131 PM [main] [DEBUG] Follower - follower-273 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower-273, logLastIndex=6, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 03:27:00,131 PM [main] [DEBUG] SyncStatusTracker - follower-273: Last sync leader does not match current leader leader-274, need to catch up to 5 [WARN] [07/03/2025 15:27:00.131] [test-pekko.actor.default-dispatcher-4] [pekko://test/deadLetters] received dead letter from TestActor[pekko://test/user/follower-273]: AppendEntriesReply{term=1, success=true, followerId=follower-273, logLastIndex=6, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 03:27:00,131 PM [main] [DEBUG] Follower - follower-273 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 5, context.getLastApplied(): -1, lastIndex(): 6 03:27:00,131 PM [main] [DEBUG] RaftActorBehavior - follower-273 (Follower): Setting last applied to 0 [WARN] [07/03/2025 15:27:00.131] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/follower-273] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower-273, initialSyncDone=false] 03:27:00,131 PM [main] [DEBUG] AbstractReplicatedLog - follower-273: Moving last applied index from -1 to 0 03:27:00,131 PM [main] [DEBUG] RaftActor - follower-273: Applying state for log index 0 data 0 03:27:00,131 PM [main] [INFO] MockRaftActor - follower-273: applyState called: 0 03:27:00,131 PM [main] [DEBUG] RaftActorBehavior - follower-273 (Follower): Setting last applied to 1 03:27:00,131 PM [main] [DEBUG] AbstractReplicatedLog - follower-273: Moving last applied index from 0 to 1 03:27:00,131 PM [main] [DEBUG] RaftActor - follower-273: Applying state for log index 1 data 1 03:27:00,131 PM [main] [INFO] MockRaftActor - follower-273: applyState called: 1 03:27:00,131 PM [main] [DEBUG] RaftActorBehavior - follower-273 (Follower): Setting last applied to 2 03:27:00,131 PM [main] [DEBUG] AbstractReplicatedLog - follower-273: Moving last applied index from 1 to 2 03:27:00,131 PM [main] [DEBUG] RaftActor - follower-273: Applying state for log index 2 data 2 03:27:00,131 PM [main] [INFO] MockRaftActor - follower-273: applyState called: 2 03:27:00,131 PM [main] [DEBUG] RaftActorBehavior - follower-273 (Follower): Setting last applied to 3 03:27:00,131 PM [main] [DEBUG] AbstractReplicatedLog - follower-273: Moving last applied index from 2 to 3 03:27:00,131 PM [main] [DEBUG] RaftActor - follower-273: Applying state for log index 3 data 3 03:27:00,131 PM [main] [INFO] MockRaftActor - follower-273: applyState called: 3 03:27:00,131 PM [main] [DEBUG] RaftActorBehavior - follower-273 (Follower): Setting last applied to 4 03:27:00,131 PM [main] [DEBUG] AbstractReplicatedLog - follower-273: Moving last applied index from 3 to 4 03:27:00,131 PM [main] [DEBUG] RaftActor - follower-273: Applying state for log index 4 data 4 03:27:00,131 PM [main] [INFO] MockRaftActor - follower-273: applyState called: 4 03:27:00,132 PM [main] [DEBUG] RaftActorBehavior - follower-273 (Follower): Setting last applied to 5 03:27:00,132 PM [main] [DEBUG] AbstractReplicatedLog - follower-273: Moving last applied index from 4 to 5 03:27:00,132 PM [main] [DEBUG] RaftActor - follower-273: Applying state for log index 5 data 5 03:27:00,132 PM [main] [INFO] MockRaftActor - follower-273: applyState called: 5 03:27:00,132 PM [main] [DEBUG] Follower - follower-273 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader-274, prevLogIndex=6, prevLogTerm=1, leaderCommit=6, replicatedToAllIndex=6, payloadVersion=0, recipientRaftVersion=5, leaderRaftVersion=5, entries==[DefaultLogEntry[index=7, term=1, command=foo-7]]} 03:27:00,132 PM [main] [DEBUG] Follower - follower-273 (Follower): Number of entries to be appended = 1 03:27:00,132 PM [main] [DEBUG] Follower - follower-273 (Follower): After cleanup, lastIndex: 6, entries to be added from: 0 03:27:00,132 PM [main] [DEBUG] Follower - follower-273 (Follower): Append entry to log foo-7 03:27:00,132 PM [main] [DEBUG] ReplicatedLogImpl - follower-273: Append log entry and persist DefaultLogEntry[index=7, term=1, command=foo-7] 03:27:00,132 PM [main] [DEBUG] RaftStorageCompleter - test: 1 completion(s) pending 03:27:00,132 PM [main] [DEBUG] RaftStorageCompleter - test: running 1 completion(s) 03:27:00,132 PM [main] [DEBUG] ReplicatedLogImpl - follower-273: persist complete JournaledLogEntry{index=7, term=1, command=foo-7, pending=false} 03:27:00,132 PM [main] [DEBUG] RaftStorageCompleter - test: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=7, term=1, command=foo-7, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c08828a8@76fc0fa} 03:27:00,132 PM [main] [DEBUG] Follower - follower-273 (Follower): Log size is now 8 03:27:00,132 PM [main] [DEBUG] Follower - follower-273 (Follower): Commit index set to 6 03:27:00,132 PM [main] [DEBUG] Follower - follower-273 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower-273, logLastIndex=7, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 03:27:00,132 PM [main] [DEBUG] SyncStatusTracker - follower-273: Lagging 0 entries behind leader leader-274 and reached 6 (of expected 5) [WARN] [07/03/2025 15:27:00.132] [test-pekko.actor.default-dispatcher-4] [pekko://test/deadLetters] received dead letter from TestActor[pekko://test/user/follower-273]: AppendEntriesReply{term=1, success=true, followerId=follower-273, logLastIndex=7, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 03:27:00,132 PM [main] [DEBUG] Follower - follower-273 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 6, context.getLastApplied(): 5, lastIndex(): 7 [WARN] [07/03/2025 15:27:00.132] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/follower-273] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower-273, initialSyncDone=true] 03:27:00,132 PM [main] [DEBUG] RaftActorBehavior - follower-273 (Follower): Setting last applied to 6 03:27:00,132 PM [main] [DEBUG] AbstractReplicatedLog - follower-273: Moving last applied index from 5 to 6 03:27:00,132 PM [main] [DEBUG] RaftActor - follower-273: Applying state for log index 6 data foo-6 03:27:00,132 PM [main] [INFO] MockRaftActor - follower-273: applyState called: foo-6 03:27:00,132 PM [main] [DEBUG] RaftStorageCompleter - test: running 1 completion(s) 03:27:00,132 PM [main] [INFO] SnapshotManager - follower-273: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=5, term=1] 03:27:00,132 PM [main] [INFO] MockRaftActor - follower-273: support() called 03:27:00,133 PM [main] [INFO] SnapshotManager - follower-273: Removed in-memory snapshotted entries, adjusted snapshotIndex: 4 and term: 1 03:27:00,133 PM [main] [DEBUG] SnapshotManager - follower-273: Snapshot success, discarding journal entries up to 0 03:27:00,133 PM [main] [DEBUG] RaftActorSnapshotMessageSupport - follower-273: SnapshotComplete received 03:27:00,133 PM [main] [DEBUG] Follower - follower-273 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader-274, prevLogIndex=7, prevLogTerm=1, leaderCommit=7, replicatedToAllIndex=7, payloadVersion=0, recipientRaftVersion=5, leaderRaftVersion=5, entries==[DefaultLogEntry[index=8, term=1, command=foo-7]]} 03:27:00,133 PM [main] [DEBUG] Follower - follower-273 (Follower): Number of entries to be appended = 1 03:27:00,133 PM [main] [DEBUG] Follower - follower-273 (Follower): After cleanup, lastIndex: 7, entries to be added from: 0 03:27:00,133 PM [main] [DEBUG] Follower - follower-273 (Follower): Append entry to log foo-7 03:27:00,133 PM [main] [DEBUG] ReplicatedLogImpl - follower-273: Append log entry and persist DefaultLogEntry[index=8, term=1, command=foo-7] 03:27:00,133 PM [main] [DEBUG] RaftStorageCompleter - test: 1 completion(s) pending 03:27:00,133 PM [main] [DEBUG] RaftStorageCompleter - test: running 1 completion(s) 03:27:00,133 PM [main] [DEBUG] ReplicatedLogImpl - follower-273: persist complete JournaledLogEntry{index=8, term=1, command=foo-7, pending=false} 03:27:00,133 PM [main] [DEBUG] RaftStorageCompleter - test: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=8, term=1, command=foo-7, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c08828a8@5e699edc} 03:27:00,133 PM [main] [DEBUG] Follower - follower-273 (Follower): Log size is now 4 03:27:00,133 PM [main] [DEBUG] Follower - follower-273 (Follower): Commit index set to 7 03:27:00,133 PM [main] [DEBUG] Follower - follower-273 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower-273, logLastIndex=8, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 03:27:00,133 PM [main] [DEBUG] SyncStatusTracker - follower-273: Lagging 0 entries behind leader leader-274 and reached 7 (of expected 5) 03:27:00,133 PM [main] [DEBUG] Follower - follower-273 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 7, context.getLastApplied(): 6, lastIndex(): 8 03:27:00,133 PM [main] [DEBUG] RaftActorBehavior - follower-273 (Follower): Setting last applied to 7 03:27:00,133 PM [main] [DEBUG] AbstractReplicatedLog - follower-273: Moving last applied index from 6 to 7 [WARN] [07/03/2025 15:27:00.133] [test-pekko.actor.default-dispatcher-4] [pekko://test/deadLetters] received dead letter from TestActor[pekko://test/user/follower-273]: AppendEntriesReply{term=1, success=true, followerId=follower-273, logLastIndex=8, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 03:27:00,133 PM [main] [DEBUG] RaftActor - follower-273: Applying state for log index 7 data foo-7 03:27:00,133 PM [main] [INFO] MockRaftActor - follower-273: applyState called: foo-7 03:27:00,133 PM [main] [DEBUG] SnapshotManager - follower-273: fakeSnapshot purging log to 6 for term 1 03:27:00,133 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$g#932842652] 03:27:00,144 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower-273] 03:27:00,144 PM [main] [DEBUG] PekkoRaftStorage - follower-273: terminating thread VirtualThread[#696,follower-273-writer-125]/waiting 03:27:00,144 PM [follower-273-writer-125] [DEBUG] JournalWriteTask - follower-273: received 1 commands after 21.33 ms 03:27:00,145 PM [follower-273-writer-125] [DEBUG] JournalWriteTask - follower-273: completed 1 commands in 33.29 μs 03:27:00,145 PM [follower-273-writer-125] [DEBUG] JournalWriteTask - follower-273: journal writer stopped 03:27:00,145 PM [main] [DEBUG] EntryJournalV1 - follower-273: journal closed 03:27:00,145 PM [main] [INFO] PekkoRaftStorage - follower-273: journal closed 03:27:00,145 PM [main] [DEBUG] RaftStorage - follower-273: stopped executor with 0 remaining tasks 03:27:00,145 PM [main] [DEBUG] RaftStorage - follower-273: stopped executor with 0 remaining tasks [WARN] [07/03/2025 15:27:00.148] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader-275]: org.opendaylight.controller.cluster.common.actor.Monitor@12026892 03:27:00,149 PM [main] [INFO] RaftActor - leader-275: Starting recovery with journal batch size 1000 03:27:00,149 PM [main] [DEBUG] RaftStorage - leader-275: started executor 03:27:00,149 PM [main] [DEBUG] RaftStorage - leader-275: started executor 03:27:00,150 PM [main] [DEBUG] EntryJournalV1 - leader-275: metadata journal open: replayFrom=1 applyTo=0 03:27:00,150 PM [main] [DEBUG] EntryJournalV1 - leader-275: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:27:00,150 PM [main] [INFO] PekkoRaftStorage - leader-275: journal open: applyTo=0 03:27:00,151 PM [leader-275-writer-126] [DEBUG] JournalWriteTask - leader-275: journal writer started 03:27:00,151 PM [leader-275-writer-126] [DEBUG] JournalWriteTask - leader-275: waiting to receive commands 03:27:00,152 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12359872126510250705/leader-275/TermInfo.properties does not exist 03:27:00,152 PM [test-pekko.actor.default-dispatcher-4] [INFO] PekkoRecovery - leader-275: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:27:00,156 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - leader-275: Set currentTerm=0, votedFor=null 03:27:00,156 PM [test-pekko.actor.default-dispatcher-4] [INFO] PekkoRecovery - leader-275: Local TermInfo store seeded with TermInfo{term=0} 03:27:00,156 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - leader-275: Pekko recovery completed 03:27:00,156 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - leader-275: no journal: skipping journal recovery 03:27:00,156 PM [main] [DEBUG] PropertiesTermInfoStore - leader-275: Set currentTerm=1, votedFor=leader-275 03:27:00,156 PM [main] [DEBUG] AbstractLeader - leader-275 (Leader): Election: Leader has following peers: [follower-276] 03:27:00,156 PM [main] [DEBUG] AbstractLeader - leader-275 (Leader): Checking sendAppendEntries for follower follower-276: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 03:27:00,156 PM [main] [DEBUG] RaftActor - leader-275: Persist data index=0 term=1 command=1 03:27:00,156 PM [main] [DEBUG] ReplicatedLogImpl - leader-275: Append log entry and persist JournaledLogEntry{index=0, term=1, command=1, pending=true} 03:27:00,156 PM [main] [DEBUG] AbstractLeader - leader-275 (Leader): Replicate message: identifier: MockIdentifier{value=1}, logIndex: 0, isSendImmediate: true 03:27:00,156 PM [main] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 03:27:00,156 PM [main] [DEBUG] AbstractLeader - leader-275 (Leader): Checking sendAppendEntries for follower follower-276: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1 03:27:00,157 PM [main] [DEBUG] AbstractLeader - leader-275 (Leader): handleAppendEntriesReply - FollowerLogInformation for follower-276 updated: matchIndex: 0, nextIndex: 1 03:27:00,157 PM [main] [DEBUG] AbstractLeader - leader-275 (Leader): Checking sendAppendEntries for follower follower-276: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1 03:27:00,157 PM [main] [DEBUG] ReplicatedLogImpl - leader-275: persist complete JournaledLogEntry{index=0, term=1, command=1, pending=true} 03:27:00,157 PM [main] [DEBUG] AbstractLeader - leader-275 (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 03:27:00,157 PM [main] [DEBUG] RaftActorBehavior - leader-275 (Leader): Setting last applied to 0 03:27:00,157 PM [main] [DEBUG] AbstractReplicatedLog - leader-275: Moving last applied index from -1 to 0 03:27:00,157 PM [main] [DEBUG] RaftActor - leader-275: Applying state for log index 0 data 1 03:27:00,157 PM [main] [INFO] MockRaftActor - leader-275: applyState called: 1 03:27:00,157 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$h#-1469866330] 03:27:00,168 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader-275] 03:27:00,168 PM [main] [DEBUG] PekkoRaftStorage - leader-275: terminating thread VirtualThread[#697,leader-275-writer-126]/waiting 03:27:00,168 PM [leader-275-writer-126] [DEBUG] JournalWriteTask - leader-275: received 1 commands after 17.60 ms 03:27:00,168 PM [leader-275-writer-126] [DEBUG] JournalWriteTask - leader-275: completed 1 commands in 25.31 μs 03:27:00,168 PM [leader-275-writer-126] [DEBUG] JournalWriteTask - leader-275: journal writer stopped 03:27:00,170 PM [main] [DEBUG] EntryJournalV1 - leader-275: journal closed 03:27:00,170 PM [main] [INFO] PekkoRaftStorage - leader-275: journal closed 03:27:00,170 PM [main] [DEBUG] RaftStorage - leader-275: stopped executor with 0 remaining tasks 03:27:00,170 PM [main] [DEBUG] RaftStorage - leader-275: stopped executor with 0 remaining tasks 03:27:00,171 PM [main] [INFO] RaftActorTest - testRestoreFromSnapshot starting [WARN] [07/03/2025 15:27:00.172] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/test-actor-277]: org.opendaylight.controller.cluster.common.actor.Monitor@3856a3d 03:27:00,173 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - test-actor-277: Starting recovery with journal batch size 1000 03:27:00,173 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-277: started executor 03:27:00,174 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-277: started executor 03:27:00,174 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - test-actor-277: metadata journal open: replayFrom=1 applyTo=0 03:27:00,175 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - test-actor-277: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:27:00,175 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - test-actor-277: journal open: applyTo=0 03:27:00,175 PM [test-actor-277-writer-127] [DEBUG] JournalWriteTask - test-actor-277: journal writer started 03:27:00,175 PM [test-actor-277-writer-127] [DEBUG] JournalWriteTask - test-actor-277: waiting to receive commands 03:27:00,176 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-277/TermInfo.properties does not exist 03:27:00,176 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-277: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-277/journal-v1-1.log 03:27:00,176 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-277: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-277/metadata-v1-1.log 03:27:00,176 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-277: no eligible files found 03:27:00,177 PM [test-pekko.actor.default-dispatcher-4] [INFO] PekkoRecovery - test-actor-277: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:27:00,179 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - test-actor-277: Set currentTerm=0, votedFor=null 03:27:00,179 PM [test-pekko.actor.default-dispatcher-4] [INFO] PekkoRecovery - test-actor-277: Local TermInfo store seeded with TermInfo{term=0} 03:27:00,179 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PekkoRecovery - test-actor-277: Restoring snapshot: Snapshot [lastIndex=4, lastTerm=1, lastAppliedIndex=3, lastAppliedTerm=1, unAppliedEntries size=1, state=MockSnapshotState[state=[A, B, C, D]], electionTerm=1, electionVotedFor=member-1, ServerConfigPayload=null] 03:27:00,184 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PekkoRecovery - test-actor-277: initializing from snapshot taken at 2025-07-03T15:27:00.184104864Z 03:27:00,184 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - test-actor-277: Set currentTerm=1, votedFor=member-1 03:27:00,184 PM [test-pekko.actor.default-dispatcher-4] [INFO] PekkoRecovery - Recovery snapshot applied for test-actor-277 in 114.6 μs: snapshotIndex=3, snapshotTerm=1, journal-size=1 03:27:00,184 PM [test-pekko.actor.default-dispatcher-4] [INFO] MockRaftActor - test-actor-277: support() called 03:27:00,184 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-277: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-277/snapshot-000000006866A144-0AF937A0.tmp 03:27:00,187 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-277: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-277/snapshot-000000006866A144-0AF937A0.v1 03:27:00,187 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-277: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-277/snapshot-000000006866A144-0AF937A0.v1 03:27:00,187 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-277: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-277/TermInfo.properties 03:27:00,187 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-277: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-277/journal-v1-1.log 03:27:00,187 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-277: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-277/metadata-v1-1.log 03:27:00,187 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-277: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=3, term=1], timestamp=2025-07-03T15:27:00.184104864Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-277/snapshot-000000006866A144-0AF937A0.v1, size=513, entryCompress=NONE, stateCompress=NONE} 03:27:00,187 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - test-actor-277: Pekko recovery completed 03:27:00,187 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - test-actor-277: starting journal recovery 03:27:00,187 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractReplicatedLog - test-actor-277: Moving last applied index from -1 to 3 03:27:00,187 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] JournalRecovery - test-actor-277: empty journal: appending 1 entries 03:27:00,187 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] EntryJournalV1 - test-actor-277: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:27:00,190 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] JournalRecovery - test-actor-277: journal recovery completedin 3.046 ms with journalIndex=1 03:27:00,190 PM [main] [DEBUG] RaftStorage - test-actor-277: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-277/snapshot-000000006866A144-0AF937A0.v1 03:27:00,190 PM [main] [DEBUG] RaftStorage - test-actor-277: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-277/TermInfo.properties 03:27:00,190 PM [main] [DEBUG] RaftStorage - test-actor-277: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-277/journal-v1-1.log 03:27:00,190 PM [main] [DEBUG] RaftStorage - test-actor-277: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-277/metadata-v1-1.log 03:27:00,190 PM [test-pekko.actor.default-dispatcher-4] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 03:27:00,190 PM [main] [DEBUG] RaftStorage - test-actor-277: picked SnapshotFileV1{lastIncluded=EntryInfo[index=3, term=1], timestamp=2025-07-03T15:27:00.184104864Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-277/snapshot-000000006866A144-0AF937A0.v1, size=513, entryCompress=NONE, stateCompress=NONE} as the latest file [WARN] [07/03/2025 15:27:00.192] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/test-actor-278]: org.opendaylight.controller.cluster.common.actor.Monitor@6c6c7ca2 03:27:00,193 PM [test-pekko.actor.default-dispatcher-4] [INFO] RaftActor - test-actor-278: Starting recovery with journal batch size 1000 03:27:00,193 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-278: started executor 03:27:00,193 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-278: started executor 03:27:00,193 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] EntryJournalV1 - test-actor-278: metadata journal open: replayFrom=1 applyTo=0 03:27:00,194 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] EntryJournalV1 - test-actor-278: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:27:00,194 PM [test-pekko.actor.default-dispatcher-4] [INFO] PekkoRaftStorage - test-actor-278: journal open: applyTo=0 03:27:00,194 PM [test-actor-278-writer-128] [DEBUG] JournalWriteTask - test-actor-278: journal writer started 03:27:00,194 PM [test-actor-278-writer-128] [DEBUG] JournalWriteTask - test-actor-278: waiting to receive commands 03:27:00,195 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-278/TermInfo.properties does not exist 03:27:00,195 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-278: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-278/journal-v1-1.log 03:27:00,195 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-278: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-278/metadata-v1-1.log 03:27:00,195 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-278: no eligible files found 03:27:00,195 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - test-actor-278: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:27:00,197 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - test-actor-278: Set currentTerm=0, votedFor=null 03:27:00,197 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - test-actor-278: Local TermInfo store seeded with TermInfo{term=0} 03:27:00,197 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRecovery - test-actor-278: Restoring snapshot: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=null, electionTerm=5, electionVotedFor=member-1, ServerConfigPayload=null] 03:27:00,197 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRecovery - test-actor-278: initializing from snapshot taken at 2025-07-03T15:27:00.197852152Z 03:27:00,197 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - test-actor-278: Set currentTerm=5, votedFor=member-1 03:27:00,197 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - Recovery snapshot applied for test-actor-278 in 2.530 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 03:27:00,197 PM [test-pekko.actor.default-dispatcher-14] [INFO] MockRaftActor - test-actor-278: support() called 03:27:00,198 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-278: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-278/snapshot-000000006866A144-0BCAFBF8.tmp 03:27:00,200 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-278: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-278/snapshot-000000006866A144-0BCAFBF8.v1 03:27:00,200 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-278: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-278/snapshot-000000006866A144-0BCAFBF8.v1 03:27:00,200 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-278: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-278/TermInfo.properties 03:27:00,200 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-278: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-278/journal-v1-1.log 03:27:00,200 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-278: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-278/metadata-v1-1.log 03:27:00,200 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-278: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-03T15:27:00.197852152Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4861541444992091390/test-actor-278/snapshot-000000006866A144-0BCAFBF8.v1, size=64, entryCompress=NONE, stateCompress=NONE} 03:27:00,200 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - test-actor-278: Pekko recovery completed 03:27:00,200 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - test-actor-278: no journal: skipping journal recovery 03:27:00,302 PM [main] [INFO] RaftActorTest - testRestoreFromSnapshot ending 03:27:00,302 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/test-actor-277] 03:27:00,313 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRaftStorage - test-actor-277: terminating thread VirtualThread[#698,test-actor-277-writer-127]/waiting 03:27:00,313 PM [test-actor-277-writer-127] [DEBUG] JournalWriteTask - test-actor-277: received 1 commands after 138.2 ms 03:27:00,313 PM [test-actor-277-writer-127] [DEBUG] JournalWriteTask - test-actor-277: completed 1 commands in 43.08 μs 03:27:00,313 PM [test-actor-277-writer-127] [DEBUG] JournalWriteTask - test-actor-277: journal writer stopped 03:27:00,314 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - test-actor-277: journal closed 03:27:00,314 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - test-actor-277: journal closed 03:27:00,314 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-277: stopped executor with 0 remaining tasks 03:27:00,314 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-277: stopped executor with 0 remaining tasks 03:27:00,314 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/test-actor-278] 03:27:00,314 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRaftStorage - test-actor-278: terminating thread VirtualThread[#699,test-actor-278-writer-128]/waiting 03:27:00,314 PM [test-actor-278-writer-128] [DEBUG] JournalWriteTask - test-actor-278: received 1 commands after 120.6 ms 03:27:00,315 PM [test-actor-278-writer-128] [DEBUG] JournalWriteTask - test-actor-278: completed 1 commands in 17.36 μs 03:27:00,315 PM [test-actor-278-writer-128] [DEBUG] JournalWriteTask - test-actor-278: journal writer stopped 03:27:00,315 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - test-actor-278: journal closed 03:27:00,315 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - test-actor-278: journal closed 03:27:00,315 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-278: stopped executor with 0 remaining tasks 03:27:00,315 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-278: stopped executor with 0 remaining tasks 03:27:00,317 PM [main] [INFO] RaftActorTest - testGetSnapshot starting [WARN] [07/03/2025 15:27:00.318] [test-pekko.actor.default-dispatcher-4] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/test-actor-279]: org.opendaylight.controller.cluster.common.actor.Monitor@fd27370 03:27:00,319 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActor - test-actor-279: Starting recovery with journal batch size 1000 03:27:00,319 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-279: started executor 03:27:00,319 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-279: started executor 03:27:00,320 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - test-actor-279: metadata journal open: replayFrom=1 applyTo=0 03:27:00,320 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - test-actor-279: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:27:00,320 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - test-actor-279: journal open: applyTo=0 03:27:00,320 PM [test-actor-279-writer-129] [DEBUG] JournalWriteTask - test-actor-279: journal writer started 03:27:00,320 PM [test-actor-279-writer-129] [DEBUG] JournalWriteTask - test-actor-279: waiting to receive commands 03:27:00,323 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest7033939333793732923/test-actor-279/TermInfo.properties does not exist 03:27:00,323 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-279: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest7033939333793732923/test-actor-279/journal-v1-1.log 03:27:00,323 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-279: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest7033939333793732923/test-actor-279/metadata-v1-1.log 03:27:00,323 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftStorage - test-actor-279: no eligible files found 03:27:00,323 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - test-actor-279: Set currentTerm=3, votedFor=member-1 03:27:00,323 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PekkoRecovery - test-actor-279: Received ReplicatedLogEntry for recovery: index: 0, size: 1 03:27:00,323 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PekkoRecovery - test-actor-279: Received ReplicatedLogEntry for recovery: index: 1, size: 1 03:27:00,323 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PekkoRecovery - test-actor-279: Received apply journal entries for recovery, applying to state: 0 to 1 03:27:00,323 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractReplicatedLog - test-actor-279: Moving last applied index from -1 to 1 03:27:00,323 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PekkoRecovery - test-actor-279: Received ReplicatedLogEntry for recovery: index: 2, size: 1 03:27:00,323 PM [test-pekko.actor.default-dispatcher-4] [INFO] PekkoRecovery - test-actor-279: Recovery completed in 162.5 μs - Switching actor to Follower - last log index = 2, last log term = 3, snapshot index = -1, snapshot term = -1, journal size = 3 03:27:00,326 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] PropertiesTermInfoStore - test-actor-279: Set currentTerm=3, votedFor=member-1 03:27:00,326 PM [test-pekko.actor.default-dispatcher-4] [INFO] PekkoRecovery - test-actor-279: Local TermInfo store seeded with TermInfo{term=3, votedFor=member-1} 03:27:00,326 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - test-actor-279: Pekko recovery completed 03:27:00,326 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] RaftActor - test-actor-279: starting journal recovery 03:27:00,326 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] AbstractReplicatedLog - test-actor-279: Moving last applied index from -1 to 1 03:27:00,326 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] JournalRecovery - test-actor-279: empty journal: appending 3 entries 03:27:00,326 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] EntryJournalV1 - test-actor-279: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:27:00,332 PM [test-pekko.actor.default-dispatcher-4] [DEBUG] JournalRecovery - test-actor-279: journal recovery completedin 5.264 ms with journalIndex=1 03:27:00,334 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - test-actor-279: onGetSnapshot 03:27:00,335 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - test-actor-279: onGetSnapshot 03:27:00,336 PM [main] [INFO] RaftActorTest - testGetSnapshot ending 03:27:00,336 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/test-actor-279] 03:27:00,337 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PekkoRaftStorage - test-actor-279: terminating thread VirtualThread[#701,test-actor-279-writer-129]/waiting 03:27:00,337 PM [test-actor-279-writer-129] [DEBUG] JournalWriteTask - test-actor-279: received 1 commands after 16.39 ms 03:27:00,337 PM [test-actor-279-writer-129] [DEBUG] JournalWriteTask - test-actor-279: completed 1 commands in 23.52 μs 03:27:00,337 PM [test-actor-279-writer-129] [DEBUG] JournalWriteTask - test-actor-279: journal writer stopped 03:27:00,337 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] EntryJournalV1 - test-actor-279: journal closed 03:27:00,337 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRaftStorage - test-actor-279: journal closed 03:27:00,337 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-279: stopped executor with 0 remaining tasks 03:27:00,337 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftStorage - test-actor-279: stopped executor with 0 remaining tasks [INFO] [07/03/2025 15:27:00.339] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 03:27:00,339 PM [test-pekko.actor.default-dispatcher-4] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [WARN] [07/03/2025 15:27:00.339] [test-pekko.actor.default-dispatcher-4] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.171.171:17355) [INFO] [07/03/2025 15:27:00.340] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.171:17355] - Exiting completed [INFO] [07/03/2025 15:27:00.340] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.171:17355] - Shutting down... [INFO] [07/03/2025 15:27:00.340] [test-pekko.actor.internal-dispatcher-2] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.171:17355] - Successfully shut down 03:27:00,342 PM [test-pekko.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.171:17355] - Exiting completed 03:27:00,342 PM [test-pekko.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.171:17355] - Shutting down... 03:27:00,342 PM [test-pekko.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.171:17355] - Successfully shut down 03:27:00,342 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - testFindLeader: terminating thread VirtualThread[#674,testFindLeader-writer-104]/waiting 03:27:00,342 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - testConstruction: terminating thread VirtualThread[#679,testConstruction-writer-108]/waiting 03:27:00,342 PM [testFindLeader-writer-104] [DEBUG] JournalWriteTask - testFindLeader: received 1 commands after 8.103 s 03:27:00,342 PM [testFindLeader-writer-104] [DEBUG] JournalWriteTask - testFindLeader: completed 1 commands in 24.83 μs 03:27:00,342 PM [testFindLeader-writer-104] [DEBUG] JournalWriteTask - testFindLeader: journal writer stopped 03:27:00,342 PM [testConstruction-writer-108] [DEBUG] JournalWriteTask - testConstruction: received 1 commands after 2.862 s 03:27:00,342 PM [testConstruction-writer-108] [DEBUG] JournalWriteTask - testConstruction: completed 1 commands in 38.66 μs 03:27:00,342 PM [testConstruction-writer-108] [DEBUG] JournalWriteTask - testConstruction: journal writer stopped 03:27:00,343 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - testFindLeader: journal closed 03:27:00,343 PM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - testFindLeader: journal closed 03:27:00,343 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - testFindLeader: stopped executor with 0 remaining tasks 03:27:00,343 PM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - testFindLeader: stopped executor with 0 remaining tasks 03:27:00,343 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - testConstruction: journal closed 03:27:00,343 PM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - testConstruction: journal closed 03:27:00,343 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - testConstruction: stopped executor with 0 remaining tasks 03:27:00,343 PM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - testConstruction: stopped executor with 0 remaining tasks [INFO] [07/03/2025 15:27:00.343] [test-pekko.remote.default-remote-dispatcher-6] [pekko://test@10.30.171.171:17355/system/remoting-terminator] Shutting down remote daemon. 03:27:00,343 PM [test-pekko.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. [INFO] [07/03/2025 15:27:00.343] [test-pekko.remote.default-remote-dispatcher-6] [pekko://test@10.30.171.171:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports. 03:27:00,343 PM [test-pekko.actor.default-dispatcher-15] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [INFO] [07/03/2025 15:27:00.345] [test-pekko.remote.default-remote-dispatcher-7] [pekko://test@10.30.171.171:17355/system/remoting-terminator] Remoting shut down. 03:27:00,345 PM [test-pekko.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down. [DEBUG] [07/03/2025 15:27:00.346] [test-pekko.actor.internal-dispatcher-3] [EventStream] shutting down: StandardOutLogger