[DEBUG] [07/31/2025 13:26:37.767] [main] [EventStream(pekko://test)] logger log1-TestEventListener started 01:26:37,767 PM [test-pekko.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [07/31/2025 13:26:37.767] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started [DEBUG] [07/31/2025 13:26:37.768] [main] [EventStream(pekko://test)] Default Loggers started [INFO] [07/31/2025 13:26:37.786] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.171.252:17355] with UID [-3816659041137464158] [INFO] [07/31/2025 13:26:37.787] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.252:17355] - Starting up, Pekko version [1.1.4] ... 01:26:37,787 PM [test-pekko.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.171.252:17355] with UID [-3816659041137464158] 01:26:37,787 PM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.252:17355] - Starting up, Pekko version [1.1.4] ... [INFO] [07/31/2025 13:26:37.788] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.252:17355] - Registered cluster JMX MBean [pekko:type=Cluster] 01:26:37,789 PM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.252:17355] - Registered cluster JMX MBean [pekko:type=Cluster] [INFO] [07/31/2025 13:26:37.789] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.252:17355] - Started up successfully 01:26:37,789 PM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.252:17355] - Started up successfully [INFO] [07/31/2025 13:26:37.790] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.252:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing [INFO] [07/31/2025 13:26:37.790] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.252:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 01:26:37,790 PM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.252:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing 01:26:37,790 PM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.252:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 01:26:37,799 PM [main] [INFO] RaftActorTest - testRestoreFromSnapshotWithRecoveredData starting 01:26:37,802 PM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - test-actor-250: Starting recovery with journal batch size 1000 01:26:37,802 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - test-actor-250: started executor 01:26:37,802 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - test-actor-250: started executor 01:26:37,802 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - test-actor-250: metadata journal open: replayFrom=1 applyTo=0 01:26:37,803 PM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - test-actor-250: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:26:37,803 PM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - test-actor-250: journal open: applyTo=0 01:26:37,803 PM [test-actor-250-writer-103] [DEBUG] JournalWriteTask - test-actor-250: journal writer started 01:26:37,803 PM [test-actor-250-writer-103] [DEBUG] JournalWriteTask - test-actor-250: waiting to receive commands 01:26:37,803 PM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/test-actor-250] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [07/31/2025 13:26:37.805] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/test-actor-250]: org.opendaylight.controller.cluster.common.actor.Monitor@3f273d2 [INFO] [pekkoDeadLetter][07/31/2025 13:26:37.803] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/test-actor-250] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:26:37,808 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest623772775223946290/test-actor-250/TermInfo.properties does not exist 01:26:37,808 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest623772775223946290/test-actor-250/journal-v1-1.log 01:26:37,808 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest623772775223946290/test-actor-250/metadata-v1-1.log 01:26:37,808 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: no eligible files found 01:26:37,808 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - test-actor-250: Received ReplicatedLogEntry for recovery: index: 0, size: 1 01:26:37,808 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - test-actor-250: Recovery completed - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1 01:26:37,811 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - test-actor-250: Set currentTerm=0, votedFor=null 01:26:37,811 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - test-actor-250: Local TermInfo store seeded with TermInfo{term=0} 01:26:37,811 PM [test-pekko.actor.default-dispatcher-5] [WARN] PekkoRecovery - test-actor-250: The provided restore snapshot was not applied because the persistence store is not empty 01:26:37,811 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - test-actor-250: taking snapshot to clear Pekko persistence to 1 01:26:37,811 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Recovery - test-actor-250: no applied entries in recovery log, re-snapshotting EntryInfo[index=-1, term=-1] 01:26:37,811 PM [test-pekko.actor.default-dispatcher-5] [INFO] Recovery - test-actor-250: Taking snapshot on entry with index -1 01:26:37,811 PM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - test-actor-250: support() called 01:26:37,811 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest623772775223946290/test-actor-250/snapshot-00000000688B6F0D-30607A20.tmp 01:26:37,814 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest623772775223946290/test-actor-250/snapshot-00000000688B6F0D-30607A20.v1 01:26:37,814 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest623772775223946290/test-actor-250/snapshot-00000000688B6F0D-30607A20.v1 01:26:37,814 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest623772775223946290/test-actor-250/TermInfo.properties 01:26:37,814 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest623772775223946290/test-actor-250/journal-v1-1.log 01:26:37,814 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest623772775223946290/test-actor-250/metadata-v1-1.log 01:26:37,814 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-31T13:26:37.811629088Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorTest623772775223946290/test-actor-250/snapshot-00000000688B6F0D-30607A20.v1, size=196, entryCompress=NONE, stateCompress=NONE} 01:26:37,814 PM [test-pekko.actor.default-dispatcher-5] [INFO] Recovery - test-actor-250: Snapshot completed in 3.474 ms, resetting timer for the next recovery snapshot 01:26:37,814 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - test-actor-250: Pekko recovery completed and can restore from snapshot 01:26:37,814 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - test-actor-250: starting journal recovery 01:26:37,814 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - test-actor-250: Moving last applied index from -1 to -1 01:26:37,814 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - test-actor-250: empty journal: appending 1 entries 01:26:37,814 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - test-actor-250: updated meta to JournalMeta[replayFrom=1, applyTo=0] 01:26:37,817 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - test-actor-250: journal recovery completedin 3.152 ms with journalIndex=1 01:26:37,818 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - test-actor-250: ignoring DeleteMessagesSuccess(1) 01:26:37,818 PM [test-pekko.actor.default-dispatcher-5] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 01:26:38,319 PM [main] [INFO] RaftActorTest - testRestoreFromSnapshotWithRecoveredData ending 01:26:38,319 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/test-actor-250] 01:26:38,330 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EnabledRaftStorage - test-actor-250: terminating thread VirtualThread[#708,test-actor-250-writer-103]/waiting 01:26:38,330 PM [test-actor-250-writer-103] [DEBUG] JournalWriteTask - test-actor-250: received 1 commands after 527.5 ms 01:26:38,330 PM [test-actor-250-writer-103] [DEBUG] JournalWriteTask - test-actor-250: completed 1 commands in 31.30 μs 01:26:38,330 PM [test-actor-250-writer-103] [DEBUG] JournalWriteTask - test-actor-250: journal writer stopped 01:26:38,331 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - test-actor-250: journal closed 01:26:38,331 PM [test-pekko.actor.default-dispatcher-5] [INFO] EnabledRaftStorage - test-actor-250: journal closed 01:26:38,331 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: stopped executor with 0 remaining tasks 01:26:38,331 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-250: stopped executor with 0 remaining tasks [WARN] [07/31/2025 13:26:38.337] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader-251]: org.opendaylight.controller.cluster.common.actor.Monitor@7b7714ce 01:26:38,338 PM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader-251] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][07/31/2025 13:26:38.338] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader-251] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:26:38,339 PM [main] [INFO] RaftActor - leader-251: Starting recovery with journal batch size 1000 01:26:38,340 PM [main] [DEBUG] RaftStorage - leader-251: started executor 01:26:38,340 PM [main] [DEBUG] RaftStorage - leader-251: started executor 01:26:38,340 PM [main] [DEBUG] EntryJournalV1 - leader-251: metadata journal open: replayFrom=1 applyTo=0 01:26:38,341 PM [main] [DEBUG] EntryJournalV1 - leader-251: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:26:38,341 PM [main] [INFO] EnabledRaftStorage - leader-251: journal open: applyTo=0 01:26:38,341 PM [leader-251-writer-104] [DEBUG] JournalWriteTask - leader-251: journal writer started 01:26:38,341 PM [leader-251-writer-104] [DEBUG] JournalWriteTask - leader-251: waiting to receive commands 01:26:38,342 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest11636386135635298725/leader-251/TermInfo.properties does not exist 01:26:38,343 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader-251: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:26:38,345 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader-251: Set currentTerm=0, votedFor=null 01:26:38,345 PM [test-pekko.actor.default-dispatcher-14] [INFO] PekkoRecovery - leader-251: Local TermInfo store seeded with TermInfo{term=0} 01:26:38,345 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader-251: Pekko recovery completed and can restore from snapshot 01:26:38,345 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - leader-251: no journal: skipping journal recovery 01:26:38,345 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:26:38,345 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Follower - leader-251 (Follower): Received TimeoutNow - switching to Candidate 01:26:38,346 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader-251 (Candidate): Election: Candidate has following voting peers: [] 01:26:38,349 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] PropertiesTermInfoStore - leader-251: Set currentTerm=1, votedFor=leader-251 01:26:38,349 PM [test-pekko.actor.default-dispatcher-14] [INFO] Candidate - leader-251 (Candidate): Starting new election term 1 01:26:38,349 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader-251 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:26:38,349 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] Candidate - leader-251 (Candidate): Received ElectionTimeout 01:26:38,349 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] AbstractLeader - leader-251 (Leader): Election: Leader has following peers: [] 01:26:38,349 PM [test-pekko.actor.default-dispatcher-14] [INFO] RaftActorBehavior - leader-251 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:26:38,349 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader-251] 01:26:38,350 PM [main] [DEBUG] EnabledRaftStorage - leader-251: terminating thread VirtualThread[#711,leader-251-writer-104]/waiting 01:26:38,350 PM [leader-251-writer-104] [DEBUG] JournalWriteTask - leader-251: received 1 commands after 8.855 ms 01:26:38,350 PM [leader-251-writer-104] [DEBUG] JournalWriteTask - leader-251: completed 1 commands in 41.92 μs 01:26:38,350 PM [leader-251-writer-104] [DEBUG] JournalWriteTask - leader-251: journal writer stopped 01:26:38,350 PM [main] [DEBUG] EntryJournalV1 - leader-251: journal closed 01:26:38,350 PM [main] [INFO] EnabledRaftStorage - leader-251: journal closed 01:26:38,351 PM [main] [DEBUG] RaftStorage - leader-251: stopped executor with 0 remaining tasks 01:26:38,351 PM [main] [DEBUG] RaftStorage - leader-251: stopped executor with 0 remaining tasks [WARN] [07/31/2025 13:26:38.354] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from Actor[pekko://test/user/testFindLeader#376924812]: org.opendaylight.controller.cluster.common.actor.Monitor@42d939a4 [INFO] [pekkoDeadLetter][07/31/2025 13:26:38.354] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[pekko://test/user/testFindLeader#376924812] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:26:38,354 PM [test-pekko.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[pekko://test/user/testFindLeader#376924812] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:26:38,355 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - testFindLeader: Starting recovery with journal batch size 1000 01:26:38,355 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - testFindLeader: started executor 01:26:38,355 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - testFindLeader: started executor 01:26:38,356 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - testFindLeader: metadata journal open: replayFrom=1 applyTo=0 01:26:38,356 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - testFindLeader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:26:38,356 PM [test-pekko.actor.default-dispatcher-5] [INFO] EnabledRaftStorage - testFindLeader: journal open: applyTo=0 01:26:38,357 PM [testFindLeader-writer-105] [DEBUG] JournalWriteTask - testFindLeader: journal writer started 01:26:38,357 PM [testFindLeader-writer-105] [DEBUG] JournalWriteTask - testFindLeader: waiting to receive commands 01:26:38,358 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12244767856679008778/testFindLeader/TermInfo.properties does not exist 01:26:38,358 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - testFindLeader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12244767856679008778/testFindLeader/journal-v1-1.log 01:26:38,358 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - testFindLeader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest12244767856679008778/testFindLeader/metadata-v1-1.log 01:26:38,358 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - testFindLeader: no eligible files found 01:26:38,358 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - testFindLeader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:26:38,361 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - testFindLeader: Set currentTerm=0, votedFor=null 01:26:38,361 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - testFindLeader: Local TermInfo store seeded with TermInfo{term=0} 01:26:38,361 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - testFindLeader: Pekko recovery completed and can restore from snapshot 01:26:38,361 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - testFindLeader: starting journal recovery 01:26:38,361 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - testFindLeader: Moving last applied index from -1 to -1 01:26:38,361 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - testFindLeader: empty journal: appending 0 entries 01:26:38,361 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - testFindLeader: updated meta to JournalMeta[replayFrom=1, applyTo=0] 01:26:38,361 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - testFindLeader: journal recovery completedin 212.6 μs with journalIndex=1 01:26:38,362 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:26:38,362 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - testFindLeader (Follower): Received TimeoutNow - switching to Candidate 01:26:38,362 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - testFindLeader (Candidate): Election: Candidate has following voting peers: [] 01:26:38,364 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - testFindLeader: Set currentTerm=1, votedFor=testFindLeader 01:26:38,364 PM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - testFindLeader (Candidate): Starting new election term 1 01:26:38,364 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - testFindLeader (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:26:38,364 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - testFindLeader (Candidate): Received ElectionTimeout 01:26:38,364 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - testFindLeader (Leader): Election: Leader has following peers: [] 01:26:38,364 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - testFindLeader (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:26:38,414 PM [main] [INFO] RaftActorTest - testLeaderTransitioning starting [WARN] [07/31/2025 13:26:38.416] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/test-actor-252]: org.opendaylight.controller.cluster.common.actor.Monitor@15e6eaf5 01:26:38,416 PM [test-pekko.actor.default-dispatcher-14] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/test-actor-252] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][07/31/2025 13:26:38.416] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/test-actor-252] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:26:38,417 PM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - test-actor-252: Starting recovery with journal batch size 1000 01:26:38,417 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-252: started executor 01:26:38,417 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-252: started executor 01:26:38,417 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - test-actor-252: metadata journal open: replayFrom=1 applyTo=0 01:26:38,418 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - test-actor-252: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:26:38,418 PM [test-pekko.actor.default-dispatcher-5] [INFO] EnabledRaftStorage - test-actor-252: journal open: applyTo=0 01:26:38,418 PM [test-actor-252-writer-106] [DEBUG] JournalWriteTask - test-actor-252: journal writer started 01:26:38,418 PM [test-actor-252-writer-106] [DEBUG] JournalWriteTask - test-actor-252: waiting to receive commands 01:26:38,419 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4606396656569475311/test-actor-252/TermInfo.properties does not exist 01:26:38,419 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-252: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4606396656569475311/test-actor-252/journal-v1-1.log 01:26:38,419 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-252: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest4606396656569475311/test-actor-252/metadata-v1-1.log 01:26:38,419 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - test-actor-252: no eligible files found 01:26:38,419 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - test-actor-252: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:26:38,421 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - test-actor-252: Set currentTerm=0, votedFor=null 01:26:38,421 PM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - test-actor-252: Local TermInfo store seeded with TermInfo{term=0} 01:26:38,421 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - test-actor-252: Pekko recovery completed and can restore from snapshot 01:26:38,421 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - test-actor-252: starting journal recovery 01:26:38,421 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - test-actor-252: Moving last applied index from -1 to -1 01:26:38,421 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - test-actor-252: empty journal: appending 0 entries 01:26:38,421 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - test-actor-252: updated meta to JournalMeta[replayFrom=1, applyTo=0] 01:26:38,421 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - test-actor-252: journal recovery completedin 162.1 μs with journalIndex=1 01:26:38,422 PM [test-pekko.actor.default-dispatcher-5] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 01:26:38,426 PM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - test-actor-252 (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=1, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term 01:26:38,428 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - test-actor-252: Set currentTerm=1, votedFor=null 01:26:38,428 PM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - test-actor-252 (Follower): The followers log is empty and the senders prevLogIndex is 0 01:26:38,428 PM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - test-actor-252 (Follower): Follower is out-of-sync so sending negative reply: AppendEntriesReply{term=1, success=false, followerId=test-actor-252, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 01:26:38,428 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - test-actor-252: Last sync leader does not match current leader leader, need to catch up to 0 [WARN] [07/31/2025 13:26:38.428] [test-pekko.actor.default-dispatcher-12] [pekko://test/deadLetters] received dead letter from TestActor[pekko://test/user/test-actor-252]: AppendEntriesReply{term=1, success=false, followerId=test-actor-252, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} [WARN] [07/31/2025 13:26:38.428] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/test-actor-252] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=test-actor-252, initialSyncDone=false] [INFO] [pekkoDeadLetter][07/31/2025 13:26:38.428] [test-pekko.actor.default-dispatcher-14] [pekko://test/deadLetters] Message [org.opendaylight.controller.cluster.raft.messages.AppendEntriesReply] from TestActor[pekko://test/user/test-actor-252] to Actor[pekko://test/deadLetters] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/deadLetters] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][07/31/2025 13:26:38.428] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/test-actor-252] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/test-actor-252] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:26:38,428 PM [test-pekko.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemoteDeadLetterActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.AppendEntriesReply] from TestActor[pekko://test/user/test-actor-252] to Actor[pekko://test/deadLetters] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/deadLetters] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:26:38,428 PM [test-pekko.actor.default-dispatcher-14] [INFO] TestActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/test-actor-252] was unhandled. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:26:38,477 PM [test-pekko.actor.default-dispatcher-14] [DEBUG] RaftActor - test-actor-252: onLeaderTransitioning: LeaderTransitioning [leaderId=leader] 01:26:38,527 PM [main] [INFO] RaftActorTest - testLeaderTransitioning ending 01:26:38,528 PM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/$a#1016036930] 01:26:38,538 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/test-actor-252] 01:26:38,539 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] EnabledRaftStorage - test-actor-252: terminating thread VirtualThread[#713,test-actor-252-writer-106]/waiting 01:26:38,539 PM [test-actor-252-writer-106] [DEBUG] JournalWriteTask - test-actor-252: received 1 commands after 121.0 ms 01:26:38,539 PM [test-actor-252-writer-106] [DEBUG] JournalWriteTask - test-actor-252: completed 1 commands in 31.42 μs 01:26:38,539 PM [test-actor-252-writer-106] [DEBUG] JournalWriteTask - test-actor-252: journal writer stopped 01:26:38,539 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - test-actor-252: journal closed 01:26:38,539 PM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - test-actor-252: journal closed 01:26:38,539 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - test-actor-252: stopped executor with 0 remaining tasks 01:26:38,539 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - test-actor-252: stopped executor with 0 remaining tasks [WARN] [07/31/2025 13:26:38.542] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/termination-monitor] received dead letter from Actor[pekko://test/user/$c#810637806]: org.opendaylight.controller.cluster.common.actor.Monitor@56794b0d [INFO] [pekkoDeadLetter][07/31/2025 13:26:38.542] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[pekko://test/user/$c#810637806] to Actor[pekko://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:26:38,542 PM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[pekko://test/user/$c#810637806] to Actor[pekko://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:26:38,543 PM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - notifier-253: Starting recovery with journal batch size 1000 01:26:38,543 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - notifier-253: started executor 01:26:38,543 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - notifier-253: started executor 01:26:38,544 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - notifier-253: metadata journal open: replayFrom=1 applyTo=0 01:26:38,544 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - notifier-253: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 01:26:38,544 PM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - notifier-253: journal open: applyTo=0 01:26:38,544 PM [notifier-253-writer-107] [DEBUG] JournalWriteTask - notifier-253: journal writer started 01:26:38,544 PM [notifier-253-writer-107] [DEBUG] JournalWriteTask - notifier-253: waiting to receive commands 01:26:38,545 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest6085426446528647884/notifier-253/TermInfo.properties does not exist 01:26:38,545 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - notifier-253: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest6085426446528647884/notifier-253/journal-v1-1.log 01:26:38,545 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - notifier-253: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorTest6085426446528647884/notifier-253/metadata-v1-1.log 01:26:38,545 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - notifier-253: no eligible files found 01:26:38,545 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - notifier-253: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:26:38,547 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=0, votedFor=null 01:26:38,547 PM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - notifier-253: Local TermInfo store seeded with TermInfo{term=0} 01:26:38,547 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - notifier-253: Pekko recovery completed and can restore from snapshot 01:26:38,548 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - notifier-253: starting journal recovery 01:26:38,548 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - notifier-253: Moving last applied index from -1 to -1 01:26:38,548 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - notifier-253: empty journal: appending 0 entries 01:26:38,548 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - notifier-253: updated meta to JournalMeta[replayFrom=1, applyTo=0] 01:26:38,548 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - notifier-253: journal recovery completedin 257.0 μs with journalIndex=1 01:26:38,733 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 01:26:38,733 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - notifier-253 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.252:17355, Removed) 01:26:38,733 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - notifier-253 (Follower): Received ElectionTimeout - switching to Candidate 01:26:38,733 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - notifier-253 (Candidate): Election: Candidate has following voting peers: [leader] 01:26:38,740 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=1, votedFor=notifier-253 01:26:38,740 PM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 1 01:26:38,740 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=1, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader 01:26:38,741 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - notifier-253 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 [WARN] [07/31/2025 13:26:38.741] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=1, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} [INFO] [pekkoDeadLetter][07/31/2025 13:26:38.741] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/$c/fake/path] Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#810637806] to Actor[pekko://test/user/$c/fake/path] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:26:38,741 PM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#810637806] to Actor[pekko://test/user/$c/fake/path] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:26:38,862 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:38,867 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=2, votedFor=notifier-253 01:26:38,867 PM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 2 01:26:38,867 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=2, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:38.867] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=2, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:38,868 PM [test-pekko.actor.default-dispatcher-14] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#810637806] to Actor[pekko://test/user/$c/fake/path] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][07/31/2025 13:26:38.867] [test-pekko.actor.default-dispatcher-14] [pekko://test/user/$c/fake/path] Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#810637806] to Actor[pekko://test/user/$c/fake/path] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:26:39,2 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:39,8 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=3, votedFor=notifier-253 01:26:39,8 PM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 3 01:26:39,8 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=3, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:39.008] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=3, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} [INFO] [pekkoDeadLetter][07/31/2025 13:26:39.008] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/$c/fake/path] Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#810637806] to Actor[pekko://test/user/$c/fake/path] was not delivered. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:26:39,8 PM [test-pekko.actor.default-dispatcher-7] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.messages.RequestVote] from Actor[pekko://test/user/$c#810637806] to Actor[pekko://test/user/$c/fake/path] was not delivered. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. If this is not an expected behavior then Actor[pekko://test/user/$c/fake/path] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 01:26:39,212 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:39,215 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=4, votedFor=notifier-253 01:26:39,216 PM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 4 01:26:39,216 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=4, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:39.216] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=4, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:39,422 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:39,426 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=5, votedFor=notifier-253 01:26:39,426 PM [test-pekko.actor.default-dispatcher-12] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 5 01:26:39,426 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=5, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:39.426] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=5, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:39,613 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:39,617 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=6, votedFor=notifier-253 01:26:39,617 PM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 6 01:26:39,618 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=6, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:39.618] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=6, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:39,813 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:39,817 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=7, votedFor=notifier-253 01:26:39,817 PM [test-pekko.actor.default-dispatcher-12] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 7 01:26:39,817 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=7, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:39.817] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=7, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:39,952 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:39,958 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=8, votedFor=notifier-253 01:26:39,958 PM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 8 01:26:39,958 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=8, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:39.959] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=8, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:40,113 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:40,117 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=9, votedFor=notifier-253 01:26:40,117 PM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 9 01:26:40,117 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=9, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:40.117] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=9, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:40,323 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:40,328 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=10, votedFor=notifier-253 01:26:40,328 PM [test-pekko.actor.default-dispatcher-12] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 10 01:26:40,328 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=10, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:40.328] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=10, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:40,473 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:40,477 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=11, votedFor=notifier-253 01:26:40,477 PM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 11 01:26:40,477 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=11, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:40.477] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=11, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:40,632 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:40,636 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=12, votedFor=notifier-253 01:26:40,636 PM [test-pekko.actor.default-dispatcher-12] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 12 01:26:40,636 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=12, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:40.636] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=12, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:40,802 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:40,804 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=13, votedFor=notifier-253 01:26:40,805 PM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 13 01:26:40,805 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=13, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:40.805] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=13, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:40,942 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:40,947 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=14, votedFor=notifier-253 01:26:40,947 PM [test-pekko.actor.default-dispatcher-12] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 14 01:26:40,947 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=14, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:40.948] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=14, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:41,163 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:41,166 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=15, votedFor=notifier-253 01:26:41,166 PM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 15 01:26:41,166 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=15, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:41.166] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=15, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:41,292 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:41,295 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=16, votedFor=notifier-253 01:26:41,295 PM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 16 01:26:41,295 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=16, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:41.296] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=16, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:41,463 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:41,469 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=17, votedFor=notifier-253 01:26:41,469 PM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 17 01:26:41,469 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=17, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:41.469] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=17, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:41,613 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:41,616 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=18, votedFor=notifier-253 01:26:41,616 PM [test-pekko.actor.default-dispatcher-12] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 18 01:26:41,616 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=18, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:41.616] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=18, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:41,762 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:41,765 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=19, votedFor=notifier-253 01:26:41,765 PM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 19 01:26:41,765 PM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=19, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:41.765] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=19, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:41,972 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:41,977 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=20, votedFor=notifier-253 01:26:41,977 PM [test-pekko.actor.default-dispatcher-12] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 20 01:26:41,977 PM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=20, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:41.977] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=20, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} 01:26:42,133 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - notifier-253 (Candidate): Received ElectionTimeout 01:26:42,135 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - notifier-253: Set currentTerm=21, votedFor=notifier-253 01:26:42,135 PM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - notifier-253 (Candidate): Starting new election term 21 01:26:42,135 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - notifier-253 (Candidate): Sending RequestVote{term=21, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1} to peer leader [WARN] [07/31/2025 13:26:42.135] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/$c/fake/path] received dead letter from Actor[pekko://test/user/$c#810637806]: RequestVote{term=21, candidateId=notifier-253, lastLogIndex=-1, lastLogTerm=-1}