[DEBUG] [11/06/2025 15:27:03.996] [main] [EventStream(pekko://test)] logger log1-TestEventListener started 03:27:03,997 PM [test-pekko.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [11/06/2025 15:27:03.997] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started [DEBUG] [11/06/2025 15:27:03.997] [main] [EventStream(pekko://test)] Default Loggers started [INFO] [11/06/2025 15:27:04.016] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.21:17355] with UID [8898747973410987801] 03:27:04,16 PM [test-pekko.actor.default-dispatcher-7] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.21:17355] with UID [8898747973410987801] [INFO] [11/06/2025 15:27:04.018] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.21:17355] - Starting up, Pekko version [1.2.1] ... 03:27:04,18 PM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.21:17355] - Starting up, Pekko version [1.2.1] ... [INFO] [11/06/2025 15:27:04.020] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.21:17355] - Registered cluster JMX MBean [pekko:type=Cluster] 03:27:04,20 PM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.21:17355] - Registered cluster JMX MBean [pekko:type=Cluster] [INFO] [11/06/2025 15:27:04.020] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.21:17355] - Started up successfully 03:27:04,20 PM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.21:17355] - Started up successfully [INFO] [11/06/2025 15:27:04.021] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.21:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing [INFO] [11/06/2025 15:27:04.021] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.21:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 03:27:04,22 PM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.21:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing 03:27:04,22 PM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.21:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 03:27:04,102 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] MockRaftActor - Actor created TestActor[pekko://test/user/testAbortTransfer-leader-221] 03:27:04,103 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - testAbortTransfer-leader-221: Starting recovery with journal batch size 1000 03:27:04,103 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testAbortTransfer-leader-221: started executor 03:27:04,103 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testAbortTransfer-leader-221: started executor 03:27:04,104 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testAbortTransfer-leader-221: metadata journal open: replayFrom=1 applyTo=0 03:27:04,104 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testAbortTransfer-leader-221: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:27:04,104 PM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - testAbortTransfer-leader-221: journal open: applyTo=0 [WARN] [11/06/2025 15:27:04.104] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/testAbortTransfer-leader-221]: org.opendaylight.controller.cluster.common.actor.Monitor@6f142bfd 03:27:04,104 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - testAbortTransfer-leader-221: starting journal recovery 03:27:04,104 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/junit-13424411543753517925/testAbortTransfer-leader-221/TermInfo.properties does not exist 03:27:04,104 PM [testAbortTransfer-leader-221-writer-98] [DEBUG] JournalWriteTask - testAbortTransfer-leader-221: journal writer started 03:27:04,104 PM [testAbortTransfer-leader-221-writer-98] [DEBUG] JournalWriteTask - testAbortTransfer-leader-221: waiting to receive commands [INFO] [pekkoDeadLetter][11/06/2025 15:27:04.104] [test-pekko.actor.default-dispatcher-8] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/testAbortTransfer-leader-221] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:27:04,105 PM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/testAbortTransfer-leader-221] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:27:04,115 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - testAbortTransfer-leader-221: Set currentTerm=0, votedFor=null 03:27:04,115 PM [test-pekko.actor.default-dispatcher-7] [INFO] Recovery - testAbortTransfer-leader-221: Local TermInfo store seeded with TermInfo{term=0} 03:27:04,115 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testAbortTransfer-leader-221: skipping unrecognized file /tmp/junit-13424411543753517925/testAbortTransfer-leader-221/TermInfo.properties 03:27:04,115 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testAbortTransfer-leader-221: skipping unrecognized file /tmp/junit-13424411543753517925/testAbortTransfer-leader-221/journal-v1-1.log 03:27:04,115 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testAbortTransfer-leader-221: skipping unrecognized file /tmp/junit-13424411543753517925/testAbortTransfer-leader-221/metadata-v1-1.log 03:27:04,115 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testAbortTransfer-leader-221: no eligible files found 03:27:04,115 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - testAbortTransfer-leader-221: Moving last applied index from -1 to -1 03:27:04,115 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - testAbortTransfer-leader-221: empty journal: appending 0 entries 03:27:04,115 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testAbortTransfer-leader-221: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:27:04,115 PM [test-pekko.actor.default-dispatcher-7] [INFO] Recovery - testAbortTransfer-leader-221: Recovery completed in in 10.87 ms: last log index = -1, last log term = -1, napshot index = -1, snapshot term = -1, journal size = 0 03:27:04,115 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - testAbortTransfer-leader-221: Recovery completed and can restore from snapshot 03:27:04,117 PM [main] [DEBUG] RaftActorLeadershipTransferCohort - testAbortTransfer-leader-221: leader transfer aborted 03:27:04,129 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/testAbortTransfer-leader-221] 03:27:04,141 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EnabledRaftStorage - testAbortTransfer-leader-221: terminating thread VirtualThread[#494,testAbortTransfer-leader-221-writer-98]/waiting 03:27:04,141 PM [testAbortTransfer-leader-221-writer-98] [DEBUG] JournalWriteTask - testAbortTransfer-leader-221: received 1 commands after 36.32 ms 03:27:04,141 PM [testAbortTransfer-leader-221-writer-98] [DEBUG] JournalWriteTask - testAbortTransfer-leader-221: completed 1 commands in 19.56 μs 03:27:04,141 PM [testAbortTransfer-leader-221-writer-98] [DEBUG] JournalWriteTask - testAbortTransfer-leader-221: journal writer stopped 03:27:04,142 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testAbortTransfer-leader-221: journal closed 03:27:04,142 PM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - testAbortTransfer-leader-221: journal closed 03:27:04,142 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testAbortTransfer-leader-221: stopped executor with 0 remaining tasks 03:27:04,142 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testAbortTransfer-leader-221: stopped executor with 0 remaining tasks 03:27:04,147 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] MockRaftActor - Actor created TestActor[pekko://test/user/testNewLeaderTimeout-leader-222] [WARN] [11/06/2025 15:27:04.148] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/testNewLeaderTimeout-leader-222]: org.opendaylight.controller.cluster.common.actor.Monitor@3a3fe719 [INFO] [pekkoDeadLetter][11/06/2025 15:27:04.148] [test-pekko.actor.default-dispatcher-8] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/testNewLeaderTimeout-leader-222] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:27:04,148 PM [test-pekko.actor.default-dispatcher-8] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/testNewLeaderTimeout-leader-222] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:27:04,152 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - testNewLeaderTimeout-leader-222: Starting recovery with journal batch size 1000 03:27:04,152 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testNewLeaderTimeout-leader-222: started executor 03:27:04,152 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testNewLeaderTimeout-leader-222: started executor 03:27:04,153 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testNewLeaderTimeout-leader-222: metadata journal open: replayFrom=1 applyTo=0 03:27:04,153 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testNewLeaderTimeout-leader-222: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:27:04,153 PM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - testNewLeaderTimeout-leader-222: journal open: applyTo=0 03:27:04,153 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - testNewLeaderTimeout-leader-222: starting journal recovery 03:27:04,153 PM [testNewLeaderTimeout-leader-222-writer-99] [DEBUG] JournalWriteTask - testNewLeaderTimeout-leader-222: journal writer started 03:27:04,153 PM [testNewLeaderTimeout-leader-222-writer-99] [DEBUG] JournalWriteTask - testNewLeaderTimeout-leader-222: waiting to receive commands 03:27:04,153 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/junit-17757474768884448453/testNewLeaderTimeout-leader-222/TermInfo.properties does not exist 03:27:04,157 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - testNewLeaderTimeout-leader-222: Set currentTerm=0, votedFor=null 03:27:04,157 PM [test-pekko.actor.default-dispatcher-7] [INFO] Recovery - testNewLeaderTimeout-leader-222: Local TermInfo store seeded with TermInfo{term=0} 03:27:04,157 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testNewLeaderTimeout-leader-222: skipping unrecognized file /tmp/junit-17757474768884448453/testNewLeaderTimeout-leader-222/TermInfo.properties 03:27:04,157 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testNewLeaderTimeout-leader-222: skipping unrecognized file /tmp/junit-17757474768884448453/testNewLeaderTimeout-leader-222/journal-v1-1.log 03:27:04,157 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testNewLeaderTimeout-leader-222: skipping unrecognized file /tmp/junit-17757474768884448453/testNewLeaderTimeout-leader-222/metadata-v1-1.log 03:27:04,157 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testNewLeaderTimeout-leader-222: no eligible files found 03:27:04,157 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - testNewLeaderTimeout-leader-222: Moving last applied index from -1 to -1 03:27:04,157 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - testNewLeaderTimeout-leader-222: empty journal: appending 0 entries 03:27:04,157 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testNewLeaderTimeout-leader-222: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:27:04,157 PM [test-pekko.actor.default-dispatcher-7] [INFO] Recovery - testNewLeaderTimeout-leader-222: Recovery completed in in 3.936 ms: last log index = -1, last log term = -1, napshot index = -1, snapshot term = -1, journal size = 0 03:27:04,157 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - testNewLeaderTimeout-leader-222: Recovery completed and can restore from snapshot 03:27:04,158 PM [main] [DEBUG] RaftActorLeadershipTransferCohort - testNewLeaderTimeout-leader-222: leader transfer complete - waiting for new leader 03:27:04,378 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - testNewLeaderTimeout-leader-222: leader not elected in time 03:27:04,391 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/testNewLeaderTimeout-leader-222] 03:27:04,392 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EnabledRaftStorage - testNewLeaderTimeout-leader-222: terminating thread VirtualThread[#495,testNewLeaderTimeout-leader-222-writer-99]/waiting 03:27:04,392 PM [testNewLeaderTimeout-leader-222-writer-99] [DEBUG] JournalWriteTask - testNewLeaderTimeout-leader-222: received 1 commands after 238.8 ms 03:27:04,392 PM [testNewLeaderTimeout-leader-222-writer-99] [DEBUG] JournalWriteTask - testNewLeaderTimeout-leader-222: completed 1 commands in 17.03 μs 03:27:04,392 PM [testNewLeaderTimeout-leader-222-writer-99] [DEBUG] JournalWriteTask - testNewLeaderTimeout-leader-222: journal writer stopped 03:27:04,393 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testNewLeaderTimeout-leader-222: journal closed 03:27:04,393 PM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - testNewLeaderTimeout-leader-222: journal closed 03:27:04,393 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testNewLeaderTimeout-leader-222: stopped executor with 0 remaining tasks 03:27:04,393 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testNewLeaderTimeout-leader-222: stopped executor with 0 remaining tasks 03:27:04,536 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] MockRaftActor - Actor created TestActor[pekko://test/user/testOnNewLeader-leader-223] [WARN] [11/06/2025 15:27:04.536] [test-pekko.actor.default-dispatcher-8] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/testOnNewLeader-leader-223]: org.opendaylight.controller.cluster.common.actor.Monitor@3e6d202c [INFO] [pekkoDeadLetter][11/06/2025 15:27:04.536] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/testOnNewLeader-leader-223] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:27:04,536 PM [test-pekko.actor.default-dispatcher-8] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/testOnNewLeader-leader-223] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:27:04,537 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - testOnNewLeader-leader-223: Starting recovery with journal batch size 1000 03:27:04,537 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testOnNewLeader-leader-223: started executor 03:27:04,537 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testOnNewLeader-leader-223: started executor 03:27:04,538 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testOnNewLeader-leader-223: metadata journal open: replayFrom=1 applyTo=0 03:27:04,539 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testOnNewLeader-leader-223: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:27:04,539 PM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - testOnNewLeader-leader-223: journal open: applyTo=0 03:27:04,539 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - testOnNewLeader-leader-223: starting journal recovery 03:27:04,539 PM [testOnNewLeader-leader-223-writer-100] [DEBUG] JournalWriteTask - testOnNewLeader-leader-223: journal writer started 03:27:04,539 PM [testOnNewLeader-leader-223-writer-100] [DEBUG] JournalWriteTask - testOnNewLeader-leader-223: waiting to receive commands 03:27:04,539 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/junit-12074320833227796475/testOnNewLeader-leader-223/TermInfo.properties does not exist 03:27:04,838 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - testOnNewLeader-leader-223: Set currentTerm=0, votedFor=null 03:27:04,838 PM [test-pekko.actor.default-dispatcher-7] [INFO] Recovery - testOnNewLeader-leader-223: Local TermInfo store seeded with TermInfo{term=0} 03:27:04,838 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testOnNewLeader-leader-223: skipping unrecognized file /tmp/junit-12074320833227796475/testOnNewLeader-leader-223/TermInfo.properties 03:27:04,838 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testOnNewLeader-leader-223: skipping unrecognized file /tmp/junit-12074320833227796475/testOnNewLeader-leader-223/journal-v1-1.log 03:27:04,838 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testOnNewLeader-leader-223: skipping unrecognized file /tmp/junit-12074320833227796475/testOnNewLeader-leader-223/metadata-v1-1.log 03:27:04,839 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testOnNewLeader-leader-223: no eligible files found 03:27:04,839 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - testOnNewLeader-leader-223: Moving last applied index from -1 to -1 03:27:04,839 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - testOnNewLeader-leader-223: empty journal: appending 0 entries 03:27:04,839 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testOnNewLeader-leader-223: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:27:04,839 PM [test-pekko.actor.default-dispatcher-7] [INFO] Recovery - testOnNewLeader-leader-223: Recovery completed in in 300.3 ms: last log index = -1, last log term = -1, napshot index = -1, snapshot term = -1, journal size = 0 03:27:04,839 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - testOnNewLeader-leader-223: Recovery completed and can restore from snapshot [WARN] [11/06/2025 15:27:04.840] [test-pekko.actor.default-dispatcher-8] [pekko://test/temp/_user_testOnNewLeader-leader-223$a] received dead letter: ActorIdentity(,Some(TestActor[pekko://test/user/testOnNewLeader-leader-223])) [INFO] [pekkoDeadLetter][11/06/2025 15:27:04.840] [test-pekko.actor.default-dispatcher-7] [pekko://test/temp/_user_testOnNewLeader-leader-223$a] Message [org.apache.pekko.actor.ActorIdentity] to Actor[pekko://test/temp/_user_testOnNewLeader-leader-223$a] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/temp/_user_testOnNewLeader-leader-223$a] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:27:04,840 PM [test-pekko.actor.default-dispatcher-7] [INFO] PromiseActorRef - pekkoDeadLetter Message [org.apache.pekko.actor.ActorIdentity] to Actor[pekko://test/temp/_user_testOnNewLeader-leader-223$a] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/temp/_user_testOnNewLeader-leader-223$a] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:27:04,937 PM [main] [DEBUG] RaftActorLeadershipTransferCohort - testOnNewLeader-leader-223: leader transfer complete - waiting for new leader 03:27:04,938 PM [main] [DEBUG] RaftActorLeadershipTransferCohort - testOnNewLeader-leader-223: leader changed to new-leader 03:27:04,938 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/testOnNewLeader-leader-223] 03:27:04,939 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EnabledRaftStorage - testOnNewLeader-leader-223: terminating thread VirtualThread[#496,testOnNewLeader-leader-223-writer-100]/waiting 03:27:04,939 PM [testOnNewLeader-leader-223-writer-100] [DEBUG] JournalWriteTask - testOnNewLeader-leader-223: received 1 commands after 400.1 ms 03:27:04,939 PM [testOnNewLeader-leader-223-writer-100] [DEBUG] JournalWriteTask - testOnNewLeader-leader-223: completed 1 commands in 12.46 μs 03:27:04,939 PM [testOnNewLeader-leader-223-writer-100] [DEBUG] JournalWriteTask - testOnNewLeader-leader-223: journal writer stopped 03:27:04,939 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testOnNewLeader-leader-223: journal closed 03:27:04,939 PM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - testOnNewLeader-leader-223: journal closed 03:27:04,939 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testOnNewLeader-leader-223: stopped executor with 0 remaining tasks 03:27:04,939 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testOnNewLeader-leader-223: stopped executor with 0 remaining tasks 03:27:04,942 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] MockRaftActor - Actor created TestActor[pekko://test/user/testNotLeaderOnDoTransfer-leader-224] [WARN] [11/06/2025 15:27:04.943] [test-pekko.actor.default-dispatcher-8] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/testNotLeaderOnDoTransfer-leader-224]: org.opendaylight.controller.cluster.common.actor.Monitor@3a52a339 [INFO] [pekkoDeadLetter][11/06/2025 15:27:04.943] [test-pekko.actor.default-dispatcher-9] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/testNotLeaderOnDoTransfer-leader-224] to Actor[pekko://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:27:04,943 PM [test-pekko.actor.default-dispatcher-9] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/testNotLeaderOnDoTransfer-leader-224] to Actor[pekko://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:27:04,943 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - testNotLeaderOnDoTransfer-leader-224: Starting recovery with journal batch size 1000 03:27:04,944 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testNotLeaderOnDoTransfer-leader-224: started executor 03:27:04,944 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testNotLeaderOnDoTransfer-leader-224: started executor 03:27:04,944 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testNotLeaderOnDoTransfer-leader-224: metadata journal open: replayFrom=1 applyTo=0 03:27:04,945 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testNotLeaderOnDoTransfer-leader-224: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:27:04,945 PM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - testNotLeaderOnDoTransfer-leader-224: journal open: applyTo=0 03:27:04,945 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - testNotLeaderOnDoTransfer-leader-224: starting journal recovery 03:27:04,945 PM [testNotLeaderOnDoTransfer-leader-224-writer-101] [DEBUG] JournalWriteTask - testNotLeaderOnDoTransfer-leader-224: journal writer started 03:27:04,945 PM [testNotLeaderOnDoTransfer-leader-224-writer-101] [DEBUG] JournalWriteTask - testNotLeaderOnDoTransfer-leader-224: waiting to receive commands 03:27:04,945 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/junit-15957760066747333542/testNotLeaderOnDoTransfer-leader-224/TermInfo.properties does not exist 03:27:04,950 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - testNotLeaderOnDoTransfer-leader-224: Set currentTerm=0, votedFor=null 03:27:04,950 PM [test-pekko.actor.default-dispatcher-7] [INFO] Recovery - testNotLeaderOnDoTransfer-leader-224: Local TermInfo store seeded with TermInfo{term=0} 03:27:04,950 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testNotLeaderOnDoTransfer-leader-224: skipping unrecognized file /tmp/junit-15957760066747333542/testNotLeaderOnDoTransfer-leader-224/TermInfo.properties 03:27:04,950 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testNotLeaderOnDoTransfer-leader-224: skipping unrecognized file /tmp/junit-15957760066747333542/testNotLeaderOnDoTransfer-leader-224/journal-v1-1.log 03:27:04,950 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testNotLeaderOnDoTransfer-leader-224: skipping unrecognized file /tmp/junit-15957760066747333542/testNotLeaderOnDoTransfer-leader-224/metadata-v1-1.log 03:27:04,950 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testNotLeaderOnDoTransfer-leader-224: no eligible files found 03:27:04,950 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - testNotLeaderOnDoTransfer-leader-224: Moving last applied index from -1 to -1 03:27:04,950 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - testNotLeaderOnDoTransfer-leader-224: empty journal: appending 0 entries 03:27:04,950 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testNotLeaderOnDoTransfer-leader-224: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:27:04,950 PM [test-pekko.actor.default-dispatcher-7] [INFO] Recovery - testNotLeaderOnDoTransfer-leader-224: Recovery completed in in 5.382 ms: last log index = -1, last log term = -1, napshot index = -1, snapshot term = -1, journal size = 0 03:27:04,950 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - testNotLeaderOnDoTransfer-leader-224: Recovery completed and can restore from snapshot 03:27:04,951 PM [main] [DEBUG] RaftActorLeadershipTransferCohort - testNotLeaderOnDoTransfer-leader-224: No longer the leader - skipping transfer 03:27:04,951 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/testNotLeaderOnDoTransfer-leader-224] 03:27:04,952 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EnabledRaftStorage - testNotLeaderOnDoTransfer-leader-224: terminating thread VirtualThread[#497,testNotLeaderOnDoTransfer-leader-224-writer-101]/waiting 03:27:04,952 PM [testNotLeaderOnDoTransfer-leader-224-writer-101] [DEBUG] JournalWriteTask - testNotLeaderOnDoTransfer-leader-224: received 1 commands after 7.105 ms 03:27:04,952 PM [testNotLeaderOnDoTransfer-leader-224-writer-101] [DEBUG] JournalWriteTask - testNotLeaderOnDoTransfer-leader-224: completed 1 commands in 9.220 μs 03:27:04,952 PM [testNotLeaderOnDoTransfer-leader-224-writer-101] [DEBUG] JournalWriteTask - testNotLeaderOnDoTransfer-leader-224: journal writer stopped 03:27:04,952 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testNotLeaderOnDoTransfer-leader-224: journal closed 03:27:04,952 PM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - testNotLeaderOnDoTransfer-leader-224: journal closed 03:27:04,952 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testNotLeaderOnDoTransfer-leader-224: stopped executor with 0 remaining tasks 03:27:04,952 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testNotLeaderOnDoTransfer-leader-224: stopped executor with 0 remaining tasks 03:27:04,956 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] MockRaftActor - Actor created TestActor[pekko://test/user/testPauseLeaderTimeout-leader-225] [WARN] [11/06/2025 15:27:04.956] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/testPauseLeaderTimeout-leader-225]: org.opendaylight.controller.cluster.common.actor.Monitor@17bf7fc5 [INFO] [pekkoDeadLetter][11/06/2025 15:27:04.956] [test-pekko.actor.default-dispatcher-9] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/testPauseLeaderTimeout-leader-225] to Actor[pekko://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:27:04,956 PM [test-pekko.actor.default-dispatcher-9] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/testPauseLeaderTimeout-leader-225] to Actor[pekko://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 03:27:04,957 PM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - testPauseLeaderTimeout-leader-225: Starting recovery with journal batch size 1000 03:27:04,957 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testPauseLeaderTimeout-leader-225: started executor 03:27:04,957 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testPauseLeaderTimeout-leader-225: started executor 03:27:04,958 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testPauseLeaderTimeout-leader-225: metadata journal open: replayFrom=1 applyTo=0 03:27:04,959 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testPauseLeaderTimeout-leader-225: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 03:27:04,959 PM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - testPauseLeaderTimeout-leader-225: journal open: applyTo=0 03:27:04,959 PM [testPauseLeaderTimeout-leader-225-writer-102] [DEBUG] JournalWriteTask - testPauseLeaderTimeout-leader-225: journal writer started 03:27:04,959 PM [testPauseLeaderTimeout-leader-225-writer-102] [DEBUG] JournalWriteTask - testPauseLeaderTimeout-leader-225: waiting to receive commands 03:27:04,959 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - testPauseLeaderTimeout-leader-225: starting journal recovery 03:27:04,959 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/junit-14182706141406143336/testPauseLeaderTimeout-leader-225/TermInfo.properties does not exist 03:27:04,962 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - testPauseLeaderTimeout-leader-225: Set currentTerm=0, votedFor=null 03:27:04,962 PM [test-pekko.actor.default-dispatcher-7] [INFO] Recovery - testPauseLeaderTimeout-leader-225: Local TermInfo store seeded with TermInfo{term=0} 03:27:04,962 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testPauseLeaderTimeout-leader-225: skipping unrecognized file /tmp/junit-14182706141406143336/testPauseLeaderTimeout-leader-225/TermInfo.properties 03:27:04,962 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testPauseLeaderTimeout-leader-225: skipping unrecognized file /tmp/junit-14182706141406143336/testPauseLeaderTimeout-leader-225/journal-v1-1.log 03:27:04,962 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testPauseLeaderTimeout-leader-225: skipping unrecognized file /tmp/junit-14182706141406143336/testPauseLeaderTimeout-leader-225/metadata-v1-1.log 03:27:04,962 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testPauseLeaderTimeout-leader-225: no eligible files found 03:27:04,962 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - testPauseLeaderTimeout-leader-225: Moving last applied index from -1 to -1 03:27:04,962 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - testPauseLeaderTimeout-leader-225: empty journal: appending 0 entries 03:27:04,962 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testPauseLeaderTimeout-leader-225: updated meta to JournalMeta[replayFrom=1, applyTo=0] 03:27:04,962 PM [test-pekko.actor.default-dispatcher-7] [INFO] Recovery - testPauseLeaderTimeout-leader-225: Recovery completed in in 3.272 ms: last log index = -1, last log term = -1, napshot index = -1, snapshot term = -1, journal size = 0 03:27:04,962 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - testPauseLeaderTimeout-leader-225: Recovery completed and can restore from snapshot 03:27:04,963 PM [main] [DEBUG] AbstractLeader - testPauseLeaderTimeout-leader-225 (Leader): Election: Leader has following peers: [] 03:27:05,178 PM [test-pekko.actor.default-dispatcher-9] [DEBUG] RaftActorLeadershipTransferCohort - testPauseLeaderTimeout-leader-225: pauseLeader timed out - continuing with transfer 03:27:05,178 PM [test-pekko.actor.default-dispatcher-9] [DEBUG] RaftActorLeadershipTransferCohort - testPauseLeaderTimeout-leader-225: leader transfer complete - waiting for new leader 03:27:05,798 PM [test-pekko.actor.default-dispatcher-9] [DEBUG] RaftActorLeadershipTransferCohort - testPauseLeaderTimeout-leader-225: leader not elected in time 03:27:05,798 PM [test-pekko.actor.default-dispatcher-9] [INFO] RaftActorLeadershipTransferCohort - testPauseLeaderTimeout-leader-225: Successfully transferred leadership to testPauseLeaderTimeout-leader-225 in 834.7 ms 03:27:05,807 PM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/testPauseLeaderTimeout-leader-225] 03:27:05,809 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EnabledRaftStorage - testPauseLeaderTimeout-leader-225: terminating thread VirtualThread[#498,testPauseLeaderTimeout-leader-225-writer-102]/waiting 03:27:05,809 PM [testPauseLeaderTimeout-leader-225-writer-102] [DEBUG] JournalWriteTask - testPauseLeaderTimeout-leader-225: received 1 commands after 849.9 ms 03:27:05,809 PM [testPauseLeaderTimeout-leader-225-writer-102] [DEBUG] JournalWriteTask - testPauseLeaderTimeout-leader-225: completed 1 commands in 9.730 μs 03:27:05,809 PM [testPauseLeaderTimeout-leader-225-writer-102] [DEBUG] JournalWriteTask - testPauseLeaderTimeout-leader-225: journal writer stopped 03:27:05,809 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - testPauseLeaderTimeout-leader-225: journal closed 03:27:05,809 PM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - testPauseLeaderTimeout-leader-225: journal closed 03:27:05,809 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testPauseLeaderTimeout-leader-225: stopped executor with 0 remaining tasks 03:27:05,809 PM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - testPauseLeaderTimeout-leader-225: stopped executor with 0 remaining tasks 03:27:05,813 PM [test-pekko.actor.default-dispatcher-9] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [INFO] [11/06/2025 15:27:05.812] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 03:27:05,816 PM [test-pekko.actor.default-dispatcher-9] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.21:17355] - Exiting completed 03:27:05,816 PM [test-pekko.actor.default-dispatcher-9] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.21:17355] - Shutting down... 03:27:05,816 PM [test-pekko.actor.default-dispatcher-9] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.21:17355] - Successfully shut down 03:27:05,817 PM [test-pekko.actor.default-dispatcher-9] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 03:27:05,817 PM [test-pekko.actor.default-dispatcher-9] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [WARN] [11/06/2025 15:27:05.817] [test-pekko.actor.default-dispatcher-7] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.170.21:17355) [INFO] [11/06/2025 15:27:05.814] [test-pekko.actor.internal-dispatcher-5] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.21:17355] - Exiting completed [INFO] [11/06/2025 15:27:05.814] [test-pekko.actor.internal-dispatcher-5] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.21:17355] - Shutting down... [INFO] [11/06/2025 15:27:05.815] [test-pekko.actor.internal-dispatcher-5] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.21:17355] - Successfully shut down [WARN] [11/06/2025 15:27:05.818] [test-pekko.actor.default-dispatcher-7] [pekko://test/system/deadLetterListener] received dead letter: UnhandledMessage(Leave(pekko://test@10.30.170.21:17355),Actor[pekko://test/deadLetters],Actor[pekko://test/system/cluster/core/daemon#-1913858869]) [INFO] [11/06/2025 15:27:05.817] [test-pekko.remote.default-remote-dispatcher-10] [pekko://test@10.30.170.21:17355/system/remoting-terminator] Shutting down remote daemon. [INFO] [11/06/2025 15:27:05.817] [test-pekko.remote.default-remote-dispatcher-10] [pekko://test@10.30.170.21:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports. 03:27:05,819 PM [test-pekko.actor.default-dispatcher-7] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down. [INFO] [11/06/2025 15:27:05.819] [test-pekko.remote.default-remote-dispatcher-12] [pekko://test@10.30.170.21:17355/system/remoting-terminator] Remoting shut down.