[DEBUG] [07/05/2025 09:20:37.605] [main] [EventStream(pekko://test)] logger log1-TestEventListener started 09:20:37,605 AM [test-pekko.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [07/05/2025 09:20:37.605] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started [DEBUG] [07/05/2025 09:20:37.605] [main] [EventStream(pekko://test)] Default Loggers started [INFO] [07/05/2025 09:20:37.629] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.171.247:17355] with UID [3430218679650454619] [INFO] [07/05/2025 09:20:37.630] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.247:17355] - Starting up, Pekko version [1.0.3] ... 09:20:37,630 AM [test-pekko.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.171.247:17355] with UID [3430218679650454619] 09:20:37,630 AM [test-pekko.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.247:17355] - Starting up, Pekko version [1.0.3] ... [INFO] [07/05/2025 09:20:37.635] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.247:17355] - Registered cluster JMX MBean [pekko:type=Cluster] 09:20:37,635 AM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.247:17355] - Registered cluster JMX MBean [pekko:type=Cluster] [INFO] [07/05/2025 09:20:37.635] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.247:17355] - Started up successfully 09:20:37,636 AM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.247:17355] - Started up successfully [INFO] [07/05/2025 09:20:37.637] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.247:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing [INFO] [07/05/2025 09:20:37.637] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.247:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 09:20:37,637 AM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.247:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing 09:20:37,637 AM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.247:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining 09:20:37,655 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithOperationInProgress starting [WARN] [07/05/2025 09:20:37.658] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server103]: org.opendaylight.controller.cluster.common.actor.Monitor@563d72f3 [INFO] [pekkoDeadLetter][07/05/2025 09:20:37.658] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/new-server103] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:20:37,659 AM [test-pekko.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/new-server103] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:20:37,659 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000 09:20:37,660 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: started executor 09:20:37,660 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: started executor 09:20:37,660 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0 09:20:37,661 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:20:37,661 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - new-server: journal open: applyTo=0 09:20:37,661 AM [new-server-writer-29] [DEBUG] JournalWriteTask - new-server: journal writer started 09:20:37,661 AM [new-server-writer-29] [DEBUG] JournalWriteTask - new-server: waiting to receive commands 09:20:37,663 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16093854800327225743/new-server/TermInfo.properties does not exist 09:20:37,663 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16093854800327225743/new-server/journal-v1-1.log 09:20:37,663 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16093854800327225743/new-server/metadata-v1-1.log 09:20:37,663 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - new-server: no eligible files found 09:20:37,663 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - new-server: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:20:37,667 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null 09:20:37,667 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0} 09:20:37,667 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot 09:20:37,667 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery 09:20:37,668 AM [test-pekko.actor.default-dispatcher-6] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [07/05/2025 09:20:37.670] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader104]: org.opendaylight.controller.cluster.common.actor.Monitor@21a9c83c [INFO] [pekkoDeadLetter][07/05/2025 09:20:37.671] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader104] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:20:37,671 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader104] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:20:37,671 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:20:37,671 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:20:37,671 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor 09:20:37,671 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor 09:20:37,672 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:20:37,672 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:20:37,672 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:20:37,672 AM [leader-writer-30] [DEBUG] JournalWriteTask - leader: journal writer started 09:20:37,672 AM [leader-writer-30] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:20:37,676 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16093854800327225743/leader/TermInfo.properties does not exist 09:20:37,677 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16093854800327225743/leader/journal-v1-1.log 09:20:37,677 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16093854800327225743/leader/metadata-v1-1.log 09:20:37,677 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: no eligible files found 09:20:37,677 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:20:37,682 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:20:37,682 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=} 09:20:37,682 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:20:37,682 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:20:37,683 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [] 09:20:37,685 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server103, votingMember=true], state: Idle 09:20:37,700 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server103, votingMember=true] 09:20:37,701 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 09:20:37,701 AM [test-pekko.actor.default-dispatcher-12] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server 09:20:37,701 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SnapshotManager - leader: last applied journal index prior to capture: 0 09:20:37,701 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - leader: support() called 09:20:37,701 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating capture snapshot for new server new-server 09:20:37,702 AM [leader-%d864949] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:20:37,704 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:20:37,705 AM [test-pekko.actor.default-dispatcher-12] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=-1, term=-1] 09:20:37,705 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - leader: support() called 09:20:37,705 AM [test-pekko.actor.default-dispatcher-12] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1 09:20:37,705 AM [leader-%d864950] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16093854800327225743/leader/snapshot-000000006868EE65-2A096F17.tmp 09:20:37,705 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): sendInstallSnapshot 09:20:37,707 AM [leader-%d864950] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16093854800327225743/leader/snapshot-000000006868EE65-2A096F17.v1 09:20:37,708 AM [leader-%d864950] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16093854800327225743/leader/snapshot-000000006868EE65-2A096F17.v1 09:20:37,708 AM [leader-%d864950] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16093854800327225743/leader/TermInfo.properties 09:20:37,708 AM [leader-%d864950] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16093854800327225743/leader/journal-v1-1.log 09:20:37,708 AM [leader-%d864950] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16093854800327225743/leader/metadata-v1-1.log 09:20:37,708 AM [leader-%d864950] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:20:37.705261335Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16093854800327225743/leader/snapshot-000000006868EE65-2A096F17.v1, size=64, entryCompress=NONE, stateCompress=NONE} 09:20:37,709 AM [leader-%d864950] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:20:37,709 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:20:37,709 AM [test-pekko.actor.default-dispatcher-12] [INFO] SnapshotManager - leader: snapshot is durable as of 2025-07-05T09:20:37.705261335Z 09:20:37,709 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SnapshotManager - leader: Snapshot success, discarding journal entries up to 0 09:20:37,709 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorSnapshotMessageSupport - leader: SnapshotComplete received 09:20:39,716 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: handleInstallSnapshotTimeout for new server new-server 09:20:39,718 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: Returning TIMEOUT for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server103, votingMember=true] 09:20:39,721 AM [test-pekko.actor.default-dispatcher-7] [WARN] RaftActorVotingConfigSupport - leader: Timeout occured for new server new-server while installing snapshot 09:20:42,722 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower101] 09:20:42,724 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector102#1932113617] 09:20:42,724 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server103] 09:20:42,725 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - new-server: terminating thread VirtualThread[#431,new-server-writer-29]/waiting 09:20:42,725 AM [new-server-writer-29] [DEBUG] JournalWriteTask - new-server: received 1 commands after 5.064 s 09:20:42,725 AM [new-server-writer-29] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 37.79 μs 09:20:42,725 AM [new-server-writer-29] [DEBUG] JournalWriteTask - new-server: journal writer stopped 09:20:42,726 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - new-server: journal closed 09:20:42,726 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - new-server: journal closed 09:20:42,726 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:20:42,726 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:20:42,726 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader104] 09:20:42,726 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#432,leader-writer-30]/waiting 09:20:42,727 AM [leader-writer-30] [DEBUG] JournalWriteTask - leader: received 1 commands after 5.054 s 09:20:42,727 AM [leader-writer-30] [DEBUG] JournalWriteTask - leader: completed 1 commands in 11.14 μs 09:20:42,727 AM [leader-writer-30] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:20:42,727 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal closed 09:20:42,727 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader: journal closed 09:20:42,727 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:20:42,727 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:20:42,727 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector105] 09:20:42,730 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerNonExistentServer starting 09:20:42,731 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader107] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [07/05/2025 09:20:42.731] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader107]: org.opendaylight.controller.cluster.common.actor.Monitor@49a534da [INFO] [pekkoDeadLetter][07/05/2025 09:20:42.731] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader107] to Actor[pekko://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:20:42,732 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:20:42,732 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:20:42,732 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor 09:20:42,733 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor 09:20:42,733 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:20:42,735 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:20:42,735 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:20:42,735 AM [leader-writer-31] [DEBUG] JournalWriteTask - leader: journal writer started 09:20:42,735 AM [leader-writer-31] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:20:42,736 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14298361597142993032/leader/TermInfo.properties does not exist 09:20:42,736 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14298361597142993032/leader/journal-v1-1.log 09:20:42,736 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14298361597142993032/leader/metadata-v1-1.log 09:20:42,736 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: no eligible files found 09:20:42,736 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:20:42,739 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:20:42,739 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=} 09:20:42,739 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:20:42,739 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:20:42,739 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [follower] 09:20:42,739 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: onRemoveServer: RemoveServer{serverId='new-server'}, state: Idle 09:20:42,740 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerNonExistentServer ending 09:20:42,740 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower106] 09:20:42,756 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader107] 09:20:42,756 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#435,leader-writer-31]/waiting 09:20:42,756 AM [leader-writer-31] [DEBUG] JournalWriteTask - leader: received 1 commands after 21.56 ms 09:20:42,757 AM [leader-writer-31] [DEBUG] JournalWriteTask - leader: completed 1 commands in 31.73 μs 09:20:42,757 AM [leader-writer-31] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:20:42,757 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal closed 09:20:42,757 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader: journal closed 09:20:42,757 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:20:42,757 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:20:42,760 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerWithNoLeader starting [WARN] [07/05/2025 09:20:42.761] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader109]: org.opendaylight.controller.cluster.common.actor.Monitor@48545e47 [INFO] [pekkoDeadLetter][07/05/2025 09:20:42.761] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader109] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:20:42,762 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader109] to Actor[pekko://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:20:42,762 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:20:42,762 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor 09:20:42,762 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor 09:20:42,762 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:20:42,763 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:20:42,763 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:20:42,763 AM [leader-writer-32] [DEBUG] JournalWriteTask - leader: journal writer started 09:20:42,763 AM [leader-writer-32] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:20:42,764 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7601572498714812494/leader/TermInfo.properties does not exist 09:20:42,764 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7601572498714812494/leader/journal-v1-1.log 09:20:42,764 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7601572498714812494/leader/metadata-v1-1.log 09:20:42,764 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: no eligible files found 09:20:42,764 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:20:42,770 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=0, votedFor=null 09:20:42,770 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=0} 09:20:42,770 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:20:42,770 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:20:42,781 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: onRemoveServer: RemoveServer{serverId='follower'}, state: Idle 09:20:42,781 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: No leader - returning NO_LEADER reply 09:20:42,781 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerWithNoLeader ending 09:20:42,781 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower108] 09:20:42,792 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader109] 09:20:42,792 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#436,leader-writer-32]/waiting 09:20:42,793 AM [leader-writer-32] [DEBUG] JournalWriteTask - leader: received 1 commands after 29.62 ms 09:20:42,793 AM [leader-writer-32] [DEBUG] JournalWriteTask - leader: completed 1 commands in 36.84 μs 09:20:42,793 AM [leader-writer-32] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:20:42,793 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal closed 09:20:42,793 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader: journal closed 09:20:42,793 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:20:42,793 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:20:42,796 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerLeader starting [WARN] [07/05/2025 09:20:42.798] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader112]: org.opendaylight.controller.cluster.common.actor.Monitor@79b837b8 [INFO] [pekkoDeadLetter][07/05/2025 09:20:42.798] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader112] to Actor[pekko://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:20:42,798 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader112] to Actor[pekko://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:20:42,798 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:20:42,799 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:20:42,799 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor 09:20:42,799 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor 09:20:42,800 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:20:42,801 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:20:42,801 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:20:42,801 AM [leader-writer-33] [DEBUG] JournalWriteTask - leader: journal writer started 09:20:42,801 AM [leader-writer-33] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:20:42,802 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest977068687727222685/leader/TermInfo.properties does not exist 09:20:42,802 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest977068687727222685/leader/journal-v1-1.log 09:20:42,802 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest977068687727222685/leader/metadata-v1-1.log 09:20:42,802 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: no eligible files found 09:20:42,802 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [07/05/2025 09:20:42.806] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower111]: org.opendaylight.controller.cluster.common.actor.Monitor@2e705039 09:20:42,806 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:20:42,806 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=} 09:20:42,806 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:20:42,806 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: no journal: skipping journal recovery [INFO] [pekkoDeadLetter][07/05/2025 09:20:42.806] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower111] to Actor[pekko://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:20:42,806 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [follower] 09:20:42,807 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - follower: Starting recovery with journal batch size 1000 09:20:42,807 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower: started executor 09:20:42,807 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower: started executor 09:20:42,808 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower111] to Actor[pekko://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:20:42,808 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower: metadata journal open: replayFrom=1 applyTo=0 09:20:42,809 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:20:42,809 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRaftStorage - follower: journal open: applyTo=0 09:20:42,809 AM [follower-writer-34] [DEBUG] JournalWriteTask - follower: journal writer started 09:20:42,809 AM [follower-writer-34] [DEBUG] JournalWriteTask - follower: waiting to receive commands 09:20:42,812 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: onRemoveServer: RemoveServer{serverId='leader'}, state: Idle 09:20:42,813 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest977068687727222685/follower/TermInfo.properties does not exist 09:20:42,813 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest977068687727222685/follower/journal-v1-1.log 09:20:42,813 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest977068687727222685/follower/metadata-v1-1.log 09:20:42,813 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower: no eligible files found 09:20:42,813 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:20:42,816 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=0, votedFor=null 09:20:42,816 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower: Local TermInfo store seeded with TermInfo{term=0} 09:20:42,816 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower: Pekko recovery completed and can restore from snapshot 09:20:42,816 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower: no journal: skipping journal recovery 09:20:42,815 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=follower, isVoting=true]] 09:20:42,818 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader: Persist data index=0 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true]]} 09:20:42,818 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true]]}, pending=true} 09:20:42,818 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=70a0c6bc-b474-48e3-b334-580c4c59d103}, logIndex: 0, isSendImmediate: true 09:20:42,818 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 09:20:42,819 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation RemoveServer{serverId='leader'} 09:20:42,820 AM [leader-%d987629] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest977068687727222685/leader/snapshot-000000006868EE6A-30CA844F.tmp 09:20:42,823 AM [leader-%d987629] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest977068687727222685/leader/snapshot-000000006868EE6A-30CA844F.v1 09:20:42,823 AM [leader-%d987629] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest977068687727222685/leader/TermInfo.properties 09:20:42,823 AM [leader-%d987629] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest977068687727222685/leader/journal-v1-1.log 09:20:42,823 AM [leader-%d987629] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest977068687727222685/leader/snapshot-000000006868EE6A-30CA844F.v1 09:20:42,824 AM [leader-%d987629] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest977068687727222685/leader/metadata-v1-1.log 09:20:42,824 AM [leader-%d987629] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:20:42.818578511Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest977068687727222685/leader/snapshot-000000006868EE6A-30CA844F.v1, size=75, entryCompress=NONE, stateCompress=NONE} 09:20:42,824 AM [leader-%d987629] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:20:42,824 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:20:42,824 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true]]}, pending=true} 09:20:44,836 AM [test-pekko.actor.default-dispatcher-16] [WARN] RaftActorVotingConfigSupport - leader: Timeout occured while replicating the new server configuration for leader 09:20:47,848 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower110] 09:20:47,859 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader112] 09:20:47,860 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#437,leader-writer-33]/waiting 09:20:47,860 AM [leader-writer-33] [DEBUG] JournalWriteTask - leader: received 1 commands after 5.059 s 09:20:47,860 AM [leader-writer-33] [DEBUG] JournalWriteTask - leader: completed 1 commands in 20.32 μs 09:20:47,860 AM [leader-writer-33] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:20:47,861 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader: journal closed 09:20:47,861 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader: journal closed 09:20:47,861 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:20:47,861 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:20:47,861 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector113] 09:20:47,861 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector114#-1000776714] 09:20:47,862 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower111] 09:20:47,862 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - follower: terminating thread VirtualThread[#441,follower-writer-34]/waiting 09:20:47,863 AM [follower-writer-34] [DEBUG] JournalWriteTask - follower: received 1 commands after 5.053 s 09:20:47,863 AM [follower-writer-34] [DEBUG] JournalWriteTask - follower: completed 1 commands in 15.30 μs 09:20:47,863 AM [follower-writer-34] [DEBUG] JournalWriteTask - follower: journal writer stopped 09:20:47,863 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower: journal closed 09:20:47,863 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower: journal closed 09:20:47,863 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks 09:20:47,863 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks 09:20:47,865 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithLeaderChangeDuringInstallSnapshot starting [WARN] [07/05/2025 09:20:47.866] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server117]: org.opendaylight.controller.cluster.common.actor.Monitor@5e22eb38 09:20:47,867 AM [test-pekko.actor.default-dispatcher-7] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/new-server117] to Actor[pekko://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][07/05/2025 09:20:47.867] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/new-server117] to Actor[pekko://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:20:47,868 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000 09:20:47,868 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: started executor 09:20:47,869 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: started executor 09:20:47,869 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0 09:20:47,870 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:20:47,870 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - new-server: journal open: applyTo=0 09:20:47,870 AM [new-server-writer-35] [DEBUG] JournalWriteTask - new-server: journal writer started 09:20:47,870 AM [new-server-writer-35] [DEBUG] JournalWriteTask - new-server: waiting to receive commands 09:20:47,872 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16943981022055139833/new-server/TermInfo.properties does not exist 09:20:47,873 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16943981022055139833/new-server/journal-v1-1.log 09:20:47,873 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16943981022055139833/new-server/metadata-v1-1.log 09:20:47,873 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: no eligible files found 09:20:47,873 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - new-server: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:20:47,887 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null 09:20:47,887 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0} 09:20:47,887 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot 09:20:47,887 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery 09:20:47,888 AM [test-pekko.actor.default-dispatcher-15] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [07/05/2025 09:20:47.889] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader118]: org.opendaylight.controller.cluster.common.actor.Monitor@f5e2be7 [INFO] [pekkoDeadLetter][07/05/2025 09:20:47.889] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader118] to Actor[pekko://test/user/termination-monitor] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:20:47,889 AM [test-pekko.actor.default-dispatcher-16] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader118] to Actor[pekko://test/user/termination-monitor] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:20:47,890 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:20:47,890 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:20:47,890 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor 09:20:47,890 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor 09:20:47,891 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:20:47,892 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:20:47,892 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:20:47,892 AM [leader-writer-36] [DEBUG] JournalWriteTask - leader: journal writer started 09:20:47,892 AM [leader-writer-36] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:20:47,893 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16943981022055139833/leader/TermInfo.properties does not exist 09:20:47,894 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16943981022055139833/leader/journal-v1-1.log 09:20:47,894 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16943981022055139833/leader/metadata-v1-1.log 09:20:47,894 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: no eligible files found 09:20:47,894 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:20:47,896 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:20:47,896 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=} 09:20:47,896 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:20:47,896 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:20:47,897 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [] 09:20:47,903 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server117, votingMember=true], state: Idle 09:20:47,903 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server117, votingMember=true] 09:20:47,904 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 09:20:47,904 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server 09:20:47,904 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - leader: last applied journal index prior to capture: 0 09:20:47,904 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader: support() called 09:20:47,904 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating capture snapshot for new server new-server 09:20:47,904 AM [leader-%d34256] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:20:47,904 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:20:47,904 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=-1, term=-1] 09:20:47,904 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader: support() called 09:20:47,905 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1 09:20:47,905 AM [leader-%d34257] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16943981022055139833/leader/snapshot-000000006868EE6F-35F254DB.tmp 09:20:47,905 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader (Leader): sendInstallSnapshot 09:20:47,907 AM [leader-%d34257] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16943981022055139833/leader/snapshot-000000006868EE6F-35F254DB.v1 09:20:47,907 AM [leader-%d34257] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16943981022055139833/leader/snapshot-000000006868EE6F-35F254DB.v1 09:20:47,908 AM [leader-%d34257] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16943981022055139833/leader/TermInfo.properties 09:20:47,908 AM [leader-%d34257] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16943981022055139833/leader/journal-v1-1.log 09:20:47,908 AM [leader-%d34257] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16943981022055139833/leader/metadata-v1-1.log 09:20:47,908 AM [leader-%d34257] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:20:47.905073883Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16943981022055139833/leader/snapshot-000000006868EE6F-35F254DB.v1, size=64, entryCompress=NONE, stateCompress=NONE} 09:20:47,908 AM [leader-%d34257] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:20:47,908 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:20:47,908 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader: snapshot is durable as of 2025-07-05T09:20:47.905073883Z 09:20:47,908 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - leader: Snapshot success, discarding journal entries up to 0 09:20:47,908 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - leader: SnapshotComplete received 09:20:49,516 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: handleInstallSnapshotTimeout for new server new-server 09:20:49,516 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: Returning TIMEOUT for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server117, votingMember=true] 09:20:49,516 AM [test-pekko.actor.default-dispatcher-7] [WARN] RaftActorVotingConfigSupport - leader: Timeout occured for new server new-server while installing snapshot 09:20:52,922 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower115] 09:20:52,934 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector116#-1119429528] 09:20:52,936 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server117] 09:20:52,937 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - new-server: terminating thread VirtualThread[#443,new-server-writer-35]/waiting 09:20:52,937 AM [new-server-writer-35] [DEBUG] JournalWriteTask - new-server: received 1 commands after 5.067 s 09:20:52,937 AM [new-server-writer-35] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 44.99 μs 09:20:52,938 AM [new-server-writer-35] [DEBUG] JournalWriteTask - new-server: journal writer stopped 09:20:52,938 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - new-server: journal closed 09:20:52,938 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - new-server: journal closed 09:20:52,938 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:20:52,938 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:20:52,939 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader118] 09:20:52,939 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#444,leader-writer-36]/waiting 09:20:52,939 AM [leader-writer-36] [DEBUG] JournalWriteTask - leader: received 1 commands after 5.047 s 09:20:52,939 AM [leader-writer-36] [DEBUG] JournalWriteTask - leader: completed 1 commands in 21.52 μs 09:20:52,939 AM [leader-writer-36] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:20:52,939 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader: journal closed 09:20:52,939 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader: journal closed 09:20:52,939 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:20:52,939 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:20:52,940 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector119] 09:20:52,944 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeToVotingWithNoLeaderAndOtherLeaderElected starting 09:20:52,949 AM [test-pekko.actor.default-dispatcher-15] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/node1] to Actor[pekko://test/user/termination-monitor] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [WARN] [07/05/2025 09:20:52.949] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/node1]: org.opendaylight.controller.cluster.common.actor.Monitor@1efc144a [INFO] [pekkoDeadLetter][07/05/2025 09:20:52.949] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/node1] to Actor[pekko://test/user/termination-monitor] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:20:52,949 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - node1: Starting recovery with journal batch size 1000 09:20:52,949 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - node1: started executor 09:20:52,950 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - node1: started executor 09:20:52,950 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - node1: metadata journal open: replayFrom=1 applyTo=0 09:20:52,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - node1: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:20:52,951 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - node1: journal open: applyTo=0 09:20:52,951 AM [node1-writer-37] [DEBUG] JournalWriteTask - node1: journal writer started 09:20:52,951 AM [node1-writer-37] [DEBUG] JournalWriteTask - node1: waiting to receive commands 09:20:52,953 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node1/TermInfo.properties does not exist 09:20:52,953 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node1/journal-v1-1.log 09:20:52,953 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node1/metadata-v1-1.log 09:20:52,953 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: no eligible files found 09:20:52,953 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=1, votedFor=node1 09:20:52,953 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRecovery - node1: Received ReplicatedLogEntry for recovery: index: 0, size: 133 09:20:52,953 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PeerInfos - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=VOTING]] 09:20:52,953 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - node1: Recovery completed - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1 09:20:52,956 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=1, votedFor=node1 09:20:52,956 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - node1: Local TermInfo store seeded with TermInfo{term=1, votedFor=node1} 09:20:52,956 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - node1: taking snapshot to clear Pekko persistence to 2 09:20:52,956 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Recovery - node1: no applied entries in recovery log, re-snapshotting EntryInfo[index=-1, term=-1] 09:20:52,956 AM [test-pekko.actor.default-dispatcher-7] [INFO] Recovery - node1: Taking snapshot on entry with index -1 09:20:52,956 AM [test-pekko.actor.default-dispatcher-7] [INFO] MockRaftActor - node1: support() called 09:20:52,956 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node1/snapshot-000000006868EE74-3901D381.tmp 09:20:52,960 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node1/snapshot-000000006868EE74-3901D381.v1 09:20:52,960 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node1/snapshot-000000006868EE74-3901D381.v1 09:20:52,960 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node1/TermInfo.properties 09:20:52,960 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node1/journal-v1-1.log 09:20:52,960 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node1/metadata-v1-1.log 09:20:52,960 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:20:52.956420993Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node1/snapshot-000000006868EE74-3901D381.v1, size=380, entryCompress=NONE, stateCompress=NONE} 09:20:52,960 AM [test-pekko.actor.default-dispatcher-7] [INFO] Recovery - node1: Snapshot completed in 4.587 ms, resetting timer for the next recovery snapshot 09:20:52,961 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - node1: Pekko recovery completed and can restore from snapshot 09:20:52,961 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - node1: starting journal recovery 09:20:52,961 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - node1: Moving last applied index from -1 to -1 09:20:52,961 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - node1: empty journal: appending 1 entries 09:20:52,961 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - node1: updated meta to JournalMeta[replayFrom=1, applyTo=0] 09:20:52,965 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - node1: journal recovery completedin 4.395 ms with journalIndex=1 09:20:52,966 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - node1: ignoring DeleteMessagesSuccess(2) [WARN] [07/05/2025 09:20:53.053] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/node2]: org.opendaylight.controller.cluster.common.actor.Monitor@587deea5 09:20:53,54 AM [test-pekko.actor.default-dispatcher-16] [INFO] EmptyLocalActorRef - pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/node2] to Actor[pekko://test/user/termination-monitor] was not delivered. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. [INFO] [pekkoDeadLetter][07/05/2025 09:20:53.054] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/node2] to Actor[pekko://test/user/termination-monitor] was not delivered. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'. 09:20:53,55 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - node2: Starting recovery with journal batch size 1000 09:20:53,55 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node2: started executor 09:20:53,55 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node2: started executor 09:20:53,56 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - node2: metadata journal open: replayFrom=1 applyTo=0 09:20:53,57 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - node2: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:20:53,57 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - node2: journal open: applyTo=0 09:20:53,57 AM [node2-writer-38] [DEBUG] JournalWriteTask - node2: journal writer started 09:20:53,57 AM [node2-writer-38] [DEBUG] JournalWriteTask - node2: waiting to receive commands 09:20:53,59 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node2/TermInfo.properties does not exist 09:20:53,59 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node2/journal-v1-1.log 09:20:53,59 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node2/metadata-v1-1.log 09:20:53,59 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: no eligible files found 09:20:53,59 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=1, votedFor=node1 09:20:53,59 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - node2: Received ReplicatedLogEntry for recovery: index: 0, size: 133 09:20:53,59 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - node2: Updated server config: isVoting: true, peers: [PeerInfo [id=node1, address=null, votingState=NON_VOTING]] 09:20:53,59 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - node2: Recovery completed - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1 09:20:53,61 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=1, votedFor=node1 09:20:53,61 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - node2: Local TermInfo store seeded with TermInfo{term=1, votedFor=node1} 09:20:53,61 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - node2: taking snapshot to clear Pekko persistence to 2 09:20:53,62 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Recovery - node2: no applied entries in recovery log, re-snapshotting EntryInfo[index=-1, term=-1] 09:20:53,62 AM [test-pekko.actor.default-dispatcher-15] [INFO] Recovery - node2: Taking snapshot on entry with index -1 09:20:53,62 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - node2: support() called 09:20:53,62 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node2/snapshot-000000006868EE75-03B3D820.tmp 09:20:53,63 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node2/snapshot-000000006868EE75-03B3D820.v1 09:20:53,63 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node2/snapshot-000000006868EE75-03B3D820.v1 09:20:53,64 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node2/TermInfo.properties 09:20:53,64 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node2/journal-v1-1.log 09:20:53,64 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node2/metadata-v1-1.log 09:20:53,64 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:20:53.062117920Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2329297534021105703/node2/snapshot-000000006868EE75-03B3D820.v1, size=380, entryCompress=NONE, stateCompress=NONE} 09:20:53,64 AM [test-pekko.actor.default-dispatcher-15] [INFO] Recovery - node2: Snapshot completed in 2.242 ms, resetting timer for the next recovery snapshot 09:20:53,64 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - node2: Pekko recovery completed and can restore from snapshot 09:20:53,64 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - node2: starting journal recovery 09:20:53,64 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - node2: Moving last applied index from -1 to -1 09:20:53,64 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - node2: empty journal: appending 1 entries 09:20:53,64 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - node2: updated meta to JournalMeta[replayFrom=1, applyTo=0] 09:20:53,68 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - node2: journal recovery completedin 4.277 ms with journalIndex=1 09:20:53,68 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - node1: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[]], state: Idle 09:20:53,69 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - node2: ignoring DeleteMessagesSuccess(2) 09:20:53,73 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState 09:20:53,73 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - node1: Sending local ElectionTimeout to start leader election 09:20:53,73 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PeerInfos - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=null, votingState=VOTING]] 09:20:53,74 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 09:20:53,74 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - node1 (Follower): Received TimeoutNow - switching to Candidate 09:20:53,74 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - node1 (Candidate): Election: Candidate has following voting peers: [node2] 09:20:53,76 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=2, votedFor=node1 09:20:53,76 AM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - node1 (Candidate): Starting new election term 2 09:20:53,76 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - node1 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 09:20:58,100 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower120] 09:20:58,112 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector121#-305697153] 09:20:58,112 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/node1] 09:20:58,112 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - node1: terminating thread VirtualThread[#447,node1-writer-37]/waiting 09:20:58,113 AM [node1-writer-37] [DEBUG] JournalWriteTask - node1: received 1 commands after 5.162 s 09:20:58,113 AM [node1-writer-37] [DEBUG] JournalWriteTask - node1: completed 1 commands in 45.00 μs 09:20:58,113 AM [node1-writer-37] [DEBUG] JournalWriteTask - node1: journal writer stopped 09:20:58,113 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - node1: journal closed 09:20:58,113 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - node1: journal closed 09:20:58,113 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: stopped executor with 0 remaining tasks 09:20:58,113 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: stopped executor with 0 remaining tasks 09:20:58,114 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector122#-530002050] 09:20:58,115 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/node2] 09:20:58,116 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - node2: terminating thread VirtualThread[#448,node2-writer-38]/waiting 09:20:58,116 AM [node2-writer-38] [DEBUG] JournalWriteTask - node2: received 1 commands after 5.059 s 09:20:58,116 AM [node2-writer-38] [DEBUG] JournalWriteTask - node2: completed 1 commands in 48.48 μs 09:20:58,116 AM [node2-writer-38] [DEBUG] JournalWriteTask - node2: journal writer stopped 09:20:58,116 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - node2: journal closed 09:20:58,116 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - node2: journal closed 09:20:58,116 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node2: stopped executor with 0 remaining tasks 09:20:58,117 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node2: stopped executor with 0 remaining tasks 09:20:58,123 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithInstallSnapshotTimeout starting [WARN] [07/05/2025 09:20:58.124] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server125]: org.opendaylight.controller.cluster.common.actor.Monitor@436eb167 09:20:58,125 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000 09:20:58,125 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: started executor 09:20:58,125 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: started executor 09:20:58,126 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0 09:20:58,126 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:20:58,126 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - new-server: journal open: applyTo=0 09:20:58,126 AM [new-server-writer-39] [DEBUG] JournalWriteTask - new-server: journal writer started 09:20:58,126 AM [new-server-writer-39] [DEBUG] JournalWriteTask - new-server: waiting to receive commands 09:20:58,128 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7124704621837174416/new-server/TermInfo.properties does not exist 09:20:58,128 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7124704621837174416/new-server/journal-v1-1.log 09:20:58,128 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7124704621837174416/new-server/metadata-v1-1.log 09:20:58,128 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: no eligible files found 09:20:58,128 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - new-server: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:20:58,130 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null 09:20:58,131 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0} 09:20:58,131 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot 09:20:58,131 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery 09:20:58,131 AM [test-pekko.actor.default-dispatcher-15] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [07/05/2025 09:20:58.132] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader126]: org.opendaylight.controller.cluster.common.actor.Monitor@4536cd04 09:20:58,133 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:20:58,133 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:20:58,133 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:20:58,133 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:20:58,134 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:20:58,135 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:20:58,135 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:20:58,135 AM [leader-writer-40] [DEBUG] JournalWriteTask - leader: journal writer started 09:20:58,135 AM [leader-writer-40] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:20:58,137 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7124704621837174416/leader/TermInfo.properties does not exist 09:20:58,137 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7124704621837174416/leader/journal-v1-1.log 09:20:58,137 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7124704621837174416/leader/metadata-v1-1.log 09:20:58,138 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: no eligible files found 09:20:58,138 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:20:58,142 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:20:58,142 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=} 09:20:58,142 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:20:58,142 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:20:58,142 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [] 09:20:58,146 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server125, votingMember=true], state: Idle 09:20:58,146 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server125, votingMember=true] 09:20:58,147 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 09:20:58,147 AM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server 09:20:58,147 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - leader: last applied journal index prior to capture: 0 09:20:58,147 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader: support() called 09:20:58,147 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating capture snapshot for new server new-server 09:20:58,148 AM [leader-%d596058] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:20:58,148 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: onUnInitializedFollowerSnapshotReply: UnInitializedFollowerSnapshotReply [followerId=bogus] 09:20:58,148 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: Dropping UnInitializedFollowerSnapshotReply for server bogus: server Id doesn't match 09:20:58,148 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:20:58,148 AM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=-1, term=-1] 09:20:58,148 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader: support() called 09:20:58,148 AM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1 09:20:58,148 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader (Leader): sendInstallSnapshot 09:20:58,148 AM [leader-%d596059] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7124704621837174416/leader/snapshot-000000006868EE7A-08DEA2CA.tmp 09:20:58,151 AM [leader-%d596059] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7124704621837174416/leader/snapshot-000000006868EE7A-08DEA2CA.v1 09:20:58,151 AM [leader-%d596059] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7124704621837174416/leader/TermInfo.properties 09:20:58,151 AM [leader-%d596059] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7124704621837174416/leader/journal-v1-1.log 09:20:58,151 AM [leader-%d596059] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7124704621837174416/leader/snapshot-000000006868EE7A-08DEA2CA.v1 09:20:58,151 AM [leader-%d596059] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7124704621837174416/leader/metadata-v1-1.log 09:20:58,151 AM [leader-%d596059] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:20:58.148808394Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7124704621837174416/leader/snapshot-000000006868EE7A-08DEA2CA.v1, size=64, entryCompress=NONE, stateCompress=NONE} 09:20:58,151 AM [leader-%d596059] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:20:58,151 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:20:58,151 AM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader: snapshot is durable as of 2025-07-05T09:20:58.148808394Z 09:20:58,151 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - leader: Snapshot success, discarding journal entries up to 0 09:20:58,152 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorSnapshotMessageSupport - leader: SnapshotComplete received 09:20:58,366 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: handleInstallSnapshotTimeout for new server new-server 09:20:58,366 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: Returning TIMEOUT for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server125, votingMember=true] 09:20:58,366 AM [test-pekko.actor.default-dispatcher-17] [WARN] RaftActorVotingConfigSupport - leader: Timeout occured for new server new-server while installing snapshot 09:20:58,367 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithInstallSnapshotTimeout ending 09:20:58,367 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower123] 09:20:58,378 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector124#-980905262] 09:20:58,378 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server125] 09:20:58,379 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - new-server: terminating thread VirtualThread[#449,new-server-writer-39]/waiting 09:20:58,379 AM [new-server-writer-39] [DEBUG] JournalWriteTask - new-server: received 1 commands after 252.7 ms 09:20:58,379 AM [new-server-writer-39] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 37.28 μs 09:20:58,379 AM [new-server-writer-39] [DEBUG] JournalWriteTask - new-server: journal writer stopped 09:20:58,379 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - new-server: journal closed 09:20:58,379 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - new-server: journal closed 09:20:58,379 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:20:58,379 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:20:58,380 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader126] 09:20:58,380 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#450,leader-writer-40]/waiting 09:20:58,380 AM [leader-writer-40] [DEBUG] JournalWriteTask - leader: received 1 commands after 244.7 ms 09:20:58,380 AM [leader-writer-40] [DEBUG] JournalWriteTask - leader: completed 1 commands in 20.52 μs 09:20:58,380 AM [leader-writer-40] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:20:58,380 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader: journal closed 09:20:58,380 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader: journal closed 09:20:58,381 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:20:58,381 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:20:58,384 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithNoExistingFollower starting [WARN] [07/05/2025 09:20:58.385] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server129]: org.opendaylight.controller.cluster.common.actor.Monitor@6f52803f 09:20:58,386 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000 09:20:58,386 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - new-server: started executor 09:20:58,387 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - new-server: started executor 09:20:58,387 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0 09:20:58,388 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:20:58,388 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - new-server: journal open: applyTo=0 09:20:58,388 AM [new-server-writer-41] [DEBUG] JournalWriteTask - new-server: journal writer started 09:20:58,388 AM [new-server-writer-41] [DEBUG] JournalWriteTask - new-server: waiting to receive commands 09:20:58,390 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7190138507414307390/new-server/TermInfo.properties does not exist 09:20:58,390 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7190138507414307390/new-server/journal-v1-1.log 09:20:58,390 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7190138507414307390/new-server/metadata-v1-1.log 09:20:58,390 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: no eligible files found 09:20:58,390 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - new-server: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:20:58,392 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null 09:20:58,393 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0} 09:20:58,393 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot 09:20:58,393 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery 09:20:58,393 AM [main] [DEBUG] AbstractReplicatedLog - : Moving last applied index from -1 to 1 09:20:58,393 AM [test-pekko.actor.default-dispatcher-15] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [07/05/2025 09:20:58.393] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader130]: org.opendaylight.controller.cluster.common.actor.Monitor@34ecdd9a 09:20:58,394 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:20:58,394 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:20:58,394 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: started executor 09:20:58,394 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: started executor 09:20:58,394 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:20:58,394 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:20:58,394 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:20:58,394 AM [leader-writer-42] [DEBUG] JournalWriteTask - leader: journal writer started 09:20:58,394 AM [leader-writer-42] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:20:58,395 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7190138507414307390/leader/TermInfo.properties does not exist 09:20:58,395 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7190138507414307390/leader/journal-v1-1.log 09:20:58,395 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7190138507414307390/leader/metadata-v1-1.log 09:20:58,395 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: no eligible files found 09:20:58,395 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:20:58,398 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:20:58,398 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=} 09:20:58,398 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:20:58,398 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:20:58,398 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [] 09:20:58,406 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server129, votingMember=true], state: Idle 09:20:58,406 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server129, votingMember=true] 09:20:58,406 AM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=1, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server 09:20:58,406 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - leader: last applied journal index prior to capture: 2 09:20:58,406 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader: support() called 09:20:58,407 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating capture snapshot for new server new-server 09:20:58,407 AM [leader-%d849611] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:20:58,407 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:20:58,407 AM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=1, term=1]/EntryInfo[index=1, term=1] 09:20:58,407 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader: support() called 09:20:58,408 AM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1 09:20:58,408 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader (Leader): sendInstallSnapshot 09:20:58,408 AM [leader-%d849612] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7190138507414307390/leader/snapshot-000000006868EE7A-18537A83.tmp 09:20:58,411 AM [leader-%d849612] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7190138507414307390/leader/snapshot-000000006868EE7A-18537A83.v1 09:20:58,411 AM [leader-%d849612] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7190138507414307390/leader/snapshot-000000006868EE7A-18537A83.v1 09:20:58,412 AM [leader-%d849612] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7190138507414307390/leader/TermInfo.properties 09:20:58,412 AM [leader-%d849612] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7190138507414307390/leader/journal-v1-1.log 09:20:58,412 AM [leader-%d849612] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7190138507414307390/leader/metadata-v1-1.log 09:20:58,412 AM [leader-%d849612] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:20:58.408124035Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7190138507414307390/leader/snapshot-000000006868EE7A-18537A83.v1, size=64, entryCompress=NONE, stateCompress=NONE} 09:20:58,412 AM [leader-%d849612] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:20:58,412 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:20:58,412 AM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader: snapshot is durable as of 2025-07-05T09:20:58.408124035Z 09:20:58,413 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - leader: Snapshot success, discarding journal entries up to 2 09:20:58,413 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorSnapshotMessageSupport - leader: SnapshotComplete received 09:21:00,416 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: handleInstallSnapshotTimeout for new server new-server 09:21:00,416 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: Returning TIMEOUT for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server129, votingMember=true] 09:21:00,416 AM [test-pekko.actor.default-dispatcher-17] [WARN] RaftActorVotingConfigSupport - leader: Timeout occured for new server new-server while installing snapshot 09:21:03,443 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower127] 09:21:03,454 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector128#1057919872] 09:21:03,455 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server129] 09:21:03,455 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - new-server: terminating thread VirtualThread[#453,new-server-writer-41]/waiting 09:21:03,455 AM [new-server-writer-41] [DEBUG] JournalWriteTask - new-server: received 1 commands after 5.067 s 09:21:03,455 AM [new-server-writer-41] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 40.45 μs 09:21:03,456 AM [new-server-writer-41] [DEBUG] JournalWriteTask - new-server: journal writer stopped 09:21:03,456 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - new-server: journal closed 09:21:03,456 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - new-server: journal closed 09:21:03,456 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:03,456 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:03,456 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader130] 09:21:03,457 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#454,leader-writer-42]/waiting 09:21:03,457 AM [leader-writer-42] [DEBUG] JournalWriteTask - leader: received 1 commands after 5.062 s 09:21:03,457 AM [leader-writer-42] [DEBUG] JournalWriteTask - leader: completed 1 commands in 21.29 μs 09:21:03,457 AM [leader-writer-42] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:21:03,457 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader: journal closed 09:21:03,457 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader: journal closed 09:21:03,457 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:03,457 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:03,458 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector131] 09:21:03,462 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeToVotingWithNoLeaderAndForwardedToOtherNodeAfterElectionTimeout starting [WARN] [07/05/2025 09:21:03.464] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/node1]: org.opendaylight.controller.cluster.common.actor.Monitor@17634fbc 09:21:03,465 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - node1: Starting recovery with journal batch size 1000 09:21:03,465 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: started executor 09:21:03,465 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: started executor 09:21:03,466 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node1: metadata journal open: replayFrom=1 applyTo=0 09:21:03,466 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node1: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:03,466 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - node1: journal open: applyTo=0 09:21:03,466 AM [node1-writer-43] [DEBUG] JournalWriteTask - node1: journal writer started 09:21:03,466 AM [node1-writer-43] [DEBUG] JournalWriteTask - node1: waiting to receive commands 09:21:03,468 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node1/TermInfo.properties does not exist 09:21:03,468 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node1/journal-v1-1.log [WARN] [07/05/2025 09:21:03.468] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/node2]: org.opendaylight.controller.cluster.common.actor.Monitor@4ab648b3 09:21:03,469 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node1/metadata-v1-1.log 09:21:03,469 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: no eligible files found 09:21:03,469 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=1, votedFor=node1 09:21:03,469 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRecovery - node1: Received ReplicatedLogEntry for recovery: index: 0, size: 133 09:21:03,469 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PeerInfos - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=NON_VOTING]] 09:21:03,469 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - node1: Recovery completed - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1 09:21:03,469 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - node2: Starting recovery with journal batch size 1000 09:21:03,469 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: started executor 09:21:03,469 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: started executor 09:21:03,470 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - node2: metadata journal open: replayFrom=1 applyTo=0 09:21:03,470 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - node2: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:03,470 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - node2: journal open: applyTo=0 09:21:03,470 AM [node2-writer-44] [DEBUG] JournalWriteTask - node2: journal writer started 09:21:03,470 AM [node2-writer-44] [DEBUG] JournalWriteTask - node2: waiting to receive commands 09:21:03,472 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=1, votedFor=node1 09:21:03,472 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - node1: Local TermInfo store seeded with TermInfo{term=1, votedFor=node1} 09:21:03,472 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - node1: taking snapshot to clear Pekko persistence to 2 09:21:03,472 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Recovery - node1: no applied entries in recovery log, re-snapshotting EntryInfo[index=-1, term=-1] 09:21:03,472 AM [test-pekko.actor.default-dispatcher-7] [INFO] Recovery - node1: Taking snapshot on entry with index -1 09:21:03,472 AM [test-pekko.actor.default-dispatcher-7] [INFO] MockRaftActor - node1: support() called 09:21:03,472 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node1/snapshot-000000006868EE7F-1C2AC203.tmp 09:21:03,472 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node2/TermInfo.properties does not exist 09:21:03,472 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node2/journal-v1-1.log 09:21:03,472 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node2/metadata-v1-1.log 09:21:03,472 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: no eligible files found 09:21:03,472 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=1, votedFor=node1 09:21:03,473 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - node2: Received ReplicatedLogEntry for recovery: index: 0, size: 133 09:21:03,473 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - node2: Updated server config: isVoting: false, peers: [PeerInfo [id=node1, address=null, votingState=NON_VOTING]] 09:21:03,473 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - node2: Received ReplicatedLogEntry for recovery: index: 1, size: 1 09:21:03,473 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRecovery - node2: Received apply journal entries for recovery, applying to state: 0 to 1 09:21:03,473 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - node2: Moving last applied index from -1 to 1 09:21:03,473 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - node2: Recovery completed in 32.26 μs - Switching actor to Follower - last log index = 1, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 2 09:21:03,474 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node1/snapshot-000000006868EE7F-1C2AC203.v1 09:21:03,475 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node1/snapshot-000000006868EE7F-1C2AC203.v1 09:21:03,475 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node1/TermInfo.properties 09:21:03,475 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node1/journal-v1-1.log 09:21:03,475 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node1/metadata-v1-1.log 09:21:03,475 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:21:03.472564227Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node1/snapshot-000000006868EE7F-1C2AC203.v1, size=380, entryCompress=NONE, stateCompress=NONE} 09:21:03,475 AM [test-pekko.actor.default-dispatcher-7] [INFO] Recovery - node1: Snapshot completed in 2.937 ms, resetting timer for the next recovery snapshot 09:21:03,475 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - node1: Pekko recovery completed and can restore from snapshot 09:21:03,475 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - node1: starting journal recovery 09:21:03,475 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - node1: Moving last applied index from -1 to -1 09:21:03,475 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - node1: empty journal: appending 1 entries 09:21:03,475 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - node1: updated meta to JournalMeta[replayFrom=1, applyTo=0] 09:21:03,475 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=1, votedFor=node1 09:21:03,475 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - node2: Local TermInfo store seeded with TermInfo{term=1, votedFor=node1} 09:21:03,475 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - node2: taking snapshot to clear Pekko persistence to 4 09:21:03,475 AM [test-pekko.actor.default-dispatcher-15] [INFO] Recovery - node2: Taking snapshot on entry with index 1 09:21:03,475 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - node2: support() called 09:21:03,475 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node2/snapshot-000000006868EE7F-1C5D7D03.tmp 09:21:03,479 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - node1: journal recovery completedin 3.577 ms with journalIndex=1 09:21:03,479 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - node1: ignoring DeleteMessagesSuccess(2) 09:21:03,479 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node2/snapshot-000000006868EE7F-1C5D7D03.v1 09:21:03,480 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node2/snapshot-000000006868EE7F-1C5D7D03.v1 09:21:03,480 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node2/TermInfo.properties 09:21:03,480 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node2/journal-v1-1.log 09:21:03,480 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node2/metadata-v1-1.log 09:21:03,480 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=1, term=1], timestamp=2025-07-05T09:21:03.475888899Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16188108936835699708/node2/snapshot-000000006868EE7F-1C5D7D03.v1, size=237, entryCompress=NONE, stateCompress=NONE} 09:21:03,480 AM [test-pekko.actor.default-dispatcher-15] [INFO] Recovery - node2: Snapshot completed in 4.600 ms, resetting timer for the next recovery snapshot 09:21:03,480 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - node2: Pekko recovery completed and can restore from snapshot 09:21:03,480 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - node2: starting journal recovery 09:21:03,480 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - node2: Moving last applied index from -1 to 1 09:21:03,480 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - node2: empty journal: appending 0 entries 09:21:03,480 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - node2: updated meta to JournalMeta[replayFrom=1, applyTo=0] 09:21:03,480 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] JournalRecovery - node2: journal recovery completedin 151.8 μs with journalIndex=1 09:21:03,480 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - node2: ignoring DeleteMessagesSuccess(4) 09:21:03,481 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - node1: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[]], state: Idle 09:21:03,481 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState 09:21:03,481 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - node1: Sending local ElectionTimeout to start leader election 09:21:03,481 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PeerInfos - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=null, votingState=VOTING]] 09:21:03,481 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 09:21:03,481 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - node1 (Follower): Received TimeoutNow - switching to Candidate 09:21:03,482 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - node1 (Candidate): Election: Candidate has following voting peers: [node2] 09:21:03,484 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=2, votedFor=node1 09:21:03,484 AM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - node1 (Candidate): Starting new election term 2 09:21:03,484 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - node1 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 09:21:03,797 AM [test-pekko.actor.default-dispatcher-15] [WARN] RaftActorVotingConfigSupport - node1: Leader election timed out - cannot apply operation ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[]] 09:21:03,797 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=NON_VOTING]] 09:21:03,797 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - node1: tryToForwardOperationToAnotherServer - servers already visited [] 09:21:03,797 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - node1: Returning NO_LEADER for operation ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[]] 09:21:03,798 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower132] 09:21:03,810 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector133#34816085] 09:21:03,810 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/node1] 09:21:03,810 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - node1: terminating thread VirtualThread[#457,node1-writer-43]/waiting 09:21:03,810 AM [node1-writer-43] [DEBUG] JournalWriteTask - node1: received 1 commands after 344.2 ms 09:21:03,811 AM [node1-writer-43] [DEBUG] JournalWriteTask - node1: completed 1 commands in 35.70 μs 09:21:03,811 AM [node1-writer-43] [DEBUG] JournalWriteTask - node1: journal writer stopped 09:21:03,811 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - node1: journal closed 09:21:03,811 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - node1: journal closed 09:21:03,811 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node1: stopped executor with 0 remaining tasks 09:21:03,811 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node1: stopped executor with 0 remaining tasks 09:21:03,811 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector134#454065925] 09:21:03,812 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/node2] 09:21:03,812 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - node2: terminating thread VirtualThread[#458,node2-writer-44]/waiting 09:21:03,812 AM [node2-writer-44] [DEBUG] JournalWriteTask - node2: received 1 commands after 341.6 ms 09:21:03,812 AM [node2-writer-44] [DEBUG] JournalWriteTask - node2: completed 1 commands in 20.75 μs 09:21:03,812 AM [node2-writer-44] [DEBUG] JournalWriteTask - node2: journal writer stopped 09:21:03,812 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - node2: journal closed 09:21:03,812 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - node2: journal closed 09:21:03,812 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: stopped executor with 0 remaining tasks 09:21:03,812 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: stopped executor with 0 remaining tasks 09:21:03,816 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithNoConsensusReached starting [WARN] [07/05/2025 09:21:03.817] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server137]: org.opendaylight.controller.cluster.common.actor.Monitor@6d9a60b5 09:21:03,817 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000 09:21:03,817 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: started executor 09:21:03,818 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: started executor 09:21:03,818 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0 09:21:03,819 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:03,819 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - new-server: journal open: applyTo=0 09:21:03,819 AM [new-server-writer-45] [DEBUG] JournalWriteTask - new-server: journal writer started 09:21:03,819 AM [new-server-writer-45] [DEBUG] JournalWriteTask - new-server: waiting to receive commands 09:21:03,820 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13572443266694882590/new-server/TermInfo.properties does not exist 09:21:03,820 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13572443266694882590/new-server/journal-v1-1.log 09:21:03,820 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13572443266694882590/new-server/metadata-v1-1.log 09:21:03,820 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: no eligible files found 09:21:03,821 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - new-server: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:03,823 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null 09:21:03,823 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0} 09:21:03,823 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot 09:21:03,823 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery 09:21:03,824 AM [test-pekko.actor.default-dispatcher-7] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [07/05/2025 09:21:03.824] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader138]: org.opendaylight.controller.cluster.common.actor.Monitor@c4c8ac8 09:21:03,825 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:03,825 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:21:03,825 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:21:03,825 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:21:03,826 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:21:03,826 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:03,826 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:21:03,827 AM [leader-writer-46] [DEBUG] JournalWriteTask - leader: journal writer started 09:21:03,827 AM [leader-writer-46] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:21:03,828 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13572443266694882590/leader/TermInfo.properties does not exist 09:21:03,828 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13572443266694882590/leader/journal-v1-1.log 09:21:03,828 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13572443266694882590/leader/metadata-v1-1.log 09:21:03,828 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: no eligible files found 09:21:03,828 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:03,832 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:03,832 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=} 09:21:03,832 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:21:03,832 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:21:03,833 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [] 09:21:03,838 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server137, votingMember=true], state: Idle 09:21:03,838 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server137, votingMember=true] 09:21:03,838 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 09:21:03,838 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server 09:21:03,838 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader: last applied journal index prior to capture: 0 09:21:03,838 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader: support() called 09:21:03,839 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating capture snapshot for new server new-server 09:21:03,839 AM [leader-%d316797] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:21:03,839 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:21:03,839 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=-1, term=-1] 09:21:03,839 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader: support() called 09:21:03,839 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1 09:21:03,839 AM [leader-%d316798] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13572443266694882590/leader/snapshot-000000006868EE7F-320E0B46.tmp 09:21:03,839 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): sendInstallSnapshot 09:21:03,842 AM [leader-%d316798] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13572443266694882590/leader/snapshot-000000006868EE7F-320E0B46.v1 09:21:03,842 AM [leader-%d316798] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13572443266694882590/leader/snapshot-000000006868EE7F-320E0B46.v1 09:21:03,842 AM [leader-%d316798] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13572443266694882590/leader/TermInfo.properties 09:21:03,842 AM [leader-%d316798] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13572443266694882590/leader/journal-v1-1.log 09:21:03,842 AM [leader-%d316798] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13572443266694882590/leader/metadata-v1-1.log 09:21:03,842 AM [leader-%d316798] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:21:03.839781190Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13572443266694882590/leader/snapshot-000000006868EE7F-320E0B46.v1, size=64, entryCompress=NONE, stateCompress=NONE} 09:21:03,842 AM [leader-%d316798] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:21:03,842 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:21:03,842 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: snapshot is durable as of 2025-07-05T09:21:03.839781190Z 09:21:03,842 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader: Snapshot success, discarding journal entries up to 0 09:21:03,842 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorSnapshotMessageSupport - leader: SnapshotComplete received 09:21:05,856 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: handleInstallSnapshotTimeout for new server new-server 09:21:05,856 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: Returning TIMEOUT for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server137, votingMember=true] 09:21:05,856 AM [test-pekko.actor.default-dispatcher-7] [WARN] RaftActorVotingConfigSupport - leader: Timeout occured for new server new-server while installing snapshot 09:21:08,871 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower135] 09:21:08,882 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector136#-2039167748] 09:21:08,883 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server137] 09:21:08,883 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - new-server: terminating thread VirtualThread[#459,new-server-writer-45]/waiting 09:21:08,884 AM [new-server-writer-45] [DEBUG] JournalWriteTask - new-server: received 1 commands after 5.065 s 09:21:08,884 AM [new-server-writer-45] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 46.80 μs 09:21:08,884 AM [new-server-writer-45] [DEBUG] JournalWriteTask - new-server: journal writer stopped 09:21:08,884 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: journal closed 09:21:08,884 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - new-server: journal closed 09:21:08,885 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:08,885 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:08,885 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader138] 09:21:08,886 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#460,leader-writer-46]/waiting 09:21:08,886 AM [leader-writer-46] [DEBUG] JournalWriteTask - leader: received 1 commands after 5.059 s 09:21:08,886 AM [leader-writer-46] [DEBUG] JournalWriteTask - leader: completed 1 commands in 21.91 μs 09:21:08,886 AM [leader-writer-46] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:21:08,886 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal closed 09:21:08,886 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader: journal closed 09:21:08,886 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:08,886 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:08,887 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector139] 09:21:08,887 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-serverCollector140] 09:21:08,891 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerLeaderWithNoFollowers starting [WARN] [07/05/2025 09:21:08.892] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader142]: org.opendaylight.controller.cluster.common.actor.Monitor@2e2da69c 09:21:08,893 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:08,893 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:21:08,893 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:21:08,894 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:21:08,894 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:21:08,894 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:08,895 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:21:08,895 AM [leader-writer-47] [DEBUG] JournalWriteTask - leader: journal writer started 09:21:08,895 AM [leader-writer-47] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:21:08,896 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8347505487164210815/leader/TermInfo.properties does not exist 09:21:08,896 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8347505487164210815/leader/journal-v1-1.log 09:21:08,896 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8347505487164210815/leader/metadata-v1-1.log 09:21:08,896 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: no eligible files found 09:21:08,896 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:08,903 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:08,903 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=} 09:21:08,903 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:21:08,903 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:21:08,903 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [] 09:21:08,905 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: onRemoveServer: RemoveServer{serverId='leader'}, state: Idle 09:21:08,906 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerLeaderWithNoFollowers ending 09:21:08,906 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower141] 09:21:08,916 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader142] 09:21:08,917 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#463,leader-writer-47]/waiting 09:21:08,917 AM [leader-writer-47] [DEBUG] JournalWriteTask - leader: received 1 commands after 22.16 ms 09:21:08,917 AM [leader-writer-47] [DEBUG] JournalWriteTask - leader: completed 1 commands in 15.66 μs 09:21:08,917 AM [leader-writer-47] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:21:08,917 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal closed 09:21:08,917 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader: journal closed 09:21:08,917 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:08,917 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:08,920 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithLeaderChangeBeforePriorSnapshotComplete starting [WARN] [07/05/2025 09:21:08.922] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server145]: org.opendaylight.controller.cluster.common.actor.Monitor@548f1d80 09:21:08,923 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000 09:21:08,923 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: started executor 09:21:08,923 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: started executor 09:21:08,924 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0 09:21:08,925 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:08,925 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - new-server: journal open: applyTo=0 09:21:08,925 AM [new-server-writer-48] [DEBUG] JournalWriteTask - new-server: journal writer started 09:21:08,925 AM [new-server-writer-48] [DEBUG] JournalWriteTask - new-server: waiting to receive commands 09:21:08,926 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8048157045473320773/new-server/TermInfo.properties does not exist 09:21:08,926 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8048157045473320773/new-server/journal-v1-1.log 09:21:08,926 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8048157045473320773/new-server/metadata-v1-1.log 09:21:08,926 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: no eligible files found 09:21:08,926 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - new-server: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:08,929 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null 09:21:08,929 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0} 09:21:08,929 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot 09:21:08,929 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery 09:21:08,929 AM [test-pekko.actor.default-dispatcher-7] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [07/05/2025 09:21:08.930] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader146]: org.opendaylight.controller.cluster.common.actor.Monitor@73e7fbb8 09:21:08,931 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:08,931 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:21:08,931 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor 09:21:08,931 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor 09:21:08,931 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:21:08,931 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:08,931 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:21:08,932 AM [leader-writer-49] [DEBUG] JournalWriteTask - leader: journal writer started 09:21:08,932 AM [leader-writer-49] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:21:08,933 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8048157045473320773/leader/TermInfo.properties does not exist 09:21:08,933 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8048157045473320773/leader/journal-v1-1.log 09:21:08,933 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8048157045473320773/leader/metadata-v1-1.log 09:21:08,933 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: no eligible files found 09:21:08,933 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:08,935 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:08,935 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=} 09:21:08,935 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:21:08,935 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:21:08,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [] 09:21:08,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: Take a snapshot of current state. lastReplicatedLog is null and replicatedToAllIndex is -1 09:21:08,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 09:21:08,936 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true] 09:21:08,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader: captured snapshot at lastSequenceNumber: 0 09:21:08,936 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=-1, term=-1] 09:21:08,936 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader: support() called 09:21:08,937 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader: user triggered or root overwrite snapshot encountered, trimming log up to last applied index -1 09:21:08,937 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1 09:21:08,937 AM [leader-%d563276] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8048157045473320773/leader/snapshot-000000006868EE84-37DACDBD.tmp 09:21:08,938 AM [leader-%d563276] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8048157045473320773/leader/snapshot-000000006868EE84-37DACDBD.v1 09:21:08,938 AM [leader-%d563276] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8048157045473320773/leader/snapshot-000000006868EE84-37DACDBD.v1 09:21:08,938 AM [leader-%d563276] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8048157045473320773/leader/TermInfo.properties 09:21:08,938 AM [leader-%d563276] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8048157045473320773/leader/journal-v1-1.log 09:21:08,938 AM [leader-%d563276] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8048157045473320773/leader/metadata-v1-1.log 09:21:08,938 AM [leader-%d563276] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:21:08.937086397Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8048157045473320773/leader/snapshot-000000006868EE84-37DACDBD.v1, size=64, entryCompress=NONE, stateCompress=NONE} 09:21:08,939 AM [leader-%d563276] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:21:08,939 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:21:08,945 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server145, votingMember=true], state: Idle 09:21:08,946 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server145, votingMember=true] 09:21:08,946 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader: captureToInstall should not be called in state PersistCapture[lastJournalIndex=0, request=CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true]] 09:21:08,946 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Snapshot already in progress - waiting for completion 09:21:09,49 AM [main] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:21:09,49 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:21:09,49 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: snapshot is durable as of 2025-07-05T09:21:08.937086397Z 09:21:09,49 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader: Snapshot success, discarding journal entries up to 0 09:21:09,49 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: onSnapshotComplete 09:21:09,49 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: No longer the leader 09:21:09,49 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorSnapshotMessageSupport - leader: SnapshotComplete received 09:21:09,49 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: handleInstallSnapshotTimeout for new server new-server 09:21:09,49 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Returning NO_LEADER for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server145, votingMember=true] 09:21:09,50 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithLeaderChangeBeforePriorSnapshotComplete ending 09:21:09,50 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower143] 09:21:09,50 AM [test-pekko.actor.default-dispatcher-15] [WARN] RaftActorVotingConfigSupport - leader: Timeout occured for new server new-server while waiting for prior snapshot to complete 09:21:09,61 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector144#-158383477] 09:21:09,61 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server145] 09:21:09,61 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - new-server: terminating thread VirtualThread[#464,new-server-writer-48]/waiting 09:21:09,61 AM [new-server-writer-48] [DEBUG] JournalWriteTask - new-server: received 1 commands after 136.7 ms 09:21:09,62 AM [new-server-writer-48] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 27.17 μs 09:21:09,62 AM [new-server-writer-48] [DEBUG] JournalWriteTask - new-server: journal writer stopped 09:21:09,62 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - new-server: journal closed 09:21:09,62 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - new-server: journal closed 09:21:09,62 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:09,62 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:09,62 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader146] 09:21:09,62 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#465,leader-writer-49]/waiting 09:21:09,62 AM [leader-writer-49] [DEBUG] JournalWriteTask - leader: received 1 commands after 130.6 ms 09:21:09,62 AM [leader-writer-49] [DEBUG] JournalWriteTask - leader: completed 1 commands in 9.050 μs 09:21:09,62 AM [leader-writer-49] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:21:09,62 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal closed 09:21:09,62 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader: journal closed 09:21:09,62 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:09,62 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:09,65 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServersAsNonVoting starting [WARN] [07/05/2025 09:21:09.066] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server149]: org.opendaylight.controller.cluster.common.actor.Monitor@29670f55 09:21:09,67 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000 09:21:09,67 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: started executor 09:21:09,67 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: started executor 09:21:09,67 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0 09:21:09,67 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:09,67 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - new-server: journal open: applyTo=0 09:21:09,67 AM [new-server-writer-50] [DEBUG] JournalWriteTask - new-server: journal writer started 09:21:09,67 AM [new-server-writer-50] [DEBUG] JournalWriteTask - new-server: waiting to receive commands 09:21:09,69 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18084920918048351840/new-server/TermInfo.properties does not exist 09:21:09,69 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18084920918048351840/new-server/journal-v1-1.log 09:21:09,69 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18084920918048351840/new-server/metadata-v1-1.log 09:21:09,69 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: no eligible files found 09:21:09,69 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - new-server: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:09,71 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null 09:21:09,71 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0} 09:21:09,71 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot 09:21:09,71 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery 09:21:09,72 AM [test-pekko.actor.default-dispatcher-15] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [07/05/2025 09:21:09.073] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader150]: org.opendaylight.controller.cluster.common.actor.Monitor@2d946fa5 09:21:09,74 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:09,74 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:21:09,74 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:21:09,74 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:21:09,75 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:21:09,75 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:09,75 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:21:09,75 AM [leader-writer-51] [DEBUG] JournalWriteTask - leader: journal writer started 09:21:09,75 AM [leader-writer-51] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:21:09,78 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18084920918048351840/leader/TermInfo.properties does not exist 09:21:09,78 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18084920918048351840/leader/journal-v1-1.log 09:21:09,78 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18084920918048351840/leader/metadata-v1-1.log 09:21:09,78 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: no eligible files found 09:21:09,78 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:09,80 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:09,80 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=} 09:21:09,80 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:21:09,80 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:21:09,80 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [] 09:21:09,80 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server149, votingMember=false], state: Idle 09:21:09,80 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server149, votingMember=false] 09:21:09,80 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: New follower is non-voting - directly persisting new server configuration 09:21:09,80 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]] 09:21:09,80 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Persist data index=0 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]} 09:21:09,80 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 09:21:09,80 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=a83df03a-bed1-4016-ab1e-7f5f5299daba}, logIndex: 0, isSendImmediate: true 09:21:09,80 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - leader (Leader): Setting last applied to 0 09:21:09,80 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - leader: Moving last applied index from -1 to 0 09:21:09,81 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]} 09:21:09,81 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server149, votingMember=false] 09:21:09,81 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorVotingConfigSupport - leader: VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]} has been successfully replicated to a majority of followers 09:21:09,81 AM [leader-%d286838] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18084920918048351840/leader/snapshot-000000006868EE85-04D135ED.tmp 09:21:09,83 AM [leader-%d286838] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18084920918048351840/leader/snapshot-000000006868EE85-04D135ED.v1 09:21:09,83 AM [leader-%d286838] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18084920918048351840/leader/snapshot-000000006868EE85-04D135ED.v1 09:21:09,83 AM [leader-%d286838] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18084920918048351840/leader/TermInfo.properties 09:21:09,83 AM [leader-%d286838] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18084920918048351840/leader/journal-v1-1.log 09:21:09,83 AM [leader-%d286838] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18084920918048351840/leader/metadata-v1-1.log 09:21:09,83 AM [leader-%d286838] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:21:09.080819693Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18084920918048351840/leader/snapshot-000000006868EE85-04D135ED.v1, size=86, entryCompress=NONE, stateCompress=NONE} 09:21:09,83 AM [leader-%d286838] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:21:09,83 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:21:09,83 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 09:21:14,176 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower147] 09:21:14,187 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector148#98678684] 09:21:14,189 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server149] 09:21:14,189 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - new-server: terminating thread VirtualThread[#468,new-server-writer-50]/waiting 09:21:14,189 AM [new-server-writer-50] [DEBUG] JournalWriteTask - new-server: received 1 commands after 5.122 s 09:21:14,190 AM [new-server-writer-50] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 45.24 μs 09:21:14,190 AM [new-server-writer-50] [DEBUG] JournalWriteTask - new-server: journal writer stopped 09:21:14,190 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: journal closed 09:21:14,190 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - new-server: journal closed 09:21:14,190 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:14,190 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:14,190 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader150] 09:21:14,191 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#469,leader-writer-51]/waiting 09:21:14,191 AM [leader-writer-51] [DEBUG] JournalWriteTask - leader: received 1 commands after 5.116 s 09:21:14,191 AM [leader-writer-51] [DEBUG] JournalWriteTask - leader: completed 1 commands in 20.63 μs 09:21:14,191 AM [leader-writer-51] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:21:14,191 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal closed 09:21:14,191 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader: journal closed 09:21:14,192 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:14,192 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:14,192 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector151] 09:21:14,197 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithPriorSnapshotInProgress starting [WARN] [07/05/2025 09:21:14.200] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server154]: org.opendaylight.controller.cluster.common.actor.Monitor@55cc7a60 09:21:14,200 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000 09:21:14,200 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: started executor 09:21:14,200 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: started executor 09:21:14,201 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0 09:21:14,201 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:14,201 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - new-server: journal open: applyTo=0 09:21:14,201 AM [new-server-writer-52] [DEBUG] JournalWriteTask - new-server: journal writer started 09:21:14,201 AM [new-server-writer-52] [DEBUG] JournalWriteTask - new-server: waiting to receive commands 09:21:14,203 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/new-server/TermInfo.properties does not exist 09:21:14,203 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/new-server/journal-v1-1.log 09:21:14,203 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/new-server/metadata-v1-1.log 09:21:14,203 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: no eligible files found 09:21:14,203 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - new-server: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:14,206 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null 09:21:14,206 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0} 09:21:14,206 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot 09:21:14,206 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery 09:21:14,206 AM [test-pekko.actor.default-dispatcher-16] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [07/05/2025 09:21:14.207] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader155]: org.opendaylight.controller.cluster.common.actor.Monitor@71529aef 09:21:14,207 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:14,208 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:21:14,208 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor 09:21:14,208 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor 09:21:14,208 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:21:14,209 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:14,209 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:21:14,209 AM [leader-writer-53] [DEBUG] JournalWriteTask - leader: journal writer started 09:21:14,209 AM [leader-writer-53] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:21:14,210 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/TermInfo.properties does not exist 09:21:14,210 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/journal-v1-1.log 09:21:14,210 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/metadata-v1-1.log 09:21:14,210 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: no eligible files found 09:21:14,210 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:14,212 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:14,212 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=} 09:21:14,212 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:21:14,212 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:21:14,212 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [] 09:21:14,212 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader: Take a snapshot of current state. lastReplicatedLog is null and replicatedToAllIndex is -1 09:21:14,212 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 09:21:14,212 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true] 09:21:14,212 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - leader: captured snapshot at lastSequenceNumber: 0 09:21:14,212 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=-1, term=-1] 09:21:14,213 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader: support() called 09:21:14,213 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - leader: user triggered or root overwrite snapshot encountered, trimming log up to last applied index -1 09:21:14,213 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1 09:21:14,213 AM [leader-%d785593] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/snapshot-000000006868EE8A-0CB6A4D7.tmp 09:21:14,215 AM [leader-%d785593] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/snapshot-000000006868EE8A-0CB6A4D7.v1 09:21:14,215 AM [leader-%d785593] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/snapshot-000000006868EE8A-0CB6A4D7.v1 09:21:14,215 AM [leader-%d785593] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/TermInfo.properties 09:21:14,215 AM [leader-%d785593] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/journal-v1-1.log 09:21:14,216 AM [leader-%d785593] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/metadata-v1-1.log 09:21:14,216 AM [leader-%d785593] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:21:14.213296343Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/snapshot-000000006868EE8A-0CB6A4D7.v1, size=64, entryCompress=NONE, stateCompress=NONE} 09:21:14,216 AM [leader-%d785593] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:21:14,216 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:21:14,322 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server154, votingMember=true], state: Idle 09:21:14,323 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server154, votingMember=true] 09:21:14,323 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - leader: captureToInstall should not be called in state PersistCapture[lastJournalIndex=0, request=CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true]] 09:21:14,323 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: Snapshot already in progress - waiting for completion 09:21:14,323 AM [main] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:21:14,323 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:21:14,323 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader: snapshot is durable as of 2025-07-05T09:21:14.213296343Z 09:21:14,323 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - leader: Snapshot success, discarding journal entries up to 0 09:21:14,324 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: onSnapshotComplete 09:21:14,324 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 09:21:14,324 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server 09:21:14,324 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - leader: last applied journal index prior to capture: 0 09:21:14,324 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader: support() called 09:21:14,324 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating capture snapshot for new server new-server 09:21:14,324 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - leader: SnapshotComplete received 09:21:14,325 AM [leader-%d785594] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:21:14,325 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:21:14,325 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=-1, term=-1] 09:21:14,325 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - leader: support() called 09:21:14,325 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1 09:21:14,325 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader (Leader): sendInstallSnapshot 09:21:14,325 AM [leader-%d785595] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/snapshot-000000006868EE8A-136649BC.tmp 09:21:14,327 AM [leader-%d785595] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/snapshot-000000006868EE8A-136649BC.v1 09:21:14,327 AM [leader-%d785595] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/snapshot-000000006868EE8A-136649BC.v1 09:21:14,328 AM [leader-%d785595] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/snapshot-000000006868EE8A-0CB6A4D7.v1 09:21:14,328 AM [leader-%d785595] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/TermInfo.properties 09:21:14,328 AM [leader-%d785595] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/journal-v1-1.log 09:21:14,328 AM [leader-%d785595] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/metadata-v1-1.log 09:21:14,328 AM [leader-%d785595] [DEBUG] RaftStorage - leader: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:21:14.213296343Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/snapshot-000000006868EE8A-0CB6A4D7.v1, size=64, entryCompress=NONE, stateCompress=NONE} 09:21:14,328 AM [leader-%d785595] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:21:14.325470652Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13443911624412920898/leader/snapshot-000000006868EE8A-136649BC.v1, size=64, entryCompress=NONE, stateCompress=NONE} 09:21:14,328 AM [leader-%d785595] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:21:14,328 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:21:14,328 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - leader: snapshot is durable as of 2025-07-05T09:21:14.325470652Z 09:21:14,328 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - leader: Snapshot success, discarding journal entries up to 0 09:21:14,329 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - leader: SnapshotComplete received 09:21:16,336 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: handleInstallSnapshotTimeout for new server new-server 09:21:16,336 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Returning TIMEOUT for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server154, votingMember=true] 09:21:16,336 AM [test-pekko.actor.default-dispatcher-15] [WARN] RaftActorVotingConfigSupport - leader: Timeout occured for new server new-server while installing snapshot 09:21:16,336 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower152] 09:21:16,348 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector153#402825807] 09:21:16,348 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server154] 09:21:16,348 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - new-server: terminating thread VirtualThread[#471,new-server-writer-52]/waiting 09:21:16,348 AM [new-server-writer-52] [DEBUG] JournalWriteTask - new-server: received 1 commands after 2.147 s 09:21:16,349 AM [new-server-writer-52] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 54.64 μs 09:21:16,349 AM [new-server-writer-52] [DEBUG] JournalWriteTask - new-server: journal writer stopped 09:21:16,349 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: journal closed 09:21:16,349 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - new-server: journal closed 09:21:16,349 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:16,349 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:16,350 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader155] 09:21:16,350 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#472,leader-writer-53]/waiting 09:21:16,350 AM [leader-writer-53] [DEBUG] JournalWriteTask - leader: received 1 commands after 2.141 s 09:21:16,350 AM [leader-writer-53] [DEBUG] JournalWriteTask - leader: completed 1 commands in 21.04 μs 09:21:16,350 AM [leader-writer-53] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:21:16,350 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal closed 09:21:16,350 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader: journal closed 09:21:16,350 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:16,350 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:16,351 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector156] 09:21:16,354 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeLeaderToNonVotingInSingleNode starting [WARN] [07/05/2025 09:21:16.355] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader158]: org.opendaylight.controller.cluster.common.actor.Monitor@60cb7143 09:21:16,356 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:16,356 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:21:16,357 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:21:16,357 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:21:16,358 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:21:16,358 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:16,358 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:21:16,358 AM [leader-writer-54] [DEBUG] JournalWriteTask - leader: journal writer started 09:21:16,359 AM [leader-writer-54] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:21:16,360 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest222061272513692456/leader/TermInfo.properties does not exist 09:21:16,360 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest222061272513692456/leader/journal-v1-1.log 09:21:16,360 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest222061272513692456/leader/metadata-v1-1.log 09:21:16,360 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: no eligible files found 09:21:16,360 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:16,364 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:16,364 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=} 09:21:16,364 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:21:16,364 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:21:16,365 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [] 09:21:16,369 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={leader=false}, serversVisited=[]], state: Idle 09:21:16,369 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState 09:21:16,369 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: Returning INVALID_REQUEST for operation ChangeServersVotingStatus [serverVotingStatusMap={leader=false}, serversVisited=[]] 09:21:16,369 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeLeaderToNonVotingInSingleNode ending 09:21:16,369 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower157] 09:21:16,380 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader158] 09:21:16,381 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#477,leader-writer-54]/waiting 09:21:16,381 AM [leader-writer-54] [DEBUG] JournalWriteTask - leader: received 1 commands after 22.37 ms 09:21:16,381 AM [leader-writer-54] [DEBUG] JournalWriteTask - leader: completed 1 commands in 27.63 μs 09:21:16,381 AM [leader-writer-54] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:21:16,381 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader: journal closed 09:21:16,381 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader: journal closed 09:21:16,382 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:16,382 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:16,385 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeLeaderToNonVoting starting [WARN] [07/05/2025 09:21:16.386] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader162]: org.opendaylight.controller.cluster.common.actor.Monitor@2a0c0a00 09:21:16,387 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:16,387 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:21:16,387 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: started executor 09:21:16,387 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: started executor 09:21:16,388 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:21:16,389 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:16,389 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:21:16,389 AM [leader-writer-55] [DEBUG] JournalWriteTask - leader: journal writer started 09:21:16,389 AM [leader-writer-55] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:21:16,390 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1507912735391430616/leader/TermInfo.properties does not exist 09:21:16,391 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1507912735391430616/leader/journal-v1-1.log 09:21:16,391 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1507912735391430616/leader/metadata-v1-1.log 09:21:16,391 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: no eligible files found 09:21:16,391 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [07/05/2025 09:21:16.391] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower160]: org.opendaylight.controller.cluster.common.actor.Monitor@4e41a754 09:21:16,392 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower: Starting recovery with journal batch size 1000 09:21:16,393 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower: started executor 09:21:16,393 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower: started executor 09:21:16,394 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower: metadata journal open: replayFrom=1 applyTo=0 09:21:16,394 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:16,394 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=} 09:21:16,394 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:21:16,394 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:21:16,394 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [follower2, follower] 09:21:16,394 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:16,394 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower: journal open: applyTo=0 09:21:16,395 AM [follower-writer-56] [DEBUG] JournalWriteTask - follower: journal writer started 09:21:16,395 AM [follower-writer-56] [DEBUG] JournalWriteTask - follower: waiting to receive commands 09:21:16,396 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1507912735391430616/follower/TermInfo.properties does not exist 09:21:16,396 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1507912735391430616/follower/journal-v1-1.log 09:21:16,396 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1507912735391430616/follower/metadata-v1-1.log 09:21:16,396 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: no eligible files found 09:21:16,396 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [07/05/2025 09:21:16.397] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower2161]: org.opendaylight.controller.cluster.common.actor.Monitor@4a840a70 09:21:16,397 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower2: Starting recovery with journal batch size 1000 09:21:16,398 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower2: started executor 09:21:16,398 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower2: started executor 09:21:16,398 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower2: metadata journal open: replayFrom=1 applyTo=0 09:21:16,398 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower2: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:16,398 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower2: journal open: applyTo=0 09:21:16,399 AM [follower2-writer-57] [DEBUG] JournalWriteTask - follower2: journal writer started 09:21:16,399 AM [follower2-writer-57] [DEBUG] JournalWriteTask - follower2: waiting to receive commands 09:21:16,399 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=0, votedFor=null 09:21:16,399 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower: Local TermInfo store seeded with TermInfo{term=0} 09:21:16,399 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower: Pekko recovery completed and can restore from snapshot 09:21:16,399 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower: no journal: skipping journal recovery 09:21:16,400 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={leader=false}, serversVisited=[]], state: Idle 09:21:16,400 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState 09:21:16,400 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1507912735391430616/follower2/TermInfo.properties does not exist 09:21:16,400 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - leader: Updated server config: isVoting: false, peers: [PeerInfo [id=follower2, address=null, votingState=VOTING], PeerInfo [id=follower, address=null, votingState=VOTING]] 09:21:16,400 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]] 09:21:16,400 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: Persist data index=0 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]} 09:21:16,400 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1507912735391430616/follower2/journal-v1-1.log 09:21:16,400 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}, pending=true} 09:21:16,400 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1507912735391430616/follower2/metadata-v1-1.log 09:21:16,400 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower2: no eligible files found 09:21:16,400 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower2: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:16,400 AM [leader-%d655039] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1507912735391430616/leader/snapshot-000000006868EE8C-17E30A12.tmp 09:21:16,401 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=434d94b6-bf8b-4a15-9a8d-e8df11c73593}, logIndex: 0, isSendImmediate: true 09:21:16,401 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 09:21:16,401 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation ChangeServersVotingStatus [serverVotingStatusMap={leader=false}, serversVisited=[]] 09:21:16,403 AM [leader-%d655039] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1507912735391430616/leader/snapshot-000000006868EE8C-17E30A12.v1 09:21:16,403 AM [leader-%d655039] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1507912735391430616/leader/snapshot-000000006868EE8C-17E30A12.v1 09:21:16,403 AM [leader-%d655039] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1507912735391430616/leader/TermInfo.properties 09:21:16,403 AM [leader-%d655039] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1507912735391430616/leader/journal-v1-1.log 09:21:16,403 AM [leader-%d655039] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1507912735391430616/leader/metadata-v1-1.log 09:21:16,403 AM [leader-%d655039] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:21:16.400755218Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1507912735391430616/leader/snapshot-000000006868EE8C-17E30A12.v1, size=96, entryCompress=NONE, stateCompress=NONE} 09:21:16,403 AM [leader-%d655039] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:21:16,404 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:21:16,404 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}, pending=true} 09:21:16,404 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower2: Set currentTerm=0, votedFor=null 09:21:16,404 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower2: Local TermInfo store seeded with TermInfo{term=0} 09:21:16,404 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower2: Pekko recovery completed and can restore from snapshot 09:21:16,404 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower2: no journal: skipping journal recovery 09:21:17,456 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 09:21:17,456 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.247:17355, Removed) 09:21:17,456 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower (Follower): Received ElectionTimeout - switching to Candidate 09:21:17,456 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - follower (Candidate): Election: Candidate has following voting peers: [leader, follower2] 09:21:17,460 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=1, votedFor=follower 09:21:17,460 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - follower (Candidate): Starting new election term 1 09:21:17,460 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - follower (Follower) :- Switching from behavior Follower to Candidate, election term: 1 09:21:17,506 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower2 (Follower): Checking if this node is isolated in the cluster unreachable set [],all members [] self member: Member(pekko://test@10.30.171.247:17355, Removed) 09:21:17,506 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower2 (Follower): Received ElectionTimeout - switching to Candidate 09:21:17,506 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - follower2 (Candidate): Election: Candidate has following voting peers: [leader, follower] 09:21:17,509 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower2: Set currentTerm=1, votedFor=follower2 09:21:17,509 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - follower2 (Candidate): Starting new election term 1 09:21:17,509 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - follower2 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 09:21:18,416 AM [test-pekko.actor.default-dispatcher-15] [WARN] RaftActorVotingConfigSupport - leader: Timeout occured while replicating the new server configuration for ChangeServersVotingStatus [serverVotingStatusMap={leader=false}, serversVisited=[]] 09:21:18,526 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - follower (Candidate): Received ElectionTimeout 09:21:18,533 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=2, votedFor=follower 09:21:18,534 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - follower (Candidate): Starting new election term 2 09:21:18,606 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - follower2 (Candidate): Received ElectionTimeout 09:21:18,609 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower2: Set currentTerm=2, votedFor=follower2 09:21:18,610 AM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - follower2 (Candidate): Starting new election term 2 09:21:19,586 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - follower (Candidate): Received ElectionTimeout 09:21:19,589 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=3, votedFor=follower 09:21:19,589 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - follower (Candidate): Starting new election term 3 09:21:19,706 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - follower2 (Candidate): Received ElectionTimeout 09:21:19,709 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower2: Set currentTerm=3, votedFor=follower2 09:21:19,709 AM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - follower2 (Candidate): Starting new election term 3 09:21:20,616 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - follower (Candidate): Received ElectionTimeout 09:21:20,620 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=4, votedFor=follower 09:21:20,620 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - follower (Candidate): Starting new election term 4 09:21:20,756 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - follower2 (Candidate): Received ElectionTimeout 09:21:20,760 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower2: Set currentTerm=4, votedFor=follower2 09:21:20,760 AM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - follower2 (Candidate): Starting new election term 4 09:21:21,422 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower159] 09:21:21,433 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader162] 09:21:21,433 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#478,leader-writer-55]/waiting 09:21:21,434 AM [leader-writer-55] [DEBUG] JournalWriteTask - leader: received 1 commands after 5.045 s 09:21:21,434 AM [leader-writer-55] [DEBUG] JournalWriteTask - leader: completed 1 commands in 28.50 μs 09:21:21,434 AM [leader-writer-55] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:21:21,434 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal closed 09:21:21,434 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader: journal closed 09:21:21,434 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:21,434 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:21,435 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector163] 09:21:21,435 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector164#1777587812] 09:21:21,435 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower160] 09:21:21,436 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - follower: terminating thread VirtualThread[#479,follower-writer-56]/waiting 09:21:21,436 AM [follower-writer-56] [DEBUG] JournalWriteTask - follower: received 1 commands after 5.041 s 09:21:21,436 AM [follower-writer-56] [DEBUG] JournalWriteTask - follower: completed 1 commands in 12.84 μs 09:21:21,436 AM [follower-writer-56] [DEBUG] JournalWriteTask - follower: journal writer stopped 09:21:21,436 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower: journal closed 09:21:21,436 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - follower: journal closed 09:21:21,436 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks 09:21:21,436 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks 09:21:21,436 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector165#59631381] 09:21:21,436 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower2161] 09:21:21,437 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - follower2: terminating thread VirtualThread[#480,follower2-writer-57]/waiting 09:21:21,437 AM [follower2-writer-57] [DEBUG] JournalWriteTask - follower2: received 1 commands after 5.038 s 09:21:21,437 AM [follower2-writer-57] [DEBUG] JournalWriteTask - follower2: completed 1 commands in 12.00 μs 09:21:21,437 AM [follower2-writer-57] [DEBUG] JournalWriteTask - follower2: journal writer stopped 09:21:21,437 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower2: journal closed 09:21:21,437 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower2: journal closed 09:21:21,437 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower2: stopped executor with 0 remaining tasks 09:21:21,437 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower2: stopped executor with 0 remaining tasks 09:21:21,441 AM [main] [INFO] RaftActorVotingConfigSupportTest - testOnApplyState starting [WARN] [07/05/2025 09:21:21.442] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader167]: org.opendaylight.controller.cluster.common.actor.Monitor@68385f29 09:21:21,443 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:21:21,443 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:21:21,443 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:21:21,444 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:21:21,444 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:21,444 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:21:21,444 AM [leader-writer-58] [DEBUG] JournalWriteTask - leader: journal writer started 09:21:21,445 AM [leader-writer-58] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:21:21,445 AM [main] [INFO] RaftActorVotingConfigSupportTest - testOnApplyState ending 09:21:21,445 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower166] 09:21:21,446 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15627885405893589986/leader/TermInfo.properties does not exist 09:21:21,446 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15627885405893589986/leader/journal-v1-1.log 09:21:21,446 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15627885405893589986/leader/metadata-v1-1.log 09:21:21,446 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: no eligible files found 09:21:21,446 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:21,449 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=0, votedFor=null 09:21:21,449 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=0} 09:21:21,449 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:21:21,449 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:21:21,456 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader167] 09:21:21,456 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#482,leader-writer-58]/waiting 09:21:21,457 AM [leader-writer-58] [DEBUG] JournalWriteTask - leader: received 1 commands after 12.00 ms 09:21:21,457 AM [leader-writer-58] [DEBUG] JournalWriteTask - leader: completed 1 commands in 15.79 μs 09:21:21,457 AM [leader-writer-58] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:21:21,457 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal closed 09:21:21,457 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader: journal closed 09:21:21,457 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:21,457 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:21,459 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServer starting [WARN] [07/05/2025 09:21:21.460] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader171]: org.opendaylight.controller.cluster.common.actor.Monitor@34257f80 09:21:21,462 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:21,462 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:21:21,462 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor 09:21:21,462 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor 09:21:21,463 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:21:21,463 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:21,464 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:21:21,464 AM [leader-writer-59] [DEBUG] JournalWriteTask - leader: journal writer started 09:21:21,464 AM [leader-writer-59] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:21:21,465 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14658115494985144401/leader/TermInfo.properties does not exist 09:21:21,465 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14658115494985144401/leader/journal-v1-1.log 09:21:21,465 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14658115494985144401/leader/metadata-v1-1.log 09:21:21,465 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: no eligible files found 09:21:21,465 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [07/05/2025 09:21:21.467] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower169]: org.opendaylight.controller.cluster.common.actor.Monitor@7b940cd9 09:21:21,468 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - follower: Starting recovery with journal batch size 1000 09:21:21,468 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower: started executor 09:21:21,468 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower: started executor 09:21:21,468 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower: metadata journal open: replayFrom=1 applyTo=0 09:21:21,469 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:21,469 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=} 09:21:21,469 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:21:21,469 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:21:21,469 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [follower2, follower, downNode] 09:21:21,469 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:21,469 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - follower: journal open: applyTo=0 09:21:21,470 AM [follower-writer-60] [DEBUG] JournalWriteTask - follower: journal writer started 09:21:21,470 AM [follower-writer-60] [DEBUG] JournalWriteTask - follower: waiting to receive commands 09:21:21,472 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14658115494985144401/follower/TermInfo.properties does not exist 09:21:21,472 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14658115494985144401/follower/journal-v1-1.log 09:21:21,472 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14658115494985144401/follower/metadata-v1-1.log 09:21:21,473 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: no eligible files found 09:21:21,473 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [07/05/2025 09:21:21.473] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower2170]: org.opendaylight.controller.cluster.common.actor.Monitor@4eaffd0d 09:21:21,473 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - follower2: Starting recovery with journal batch size 1000 09:21:21,474 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower2: started executor 09:21:21,474 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower2: started executor 09:21:21,474 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower2: metadata journal open: replayFrom=1 applyTo=0 09:21:21,475 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=0, votedFor=null 09:21:21,475 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower: Local TermInfo store seeded with TermInfo{term=0} 09:21:21,475 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower: Pekko recovery completed and can restore from snapshot 09:21:21,475 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower2: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:21,475 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower: no journal: skipping journal recovery 09:21:21,475 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRaftStorage - follower2: journal open: applyTo=0 09:21:21,475 AM [follower2-writer-61] [DEBUG] JournalWriteTask - follower2: journal writer started 09:21:21,475 AM [follower2-writer-61] [DEBUG] JournalWriteTask - follower2: waiting to receive commands 09:21:21,476 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14658115494985144401/follower2/TermInfo.properties does not exist 09:21:21,476 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14658115494985144401/follower2/journal-v1-1.log 09:21:21,476 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14658115494985144401/follower2/metadata-v1-1.log 09:21:21,476 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower2: no eligible files found 09:21:21,476 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower2: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:21,478 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower2: Set currentTerm=0, votedFor=null 09:21:21,478 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower2: Local TermInfo store seeded with TermInfo{term=0} 09:21:21,478 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower2: Pekko recovery completed and can restore from snapshot 09:21:21,478 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower2: no journal: skipping journal recovery 09:21:21,489 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: onRemoveServer: RemoveServer{serverId='follower'}, state: Idle 09:21:21,489 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=downNode, isVoting=true], ServerInfo[peerId=leader, isVoting=true]] 09:21:21,489 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: Persist data index=0 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=downNode, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]} 09:21:21,489 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=downNode, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 09:21:21,489 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=4329ab57-e966-4756-8c74-25ff76761fa9}, logIndex: 0, isSendImmediate: true 09:21:21,489 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 09:21:21,489 AM [leader-%d516435] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14658115494985144401/leader/snapshot-000000006868EE91-1D2FB0E3.tmp 09:21:21,489 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation RemoveServer{serverId='follower'} 09:21:21,492 AM [leader-%d516435] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14658115494985144401/leader/snapshot-000000006868EE91-1D2FB0E3.v1 09:21:21,492 AM [leader-%d516435] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14658115494985144401/leader/TermInfo.properties 09:21:21,492 AM [leader-%d516435] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14658115494985144401/leader/journal-v1-1.log 09:21:21,492 AM [leader-%d516435] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14658115494985144401/leader/metadata-v1-1.log 09:21:21,492 AM [leader-%d516435] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14658115494985144401/leader/snapshot-000000006868EE91-1D2FB0E3.v1 09:21:21,492 AM [leader-%d516435] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:21:21.489664739Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14658115494985144401/leader/snapshot-000000006868EE91-1D2FB0E3.v1, size=96, entryCompress=NONE, stateCompress=NONE} 09:21:21,493 AM [leader-%d516435] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:21:21,493 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:21:21,493 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=downNode, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 09:21:23,506 AM [test-pekko.actor.default-dispatcher-15] [WARN] RaftActorVotingConfigSupport - leader: Timeout occured while replicating the new server configuration for follower 09:21:26,509 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower168] 09:21:26,520 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader171] 09:21:26,521 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#483,leader-writer-59]/waiting 09:21:26,521 AM [leader-writer-59] [DEBUG] JournalWriteTask - leader: received 1 commands after 5.057 s 09:21:26,521 AM [leader-writer-59] [DEBUG] JournalWriteTask - leader: completed 1 commands in 46.26 μs 09:21:26,521 AM [leader-writer-59] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:21:26,522 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal closed 09:21:26,522 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader: journal closed 09:21:26,522 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:26,522 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:26,522 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector172] 09:21:26,522 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector173#21959752] 09:21:26,523 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower169] 09:21:26,523 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - follower: terminating thread VirtualThread[#484,follower-writer-60]/waiting 09:21:26,523 AM [follower-writer-60] [DEBUG] JournalWriteTask - follower: received 1 commands after 5.053 s 09:21:26,523 AM [follower-writer-60] [DEBUG] JournalWriteTask - follower: completed 1 commands in 19.83 μs 09:21:26,523 AM [follower-writer-60] [DEBUG] JournalWriteTask - follower: journal writer stopped 09:21:26,523 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower: journal closed 09:21:26,523 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower: journal closed 09:21:26,523 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks 09:21:26,523 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks 09:21:26,524 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector174#1739167006] 09:21:26,524 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower2170] 09:21:26,524 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - follower2: terminating thread VirtualThread[#485,follower2-writer-61]/waiting 09:21:26,524 AM [follower2-writer-61] [DEBUG] JournalWriteTask - follower2: received 1 commands after 5.049 s 09:21:26,524 AM [follower2-writer-61] [DEBUG] JournalWriteTask - follower2: completed 1 commands in 18.54 μs 09:21:26,524 AM [follower2-writer-61] [DEBUG] JournalWriteTask - follower2: journal writer stopped 09:21:26,525 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower2: journal closed 09:21:26,525 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower2: journal closed 09:21:26,525 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower2: stopped executor with 0 remaining tasks 09:21:26,525 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower2: stopped executor with 0 remaining tasks 09:21:26,531 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithNoLeader starting [WARN] [07/05/2025 09:21:26.532] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server177]: org.opendaylight.controller.cluster.common.actor.Monitor@1a4940a9 09:21:26,533 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000 09:21:26,533 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: started executor 09:21:26,533 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: started executor 09:21:26,534 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0 09:21:26,536 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:26,536 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - new-server: journal open: applyTo=0 09:21:26,536 AM [new-server-writer-62] [DEBUG] JournalWriteTask - new-server: journal writer started 09:21:26,536 AM [new-server-writer-62] [DEBUG] JournalWriteTask - new-server: waiting to receive commands 09:21:26,537 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6336262575561569861/new-server/TermInfo.properties does not exist 09:21:26,537 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6336262575561569861/new-server/journal-v1-1.log 09:21:26,538 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6336262575561569861/new-server/metadata-v1-1.log 09:21:26,538 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: no eligible files found 09:21:26,538 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - new-server: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:26,540 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null 09:21:26,540 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0} 09:21:26,540 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot 09:21:26,540 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery 09:21:26,540 AM [test-pekko.actor.default-dispatcher-7] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [07/05/2025 09:21:26.541] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader178]: org.opendaylight.controller.cluster.common.actor.Monitor@6fce276c 09:21:26,541 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:21:26,541 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:21:26,541 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:21:26,542 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:21:26,542 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:26,542 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:21:26,542 AM [leader-writer-63] [DEBUG] JournalWriteTask - leader: journal writer started 09:21:26,542 AM [leader-writer-63] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:21:26,543 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6336262575561569861/leader/TermInfo.properties does not exist 09:21:26,543 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6336262575561569861/leader/journal-v1-1.log 09:21:26,543 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6336262575561569861/leader/metadata-v1-1.log 09:21:26,543 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: no eligible files found 09:21:26,543 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:26,546 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=0, votedFor=null 09:21:26,546 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=0} 09:21:26,546 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:21:26,546 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:21:26,557 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server177, votingMember=true], state: Idle 09:21:26,557 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: No leader - returning NO_LEADER reply 09:21:26,557 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithNoLeader ending 09:21:26,557 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower175] 09:21:26,568 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector176#-1338065539] 09:21:26,568 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server177] 09:21:26,568 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - new-server: terminating thread VirtualThread[#487,new-server-writer-62]/waiting 09:21:26,569 AM [new-server-writer-62] [DEBUG] JournalWriteTask - new-server: received 1 commands after 32.44 ms 09:21:26,569 AM [new-server-writer-62] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 29.16 μs 09:21:26,569 AM [new-server-writer-62] [DEBUG] JournalWriteTask - new-server: journal writer stopped 09:21:26,569 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: journal closed 09:21:26,569 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - new-server: journal closed 09:21:26,569 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:26,569 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:26,569 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader178] 09:21:26,570 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#488,leader-writer-63]/waiting 09:21:26,570 AM [leader-writer-63] [DEBUG] JournalWriteTask - leader: received 1 commands after 27.45 ms 09:21:26,570 AM [leader-writer-63] [DEBUG] JournalWriteTask - leader: completed 1 commands in 9.160 μs 09:21:26,570 AM [leader-writer-63] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:21:26,570 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal closed 09:21:26,570 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader: journal closed 09:21:26,570 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:26,570 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:26,573 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeServersVotingStatus starting [WARN] [07/05/2025 09:21:26.574] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader182]: org.opendaylight.controller.cluster.common.actor.Monitor@25a55cf2 09:21:26,574 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:26,574 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:21:26,574 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:21:26,574 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:21:26,575 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:21:26,575 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:26,575 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:21:26,575 AM [leader-writer-64] [DEBUG] JournalWriteTask - leader: journal writer started 09:21:26,575 AM [leader-writer-64] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:21:26,577 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest3152171244375382161/leader/TermInfo.properties does not exist 09:21:26,577 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest3152171244375382161/leader/journal-v1-1.log 09:21:26,577 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest3152171244375382161/leader/metadata-v1-1.log 09:21:26,577 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: no eligible files found 09:21:26,577 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [07/05/2025 09:21:26.577] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower180]: org.opendaylight.controller.cluster.common.actor.Monitor@676c49e0 09:21:26,578 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower: Starting recovery with journal batch size 1000 09:21:26,578 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower: started executor 09:21:26,578 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower: started executor 09:21:26,579 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower: metadata journal open: replayFrom=1 applyTo=0 09:21:26,579 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:26,579 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower: journal open: applyTo=0 09:21:26,580 AM [follower-writer-65] [DEBUG] JournalWriteTask - follower: journal writer started 09:21:26,580 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:26,580 AM [follower-writer-65] [DEBUG] JournalWriteTask - follower: waiting to receive commands 09:21:26,580 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=} 09:21:26,580 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:21:26,580 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:21:26,580 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [follower2, follower] 09:21:26,581 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest3152171244375382161/follower/TermInfo.properties does not exist 09:21:26,581 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest3152171244375382161/follower/journal-v1-1.log 09:21:26,581 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest3152171244375382161/follower/metadata-v1-1.log 09:21:26,581 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower: no eligible files found 09:21:26,581 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [07/05/2025 09:21:26.582] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower2181]: org.opendaylight.controller.cluster.common.actor.Monitor@f5854a3 09:21:26,583 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=0, votedFor=null 09:21:26,583 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower: Local TermInfo store seeded with TermInfo{term=0} 09:21:26,583 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower: Pekko recovery completed and can restore from snapshot 09:21:26,583 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower: no journal: skipping journal recovery 09:21:26,583 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower2: Starting recovery with journal batch size 1000 09:21:26,583 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower2: started executor 09:21:26,583 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower2: started executor 09:21:26,583 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower2: metadata journal open: replayFrom=1 applyTo=0 09:21:26,584 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower2: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:26,584 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - follower2: journal open: applyTo=0 09:21:26,584 AM [follower2-writer-66] [DEBUG] JournalWriteTask - follower2: journal writer started 09:21:26,584 AM [follower2-writer-66] [DEBUG] JournalWriteTask - follower2: waiting to receive commands 09:21:26,585 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest3152171244375382161/follower2/TermInfo.properties does not exist 09:21:26,585 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest3152171244375382161/follower2/journal-v1-1.log 09:21:26,585 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest3152171244375382161/follower2/metadata-v1-1.log 09:21:26,585 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={follower2=false, follower=false}, serversVisited=[]], state: Idle 09:21:26,585 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower2: no eligible files found 09:21:26,585 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState 09:21:26,585 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower2: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:26,585 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - leader: Updated server config: isVoting: true, peers: [PeerInfo [id=follower2, address=null, votingState=NON_VOTING], PeerInfo [id=follower, address=null, votingState=NON_VOTING]] 09:21:26,585 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]] 09:21:26,585 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: Persist data index=0 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]} 09:21:26,585 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 09:21:26,585 AM [leader-%d823707] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest3152171244375382161/leader/snapshot-000000006868EE96-22E93083.tmp 09:21:26,585 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=e32daab7-71fb-4ddd-bd2d-7cae7021e7ef}, logIndex: 0, isSendImmediate: true 09:21:26,585 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader (Leader): Setting last applied to 0 09:21:26,585 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader: Moving last applied index from -1 to 0 09:21:26,585 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]} 09:21:26,586 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation ChangeServersVotingStatus [serverVotingStatusMap={follower2=false, follower=false}, serversVisited=[]] 09:21:26,586 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorVotingConfigSupport - leader: VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]} has been successfully replicated to a majority of followers 09:21:26,589 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower2: Set currentTerm=0, votedFor=null 09:21:26,589 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower2: Local TermInfo store seeded with TermInfo{term=0} 09:21:26,589 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower2: Pekko recovery completed and can restore from snapshot 09:21:26,589 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower2: no journal: skipping journal recovery 09:21:26,589 AM [leader-%d823707] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest3152171244375382161/leader/snapshot-000000006868EE96-22E93083.v1 09:21:26,589 AM [leader-%d823707] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest3152171244375382161/leader/snapshot-000000006868EE96-22E93083.v1 09:21:26,590 AM [leader-%d823707] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest3152171244375382161/leader/TermInfo.properties 09:21:26,590 AM [leader-%d823707] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest3152171244375382161/leader/journal-v1-1.log 09:21:26,590 AM [leader-%d823707] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest3152171244375382161/leader/metadata-v1-1.log 09:21:26,590 AM [leader-%d823707] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:21:26.585707651Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest3152171244375382161/leader/snapshot-000000006868EE96-22E93083.v1, size=96, entryCompress=NONE, stateCompress=NONE} 09:21:26,590 AM [leader-%d823707] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending 09:21:26,590 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s) 09:21:26,590 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} [WARN] [07/05/2025 09:21:28.957] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/leader146] received dead letter from TestActor[pekko://test/user/leader146]: org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupport$ServerOperationTimeout@41fb4042 09:21:31,666 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower179] 09:21:31,677 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader182] 09:21:31,677 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#489,leader-writer-64]/waiting 09:21:31,678 AM [leader-writer-64] [DEBUG] JournalWriteTask - leader: received 1 commands after 5.102 s 09:21:31,678 AM [leader-writer-64] [DEBUG] JournalWriteTask - leader: completed 1 commands in 34.12 μs 09:21:31,678 AM [leader-writer-64] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:21:31,678 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal closed 09:21:31,678 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader: journal closed 09:21:31,678 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:31,678 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:31,679 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector183] 09:21:31,679 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector184#-673076424] 09:21:31,679 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower180] 09:21:31,679 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - follower: terminating thread VirtualThread[#490,follower-writer-65]/waiting 09:21:31,680 AM [follower-writer-65] [DEBUG] JournalWriteTask - follower: received 1 commands after 5.100 s 09:21:31,680 AM [follower-writer-65] [DEBUG] JournalWriteTask - follower: completed 1 commands in 20.07 μs 09:21:31,680 AM [follower-writer-65] [DEBUG] JournalWriteTask - follower: journal writer stopped 09:21:31,680 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower: journal closed 09:21:31,680 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower: journal closed 09:21:31,680 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks 09:21:31,680 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks 09:21:31,680 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector185#-1947813319] 09:21:31,681 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower2181] 09:21:31,681 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - follower2: terminating thread VirtualThread[#491,follower2-writer-66]/waiting 09:21:31,681 AM [follower2-writer-66] [DEBUG] JournalWriteTask - follower2: received 1 commands after 5.097 s 09:21:31,681 AM [follower2-writer-66] [DEBUG] JournalWriteTask - follower2: completed 1 commands in 19.70 μs 09:21:31,681 AM [follower2-writer-66] [DEBUG] JournalWriteTask - follower2: journal writer stopped 09:21:31,681 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower2: journal closed 09:21:31,681 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower2: journal closed 09:21:31,681 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower2: stopped executor with 0 remaining tasks 09:21:31,681 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower2: stopped executor with 0 remaining tasks 09:21:31,687 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithExistingFollower starting 09:21:31,689 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000 09:21:31,689 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: started executor 09:21:31,689 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: started executor [WARN] [07/05/2025 09:21:31.689] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server188]: org.opendaylight.controller.cluster.common.actor.Monitor@7dc77d4e 09:21:31,690 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0 09:21:31,690 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:31,690 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - new-server: journal open: applyTo=0 09:21:31,691 AM [new-server-writer-67] [DEBUG] JournalWriteTask - new-server: journal writer started 09:21:31,691 AM [new-server-writer-67] [DEBUG] JournalWriteTask - new-server: waiting to receive commands 09:21:31,692 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16530346489553338816/new-server/TermInfo.properties does not exist 09:21:31,693 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16530346489553338816/new-server/journal-v1-1.log 09:21:31,693 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16530346489553338816/new-server/metadata-v1-1.log 09:21:31,693 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: no eligible files found 09:21:31,693 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - new-server: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:31,695 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null 09:21:31,695 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0} 09:21:31,695 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot 09:21:31,695 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery 09:21:31,696 AM [test-pekko.actor.default-dispatcher-15] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 09:21:31,696 AM [main] [DEBUG] AbstractReplicatedLog - follower: Moving last applied index from -1 to 2 [WARN] [07/05/2025 09:21:31.697] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader189]: org.opendaylight.controller.cluster.common.actor.Monitor@5bb95617 09:21:31,697 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=leader 09:21:31,697 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:21:31,697 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:21:31,697 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor 09:21:31,698 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:21:31,699 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:31,699 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:21:31,699 AM [leader-writer-68] [DEBUG] JournalWriteTask - leader: journal writer started 09:21:31,699 AM [leader-writer-68] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:21:31,700 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16530346489553338816/leader/TermInfo.properties does not exist 09:21:31,700 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16530346489553338816/leader/journal-v1-1.log 09:21:31,700 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16530346489553338816/leader/metadata-v1-1.log 09:21:31,701 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: no eligible files found 09:21:31,701 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:31,705 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=leader 09:21:31,705 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=leader} 09:21:31,705 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:21:31,705 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:21:31,705 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [follower] 09:21:36,730 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower186] 09:21:36,742 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector187#-744819772] 09:21:36,743 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server188] 09:21:36,743 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - new-server: terminating thread VirtualThread[#493,new-server-writer-67]/waiting 09:21:36,743 AM [new-server-writer-67] [DEBUG] JournalWriteTask - new-server: received 1 commands after 5.053 s 09:21:36,743 AM [new-server-writer-67] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 38.95 μs 09:21:36,744 AM [new-server-writer-67] [DEBUG] JournalWriteTask - new-server: journal writer stopped 09:21:36,744 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - new-server: journal closed 09:21:36,744 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - new-server: journal closed 09:21:36,744 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:36,744 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:36,744 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader189] 09:21:36,745 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#494,leader-writer-68]/waiting 09:21:36,745 AM [leader-writer-68] [DEBUG] JournalWriteTask - leader: received 1 commands after 5.046 s 09:21:36,745 AM [leader-writer-68] [DEBUG] JournalWriteTask - leader: completed 1 commands in 21.22 μs 09:21:36,745 AM [leader-writer-68] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:21:36,745 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader: journal closed 09:21:36,745 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - leader: journal closed 09:21:36,745 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:36,745 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:36,750 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerForwardedToLeader starting [WARN] [07/05/2025 09:21:36.752] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server192]: org.opendaylight.controller.cluster.common.actor.Monitor@5d2182e2 09:21:36,753 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000 09:21:36,753 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: started executor 09:21:36,753 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: started executor 09:21:36,754 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0 09:21:36,754 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:36,754 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - new-server: journal open: applyTo=0 09:21:36,755 AM [new-server-writer-69] [DEBUG] JournalWriteTask - new-server: journal writer started 09:21:36,755 AM [new-server-writer-69] [DEBUG] JournalWriteTask - new-server: waiting to receive commands 09:21:36,757 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest5518573400005372091/new-server/TermInfo.properties does not exist 09:21:36,757 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest5518573400005372091/new-server/journal-v1-1.log 09:21:36,757 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest5518573400005372091/new-server/metadata-v1-1.log 09:21:36,757 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - new-server: no eligible files found 09:21:36,757 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - new-server: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:36,760 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null 09:21:36,760 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0} 09:21:36,760 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot 09:21:36,760 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery 09:21:36,761 AM [test-pekko.actor.default-dispatcher-17] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [07/05/2025 09:21:36.762] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower194]: org.opendaylight.controller.cluster.common.actor.Monitor@d5d4236 09:21:36,763 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - follower: Starting recovery with journal batch size 1000 09:21:36,763 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower: started executor 09:21:36,763 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower: started executor 09:21:36,764 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower: metadata journal open: replayFrom=1 applyTo=0 09:21:36,765 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:36,765 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower: journal open: applyTo=0 09:21:36,765 AM [follower-writer-70] [DEBUG] JournalWriteTask - follower: journal writer started 09:21:36,765 AM [follower-writer-70] [DEBUG] JournalWriteTask - follower: waiting to receive commands 09:21:36,767 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest5518573400005372091/follower/TermInfo.properties does not exist 09:21:36,767 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest5518573400005372091/follower/journal-v1-1.log 09:21:36,767 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest5518573400005372091/follower/metadata-v1-1.log 09:21:36,767 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: no eligible files found 09:21:36,767 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:36,771 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=0, votedFor=null 09:21:36,771 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower: Local TermInfo store seeded with TermInfo{term=0} 09:21:36,771 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower: Pekko recovery completed and can restore from snapshot 09:21:36,771 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower: no journal: skipping journal recovery 09:21:36,772 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=0, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term 09:21:36,774 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=1, votedFor=null 09:21:36,774 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower (Follower): The followers log is empty and the senders prevLogIndex is 0 09:21:36,775 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower (Follower): Follower is out-of-sync so sending negative reply: AppendEntriesReply{term=1, success=false, followerId=follower, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:21:36,775 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower: Last sync leader does not match current leader leader, need to catch up to -1 [WARN] [07/05/2025 09:21:36.780] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower194] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower, initialSyncDone=false] 09:21:36,782 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - follower: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server192, votingMember=true], state: Idle 09:21:36,782 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower: getLeaderAddress leaderId = leader peerAddress = null 09:21:36,782 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - follower: No leader - returning NO_LEADER reply 09:21:41,810 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower190] 09:21:41,821 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector191#-2061476947] 09:21:41,821 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server192] 09:21:41,821 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - new-server: terminating thread VirtualThread[#495,new-server-writer-69]/waiting 09:21:41,822 AM [new-server-writer-69] [DEBUG] JournalWriteTask - new-server: received 1 commands after 5.067 s 09:21:41,822 AM [new-server-writer-69] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 44.53 μs 09:21:41,822 AM [new-server-writer-69] [DEBUG] JournalWriteTask - new-server: journal writer stopped 09:21:41,823 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - new-server: journal closed 09:21:41,823 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - new-server: journal closed 09:21:41,823 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:41,823 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:41,824 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader193#-1698175330] 09:21:41,824 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower194] 09:21:41,824 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PekkoRaftStorage - follower: terminating thread VirtualThread[#496,follower-writer-70]/waiting 09:21:41,824 AM [follower-writer-70] [DEBUG] JournalWriteTask - follower: received 1 commands after 5.059 s 09:21:41,824 AM [follower-writer-70] [DEBUG] JournalWriteTask - follower: completed 1 commands in 19.15 μs 09:21:41,824 AM [follower-writer-70] [DEBUG] JournalWriteTask - follower: journal writer stopped 09:21:41,825 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower: journal closed 09:21:41,825 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower: journal closed 09:21:41,825 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks 09:21:41,825 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks 09:21:41,830 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerForwardToLeader starting [WARN] [07/05/2025 09:21:41.831] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower197]: org.opendaylight.controller.cluster.common.actor.Monitor@63e9878c 09:21:41,832 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower: Starting recovery with journal batch size 1000 09:21:41,833 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: started executor 09:21:41,833 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: started executor 09:21:41,833 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower: metadata journal open: replayFrom=1 applyTo=0 09:21:41,834 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:41,834 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - follower: journal open: applyTo=0 09:21:41,834 AM [follower-writer-71] [DEBUG] JournalWriteTask - follower: journal writer started 09:21:41,834 AM [follower-writer-71] [DEBUG] JournalWriteTask - follower: waiting to receive commands 09:21:41,836 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest492974235790755292/follower/TermInfo.properties does not exist 09:21:41,836 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest492974235790755292/follower/journal-v1-1.log 09:21:41,836 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest492974235790755292/follower/metadata-v1-1.log 09:21:41,836 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower: no eligible files found 09:21:41,837 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:41,839 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=0, votedFor=null 09:21:41,839 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower: Local TermInfo store seeded with TermInfo{term=0} 09:21:41,839 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower: Pekko recovery completed and can restore from snapshot 09:21:41,839 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower: no journal: skipping journal recovery 09:21:41,840 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=0, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term 09:21:41,842 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=1, votedFor=null 09:21:41,842 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower (Follower): The followers log is empty and the senders prevLogIndex is 0 09:21:41,842 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower (Follower): Follower is out-of-sync so sending negative reply: AppendEntriesReply{term=1, success=false, followerId=follower, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} 09:21:41,843 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower: Last sync leader does not match current leader leader, need to catch up to -1 [WARN] [07/05/2025 09:21:41.843] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower197] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower, initialSyncDone=false] 09:21:41,850 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - follower: onRemoveServer: RemoveServer{serverId='follower'}, state: Idle 09:21:41,851 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower: getLeaderAddress leaderId = leader peerAddress = null 09:21:41,851 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - follower: No leader - returning NO_LEADER reply 09:21:46,867 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower195] 09:21:46,878 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader196] 09:21:46,879 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower197] 09:21:46,879 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - follower: terminating thread VirtualThread[#497,follower-writer-71]/waiting 09:21:46,880 AM [follower-writer-71] [DEBUG] JournalWriteTask - follower: received 1 commands after 5.045 s 09:21:46,880 AM [follower-writer-71] [DEBUG] JournalWriteTask - follower: completed 1 commands in 43.40 μs 09:21:46,880 AM [follower-writer-71] [DEBUG] JournalWriteTask - follower: journal writer stopped 09:21:46,880 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower: journal closed 09:21:46,880 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - follower: journal closed 09:21:46,880 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks 09:21:46,881 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks 09:21:46,986 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithExistingServer starting [WARN] [07/05/2025 09:21:46.987] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader199]: org.opendaylight.controller.cluster.common.actor.Monitor@50d31bfc 09:21:46,988 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:46,988 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:21:46,988 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: started executor 09:21:46,988 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: started executor 09:21:46,989 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:21:46,991 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:46,991 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:21:46,991 AM [leader-writer-72] [DEBUG] JournalWriteTask - leader: journal writer started 09:21:46,991 AM [leader-writer-72] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:21:46,993 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest585984489875930714/leader/TermInfo.properties does not exist 09:21:46,993 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest585984489875930714/leader/journal-v1-1.log 09:21:46,993 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest585984489875930714/leader/metadata-v1-1.log 09:21:46,993 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: no eligible files found 09:21:46,993 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:46,995 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:46,996 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=} 09:21:46,996 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:21:46,996 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:21:46,996 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [follower] 09:21:47,1 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=follower, newServerAddress=pekko://test/user/follower198, votingMember=true], state: Idle 09:21:47,2 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=follower, newServerAddress=pekko://test/user/follower198, votingMember=true] 09:21:47,2 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: Returning ALREADY_EXISTS for operation AddServer [newServerId=follower, newServerAddress=pekko://test/user/follower198, votingMember=true] 09:21:47,2 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithExistingServer ending 09:21:47,2 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower198] 09:21:47,13 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader199] 09:21:47,13 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#498,leader-writer-72]/waiting 09:21:47,13 AM [leader-writer-72] [DEBUG] JournalWriteTask - leader: received 1 commands after 22.14 ms 09:21:47,13 AM [leader-writer-72] [DEBUG] JournalWriteTask - leader: completed 1 commands in 23.38 μs 09:21:47,13 AM [leader-writer-72] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:21:47,13 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader: journal closed 09:21:47,14 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader: journal closed 09:21:47,14 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:47,14 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:47,117 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeToVotingWithNoLeaderAndElectionTimeout starting [WARN] [07/05/2025 09:21:47.120] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/node1]: org.opendaylight.controller.cluster.common.actor.Monitor@59a6c600 09:21:47,121 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - node1: Starting recovery with journal batch size 1000 09:21:47,121 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: started executor 09:21:47,121 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: started executor 09:21:47,122 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node1: metadata journal open: replayFrom=1 applyTo=0 09:21:47,122 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node1: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:47,122 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - node1: journal open: applyTo=0 09:21:47,122 AM [node1-writer-73] [DEBUG] JournalWriteTask - node1: journal writer started 09:21:47,123 AM [node1-writer-73] [DEBUG] JournalWriteTask - node1: waiting to receive commands 09:21:47,124 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node1/TermInfo.properties does not exist 09:21:47,124 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - node2: Starting recovery with journal batch size 1000 09:21:47,125 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - node2: started executor 09:21:47,125 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node1/journal-v1-1.log 09:21:47,125 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node1/metadata-v1-1.log 09:21:47,125 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - node2: started executor 09:21:47,125 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - node1: no eligible files found 09:21:47,125 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=1, votedFor=node1 09:21:47,125 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PekkoRecovery - node1: Received ReplicatedLogEntry for recovery: index: 0, size: 133 09:21:47,125 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PeerInfos - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=VOTING]] 09:21:47,125 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - node1: Recovery completed - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1 09:21:47,125 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - node2: metadata journal open: replayFrom=1 applyTo=0 [WARN] [07/05/2025 09:21:47.124] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/node2]: org.opendaylight.controller.cluster.common.actor.Monitor@477829af 09:21:47,126 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - node2: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:47,126 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - node2: journal open: applyTo=0 09:21:47,126 AM [node2-writer-74] [DEBUG] JournalWriteTask - node2: journal writer started 09:21:47,126 AM [node2-writer-74] [DEBUG] JournalWriteTask - node2: waiting to receive commands 09:21:47,127 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node2/TermInfo.properties does not exist 09:21:47,127 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node2/journal-v1-1.log 09:21:47,127 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node2/metadata-v1-1.log 09:21:47,127 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: no eligible files found 09:21:47,127 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=1, votedFor=node1 09:21:47,127 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - node2: Received ReplicatedLogEntry for recovery: index: 0, size: 133 09:21:47,127 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PeerInfos - node2: Updated server config: isVoting: true, peers: [PeerInfo [id=node1, address=null, votingState=NON_VOTING]] 09:21:47,128 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - node2: Recovery completed - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1 09:21:47,130 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=1, votedFor=node1 09:21:47,130 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - node1: Local TermInfo store seeded with TermInfo{term=1, votedFor=node1} 09:21:47,130 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - node1: taking snapshot to clear Pekko persistence to 2 09:21:47,130 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Recovery - node1: no applied entries in recovery log, re-snapshotting EntryInfo[index=-1, term=-1] 09:21:47,130 AM [test-pekko.actor.default-dispatcher-6] [INFO] Recovery - node1: Taking snapshot on entry with index -1 09:21:47,131 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - node1: support() called 09:21:47,131 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - node1: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node1/snapshot-000000006868EEAB-07CFA1CA.tmp 09:21:47,131 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=1, votedFor=node1 09:21:47,131 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - node2: Local TermInfo store seeded with TermInfo{term=1, votedFor=node1} 09:21:47,131 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - node2: taking snapshot to clear Pekko persistence to 2 09:21:47,131 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Recovery - node2: no applied entries in recovery log, re-snapshotting EntryInfo[index=-1, term=-1] 09:21:47,131 AM [test-pekko.actor.default-dispatcher-17] [INFO] Recovery - node2: Taking snapshot on entry with index -1 09:21:47,131 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - node2: support() called 09:21:47,131 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node2/snapshot-000000006868EEAB-07DC3159.tmp 09:21:47,133 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - node1: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node1/snapshot-000000006868EEAB-07CFA1CA.v1 09:21:47,133 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - node1: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node1/snapshot-000000006868EEAB-07CFA1CA.v1 09:21:47,133 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node1/TermInfo.properties 09:21:47,134 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node1/journal-v1-1.log 09:21:47,134 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node1/metadata-v1-1.log 09:21:47,134 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - node1: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:21:47.131047882Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node1/snapshot-000000006868EEAB-07CFA1CA.v1, size=380, entryCompress=NONE, stateCompress=NONE} 09:21:47,134 AM [test-pekko.actor.default-dispatcher-6] [INFO] Recovery - node1: Snapshot completed in 3.271 ms, resetting timer for the next recovery snapshot 09:21:47,134 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - node1: Pekko recovery completed and can restore from snapshot 09:21:47,134 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - node1: starting journal recovery 09:21:47,134 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - node1: Moving last applied index from -1 to -1 09:21:47,134 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node2/snapshot-000000006868EEAB-07DC3159.v1 09:21:47,134 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - node1: empty journal: appending 1 entries 09:21:47,134 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node2/snapshot-000000006868EEAB-07DC3159.v1 09:21:47,134 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - node1: updated meta to JournalMeta[replayFrom=1, applyTo=0] 09:21:47,134 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node2/TermInfo.properties 09:21:47,134 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node2/journal-v1-1.log 09:21:47,134 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node2/metadata-v1-1.log 09:21:47,134 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-05T09:21:47.131871065Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6019880218334355844/node2/snapshot-000000006868EEAB-07DC3159.v1, size=380, entryCompress=NONE, stateCompress=NONE} 09:21:47,134 AM [test-pekko.actor.default-dispatcher-17] [INFO] Recovery - node2: Snapshot completed in 3.072 ms, resetting timer for the next recovery snapshot 09:21:47,134 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - node2: Pekko recovery completed and can restore from snapshot 09:21:47,134 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - node2: starting journal recovery 09:21:47,134 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - node2: Moving last applied index from -1 to -1 09:21:47,135 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - node2: empty journal: appending 1 entries 09:21:47,135 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node2: updated meta to JournalMeta[replayFrom=1, applyTo=0] 09:21:47,138 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] JournalRecovery - node1: journal recovery completedin 4.386 ms with journalIndex=1 09:21:47,139 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - node1: ignoring DeleteMessagesSuccess(2) 09:21:47,139 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - node1: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={node1=true}, serversVisited=[]], state: Idle 09:21:47,139 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState 09:21:47,139 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - node1: Sending local ElectionTimeout to start leader election 09:21:47,139 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PeerInfos - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=null, votingState=VOTING]] 09:21:47,139 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 09:21:47,139 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - node1 (Follower): Received TimeoutNow - switching to Candidate 09:21:47,139 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - node1 (Candidate): Election: Candidate has following voting peers: [node2] 09:21:47,139 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - node2: journal recovery completedin 4.803 ms with journalIndex=1 09:21:47,140 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - node2: ignoring DeleteMessagesSuccess(2) 09:21:47,141 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=2, votedFor=node1 09:21:47,141 AM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - node1 (Candidate): Starting new election term 2 09:21:47,141 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - node1 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 09:21:47,256 AM [test-pekko.actor.default-dispatcher-17] [WARN] RaftActorVotingConfigSupport - node1: Leader election timed out - cannot apply operation ChangeServersVotingStatus [serverVotingStatusMap={node1=true}, serversVisited=[]] 09:21:47,256 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PeerInfos - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=VOTING]] 09:21:47,257 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - node1: tryToForwardOperationToAnotherServer - servers already visited [] 09:21:47,257 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - node1: Returning NO_LEADER for operation ChangeServersVotingStatus [serverVotingStatusMap={node1=true}, serversVisited=[]] 09:21:47,257 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeToVotingWithNoLeaderAndElectionTimeout ending 09:21:47,257 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower200] 09:21:47,268 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector201#1606070109] 09:21:47,269 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/node1] 09:21:47,269 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - node1: terminating thread VirtualThread[#499,node1-writer-73]/waiting 09:21:47,269 AM [node1-writer-73] [DEBUG] JournalWriteTask - node1: received 1 commands after 146.5 ms 09:21:47,269 AM [node1-writer-73] [DEBUG] JournalWriteTask - node1: completed 1 commands in 41.84 μs 09:21:47,269 AM [node1-writer-73] [DEBUG] JournalWriteTask - node1: journal writer stopped 09:21:47,270 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node1: journal closed 09:21:47,270 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - node1: journal closed 09:21:47,270 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: stopped executor with 0 remaining tasks 09:21:47,270 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: stopped executor with 0 remaining tasks 09:21:47,270 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector202#-112405124] 09:21:47,270 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/node2] 09:21:47,270 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - node2: terminating thread VirtualThread[#500,node2-writer-74]/waiting 09:21:47,271 AM [node2-writer-74] [DEBUG] JournalWriteTask - node2: received 1 commands after 144.5 ms 09:21:47,271 AM [node2-writer-74] [DEBUG] JournalWriteTask - node2: completed 1 commands in 19.89 μs 09:21:47,271 AM [node2-writer-74] [DEBUG] JournalWriteTask - node2: journal writer stopped 09:21:47,271 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node2: journal closed 09:21:47,271 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - node2: journal closed 09:21:47,271 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: stopped executor with 0 remaining tasks 09:21:47,271 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: stopped executor with 0 remaining tasks 09:21:47,274 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeToVotingWithNoLeader starting [WARN] [07/05/2025 09:21:47.276] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/node1]: org.opendaylight.controller.cluster.common.actor.Monitor@fea99c2 09:21:47,277 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - node1: Starting recovery with journal batch size 1000 09:21:47,277 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: started executor 09:21:47,277 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: started executor 09:21:47,278 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node1: metadata journal open: replayFrom=1 applyTo=0 09:21:47,279 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node1: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:47,279 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - node1: journal open: applyTo=0 09:21:47,279 AM [node1-writer-75] [DEBUG] JournalWriteTask - node1: journal writer started 09:21:47,279 AM [node1-writer-75] [DEBUG] JournalWriteTask - node1: waiting to receive commands [WARN] [07/05/2025 09:21:47.280] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/node2]: org.opendaylight.controller.cluster.common.actor.Monitor@114f83d0 09:21:47,280 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - node2: Starting recovery with journal batch size 1000 09:21:47,281 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - node2: started executor 09:21:47,281 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - node2: started executor 09:21:47,281 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node1/TermInfo.properties does not exist 09:21:47,281 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node1/journal-v1-1.log 09:21:47,281 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node1/metadata-v1-1.log 09:21:47,281 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - node1: no eligible files found 09:21:47,281 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=1, votedFor=downNode1 09:21:47,281 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - node2: metadata journal open: replayFrom=1 applyTo=0 09:21:47,281 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - node1: Received ReplicatedLogEntry for recovery: index: 0, size: 163 09:21:47,281 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PeerInfos - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=NON_VOTING], PeerInfo [id=downNode2, address=null, votingState=VOTING], PeerInfo [id=downNode1, address=null, votingState=VOTING]] 09:21:47,281 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRecovery - node1: Received apply journal entries for recovery, applying to state: 0 to 0 09:21:47,282 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - node1: Moving last applied index from -1 to 0 09:21:47,282 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - node2: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:47,282 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRaftStorage - node2: journal open: applyTo=0 09:21:47,282 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - node1: Recovery completed in 82.38 μs - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1 09:21:47,282 AM [node2-writer-76] [DEBUG] JournalWriteTask - node2: journal writer started 09:21:47,282 AM [node2-writer-76] [DEBUG] JournalWriteTask - node2: waiting to receive commands 09:21:47,283 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node2/TermInfo.properties does not exist 09:21:47,283 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node2/journal-v1-1.log 09:21:47,283 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node2/metadata-v1-1.log 09:21:47,283 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: no eligible files found 09:21:47,283 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=1, votedFor=downNode2 09:21:47,283 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - node2: Received ReplicatedLogEntry for recovery: index: 0, size: 163 09:21:47,284 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PeerInfos - node2: Updated server config: isVoting: false, peers: [PeerInfo [id=downNode2, address=null, votingState=VOTING], PeerInfo [id=downNode1, address=null, votingState=VOTING], PeerInfo [id=node1, address=null, votingState=NON_VOTING]] 09:21:47,284 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - node2: Received apply journal entries for recovery, applying to state: 0 to 0 09:21:47,284 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - node2: Moving last applied index from -1 to 0 09:21:47,284 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - node2: Recovery completed in 41.63 μs - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1 09:21:47,285 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=1, votedFor=downNode1 09:21:47,285 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - node1: Local TermInfo store seeded with TermInfo{term=1, votedFor=downNode1} 09:21:47,286 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - node1: taking snapshot to clear Pekko persistence to 3 09:21:47,286 AM [test-pekko.actor.default-dispatcher-11] [INFO] Recovery - node1: Taking snapshot on entry with index 0 09:21:47,286 AM [test-pekko.actor.default-dispatcher-11] [INFO] MockRaftActor - node1: support() called 09:21:47,286 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - node1: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node1/snapshot-000000006868EEAB-110F8ACC.tmp 09:21:47,290 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=1, votedFor=downNode2 09:21:47,290 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - node2: Local TermInfo store seeded with TermInfo{term=1, votedFor=downNode2} 09:21:47,290 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - node2: taking snapshot to clear Pekko persistence to 3 09:21:47,290 AM [test-pekko.actor.default-dispatcher-17] [INFO] Recovery - node2: Taking snapshot on entry with index 0 09:21:47,290 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - node2: support() called 09:21:47,290 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node2/snapshot-000000006868EEAB-114DAB9A.tmp 09:21:47,291 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - node1: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node1/snapshot-000000006868EEAB-110F8ACC.v1 09:21:47,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - node1: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node1/snapshot-000000006868EEAB-110F8ACC.v1 09:21:47,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node1/TermInfo.properties 09:21:47,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node1/journal-v1-1.log 09:21:47,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node1/metadata-v1-1.log 09:21:47,292 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - node1: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=0, term=1], timestamp=2025-07-05T09:21:47.286231244Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node1/snapshot-000000006868EEAB-110F8ACC.v1, size=261, entryCompress=NONE, stateCompress=NONE} 09:21:47,293 AM [test-pekko.actor.default-dispatcher-11] [INFO] Recovery - node1: Snapshot completed in 7.101 ms, resetting timer for the next recovery snapshot 09:21:47,293 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - node1: Pekko recovery completed and can restore from snapshot 09:21:47,293 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - node1: starting journal recovery 09:21:47,293 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] AbstractReplicatedLog - node1: Moving last applied index from -1 to 0 09:21:47,293 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - node1: empty journal: appending 0 entries 09:21:47,293 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - node1: updated meta to JournalMeta[replayFrom=1, applyTo=0] 09:21:47,293 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] JournalRecovery - node1: journal recovery completedin 309.7 μs with journalIndex=1 09:21:47,293 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node2/snapshot-000000006868EEAB-114DAB9A.v1 09:21:47,293 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node2/snapshot-000000006868EEAB-114DAB9A.v1 09:21:47,294 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node2/TermInfo.properties 09:21:47,294 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node2/journal-v1-1.log 09:21:47,294 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node2/metadata-v1-1.log 09:21:47,294 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=0, term=1], timestamp=2025-07-05T09:21:47.290302874Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16612799294407962669/node2/snapshot-000000006868EEAB-114DAB9A.v1, size=261, entryCompress=NONE, stateCompress=NONE} 09:21:47,294 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - node1: ignoring DeleteMessagesSuccess(3) 09:21:47,294 AM [test-pekko.actor.default-dispatcher-17] [INFO] Recovery - node2: Snapshot completed in 4.229 ms, resetting timer for the next recovery snapshot 09:21:47,294 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - node2: Pekko recovery completed and can restore from snapshot 09:21:47,294 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - node2: starting journal recovery 09:21:47,294 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - node2: Moving last applied index from -1 to 0 09:21:47,294 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - node2: empty journal: appending 0 entries 09:21:47,294 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node2: updated meta to JournalMeta[replayFrom=1, applyTo=0] 09:21:47,294 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - node2: journal recovery completedin 284.2 μs with journalIndex=1 09:21:47,295 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - node2: ignoring DeleteMessagesSuccess(3) 09:21:47,306 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - node1: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={downNode2=false, node2=true, downNode1=false, node1=true}, serversVisited=[]], state: Idle 09:21:47,306 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState 09:21:47,306 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - node1: Sending local ElectionTimeout to start leader election 09:21:47,306 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PeerInfos - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=null, votingState=VOTING], PeerInfo [id=downNode2, address=null, votingState=NON_VOTING], PeerInfo [id=downNode1, address=null, votingState=NON_VOTING]] 09:21:47,306 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy 09:21:47,306 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - node1 (Follower): Received TimeoutNow - switching to Candidate 09:21:47,306 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - node1 (Candidate): Election: Candidate has following voting peers: [node2] 09:21:47,309 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=2, votedFor=node1 09:21:47,309 AM [test-pekko.actor.default-dispatcher-17] [INFO] Candidate - node1 (Candidate): Starting new election term 2 09:21:47,309 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - node1 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 09:21:47,826 AM [test-pekko.actor.default-dispatcher-11] [WARN] RaftActorVotingConfigSupport - node1: Leader election timed out - cannot apply operation ChangeServersVotingStatus [serverVotingStatusMap={downNode2=false, node2=true, downNode1=false, node1=true}, serversVisited=[]] 09:21:47,826 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PeerInfos - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=NON_VOTING], PeerInfo [id=downNode2, address=null, votingState=VOTING], PeerInfo [id=downNode1, address=null, votingState=VOTING]] 09:21:47,826 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorVotingConfigSupport - node1: tryToForwardOperationToAnotherServer - servers already visited [] 09:21:47,826 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorVotingConfigSupport - node1: Returning NO_LEADER for operation ChangeServersVotingStatus [serverVotingStatusMap={downNode2=false, node2=true, downNode1=false, node1=true}, serversVisited=[]] 09:21:47,827 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - node1: Last sync leader does not match current leader downNode1, need to catch up to 0 [WARN] [07/05/2025 09:21:47.827] [test-pekko.actor.default-dispatcher-11] [pekko://test/deadLetters] received dead letter from TestActor[pekko://test/user/node1]: AppendEntriesReply{term=2, success=true, followerId=node1, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5} [WARN] [07/05/2025 09:21:47.827] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/node1] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=node1, initialSyncDone=false] 09:21:48,440 AM [main] [INFO] PeerInfos - node1: Peer address for peer node2 set to pekko://test/user/node2 09:21:48,440 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorVotingConfigSupport - node1: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={downNode2=false, node2=true, downNode1=false, node1=true}, serversVisited=[]], state: Idle 09:21:48,440 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState 09:21:48,440 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActorVotingConfigSupport - node1: Sending local ElectionTimeout to start leader election 09:21:48,440 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PeerInfos - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=pekko://test/user/node2, votingState=VOTING], PeerInfo [id=downNode2, address=null, votingState=NON_VOTING], PeerInfo [id=downNode1, address=null, votingState=NON_VOTING]] 09:21:48,440 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Follower - node1 (Follower): Received TimeoutNow - switching to Candidate 09:21:48,441 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] Candidate - node1 (Candidate): Election: Candidate has following voting peers: [node2] 09:21:48,445 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=3, votedFor=node1 09:21:48,445 AM [test-pekko.actor.default-dispatcher-11] [INFO] Candidate - node1 (Candidate): Starting new election term 3 09:21:48,445 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActorBehavior - node1 (Follower) :- Switching from behavior Follower to Candidate, election term: 3 09:21:48,956 AM [test-pekko.actor.default-dispatcher-17] [WARN] RaftActorVotingConfigSupport - node1: Leader election timed out - cannot apply operation ChangeServersVotingStatus [serverVotingStatusMap={downNode2=false, node2=true, downNode1=false, node1=true}, serversVisited=[]] 09:21:48,956 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PeerInfos - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=NON_VOTING], PeerInfo [id=downNode2, address=null, votingState=VOTING], PeerInfo [id=downNode1, address=null, votingState=VOTING]] 09:21:48,957 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - node1: tryToForwardOperationToAnotherServer - servers already visited [] 09:21:48,957 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - node1: Returning NO_LEADER for operation ChangeServersVotingStatus [serverVotingStatusMap={downNode2=false, node2=true, downNode1=false, node1=true}, serversVisited=[]] 09:21:48,958 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower203] 09:21:48,970 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector204#-684856919] 09:21:48,970 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/node1] 09:21:48,970 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - node1: terminating thread VirtualThread[#501,node1-writer-75]/waiting 09:21:48,971 AM [node1-writer-75] [DEBUG] JournalWriteTask - node1: received 1 commands after 1.692 s 09:21:48,971 AM [node1-writer-75] [DEBUG] JournalWriteTask - node1: completed 1 commands in 41.76 μs 09:21:48,971 AM [node1-writer-75] [DEBUG] JournalWriteTask - node1: journal writer stopped 09:21:48,971 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - node1: journal closed 09:21:48,971 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - node1: journal closed 09:21:48,971 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - node1: stopped executor with 0 remaining tasks 09:21:48,971 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - node1: stopped executor with 0 remaining tasks 09:21:48,972 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector205#-1460903634] 09:21:48,972 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/node2] 09:21:48,972 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PekkoRaftStorage - node2: terminating thread VirtualThread[#502,node2-writer-76]/waiting 09:21:48,972 AM [node2-writer-76] [DEBUG] JournalWriteTask - node2: received 1 commands after 1.690 s 09:21:48,972 AM [node2-writer-76] [DEBUG] JournalWriteTask - node2: completed 1 commands in 18.74 μs 09:21:48,972 AM [node2-writer-76] [DEBUG] JournalWriteTask - node2: journal writer stopped 09:21:48,973 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - node2: journal closed 09:21:48,973 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - node2: journal closed 09:21:48,973 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - node2: stopped executor with 0 remaining tasks 09:21:48,973 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - node2: stopped executor with 0 remaining tasks 09:21:48,976 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithPriorSnapshotCompleteTimeout starting [WARN] [07/05/2025 09:21:48.978] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server208]: org.opendaylight.controller.cluster.common.actor.Monitor@4757fc98 09:21:48,979 AM [test-pekko.actor.default-dispatcher-11] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000 09:21:48,979 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - new-server: started executor 09:21:48,979 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - new-server: started executor 09:21:48,979 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0 09:21:48,980 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:48,980 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRaftStorage - new-server: journal open: applyTo=0 09:21:48,980 AM [new-server-writer-77] [DEBUG] JournalWriteTask - new-server: journal writer started 09:21:48,980 AM [new-server-writer-77] [DEBUG] JournalWriteTask - new-server: waiting to receive commands 09:21:48,981 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest5071877658933928881/new-server/TermInfo.properties does not exist 09:21:48,981 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest5071877658933928881/new-server/journal-v1-1.log 09:21:48,981 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest5071877658933928881/new-server/metadata-v1-1.log 09:21:48,981 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftStorage - new-server: no eligible files found 09:21:48,981 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - new-server: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:48,984 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null 09:21:48,984 AM [test-pekko.actor.default-dispatcher-11] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0} 09:21:48,984 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot 09:21:48,984 AM [test-pekko.actor.default-dispatcher-11] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery 09:21:48,984 AM [test-pekko.actor.default-dispatcher-11] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 09:21:48,986 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:48,986 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000 09:21:48,986 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: started executor 09:21:48,986 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: started executor [WARN] [07/05/2025 09:21:48.986] [test-pekko.actor.default-dispatcher-11] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader209]: org.opendaylight.controller.cluster.common.actor.Monitor@3162015b 09:21:48,987 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0 09:21:48,987 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0 09:21:48,987 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader: journal open: applyTo=0 09:21:48,987 AM [leader-writer-78] [DEBUG] JournalWriteTask - leader: journal writer started 09:21:48,987 AM [leader-writer-78] [DEBUG] JournalWriteTask - leader: waiting to receive commands 09:21:48,988 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest5071877658933928881/leader/TermInfo.properties does not exist 09:21:48,989 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest5071877658933928881/leader/journal-v1-1.log 09:21:48,989 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest5071877658933928881/leader/metadata-v1-1.log 09:21:48,989 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: no eligible files found 09:21:48,989 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 09:21:48,993 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor= 09:21:48,993 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=} 09:21:48,993 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot 09:21:48,993 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader: no journal: skipping journal recovery 09:21:48,993 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [] 09:21:48,994 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader: Take a snapshot of current state. lastReplicatedLog is null and replicatedToAllIndex is -1 09:21:48,994 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 09:21:48,994 AM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true] 09:21:48,994 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - leader: captured snapshot at lastSequenceNumber: 0 09:21:48,994 AM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=-1, term=-1] 09:21:48,994 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - leader: support() called 09:21:48,994 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - leader: user triggered or root overwrite snapshot encountered, trimming log up to last applied index -1 09:21:48,994 AM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1 09:21:48,999 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server208, votingMember=true], state: Idle 09:21:48,999 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server208, votingMember=true] 09:21:48,999 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - leader: captureToInstall should not be called in state PersistCapture[lastJournalIndex=0, request=CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true]] 09:21:48,999 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: Snapshot already in progress - waiting for completion 09:21:49,216 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: handleInstallSnapshotTimeout for new server new-server 09:21:49,216 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: Returning TIMEOUT for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server208, votingMember=true] 09:21:49,217 AM [test-pekko.actor.default-dispatcher-17] [WARN] RaftActorVotingConfigSupport - leader: Timeout occured for new server new-server while waiting for prior snapshot to complete 09:21:49,217 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithPriorSnapshotCompleteTimeout ending 09:21:49,217 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower206] 09:21:49,218 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector207#321618028] 09:21:49,218 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server208] 09:21:49,218 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - new-server: terminating thread VirtualThread[#503,new-server-writer-77]/waiting 09:21:49,219 AM [new-server-writer-77] [DEBUG] JournalWriteTask - new-server: received 1 commands after 238.5 ms 09:21:49,219 AM [new-server-writer-77] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 29.20 μs 09:21:49,219 AM [new-server-writer-77] [DEBUG] JournalWriteTask - new-server: journal writer stopped 09:21:49,219 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - new-server: journal closed 09:21:49,219 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - new-server: journal closed 09:21:49,219 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:49,219 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks 09:21:49,219 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader209] 09:21:49,220 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRaftStorage - leader: terminating thread VirtualThread[#504,leader-writer-78]/waiting 09:21:49,220 AM [leader-writer-78] [DEBUG] JournalWriteTask - leader: received 1 commands after 232.4 ms 09:21:49,220 AM [leader-writer-78] [DEBUG] JournalWriteTask - leader: completed 1 commands in 18.63 μs 09:21:49,220 AM [leader-writer-78] [DEBUG] JournalWriteTask - leader: journal writer stopped 09:21:49,220 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader: journal closed 09:21:49,220 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRaftStorage - leader: journal closed 09:21:49,220 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks 09:21:49,220 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks [INFO] [07/05/2025 09:21:49.222] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 09:21:49,222 AM [test-pekko.actor.default-dispatcher-11] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] [WARN] [07/05/2025 09:21:49.223] [test-pekko.actor.default-dispatcher-11] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.171.247:17355) [INFO] [07/05/2025 09:21:49.223] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.247:17355] - Exiting completed 09:21:49,224 AM [test-pekko.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.247:17355] - Exiting completed [INFO] [07/05/2025 09:21:49.223] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.247:17355] - Shutting down... 09:21:49,224 AM [test-pekko.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.247:17355] - Shutting down... [INFO] [07/05/2025 09:21:49.224] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.171.247:17355] - Successfully shut down 09:21:49,224 AM [test-pekko.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [pekko://test@10.30.171.247:17355] - Successfully shut down 09:21:49,225 AM [test-pekko.actor.default-dispatcher-17] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. [INFO] [07/05/2025 09:21:49.225] [test-pekko.remote.default-remote-dispatcher-8] [pekko://test@10.30.171.247:17355/system/remoting-terminator] Shutting down remote daemon. [INFO] [07/05/2025 09:21:49.226] [test-pekko.remote.default-remote-dispatcher-8] [pekko://test@10.30.171.247:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports. 09:21:49,226 AM [test-pekko.actor.default-dispatcher-17] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [INFO] [07/05/2025 09:21:49.228] [test-pekko.remote.default-remote-dispatcher-8] [pekko://test@10.30.171.247:17355/system/remoting-terminator] Remoting shut down. 09:21:49,228 AM [test-pekko.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down. [DEBUG] [07/05/2025 09:21:49.228] [test-pekko.actor.internal-dispatcher-2] [EventStream] shutting down: StandardOutLogger