[DEBUG] [07/12/2025 01:14:25.908] [main] [EventStream(pekko://test)] logger log1-TestEventListener started
01:14:25,909 AM [test-pekko.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started
[DEBUG] [07/12/2025 01:14:25.909] [main] [EventStream(pekko://test)] logger log2-Slf4jLogger started
[DEBUG] [07/12/2025 01:14:25.909] [main] [EventStream(pekko://test)] Default Loggers started
[INFO] [07/12/2025 01:14:25.924] [main] [ArteryTransport(pekko://test)] Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.124:17355] with UID [-8226736573517238986]
01:14:25,924 AM [test-pekko.actor.default-dispatcher-7] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [pekko://test@10.30.170.124:17355] with UID [-8226736573517238986]
[INFO] [07/12/2025 01:14:25.925] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.124:17355] - Starting up, Pekko version [1.0.3] ...
01:14:25,925 AM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.124:17355] - Starting up, Pekko version [1.0.3] ...
[INFO] [07/12/2025 01:14:25.928] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.124:17355] - Registered cluster JMX MBean [pekko:type=Cluster]
01:14:25,928 AM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.124:17355] - Registered cluster JMX MBean [pekko:type=Cluster]
[INFO] [07/12/2025 01:14:25.928] [main] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.124:17355] - Started up successfully
01:14:25,928 AM [test-pekko.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.124:17355] - Started up successfully
[INFO] [07/12/2025 01:14:25.929] [test-pekko.actor.internal-dispatcher-4] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.124:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing
[INFO] [07/12/2025 01:14:25.929] [test-pekko.actor.internal-dispatcher-4] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.124:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining
01:14:25,929 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.124:17355] - No downing-provider-class configured, manual cluster downing required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#downing
01:14:25,929 AM [test-pekko.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.124:17355] - No seed-nodes configured, manual cluster join required, see https://pekko.apache.org/docs/pekko/current/typed/cluster.html#joining
01:14:25,943 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithOperationInProgress starting
[WARN] [07/12/2025 01:14:25.946] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server109]: org.opendaylight.controller.cluster.common.actor.Monitor@25f25296
[INFO] [pekkoDeadLetter][07/12/2025 01:14:25.946] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/new-server109] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
01:14:25,948 AM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/new-server109] to Actor[pekko://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
01:14:25,948 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000
01:14:25,948 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: started executor
01:14:25,948 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: started executor
01:14:25,948 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0
01:14:25,949 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:25,949 AM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - new-server: journal open: applyTo=0
01:14:25,949 AM [new-server-writer-35] [DEBUG] JournalWriteTask - new-server: journal writer started
01:14:25,949 AM [new-server-writer-35] [DEBUG] JournalWriteTask - new-server: waiting to receive commands
01:14:25,952 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/TermInfo.properties does not exist
01:14:25,952 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/journal-v1-1.log
01:14:25,952 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/metadata-v1-1.log
01:14:25,952 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - new-server: no eligible files found
01:14:25,952 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:25,955 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null
01:14:25,955 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0}
01:14:25,955 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot
01:14:25,955 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery
[WARN] [07/12/2025 01:14:25.957] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader110]: org.opendaylight.controller.cluster.common.actor.Monitor@73d2314c
[INFO] [pekkoDeadLetter][07/12/2025 01:14:25.958] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader110] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
01:14:25,958 AM [test-pekko.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader110] to Actor[pekko://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
01:14:25,958 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:25,958 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:25,959 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor
01:14:25,959 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor
01:14:25,959 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:25,960 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:25,960 AM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:25,960 AM [leader-writer-36] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:25,960 AM [leader-writer-36] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:25,964 AM [test-pekko.actor.default-dispatcher-12] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
01:14:25,965 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/TermInfo.properties does not exist
01:14:25,965 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/journal-v1-1.log
01:14:25,965 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/metadata-v1-1.log
01:14:25,965 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: no eligible files found
01:14:25,965 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:25,969 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:25,969 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=}
01:14:25,969 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:25,969 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:25,969 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: []
01:14:25,973 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server109, votingMember=true], state: Idle
01:14:25,982 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server109, votingMember=true]
01:14:25,983 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
01:14:25,983 AM [test-pekko.actor.default-dispatcher-12] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server
01:14:25,983 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SnapshotManager - leader: last applied journal index prior to capture: 0
01:14:25,983 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - leader: support() called
01:14:25,983 AM [leader-%d843045] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:25,983 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating capture snapshot for new server new-server
01:14:25,987 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:25,987 AM [test-pekko.actor.default-dispatcher-12] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=-1, term=-1]
01:14:25,987 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - leader: support() called
01:14:25,987 AM [leader-%d843046] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/snapshot-000000006871B6F1-3AD9B600.tmp
01:14:25,987 AM [test-pekko.actor.default-dispatcher-12] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1
01:14:25,987 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): sendInstallSnapshot
01:14:25,987 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Snapshot 157 bytes, total chunks to send: 1
01:14:25,987 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Next chunk: total length=157, offset=0, size=157, hashCode=1546036366
01:14:25,987 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): next snapshot chunk size for follower new-server: 157
01:14:25,987 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): InstallSnapshot sent to follower Vector(user, new-server109), Chunk: 1/1
01:14:25,989 AM [leader-%d843046] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/snapshot-000000006871B6F1-3AD9B600.v1
01:14:25,989 AM [leader-%d843046] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/snapshot-000000006871B6F1-3AD9B600.v1
01:14:25,989 AM [leader-%d843046] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/TermInfo.properties
01:14:25,989 AM [leader-%d843046] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/journal-v1-1.log
01:14:25,989 AM [leader-%d843046] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/metadata-v1-1.log
01:14:25,989 AM [leader-%d843046] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:25.987346432Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/snapshot-000000006871B6F1-3AD9B600.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:25,989 AM [leader-%d843046] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:25,989 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:25,989 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: snapshot is durable as of 2025-07-12T01:14:25.987346432Z
01:14:25,989 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader: Snapshot success, discarding journal entries up to 0
01:14:25,989 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorSnapshotMessageSupport - leader: SnapshotComplete received
01:14:26,35 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server2, newServerAddress=pekko://test/user/follower107, votingMember=false], state: InstallingSnapshot
01:14:26,36 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Server operation already in progress - queueing AddServer [newServerId=new-server2, newServerAddress=pekko://test/user/follower107, votingMember=false]
01:14:26,36 AM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - new-server (Follower): Term 1 in "InstallSnapshot{term=1, leaderId=leader, lastIncludedIndex=-1, lastIncludedTerm=-1, datasize=157, chunk=1/1, lastChunkHashCode=OptionalInt[-1]}" message is greater than follower's term 0 - updating term
01:14:26,39 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=1, votedFor=null
01:14:26,39 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - new-server (Follower): handleInstallSnapshot: InstallSnapshot{term=1, leaderId=leader, lastIncludedIndex=-1, lastIncludedTerm=-1, datasize=157, chunk=1/1, lastChunkHashCode=OptionalInt[-1]}
01:14:26,39 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to -1
01:14:26,39 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotTracker - new-server (Follower): addChunk: chunkIndex=1, lastChunkIndex=0, collectedChunks.size=0, lastChunkHashCode=-1
01:14:26,39 AM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - new-server (Follower): Snapshot received from leader: leader
01:14:26,39 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - new-server: Applying snapshot on follower: PlainSnapshotSource{io=MemoryStreamSource{size=157}}
01:14:26,39 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - new-server: support() called
[WARN] [07/12/2025 01:14:26.040] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/new-server109] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=new-server, initialSyncDone=false]
01:14:26,40 AM [test-pekko.actor.default-dispatcher-7] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/new-server109] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[INFO] [pekkoDeadLetter][07/12/2025 01:14:26.040] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/new-server109] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/new-server109] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
01:14:26,40 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - new-server: Converted InstallSnapshot from leader: leader to state
01:14:26,40 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - new-server: last applied journal index prior to persisting applied snapshot: 0
01:14:26,40 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - new-server: support() called
01:14:26,41 AM [new-server-%d833288] [DEBUG] RaftStorage - new-server: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/snapshot-000000006871B6F2-02723F25.tmp
01:14:26,43 AM [new-server-%d833288] [DEBUG] RaftStorage - new-server: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/snapshot-000000006871B6F2-02723F25.v1
01:14:26,43 AM [new-server-%d833288] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/snapshot-000000006871B6F2-02723F25.v1
01:14:26,43 AM [new-server-%d833288] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/TermInfo.properties
01:14:26,43 AM [new-server-%d833288] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/journal-v1-1.log
01:14:26,43 AM [new-server-%d833288] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/metadata-v1-1.log
01:14:26,43 AM [new-server-%d833288] [DEBUG] RaftStorage - new-server: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:26.041041701Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/snapshot-000000006871B6F2-02723F25.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:26,43 AM [new-server-%d833288] [DEBUG] RaftStorageCompleter - new-server: 1 completion(s) pending
01:14:26,43 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - new-server: running 1 completion(s)
01:14:26,43 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - new-server: snapshot is durable as of 2025-07-12T01:14:26.041041701Z
01:14:26,44 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - new-server: support() called
01:14:26,44 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - new-server: applySnapshot called
01:14:26,44 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - new-server (Follower): handleInstallSnapshot returning: InstallSnapshotReply{term=1, followerId=new-server, chunkIndex=1, success=true}
01:14:26,44 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - new-server: Snapshot success, discarding journal entries up to 0
01:14:26,44 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorSnapshotMessageSupport - new-server: SnapshotComplete received
01:14:26,45 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): handleInstallSnapshotReply: InstallSnapshotReply{term=1, followerId=new-server, chunkIndex=1, success=true}
01:14:26,45 AM [test-pekko.actor.default-dispatcher-12] [INFO] AbstractLeader - leader (Leader): Snapshot successfully installed on follower new-server (last chunk 1) - matchIndex set to -1, nextIndex set to 0
01:14:26,45 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - Sent message UnInitializedFollowerSnapshotReply to self
01:14:26,45 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: onUnInitializedFollowerSnapshotReply: UnInitializedFollowerSnapshotReply [followerId=new-server]
01:14:26,45 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]
01:14:26,46 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: Persist data index=0 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:26,46 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:26,46 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=01d91e42-5fd4-48f6-ae7f-2d94c2675a69}, logIndex: 0, isSendImmediate: true
01:14:26,46 AM [leader-%d843047] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/snapshot-000000006871B6F2-02C14C0D.tmp
01:14:26,46 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:26,46 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:26,46 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower new-server
01:14:26,46 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:26,46 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - new-server (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:26,47 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - new-server (Follower): Number of entries to be appended = 1
01:14:26,47 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - new-server (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
01:14:26,47 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - new-server (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:26,47 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - new-server: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:26,47 AM [new-server-%d833289] [DEBUG] RaftStorage - new-server: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/snapshot-000000006871B6F2-02D01F6B.tmp
01:14:26,47 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PeerInfos - new-server: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=null, votingState=VOTING]]
01:14:26,47 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - new-server (Follower): Log size is now 1
01:14:26,47 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - new-server (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=new-server, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:26,47 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached -1 (of expected -1)
01:14:26,47 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - new-server: awaiting more completions to resolve 1 synchronized callback(s)
01:14:26,47 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server109, votingMember=true]
01:14:26,48 AM [leader-%d843047] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/snapshot-000000006871B6F2-02C14C0D.v1
01:14:26,48 AM [leader-%d843047] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/snapshot-000000006871B6F2-02C14C0D.v1
01:14:26,48 AM [leader-%d843047] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/snapshot-000000006871B6F1-3AD9B600.v1
01:14:26,48 AM [leader-%d843047] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/TermInfo.properties
01:14:26,48 AM [leader-%d843047] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/journal-v1-1.log
01:14:26,48 AM [leader-%d843047] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/metadata-v1-1.log
01:14:26,48 AM [leader-%d843047] [DEBUG] RaftStorage - leader: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:25.987346432Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/snapshot-000000006871B6F1-3AD9B600.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:26,48 AM [new-server-%d833289] [DEBUG] RaftStorage - new-server: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/snapshot-000000006871B6F2-02D01F6B.v1
01:14:26,48 AM [leader-%d843047] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:26.046222349Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/snapshot-000000006871B6F2-02C14C0D.v1, size=86, entryCompress=NONE, stateCompress=NONE}
01:14:26,48 AM [leader-%d843047] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:26,49 AM [new-server-%d833289] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/snapshot-000000006871B6F2-02D01F6B.v1
01:14:26,49 AM [new-server-%d833289] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/snapshot-000000006871B6F2-02723F25.v1
01:14:26,49 AM [new-server-%d833289] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/TermInfo.properties
01:14:26,49 AM [new-server-%d833289] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/journal-v1-1.log
01:14:26,49 AM [new-server-%d833289] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/metadata-v1-1.log
01:14:26,49 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:26,49 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}
01:14:26,49 AM [new-server-%d833289] [DEBUG] RaftStorage - new-server: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:26.041041701Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/snapshot-000000006871B6F2-02723F25.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:26,49 AM [new-server-%d833289] [DEBUG] RaftStorage - new-server: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:26.047193963Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/snapshot-000000006871B6F2-02D01F6B.v1, size=86, entryCompress=NONE, stateCompress=NONE}
01:14:26,49 AM [new-server-%d833289] [DEBUG] RaftStorageCompleter - new-server: 1 completion(s) pending
01:14:26,49 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - new-server: running 1 completion(s)
01:14:26,49 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - new-server: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}
01:14:26,49 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - new-server: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@9049076}
01:14:26,49 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: 0, nextIndex: 1
01:14:26,49 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - new-server: synchronized callbacks after 2.050 ms
01:14:26,49 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
01:14:26,50 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - leader (Leader): Setting last applied to 0
01:14:26,50 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - leader: Moving last applied index from -1 to 0
01:14:26,50 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:26,50 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
[WARN] [07/12/2025 01:14:26.050] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/new-server109] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=new-server, initialSyncDone=true]
01:14:26,50 AM [test-pekko.actor.default-dispatcher-7] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/new-server109] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[INFO] [pekkoDeadLetter][07/12/2025 01:14:26.050] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/new-server109] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/new-server109] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
01:14:26,50 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActorVotingConfigSupport - leader: VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]} has been successfully replicated to a majority of followers
01:14:26,50 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server2, newServerAddress=pekko://test/user/follower107, votingMember=false]
01:14:26,50 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: New follower is non-voting - directly persisting new server configuration
01:14:26,50 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): Commit index set to 0
01:14:26,50 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]
01:14:26,50 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
01:14:26,50 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: Persist data index=1 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
01:14:26,50 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:26,50 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
01:14:26,50 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - new-server (Follower): Setting last applied to 0
01:14:26,50 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - new-server: Moving last applied index from -1 to 0
01:14:26,50 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - new-server: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:26,50 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=46b1299f-c4b7-4d51-974f-4f18fbe52433}, logIndex: 1, isSendImmediate: true
01:14:26,50 AM [leader-%d843048] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/snapshot-000000006871B6F2-0304714A.tmp
01:14:26,50 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
01:14:26,50 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 1 is present for follower new-server
01:14:26,50 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries{term=1, leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:26,50 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server2: active: false, followerNextIndex: 0, leaderLastIndex: 1, leaderSnapShotIndex: -1
01:14:26,51 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation AddServer [newServerId=new-server2, newServerAddress=pekko://test/user/follower107, votingMember=false]
01:14:26,50 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:26,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): Number of entries to be appended = 1
01:14:26,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
01:14:26,51 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - new-server2: Last sync leader does not match current leader leader, need to catch up to -1
01:14:26,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
01:14:26,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - new-server: Append log entry and persist JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:26,51 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 1 is present for follower new-server
01:14:26,51 AM [new-server-%d833290] [DEBUG] RaftStorage - new-server: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/snapshot-000000006871B6F2-030EF1E3.tmp
01:14:26,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - new-server: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=null, votingState=VOTING], PeerInfo [id=new-server2, address=null, votingState=NON_VOTING]]
01:14:26,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): Log size is now 2
01:14:26,51 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower new-server2
01:14:26,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=new-server, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:26,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
01:14:26,51 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - new-server: awaiting more completions to resolve 1 synchronized callback(s)
01:14:26,51 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server2: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}, JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:26,51 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: 1, nextIndex: 2
01:14:26,51 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1
01:14:26,52 AM [leader-%d843048] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/snapshot-000000006871B6F2-0304714A.v1
01:14:26,52 AM [leader-%d843048] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/snapshot-000000006871B6F2-0304714A.v1
01:14:26,52 AM [leader-%d843048] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/snapshot-000000006871B6F2-02C14C0D.v1
01:14:26,52 AM [leader-%d843048] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/TermInfo.properties
01:14:26,52 AM [leader-%d843048] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/journal-v1-1.log
01:14:26,52 AM [leader-%d843048] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/metadata-v1-1.log
01:14:26,52 AM [leader-%d843048] [DEBUG] RaftStorage - leader: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:26.046222349Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/snapshot-000000006871B6F2-02C14C0D.v1, size=86, entryCompress=NONE, stateCompress=NONE}
01:14:26,52 AM [leader-%d843048] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:26.050622794Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/leader/snapshot-000000006871B6F2-0304714A.v1, size=100, entryCompress=NONE, stateCompress=NONE}
01:14:26,53 AM [leader-%d843048] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:26,53 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:26,53 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}
01:14:26,53 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0
01:14:26,53 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader (Leader): Setting last applied to 1
01:14:26,53 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader: Moving last applied index from 0 to 1
01:14:26,53 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: Applying state for log index 1 data VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
01:14:26,53 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorVotingConfigSupport - leader: VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]} has been successfully replicated to a majority of followers
01:14:26,53 AM [new-server-%d833290] [DEBUG] RaftStorage - new-server: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/snapshot-000000006871B6F2-030EF1E3.v1
01:14:26,54 AM [new-server-%d833290] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/snapshot-000000006871B6F2-02D01F6B.v1
01:14:26,58 AM [new-server-%d833290] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/snapshot-000000006871B6F2-030EF1E3.v1
01:14:26,58 AM [new-server-%d833290] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/TermInfo.properties
01:14:26,58 AM [new-server-%d833290] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/journal-v1-1.log
01:14:26,58 AM [new-server-%d833290] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/metadata-v1-1.log
01:14:26,58 AM [new-server-%d833290] [DEBUG] RaftStorage - new-server: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:26.047193963Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/snapshot-000000006871B6F2-02D01F6B.v1, size=86, entryCompress=NONE, stateCompress=NONE}
01:14:26,58 AM [new-server-%d833290] [DEBUG] RaftStorage - new-server: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:26.051311075Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10025447155843808442/new-server/snapshot-000000006871B6F2-030EF1E3.v1, size=100, entryCompress=NONE, stateCompress=NONE}
01:14:26,58 AM [new-server-%d833290] [DEBUG] RaftStorageCompleter - new-server: 1 completion(s) pending
01:14:26,58 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - new-server: running 1 completion(s)
01:14:26,58 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - new-server: persist complete JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}
01:14:26,58 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - new-server: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@6859d8c4}
01:14:26,58 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - new-server: synchronized callbacks after 7.049 ms
01:14:26,61 AM [test-pekko.actor.default-dispatcher-15] [ERROR] OneForOneStrategy - Cannot invoke "org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.getReplicatedToAllIndex()" because "currentBehavior" is null
java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.getReplicatedToAllIndex()" because "currentBehavior" is null
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.trimLog(SnapshotManager.java:663)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.performSnapshotWithoutCapture(RaftActorBehavior.java:438)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.Follower.handleAppendEntries(Follower.java:221)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.appendEntries(RaftActorBehavior.java:152)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.handleMessage(RaftActorBehavior.java:375)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.Follower.handleMessage(Follower.java:501)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ForwardMessageToBehaviorActor.onReceive(ForwardMessageToBehaviorActor.java:25)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.UntypedAbstractActor$$anonfun$receive$1.applyOrElse(AbstractActor.scala:341)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.AbstractActor.aroundReceive(AbstractActor.scala:229)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312)
	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188)
[ERROR] [07/12/2025 01:14:26.061] [test-pekko.actor.internal-dispatcher-4] [pekko://test/user/follower107] Cannot invoke "org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.getReplicatedToAllIndex()" because "currentBehavior" is null
java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.getReplicatedToAllIndex()" because "currentBehavior" is null
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.trimLog(SnapshotManager.java:663)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.performSnapshotWithoutCapture(RaftActorBehavior.java:438)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.Follower.handleAppendEntries(Follower.java:221)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.appendEntries(RaftActorBehavior.java:152)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.handleMessage(RaftActorBehavior.java:375)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.Follower.handleMessage(Follower.java:501)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ForwardMessageToBehaviorActor.onReceive(ForwardMessageToBehaviorActor.java:25)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.UntypedAbstractActor$$anonfun$receive$1.applyOrElse(AbstractActor.scala:341)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.AbstractActor.aroundReceive(AbstractActor.scala:229)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312)
	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188)

01:14:26,215 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower new-server2
01:14:26,215 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): Commit index set to 1
01:14:26,215 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server2: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}, JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}]}
01:14:26,215 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 1 (of expected -1)
01:14:26,215 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
01:14:26,215 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - new-server (Follower): Setting last applied to 1
01:14:26,215 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - new-server: Moving last applied index from 0 to 1
01:14:26,215 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - new-server: Applying state for log index 1 data VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
01:14:26,253 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithOperationInProgress ending
01:14:26,253 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower107]
01:14:26,265 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector108#1455300486]
01:14:26,265 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server109]
01:14:26,266 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EnabledRaftStorage - new-server: terminating thread VirtualThread[#475,new-server-writer-35]/waiting
01:14:26,266 AM [new-server-writer-35] [DEBUG] JournalWriteTask - new-server: received 1 commands after 316.4 ms
01:14:26,266 AM [new-server-writer-35] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 32.91 μs
01:14:26,266 AM [new-server-writer-35] [DEBUG] JournalWriteTask - new-server: journal writer stopped
01:14:26,266 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: journal closed
01:14:26,266 AM [test-pekko.actor.default-dispatcher-15] [INFO] EnabledRaftStorage - new-server: journal closed
01:14:26,266 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:26,266 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:26,267 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader110]
01:14:26,267 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#477,leader-writer-36]/waiting
01:14:26,267 AM [leader-writer-36] [DEBUG] JournalWriteTask - leader: received 1 commands after 306.6 ms
01:14:26,267 AM [leader-writer-36] [DEBUG] JournalWriteTask - leader: completed 1 commands in 19.95 μs
01:14:26,267 AM [leader-writer-36] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:26,267 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:26,267 AM [test-pekko.actor.default-dispatcher-15] [INFO] EnabledRaftStorage - leader: journal closed
01:14:26,267 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:26,267 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:26,268 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector111]
01:14:26,272 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerNonExistentServer starting
[WARN] [07/12/2025 01:14:26.273] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader113]: org.opendaylight.controller.cluster.common.actor.Monitor@621dc4ab
01:14:26,273 AM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader113] to Actor[pekko://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
[INFO] [pekkoDeadLetter][07/12/2025 01:14:26.273] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader113] to Actor[pekko://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
01:14:26,274 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:26,274 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:26,274 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor
01:14:26,274 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor
01:14:26,275 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:26,276 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:26,276 AM [test-pekko.actor.default-dispatcher-15] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:26,276 AM [leader-writer-37] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:26,276 AM [leader-writer-37] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:26,278 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1057319476315816759/leader/TermInfo.properties does not exist
01:14:26,278 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1057319476315816759/leader/journal-v1-1.log
01:14:26,278 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1057319476315816759/leader/metadata-v1-1.log
01:14:26,278 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: no eligible files found
01:14:26,278 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:26,281 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:26,281 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=}
01:14:26,281 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:26,281 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:26,282 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [follower]
01:14:26,282 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:26,287 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: onRemoveServer: RemoveServer{serverId='new-server'}, state: Idle
01:14:26,288 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerNonExistentServer ending
01:14:26,289 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower112]
01:14:26,290 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader113]
01:14:26,290 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#485,leader-writer-37]/waiting
01:14:26,290 AM [leader-writer-37] [DEBUG] JournalWriteTask - leader: received 1 commands after 13.74 ms
01:14:26,290 AM [leader-writer-37] [DEBUG] JournalWriteTask - leader: completed 1 commands in 35.43 μs
01:14:26,290 AM [leader-writer-37] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:26,290 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:26,290 AM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - leader: journal closed
01:14:26,290 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:26,290 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:26,293 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerWithNoLeader starting
[WARN] [07/12/2025 01:14:26.294] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader115]: org.opendaylight.controller.cluster.common.actor.Monitor@26f9b86c
[INFO] [pekkoDeadLetter][07/12/2025 01:14:26.294] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader115] to Actor[pekko://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
01:14:26,294 AM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader115] to Actor[pekko://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
01:14:26,295 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:26,295 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: started executor
01:14:26,295 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: started executor
01:14:26,295 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:26,296 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:26,296 AM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:26,296 AM [leader-writer-38] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:26,296 AM [leader-writer-38] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:26,297 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest5268135648955762811/leader/TermInfo.properties does not exist
01:14:26,297 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest5268135648955762811/leader/journal-v1-1.log
01:14:26,298 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest5268135648955762811/leader/metadata-v1-1.log
01:14:26,298 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader: no eligible files found
01:14:26,298 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:26,300 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=0, votedFor=null
01:14:26,300 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=0}
01:14:26,300 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:26,300 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:26,311 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: onRemoveServer: RemoveServer{serverId='follower'}, state: Idle
01:14:26,311 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: No leader - returning NO_LEADER reply
01:14:26,311 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerWithNoLeader ending
01:14:26,311 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower114]
01:14:26,322 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader115]
01:14:26,322 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#486,leader-writer-38]/waiting
01:14:26,323 AM [leader-writer-38] [DEBUG] JournalWriteTask - leader: received 1 commands after 26.65 ms
01:14:26,323 AM [leader-writer-38] [DEBUG] JournalWriteTask - leader: completed 1 commands in 36.66 μs
01:14:26,323 AM [leader-writer-38] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:26,323 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:26,323 AM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - leader: journal closed
01:14:26,323 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:26,323 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:26,326 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerLeader starting
[WARN] [07/12/2025 01:14:26.327] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader118]: org.opendaylight.controller.cluster.common.actor.Monitor@7b1b2b63
[INFO] [pekkoDeadLetter][07/12/2025 01:14:26.327] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader118] to Actor[pekko://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
01:14:26,327 AM [test-pekko.actor.default-dispatcher-15] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/leader118] to Actor[pekko://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
01:14:26,327 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:26,328 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:26,328 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: started executor
01:14:26,328 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: started executor
01:14:26,336 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:26,337 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:26,337 AM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:26,337 AM [leader-writer-39] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:26,337 AM [leader-writer-39] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:26,338 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/leader/TermInfo.properties does not exist
01:14:26,338 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/leader/journal-v1-1.log
01:14:26,338 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/leader/metadata-v1-1.log
01:14:26,338 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: no eligible files found
01:14:26,338 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:26,341 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:26,341 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=}
01:14:26,341 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:26,341 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
[WARN] [07/12/2025 01:14:26.341] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower117]: org.opendaylight.controller.cluster.common.actor.Monitor@148cf7e3
01:14:26,341 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [follower]
01:14:26,341 AM [test-pekko.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower117] to Actor[pekko://test/user/termination-monitor] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
01:14:26,341 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
[INFO] [pekkoDeadLetter][07/12/2025 01:14:26.341] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[pekko://test/user/follower117] to Actor[pekko://test/user/termination-monitor] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[pekko://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
01:14:26,342 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - follower: Starting recovery with journal batch size 1000
01:14:26,342 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower: started executor
01:14:26,342 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower: started executor
01:14:26,343 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower: metadata journal open: replayFrom=1 applyTo=0
01:14:26,343 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:26,343 AM [test-pekko.actor.default-dispatcher-15] [INFO] EnabledRaftStorage - follower: journal open: applyTo=0
01:14:26,343 AM [follower-writer-40] [DEBUG] JournalWriteTask - follower: journal writer started
01:14:26,343 AM [follower-writer-40] [DEBUG] JournalWriteTask - follower: waiting to receive commands
01:14:26,345 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/follower/TermInfo.properties does not exist
01:14:26,345 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/follower/journal-v1-1.log
01:14:26,345 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/follower/metadata-v1-1.log
01:14:26,345 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower: no eligible files found
01:14:26,345 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:26,348 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=0, votedFor=null
01:14:26,348 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower: Local TermInfo store seeded with TermInfo{term=0}
01:14:26,348 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower: Pekko recovery completed and can restore from snapshot
01:14:26,348 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower: no journal: skipping journal recovery
01:14:26,348 AM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - follower (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term
01:14:26,351 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=1, votedFor=null
01:14:26,351 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower: Last sync leader does not match current leader leader, need to catch up to -1
01:14:26,351 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: -1, nextIndex: 0
01:14:26,351 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/12/2025 01:14:26.351] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower117] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower, initialSyncDone=false]
[INFO] [pekkoDeadLetter][07/12/2025 01:14:26.351] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower117] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower117] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
01:14:26,351 AM [test-pekko.actor.default-dispatcher-7] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower117] was unhandled. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
01:14:26,354 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: onRemoveServer: RemoveServer{serverId='leader'}, state: Idle
01:14:26,356 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=follower, isVoting=true]]
01:14:26,356 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Persist data index=0 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true]]}
01:14:26,356 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true]]}, pending=true} 
01:14:26,357 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=5f0c93c2-923e-443a-a706-a1c767d02a49}, logIndex: 0, isSendImmediate: true
01:14:26,357 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:26,357 AM [leader-%d233295] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/leader/snapshot-000000006871B6F2-1548DD67.tmp
01:14:26,357 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:26,357 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower follower
01:14:26,357 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower follower: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true]]}, pending=true}]}
01:14:26,357 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation RemoveServer{serverId='leader'}
01:14:26,357 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true]]}, pending=true}]}
01:14:26,357 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower (Follower): Number of entries to be appended = 1
01:14:26,357 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
01:14:26,357 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true]]}
01:14:26,357 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true]]}, pending=true} 
01:14:26,357 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - follower: Updated server config: isVoting: true, peers: []
01:14:26,357 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower (Follower): Log size is now 1
01:14:26,357 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:26,358 AM [follower-%d133359] [DEBUG] RaftStorage - follower: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/follower/snapshot-000000006871B6F2-1553EC94.tmp
01:14:26,358 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached -1 (of expected -1)
01:14:26,358 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - follower: awaiting more completions to resolve 1 synchronized callback(s)
01:14:26,358 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: 0, nextIndex: 1
01:14:26,358 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:26,359 AM [leader-%d233295] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/leader/snapshot-000000006871B6F2-1548DD67.v1
01:14:26,360 AM [leader-%d233295] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/leader/TermInfo.properties
01:14:26,360 AM [leader-%d233295] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/leader/journal-v1-1.log
01:14:26,360 AM [leader-%d233295] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/leader/metadata-v1-1.log
01:14:26,360 AM [leader-%d233295] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/leader/snapshot-000000006871B6F2-1548DD67.v1
01:14:26,360 AM [follower-%d133359] [DEBUG] RaftStorage - follower: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/follower/snapshot-000000006871B6F2-1553EC94.v1
01:14:26,360 AM [follower-%d133359] [DEBUG] RaftStorage - follower: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/follower/snapshot-000000006871B6F2-1553EC94.v1
01:14:26,360 AM [follower-%d133359] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/follower/TermInfo.properties
01:14:26,360 AM [follower-%d133359] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/follower/journal-v1-1.log
01:14:26,360 AM [follower-%d133359] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/follower/metadata-v1-1.log
01:14:26,360 AM [follower-%d133359] [DEBUG] RaftStorage - follower: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:26.357821588Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/follower/snapshot-000000006871B6F2-1553EC94.v1, size=75, entryCompress=NONE, stateCompress=NONE}
01:14:26,361 AM [follower-%d133359] [DEBUG] RaftStorageCompleter - follower: 1 completion(s) pending
01:14:26,361 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - follower: running 1 completion(s)
01:14:26,361 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true]]}, pending=false}
01:14:26,361 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - follower: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@59c7a8da}
01:14:26,361 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - follower: synchronized callbacks after 3.118 ms
01:14:26,361 AM [leader-%d233295] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:26.357096807Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest14047728336160224449/leader/snapshot-000000006871B6F2-1548DD67.v1, size=75, entryCompress=NONE, stateCompress=NONE}
01:14:26,361 AM [leader-%d233295] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
[WARN] [07/12/2025 01:14:26.361] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower117] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower, initialSyncDone=true]
01:14:26,361 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:26,361 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true]]}, pending=true}
01:14:26,361 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
01:14:26,361 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - leader (Leader): Setting last applied to 0
01:14:26,361 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - leader: Moving last applied index from -1 to 0
01:14:26,361 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true]]}
[INFO] [pekkoDeadLetter][07/12/2025 01:14:26.361] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower117] Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower117] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
01:14:26,361 AM [test-pekko.actor.default-dispatcher-5] [INFO] TestActorRef -  pekkoDeadLetter Message [org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus] to TestActor[pekko://test/user/follower117] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'pekko.log-dead-letters' and 'pekko.log-dead-letters-during-shutdown'.
01:14:26,361 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorVotingConfigSupport - leader: VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true]]} has been successfully replicated to a majority of followers
[WARN] [07/12/2025 01:14:26.363] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/leader118] unhandled message from TestActor[pekko://test/user/leader118]: ServerRemoved [serverId=leader]
01:14:26,576 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower (Follower): Commit index set to 0
01:14:26,576 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
01:14:26,576 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - follower (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
01:14:26,576 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - follower (Follower): Setting last applied to 0
01:14:26,576 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - follower: Moving last applied index from -1 to 0
01:14:26,576 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true]]}
01:14:26,609 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerLeader ending
01:14:26,609 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower116]
01:14:26,621 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader118]
01:14:26,621 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#487,leader-writer-39]/waiting
01:14:26,621 AM [leader-writer-39] [DEBUG] JournalWriteTask - leader: received 1 commands after 284.5 ms
01:14:26,621 AM [leader-writer-39] [DEBUG] JournalWriteTask - leader: completed 1 commands in 82.64 μs
01:14:26,622 AM [leader-writer-39] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:26,622 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:26,622 AM [test-pekko.actor.default-dispatcher-15] [INFO] EnabledRaftStorage - leader: journal closed
01:14:26,622 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:26,622 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:26,622 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector119]
01:14:26,623 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector120#1654801506]
01:14:26,623 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower117]
01:14:26,623 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EnabledRaftStorage - follower: terminating thread VirtualThread[#488,follower-writer-40]/waiting
01:14:26,624 AM [follower-writer-40] [DEBUG] JournalWriteTask - follower: received 1 commands after 280.2 ms
01:14:26,624 AM [follower-writer-40] [DEBUG] JournalWriteTask - follower: completed 1 commands in 20.80 μs
01:14:26,624 AM [follower-writer-40] [DEBUG] JournalWriteTask - follower: journal writer stopped
01:14:26,624 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - follower: journal closed
01:14:26,624 AM [test-pekko.actor.default-dispatcher-15] [INFO] EnabledRaftStorage - follower: journal closed
01:14:26,624 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks
01:14:26,624 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks
01:14:26,627 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithLeaderChangeDuringInstallSnapshot starting
[WARN] [07/12/2025 01:14:26.628] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server123]: org.opendaylight.controller.cluster.common.actor.Monitor@556973cb
01:14:26,630 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000
01:14:26,630 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: started executor
01:14:26,630 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: started executor
01:14:26,631 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0
01:14:26,631 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:26,631 AM [test-pekko.actor.default-dispatcher-15] [INFO] EnabledRaftStorage - new-server: journal open: applyTo=0
01:14:26,631 AM [new-server-writer-41] [DEBUG] JournalWriteTask - new-server: journal writer started
01:14:26,631 AM [new-server-writer-41] [DEBUG] JournalWriteTask - new-server: waiting to receive commands
01:14:26,632 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/new-server/TermInfo.properties does not exist
01:14:26,633 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/new-server/journal-v1-1.log
01:14:26,633 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/new-server/metadata-v1-1.log
01:14:26,633 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: no eligible files found
01:14:26,633 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:26,637 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null
01:14:26,637 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0}
01:14:26,637 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot
01:14:26,637 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery
01:14:26,638 AM [test-pekko.actor.default-dispatcher-7] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
01:14:26,639 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:26,639 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:26,639 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor
01:14:26,639 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor
[WARN] [07/12/2025 01:14:26.639] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader124]: org.opendaylight.controller.cluster.common.actor.Monitor@75f04d11
01:14:26,639 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:26,640 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:26,640 AM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:26,640 AM [leader-writer-42] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:26,640 AM [leader-writer-42] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:26,640 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/leader/TermInfo.properties does not exist
01:14:26,641 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/leader/journal-v1-1.log
01:14:26,641 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/leader/metadata-v1-1.log
01:14:26,641 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: no eligible files found
01:14:26,641 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:26,644 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:26,644 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=}
01:14:26,644 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:26,644 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:26,645 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: []
01:14:26,651 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server123, votingMember=true], state: Idle
01:14:26,651 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server123, votingMember=true]
01:14:26,651 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
01:14:26,651 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server
01:14:26,651 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader: last applied journal index prior to capture: 0
01:14:26,651 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader: support() called
01:14:26,652 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating capture snapshot for new server new-server
01:14:26,652 AM [leader-%d434427] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:26,652 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:26,652 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=-1, term=-1]
01:14:26,652 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader: support() called
01:14:26,653 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1
01:14:26,653 AM [leader-%d434428] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/leader/snapshot-000000006871B6F2-26EE9EA8.tmp
01:14:26,653 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): sendInstallSnapshot
01:14:26,653 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Snapshot 157 bytes, total chunks to send: 1
01:14:26,653 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Next chunk: total length=157, offset=0, size=157, hashCode=1546036366
01:14:26,653 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): next snapshot chunk size for follower new-server: 157
01:14:26,653 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): InstallSnapshot sent to follower Vector(user, new-server123), Chunk: 1/1
01:14:26,653 AM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - new-server (Follower): Term 1 in "InstallSnapshot{term=1, leaderId=leader, lastIncludedIndex=-1, lastIncludedTerm=-1, datasize=157, chunk=1/1, lastChunkHashCode=OptionalInt[-1]}" message is greater than follower's term 0 - updating term
01:14:26,657 AM [leader-%d434428] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/leader/snapshot-000000006871B6F2-26EE9EA8.v1
01:14:26,657 AM [leader-%d434428] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/leader/snapshot-000000006871B6F2-26EE9EA8.v1
01:14:26,657 AM [leader-%d434428] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/leader/TermInfo.properties
01:14:26,657 AM [leader-%d434428] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/leader/journal-v1-1.log
01:14:26,657 AM [leader-%d434428] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/leader/metadata-v1-1.log
01:14:26,658 AM [leader-%d434428] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:26.653172392Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/leader/snapshot-000000006871B6F2-26EE9EA8.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:26,658 AM [leader-%d434428] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:26,657 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=1, votedFor=null
01:14:26,658 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:26,658 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): handleInstallSnapshot: InstallSnapshot{term=1, leaderId=leader, lastIncludedIndex=-1, lastIncludedTerm=-1, datasize=157, chunk=1/1, lastChunkHashCode=OptionalInt[-1]}
01:14:26,658 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: snapshot is durable as of 2025-07-12T01:14:26.653172392Z
01:14:26,658 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to -1
01:14:26,658 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader: Snapshot success, discarding journal entries up to 0
01:14:26,658 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotTracker - new-server (Follower): addChunk: chunkIndex=1, lastChunkIndex=0, collectedChunks.size=0, lastChunkHashCode=-1
01:14:26,658 AM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - new-server (Follower): Snapshot received from leader: leader
01:14:26,658 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorSnapshotMessageSupport - leader: SnapshotComplete received
01:14:26,658 AM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - new-server: Applying snapshot on follower: PlainSnapshotSource{io=MemoryStreamSource{size=157}}
01:14:26,658 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - new-server: support() called
[WARN] [07/12/2025 01:14:26.658] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/new-server123] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=new-server, initialSyncDone=false]
01:14:26,659 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - new-server: Converted InstallSnapshot from leader: leader to state
01:14:26,659 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - new-server: last applied journal index prior to persisting applied snapshot: 0
01:14:26,659 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - new-server: support() called
01:14:26,659 AM [new-server-%d993513] [DEBUG] RaftStorage - new-server: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/new-server/snapshot-000000006871B6F2-2751F0FA.tmp
01:14:26,661 AM [new-server-%d993513] [DEBUG] RaftStorage - new-server: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/new-server/snapshot-000000006871B6F2-2751F0FA.v1
01:14:26,661 AM [new-server-%d993513] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/new-server/snapshot-000000006871B6F2-2751F0FA.v1
01:14:26,662 AM [new-server-%d993513] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/new-server/TermInfo.properties
01:14:26,662 AM [new-server-%d993513] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/new-server/journal-v1-1.log
01:14:26,662 AM [new-server-%d993513] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/new-server/metadata-v1-1.log
01:14:26,662 AM [new-server-%d993513] [DEBUG] RaftStorage - new-server: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:26.659681530Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest15079274082715562180/new-server/snapshot-000000006871B6F2-2751F0FA.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:26,662 AM [new-server-%d993513] [DEBUG] RaftStorageCompleter - new-server: 1 completion(s) pending
01:14:26,662 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - new-server: running 1 completion(s)
01:14:26,662 AM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - new-server: snapshot is durable as of 2025-07-12T01:14:26.659681530Z
01:14:26,662 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - new-server: support() called
01:14:26,662 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - new-server: applySnapshot called
01:14:26,662 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): handleInstallSnapshot returning: InstallSnapshotReply{term=1, followerId=new-server, chunkIndex=1, success=true}
01:14:26,662 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - new-server: Snapshot success, discarding journal entries up to 0
01:14:26,663 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorSnapshotMessageSupport - new-server: SnapshotComplete received
01:14:26,663 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): handleInstallSnapshotReply: InstallSnapshotReply{term=1, followerId=new-server, chunkIndex=1, success=true}
01:14:26,663 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractLeader - leader (Leader): Snapshot successfully installed on follower new-server (last chunk 1) - matchIndex set to -1, nextIndex set to 0
01:14:26,663 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - Sent message UnInitializedFollowerSnapshotReply to self
01:14:26,702 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: onUnInitializedFollowerSnapshotReply: UnInitializedFollowerSnapshotReply [followerId=new-server]
01:14:26,702 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Dropping UnInitializedFollowerSnapshotReply for server new-server: not leader
01:14:28,265 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: handleInstallSnapshotTimeout for new server new-server
01:14:28,266 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Returning NO_LEADER for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server123, votingMember=true]
01:14:28,266 AM [test-pekko.actor.default-dispatcher-15] [WARN] RaftActorVotingConfigSupport - leader: Timeout occured for new server new-server while installing snapshot
01:14:28,266 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithLeaderChangeDuringInstallSnapshot ending
01:14:28,266 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower121]
01:14:28,278 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector122#-567444689]
01:14:28,278 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server123]
01:14:28,278 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EnabledRaftStorage - new-server: terminating thread VirtualThread[#491,new-server-writer-41]/waiting
01:14:28,279 AM [new-server-writer-41] [DEBUG] JournalWriteTask - new-server: received 1 commands after 1.647 s
01:14:28,279 AM [new-server-writer-41] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 29.55 μs
01:14:28,279 AM [new-server-writer-41] [DEBUG] JournalWriteTask - new-server: journal writer stopped
01:14:28,279 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: journal closed
01:14:28,279 AM [test-pekko.actor.default-dispatcher-15] [INFO] EnabledRaftStorage - new-server: journal closed
01:14:28,279 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:28,279 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:28,280 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader124]
01:14:28,280 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#492,leader-writer-42]/waiting
01:14:28,280 AM [leader-writer-42] [DEBUG] JournalWriteTask - leader: received 1 commands after 1.640 s
01:14:28,280 AM [leader-writer-42] [DEBUG] JournalWriteTask - leader: completed 1 commands in 19.96 μs
01:14:28,280 AM [leader-writer-42] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:28,280 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:28,280 AM [test-pekko.actor.default-dispatcher-15] [INFO] EnabledRaftStorage - leader: journal closed
01:14:28,280 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:28,280 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:28,281 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector125]
01:14:28,284 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeToVotingWithNoLeaderAndOtherLeaderElected starting
[WARN] [07/12/2025 01:14:28.287] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/node1]: org.opendaylight.controller.cluster.common.actor.Monitor@7807a4b6
01:14:28,289 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - node1: Starting recovery with journal batch size 1000
01:14:28,289 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node1: started executor
01:14:28,289 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node1: started executor
01:14:28,290 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - node1: metadata journal open: replayFrom=1 applyTo=0
01:14:28,291 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - node1: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:28,291 AM [test-pekko.actor.default-dispatcher-15] [INFO] EnabledRaftStorage - node1: journal open: applyTo=0
01:14:28,291 AM [node1-writer-43] [DEBUG] JournalWriteTask - node1: journal writer started
01:14:28,291 AM [node1-writer-43] [DEBUG] JournalWriteTask - node1: waiting to receive commands
[WARN] [07/12/2025 01:14:28.292] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/node2]: org.opendaylight.controller.cluster.common.actor.Monitor@72c34602
01:14:28,293 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node1/TermInfo.properties does not exist
01:14:28,293 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - node2: Starting recovery with journal batch size 1000
01:14:28,293 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node1/journal-v1-1.log
01:14:28,293 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - node2: started executor
01:14:28,293 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node1/metadata-v1-1.log
01:14:28,293 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: no eligible files found
01:14:28,293 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=1, votedFor=node1
01:14:28,293 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - node2: started executor
01:14:28,293 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PekkoRecovery - node1: Received ReplicatedLogEntry for recovery: index: 0, size: 133
01:14:28,293 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PeerInfos - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=VOTING]]
01:14:28,293 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - node1: Recovery completed  - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1
01:14:28,293 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - node2: metadata journal open: replayFrom=1 applyTo=0
01:14:28,294 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - node2: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:28,294 AM [test-pekko.actor.default-dispatcher-5] [INFO] EnabledRaftStorage - node2: journal open: applyTo=0
01:14:28,294 AM [node2-writer-44] [DEBUG] JournalWriteTask - node2: journal writer started
01:14:28,294 AM [node2-writer-44] [DEBUG] JournalWriteTask - node2: waiting to receive commands
01:14:28,296 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node2/TermInfo.properties does not exist
01:14:28,296 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=1, votedFor=node1
01:14:28,296 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - node1: Local TermInfo store seeded with TermInfo{term=1, votedFor=node1}
01:14:28,296 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node2/journal-v1-1.log
01:14:28,296 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - node1: taking snapshot to clear Pekko persistence to 2
01:14:28,296 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node2/metadata-v1-1.log
01:14:28,296 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Recovery - node1: no applied entries in recovery log, re-snapshotting EntryInfo[index=-1, term=-1]
01:14:28,296 AM [test-pekko.actor.default-dispatcher-7] [INFO] Recovery - node1: Taking snapshot on entry with index -1
01:14:28,296 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: no eligible files found
01:14:28,296 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=1, votedFor=node1
01:14:28,296 AM [test-pekko.actor.default-dispatcher-7] [INFO] MockRaftActor - node1: support() called
01:14:28,296 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node1/snapshot-000000006871B6F4-11AD2E8F.tmp
01:14:28,296 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - node2: Received ReplicatedLogEntry for recovery: index: 0, size: 133
01:14:28,296 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - node2: Updated server config: isVoting: true, peers: [PeerInfo [id=node1, address=null, votingState=NON_VOTING]]
01:14:28,296 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - node2: Recovery completed  - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1
01:14:28,299 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node1/snapshot-000000006871B6F4-11AD2E8F.v1
01:14:28,299 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node1/snapshot-000000006871B6F4-11AD2E8F.v1
01:14:28,299 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node1/TermInfo.properties
01:14:28,299 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node1/journal-v1-1.log
01:14:28,299 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node1/metadata-v1-1.log
01:14:28,299 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node1: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:28.296562319Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node1/snapshot-000000006871B6F4-11AD2E8F.v1, size=380, entryCompress=NONE, stateCompress=NONE}
01:14:28,299 AM [test-pekko.actor.default-dispatcher-7] [INFO] Recovery - node1: Snapshot completed in 3.493 ms, resetting timer for the next recovery snapshot
01:14:28,300 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - node1: Pekko recovery completed and can restore from snapshot
01:14:28,300 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - node1: starting journal recovery
01:14:28,300 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - node1: Moving last applied index from -1 to -1
01:14:28,300 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - node1: empty journal: appending 1 entries
01:14:28,300 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - node1: updated meta to JournalMeta[replayFrom=1, applyTo=0]
01:14:28,300 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=1, votedFor=node1
01:14:28,300 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - node2: Local TermInfo store seeded with TermInfo{term=1, votedFor=node1}
01:14:28,300 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - node2: taking snapshot to clear Pekko persistence to 2
01:14:28,300 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Recovery - node2: no applied entries in recovery log, re-snapshotting EntryInfo[index=-1, term=-1]
01:14:28,300 AM [test-pekko.actor.default-dispatcher-12] [INFO] Recovery - node2: Taking snapshot on entry with index -1
01:14:28,300 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - node2: support() called
01:14:28,300 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node2/snapshot-000000006871B6F4-11EAF162.tmp
01:14:28,303 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] JournalRecovery - node1: journal recovery completedin 3.739 ms with journalIndex=1
01:14:28,304 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - node1: ignoring DeleteMessagesSuccess(2)
01:14:28,305 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node2/snapshot-000000006871B6F4-11EAF162.v1
01:14:28,305 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node2/TermInfo.properties
01:14:28,305 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node2/journal-v1-1.log
01:14:28,305 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node2/snapshot-000000006871B6F4-11EAF162.v1
01:14:28,305 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node2/metadata-v1-1.log
01:14:28,305 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:28.300609890Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18147039054253545221/node2/snapshot-000000006871B6F4-11EAF162.v1, size=380, entryCompress=NONE, stateCompress=NONE}
01:14:28,305 AM [test-pekko.actor.default-dispatcher-12] [INFO] Recovery - node2: Snapshot completed in 4.850 ms, resetting timer for the next recovery snapshot
01:14:28,305 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - node2: Pekko recovery completed and can restore from snapshot
01:14:28,305 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - node2: starting journal recovery
01:14:28,305 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - node2: Moving last applied index from -1 to -1
01:14:28,305 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - node2: empty journal: appending 1 entries
01:14:28,305 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - node2: updated meta to JournalMeta[replayFrom=1, applyTo=0]
01:14:28,305 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - node1: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[]], state: Idle
01:14:28,308 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - node2: journal recovery completedin 3.323 ms with journalIndex=1
01:14:28,309 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState
01:14:28,309 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - node1: Sending local ElectionTimeout to start leader election
01:14:28,309 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - node2: ignoring DeleteMessagesSuccess(2)
01:14:28,309 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PeerInfos - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=null, votingState=VOTING]]
01:14:28,309 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:28,309 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - node1 (Follower): Received TimeoutNow - switching to Candidate
01:14:28,309 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - node1 (Candidate): Election: Candidate has following voting peers: [node2]
01:14:28,311 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=2, votedFor=node1
01:14:28,311 AM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - node1 (Candidate): Starting new election term 2
01:14:28,312 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - node1 (Candidate): Sending RequestVote{term=2, candidateId=node1, lastLogIndex=0, lastLogTerm=1} to peer node2
01:14:28,312 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - node1 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
01:14:28,356 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - node2 (Follower): Received TimeoutNow - switching to Candidate
01:14:28,356 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - node2 (Candidate): Election: Candidate has following voting peers: []
01:14:28,360 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=2, votedFor=node2
01:14:28,360 AM [test-pekko.actor.default-dispatcher-15] [INFO] Candidate - node2 (Candidate): Starting new election term 2
01:14:28,360 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - node2 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
01:14:28,360 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Candidate - node2 (Candidate): Received ElectionTimeout
01:14:28,360 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - node2 (Leader): Election: Leader has following peers: [node1]
01:14:28,360 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - node2 (Leader): Checking sendAppendEntries for follower node1: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:28,360 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorBehavior - node2 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
01:14:28,360 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - node1 (Candidate): RaftRPC message received AppendEntries{term=2, leaderId=node2, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}, my term is 2
01:14:28,361 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Candidate - node1 (Candidate): handleAppendEntries: AppendEntries{term=2, leaderId=node2, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
01:14:28,361 AM [test-pekko.actor.default-dispatcher-7] [INFO] Candidate - node1 (Candidate): New Leader node2 sent an AppendEntries to Candidate for term 2 - will switch to Follower
01:14:28,361 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - node1 (Candidate) :- Switching from behavior Candidate to Follower, election term: 2
01:14:28,475 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - node1: Last sync leader does not match current leader node2, need to catch up to -1
01:14:28,475 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorVotingConfigSupport - node1: New leader node2 elected
01:14:28,475 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorVotingConfigSupport - node1: Forwarding ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[]] to new leader
01:14:28,475 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=pekko://test/user/node2, votingState=VOTING]]
01:14:28,475 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - node2 (Leader): handleAppendEntriesReply - FollowerLogInformation for node1 updated: matchIndex: 0, nextIndex: 1
01:14:28,475 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - node1: getLeaderAddress leaderId = node2 peerAddress = pekko://test/user/node2
01:14:28,475 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - node2 (Leader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2
01:14:28,475 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorVotingConfigSupport - node1: Not leader - forwarding to leader ActorSelection[Anchor(pekko://test/), Path(/user/node2)]
01:14:28,476 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - node2 (Leader): Checking sendAppendEntries for follower node1: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:28,476 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - node2: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[]], state: Idle
[WARN] [07/12/2025 01:14:28.476] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/node1] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=node1, initialSyncDone=false]
01:14:28,476 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState
01:14:28,476 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - node2: Updated server config: isVoting: true, peers: [PeerInfo [id=node1, address=pekko://test/user/node1, votingState=VOTING]]
01:14:28,476 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - node2: New server configuration : [ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]
01:14:28,476 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - node2: Persist data index=1 term=2 command=VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}
01:14:28,476 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - node2: Append log entry and persist JournaledLogEntry{index=1, term=2, command=VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}, pending=true} 
01:14:28,477 AM [node2-writer-44] [DEBUG] JournalWriteTask - node2: received 1 commands after 182.3 ms
01:14:28,477 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - node2 (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=15cfec37-2d23-466d-ac72-23b87939b04d}, logIndex: 1, isSendImmediate: true
01:14:28,477 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - node2 (Leader): Checking sendAppendEntries for follower node1: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
01:14:28,477 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - node2 (Leader): sendAppendEntries: 1 is present for follower node1
01:14:28,477 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - node2 (Leader): Sending AppendEntries to follower node1: AppendEntries{term=2, leaderId=node2, prevLogIndex=0, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=2, command=VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}, pending=true}]}
01:14:28,478 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - node1 (Follower): handleAppendEntries: AppendEntries{term=2, leaderId=node2, prevLogIndex=0, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=2, command=VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}, pending=true}]}
01:14:28,478 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - node2: Returning OK for operation ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[]]
01:14:28,478 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - node1 (Follower): Number of entries to be appended = 1
01:14:28,478 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - node1 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
01:14:28,478 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - node1 (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}
01:14:28,478 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - node1: Append log entry and persist JournaledLogEntry{index=1, term=2, command=VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}, pending=true} 
01:14:28,478 AM [node2-writer-44] [DEBUG] RaftStorageCompleter - node2: 1 completion(s) pending
01:14:28,478 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PeerInfos - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=pekko://test/user/node2, votingState=VOTING]]
01:14:28,478 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - node1 (Follower): Log size is now 2
01:14:28,478 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - node1 (Follower): handleAppendEntries returning : AppendEntriesReply{term=2, success=true, followerId=node1, logLastIndex=1, logLastTerm=2, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:28,478 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - node1: Lagging 0 entries behind leader node2 and reached -1 (of expected -1)
01:14:28,478 AM [node2-writer-44] [DEBUG] JournalWriteTask - node2: completed 1 commands in 1.421 ms
01:14:28,478 AM [node1-writer-43] [DEBUG] JournalWriteTask - node1: received 1 commands after 187.4 ms
01:14:28,478 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - node1: awaiting more completions to resolve 1 synchronized callback(s)
01:14:28,478 AM [node2-writer-44] [DEBUG] JournalWriteTask - node2: waiting to receive commands
01:14:28,479 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - node2: running 1 completion(s)
01:14:28,479 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - node2: persist complete JournaledLogEntry{index=1, term=2, command=VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}, pending=true}
01:14:28,479 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - node2 (Leader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2
01:14:28,479 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - node2 (Leader): handleAppendEntriesReply - FollowerLogInformation for node1 updated: matchIndex: 1, nextIndex: 2
01:14:28,479 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - node2 (Leader): Not updating commit index to 0 - retrieved log entry with index 0, term 1 does not match the current term 2
01:14:28,479 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - node2 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: -1
01:14:28,479 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - node2 (Leader): Setting last applied to 0
01:14:28,479 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - node2: Moving last applied index from -1 to 0
01:14:28,479 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - node2: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=false], ServerInfo[peerId=node2, isVoting=true]]}
01:14:28,479 AM [node1-writer-43] [DEBUG] RaftStorageCompleter - node1: 1 completion(s) pending
01:14:28,479 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - node2 (Leader): Setting last applied to 1
01:14:28,479 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - node2: Moving last applied index from 0 to 1
01:14:28,479 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - node1: running 1 completion(s)
01:14:28,479 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - node2: Applying state for log index 1 data VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}
01:14:28,479 AM [node1-writer-43] [DEBUG] JournalWriteTask - node1: completed 1 commands in 994.0 μs
01:14:28,479 AM [node1-writer-43] [DEBUG] JournalWriteTask - node1: waiting to receive commands
01:14:28,479 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - node1: persist complete JournaledLogEntry{index=1, term=2, command=VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}, pending=false}
01:14:28,479 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - node1: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=1, term=2, command=VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@312a976d}
01:14:28,479 AM [node2-writer-44] [DEBUG] JournalWriteTask - node2: received 1 commands after 1.145 ms
01:14:28,479 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - node1: synchronized callbacks after 1.199 ms
[WARN] [07/12/2025 01:14:28.480] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/node1] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=node1, initialSyncDone=true]
01:14:28,480 AM [node2-writer-44] [DEBUG] EntryJournalV1 - node2: updated meta to JournalMeta[replayFrom=1, applyTo=2]
01:14:28,480 AM [node2-writer-44] [DEBUG] RaftStorageCompleter - node2: 1 completion(s) pending
01:14:28,480 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - node2: fakeSnapshot purging log to 0 for term 2
01:14:28,480 AM [node2-writer-44] [DEBUG] JournalWriteTask - node2: completed 1 commands in 408.5 μs
01:14:28,480 AM [node2-writer-44] [DEBUG] JournalWriteTask - node2: waiting to receive commands
01:14:28,480 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - node2 (Leader): Checking sendAppendEntries for follower node1: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: 0
01:14:28,480 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - node1 (Follower): Commit index set to 1
01:14:28,480 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - node1: Lagging 0 entries behind leader node2 and reached 1 (of expected -1)
01:14:28,480 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - node1 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): -1, lastIndex(): 1
01:14:28,480 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - node1 (Follower): Setting last applied to 0
01:14:28,480 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - node1: Moving last applied index from -1 to 0
01:14:28,480 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - node1: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=false], ServerInfo[peerId=node2, isVoting=true]]}
01:14:28,480 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - node1 (Follower): Setting last applied to 1
01:14:28,480 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - node1: Moving last applied index from 0 to 1
01:14:28,480 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - node1: Applying state for log index 1 data VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}
01:14:28,480 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SnapshotManager - node1: fakeSnapshot purging log to 0 for term 2
01:14:28,481 AM [node1-writer-43] [DEBUG] JournalWriteTask - node1: received 1 commands after 1.152 ms
01:14:28,481 AM [node1-writer-43] [DEBUG] EntryJournalV1 - node1: updated meta to JournalMeta[replayFrom=1, applyTo=2]
01:14:28,481 AM [node1-writer-43] [DEBUG] RaftStorageCompleter - node1: 1 completion(s) pending
01:14:28,481 AM [node1-writer-43] [DEBUG] JournalWriteTask - node1: completed 1 commands in 234.7 μs
01:14:28,481 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - node1: running 1 completion(s)
01:14:28,481 AM [node1-writer-43] [DEBUG] JournalWriteTask - node1: waiting to receive commands
01:14:28,481 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - node2: running 1 completion(s)
01:14:28,481 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorVotingConfigSupport - node2: VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]} has been successfully replicated to a majority of followers
01:14:28,595 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - node1: Lagging 0 entries behind leader node2 and reached 1 (of expected -1)
01:14:28,681 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeToVotingWithNoLeaderAndOtherLeaderElected ending
01:14:28,681 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower126]
01:14:28,693 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector127#99544058]
01:14:28,693 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/node1]
01:14:28,693 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EnabledRaftStorage - node1: terminating thread VirtualThread[#496,node1-writer-43]/waiting
01:14:28,693 AM [node1-writer-43] [DEBUG] JournalWriteTask - node1: received 1 commands after 212.6 ms
01:14:28,694 AM [node1-writer-43] [DEBUG] JournalWriteTask - node1: completed 1 commands in 39.03 μs
01:14:28,694 AM [node1-writer-43] [DEBUG] JournalWriteTask - node1: journal writer stopped
01:14:28,694 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - node1: journal closed
01:14:28,694 AM [test-pekko.actor.default-dispatcher-15] [INFO] EnabledRaftStorage - node1: journal closed
01:14:28,694 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node1: stopped executor with 0 remaining tasks
01:14:28,694 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node1: stopped executor with 0 remaining tasks
01:14:28,695 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector128#1226599636]
01:14:28,695 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/node2]
01:14:28,695 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EnabledRaftStorage - node2: terminating thread VirtualThread[#497,node2-writer-44]/waiting
01:14:28,695 AM [node2-writer-44] [DEBUG] JournalWriteTask - node2: received 1 commands after 215.2 ms
01:14:28,695 AM [node2-writer-44] [DEBUG] JournalWriteTask - node2: completed 1 commands in 18.77 μs
01:14:28,695 AM [node2-writer-44] [DEBUG] JournalWriteTask - node2: journal writer stopped
01:14:28,696 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - node2: journal closed
01:14:28,696 AM [test-pekko.actor.default-dispatcher-15] [INFO] EnabledRaftStorage - node2: journal closed
01:14:28,696 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: stopped executor with 0 remaining tasks
01:14:28,696 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - node2: stopped executor with 0 remaining tasks
01:14:28,699 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithInstallSnapshotTimeout starting
[WARN] [07/12/2025 01:14:28.701] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server131]: org.opendaylight.controller.cluster.common.actor.Monitor@2fac9ae5
01:14:28,702 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000
01:14:28,702 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: started executor
01:14:28,703 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - new-server: started executor
01:14:28,703 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0
01:14:28,704 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:28,704 AM [test-pekko.actor.default-dispatcher-15] [INFO] EnabledRaftStorage - new-server: journal open: applyTo=0
01:14:28,704 AM [new-server-writer-45] [DEBUG] JournalWriteTask - new-server: journal writer started
01:14:28,704 AM [new-server-writer-45] [DEBUG] JournalWriteTask - new-server: waiting to receive commands
01:14:28,705 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8673542378119173367/new-server/TermInfo.properties does not exist
01:14:28,706 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8673542378119173367/new-server/journal-v1-1.log
01:14:28,706 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8673542378119173367/new-server/metadata-v1-1.log
01:14:28,706 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: no eligible files found
01:14:28,706 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:28,709 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null
01:14:28,709 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0}
01:14:28,709 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot
01:14:28,709 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery
01:14:28,710 AM [test-pekko.actor.default-dispatcher-7] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
[WARN] [07/12/2025 01:14:28.710] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader132]: org.opendaylight.controller.cluster.common.actor.Monitor@2fdd3fff
01:14:28,711 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:28,711 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:28,711 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor
01:14:28,711 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: started executor
01:14:28,712 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:28,713 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:28,713 AM [test-pekko.actor.default-dispatcher-15] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:28,713 AM [leader-writer-46] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:28,713 AM [leader-writer-46] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:28,714 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8673542378119173367/leader/TermInfo.properties does not exist
01:14:28,715 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8673542378119173367/leader/journal-v1-1.log
01:14:28,715 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8673542378119173367/leader/metadata-v1-1.log
01:14:28,715 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - leader: no eligible files found
01:14:28,715 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:28,719 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:28,719 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=}
01:14:28,719 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:28,719 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:28,719 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: []
01:14:28,720 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server131, votingMember=true], state: Idle
01:14:28,720 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server131, votingMember=true]
01:14:28,720 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
01:14:28,720 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server
01:14:28,720 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader: last applied journal index prior to capture: 0
01:14:28,720 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader: support() called
01:14:28,721 AM [leader-%d198980] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:28,721 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating capture snapshot for new server new-server
01:14:28,721 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:28,721 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=-1, term=-1]
01:14:28,721 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader: support() called
01:14:28,722 AM [leader-%d198981] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8673542378119173367/leader/snapshot-000000006871B6F4-2B07BEF9.tmp
01:14:28,722 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1
01:14:28,722 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): sendInstallSnapshot
01:14:28,722 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Snapshot 157 bytes, total chunks to send: 1
01:14:28,722 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Next chunk: total length=157, offset=0, size=157, hashCode=1546036366
01:14:28,722 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): next snapshot chunk size for follower new-server: 157
01:14:28,722 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): InstallSnapshot sent to follower Vector(user, new-server131), Chunk: 1/1
01:14:28,722 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: onUnInitializedFollowerSnapshotReply: UnInitializedFollowerSnapshotReply [followerId=bogus]
01:14:28,722 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Dropping UnInitializedFollowerSnapshotReply for server bogus: server Id doesn't match
01:14:28,724 AM [leader-%d198981] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8673542378119173367/leader/snapshot-000000006871B6F4-2B07BEF9.v1
01:14:28,724 AM [leader-%d198981] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8673542378119173367/leader/snapshot-000000006871B6F4-2B07BEF9.v1
01:14:28,725 AM [leader-%d198981] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8673542378119173367/leader/TermInfo.properties
01:14:28,725 AM [leader-%d198981] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8673542378119173367/leader/journal-v1-1.log
01:14:28,725 AM [leader-%d198981] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8673542378119173367/leader/metadata-v1-1.log
01:14:28,725 AM [leader-%d198981] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:28.721927929Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8673542378119173367/leader/snapshot-000000006871B6F4-2B07BEF9.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:28,725 AM [leader-%d198981] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:28,725 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:28,725 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: snapshot is durable as of 2025-07-12T01:14:28.721927929Z
01:14:28,725 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader: Snapshot success, discarding journal entries up to 0
01:14:28,725 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorSnapshotMessageSupport - leader: SnapshotComplete received
01:14:28,836 AM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - new-server (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term
01:14:28,838 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=1, votedFor=null
01:14:28,839 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to -1
01:14:28,839 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: -1, nextIndex: 0
[WARN] [07/12/2025 01:14:28.839] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/new-server131] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=new-server, initialSyncDone=false]
01:14:28,934 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: handleInstallSnapshotTimeout for new server new-server
01:14:28,935 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: Returning TIMEOUT for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server131, votingMember=true]
01:14:28,935 AM [test-pekko.actor.default-dispatcher-7] [WARN] RaftActorVotingConfigSupport - leader: Timeout occured for new server new-server while installing snapshot
01:14:28,935 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithInstallSnapshotTimeout ending
01:14:28,935 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower129]
01:14:28,936 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector130#1546901929]
01:14:28,937 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server131]
01:14:28,937 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EnabledRaftStorage - new-server: terminating thread VirtualThread[#500,new-server-writer-45]/waiting
01:14:28,937 AM [new-server-writer-45] [DEBUG] JournalWriteTask - new-server: received 1 commands after 233.3 ms
01:14:28,937 AM [new-server-writer-45] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 30.31 μs
01:14:28,937 AM [new-server-writer-45] [DEBUG] JournalWriteTask - new-server: journal writer stopped
01:14:28,938 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - new-server: journal closed
01:14:28,938 AM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - new-server: journal closed
01:14:28,938 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:28,938 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:28,938 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader132]
01:14:28,938 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#501,leader-writer-46]/waiting
01:14:28,938 AM [leader-writer-46] [DEBUG] JournalWriteTask - leader: received 1 commands after 225.6 ms
01:14:28,939 AM [leader-writer-46] [DEBUG] JournalWriteTask - leader: completed 1 commands in 19.95 μs
01:14:28,939 AM [leader-writer-46] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:28,939 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:28,939 AM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - leader: journal closed
01:14:28,939 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:28,939 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:28,942 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithNoExistingFollower starting
[WARN] [07/12/2025 01:14:28.944] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server135]: org.opendaylight.controller.cluster.common.actor.Monitor@2051917
01:14:28,945 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000
01:14:28,945 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: started executor
01:14:28,946 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - new-server: started executor
01:14:28,946 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0
01:14:28,947 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:28,947 AM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - new-server: journal open: applyTo=0
01:14:28,947 AM [new-server-writer-47] [DEBUG] JournalWriteTask - new-server: journal writer started
01:14:28,947 AM [new-server-writer-47] [DEBUG] JournalWriteTask - new-server: waiting to receive commands
01:14:28,948 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/TermInfo.properties does not exist
01:14:28,948 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/journal-v1-1.log
01:14:28,948 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/metadata-v1-1.log
01:14:28,948 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - new-server: no eligible files found
01:14:28,948 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:28,951 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null
01:14:28,951 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0}
01:14:28,951 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot
01:14:28,951 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery
01:14:28,951 AM [test-pekko.actor.default-dispatcher-5] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
01:14:28,951 AM [main] [DEBUG] AbstractReplicatedLog - : Moving last applied index from -1 to 1
[WARN] [07/12/2025 01:14:28.952] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader136]: org.opendaylight.controller.cluster.common.actor.Monitor@79f739e0
01:14:28,952 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:28,953 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:28,953 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor
01:14:28,953 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor
01:14:28,953 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:28,953 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:28,953 AM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:28,953 AM [leader-writer-48] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:28,953 AM [leader-writer-48] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:28,955 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/TermInfo.properties does not exist
01:14:28,955 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/journal-v1-1.log
01:14:28,955 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/metadata-v1-1.log
01:14:28,955 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader: no eligible files found
01:14:28,955 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:28,957 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:28,957 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=}
01:14:28,957 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:28,957 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:28,958 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: []
01:14:28,965 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server135, votingMember=true], state: Idle
01:14:28,965 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server135, votingMember=true]
01:14:28,965 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=1, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server
01:14:28,966 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader: last applied journal index prior to capture: 2
01:14:28,966 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader: support() called
01:14:28,966 AM [leader-%d810684] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:28,967 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating capture snapshot for new server new-server
01:14:28,967 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:28,967 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=1, term=1]/EntryInfo[index=1, term=1]
01:14:28,967 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - leader: support() called
01:14:28,967 AM [leader-%d810685] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/snapshot-000000006871B6F4-39ABE76B.tmp
01:14:28,968 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1
01:14:28,968 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): sendInstallSnapshot
01:14:28,968 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Snapshot 157 bytes, total chunks to send: 1
01:14:28,968 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Next chunk: total length=157, offset=0, size=157, hashCode=1546036366
01:14:28,968 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): next snapshot chunk size for follower new-server: 157
01:14:28,968 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): InstallSnapshot sent to follower Vector(user, new-server135), Chunk: 1/1
01:14:28,968 AM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - new-server (Follower): Term 1 in "InstallSnapshot{term=1, leaderId=leader, lastIncludedIndex=1, lastIncludedTerm=1, datasize=157, chunk=1/1, lastChunkHashCode=OptionalInt[-1]}" message is greater than follower's term 0 - updating term
01:14:28,970 AM [leader-%d810685] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/snapshot-000000006871B6F4-39ABE76B.v1
01:14:28,971 AM [leader-%d810685] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/snapshot-000000006871B6F4-39ABE76B.v1
01:14:28,971 AM [leader-%d810685] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/TermInfo.properties
01:14:28,971 AM [leader-%d810685] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/journal-v1-1.log
01:14:28,971 AM [leader-%d810685] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/metadata-v1-1.log
01:14:28,971 AM [leader-%d810685] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:28.967567211Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/snapshot-000000006871B6F4-39ABE76B.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:28,971 AM [leader-%d810685] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:28,971 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:28,971 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - leader: snapshot is durable as of 2025-07-12T01:14:28.967567211Z
01:14:28,971 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - leader: Snapshot success, discarding journal entries up to 2
01:14:28,971 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorSnapshotMessageSupport - leader: SnapshotComplete received
01:14:28,971 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=1, votedFor=null
01:14:28,971 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Follower - new-server (Follower): handleInstallSnapshot: InstallSnapshot{term=1, leaderId=leader, lastIncludedIndex=1, lastIncludedTerm=1, datasize=157, chunk=1/1, lastChunkHashCode=OptionalInt[-1]}
01:14:28,971 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to 1
01:14:28,971 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotTracker - new-server (Follower): addChunk: chunkIndex=1, lastChunkIndex=0, collectedChunks.size=0, lastChunkHashCode=-1
01:14:28,971 AM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - new-server (Follower): Snapshot received from leader: leader
01:14:28,972 AM [test-pekko.actor.default-dispatcher-7] [INFO] SnapshotManager - new-server: Applying snapshot on follower: PlainSnapshotSource{io=MemoryStreamSource{size=157}}
01:14:28,972 AM [test-pekko.actor.default-dispatcher-7] [INFO] MockRaftActor - new-server: support() called
[WARN] [07/12/2025 01:14:28.972] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/new-server135] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=new-server, initialSyncDone=false]
01:14:28,972 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - new-server: Converted InstallSnapshot from leader: leader to state
01:14:28,973 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - new-server: last applied journal index prior to persisting applied snapshot: 0
01:14:28,973 AM [test-pekko.actor.default-dispatcher-7] [INFO] MockRaftActor - new-server: support() called
01:14:28,973 AM [new-server-%d154624] [DEBUG] RaftStorage - new-server: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/snapshot-000000006871B6F4-3A03A190.tmp
01:14:28,975 AM [new-server-%d154624] [DEBUG] RaftStorage - new-server: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/snapshot-000000006871B6F4-3A03A190.v1
01:14:28,975 AM [new-server-%d154624] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/TermInfo.properties
01:14:28,975 AM [new-server-%d154624] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/snapshot-000000006871B6F4-3A03A190.v1
01:14:28,975 AM [new-server-%d154624] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/journal-v1-1.log
01:14:28,975 AM [new-server-%d154624] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/metadata-v1-1.log
01:14:28,975 AM [new-server-%d154624] [DEBUG] RaftStorage - new-server: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:28.973316496Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/snapshot-000000006871B6F4-3A03A190.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:28,975 AM [new-server-%d154624] [DEBUG] RaftStorageCompleter - new-server: 1 completion(s) pending
01:14:28,976 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - new-server: running 1 completion(s)
01:14:28,976 AM [test-pekko.actor.default-dispatcher-15] [INFO] SnapshotManager - new-server: snapshot is durable as of 2025-07-12T01:14:28.973316496Z
01:14:28,976 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - new-server: support() called
01:14:28,976 AM [test-pekko.actor.default-dispatcher-15] [INFO] MockRaftActor - new-server: applySnapshot called
01:14:28,976 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - new-server (Follower): handleInstallSnapshot returning: InstallSnapshotReply{term=1, followerId=new-server, chunkIndex=1, success=true}
01:14:28,976 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SnapshotManager - new-server: Snapshot success, discarding journal entries up to 0
01:14:28,976 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorSnapshotMessageSupport - new-server: SnapshotComplete received
01:14:28,976 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): handleInstallSnapshotReply: InstallSnapshotReply{term=1, followerId=new-server, chunkIndex=1, success=true}
01:14:28,976 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractLeader - leader (Leader): Snapshot successfully installed on follower new-server (last chunk 1) - matchIndex set to 1, nextIndex set to 2
01:14:28,976 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - Sent message UnInitializedFollowerSnapshotReply to self
01:14:28,976 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - leader: fakeSnapshot purging log to 0 for term 1
01:14:28,976 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: onUnInitializedFollowerSnapshotReply: UnInitializedFollowerSnapshotReply [followerId=new-server]
01:14:28,976 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]
01:14:28,976 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Persist data index=2 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:28,976 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=2, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:28,977 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=88e08b0e-c2d5-456a-9786-155991f3a3ad}, logIndex: 2, isSendImmediate: true
01:14:28,977 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:28,977 AM [leader-%d810686] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/snapshot-000000006871B6F4-3A3D3FA9.tmp
01:14:28,977 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: 0
01:14:28,977 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 2 is present for follower new-server
01:14:28,977 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries{term=1, leaderId=leader, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:28,977 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server135, votingMember=true]
01:14:28,977 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - new-server (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:28,977 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - new-server (Follower): Number of entries to be appended = 1
01:14:28,977 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - new-server (Follower): After cleanup, lastIndex: 1, entries to be added from: 0
01:14:28,977 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - new-server (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:28,977 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - new-server: Append log entry and persist JournaledLogEntry{index=2, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:28,977 AM [new-server-%d154625] [DEBUG] RaftStorage - new-server: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/snapshot-000000006871B6F4-3A46E9EB.tmp
01:14:28,977 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - new-server: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=null, votingState=VOTING]]
01:14:28,977 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - new-server (Follower): Log size is now 1
01:14:28,977 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - new-server (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=new-server, logLastIndex=2, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:28,977 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 1 (of expected 1)
01:14:28,977 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - new-server: awaiting more completions to resolve 1 synchronized callback(s)
01:14:28,977 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: 2, nextIndex: 3
01:14:28,978 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: 0
01:14:28,979 AM [leader-%d810686] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/snapshot-000000006871B6F4-3A3D3FA9.v1
01:14:28,979 AM [leader-%d810686] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/snapshot-000000006871B6F4-3A3D3FA9.v1
01:14:28,979 AM [leader-%d810686] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/snapshot-000000006871B6F4-39ABE76B.v1
01:14:28,980 AM [leader-%d810686] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/TermInfo.properties
01:14:28,980 AM [leader-%d810686] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/journal-v1-1.log
01:14:28,980 AM [leader-%d810686] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/metadata-v1-1.log
01:14:28,980 AM [leader-%d810686] [DEBUG] RaftStorage - leader: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:28.967567211Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/snapshot-000000006871B6F4-39ABE76B.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:28,980 AM [leader-%d810686] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:28.977092521Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/leader/snapshot-000000006871B6F4-3A3D3FA9.v1, size=86, entryCompress=NONE, stateCompress=NONE}
01:14:28,980 AM [leader-%d810686] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:28,980 AM [new-server-%d154625] [DEBUG] RaftStorage - new-server: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/snapshot-000000006871B6F4-3A46E9EB.v1
01:14:28,980 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:28,980 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=2, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}
01:14:28,980 AM [new-server-%d154625] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/snapshot-000000006871B6F4-3A46E9EB.v1
01:14:28,980 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1
01:14:28,980 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - leader (Leader): Setting last applied to 2
01:14:28,980 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - leader: Moving last applied index from 1 to 2
01:14:28,980 AM [new-server-%d154625] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/TermInfo.properties
01:14:28,980 AM [new-server-%d154625] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/snapshot-000000006871B6F4-3A03A190.v1
01:14:28,980 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Applying state for log index 2 data VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:28,980 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SnapshotManager - leader: fakeSnapshot purging log to 1 for term 1
01:14:28,980 AM [new-server-%d154625] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/journal-v1-1.log
01:14:28,980 AM [new-server-%d154625] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/metadata-v1-1.log
01:14:28,980 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorVotingConfigSupport - leader: VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]} has been successfully replicated to a majority of followers
01:14:28,980 AM [new-server-%d154625] [DEBUG] RaftStorage - new-server: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:28.973316496Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/snapshot-000000006871B6F4-3A03A190.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:28,980 AM [new-server-%d154625] [DEBUG] RaftStorage - new-server: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:28.977725931Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest10799660722198125201/new-server/snapshot-000000006871B6F4-3A46E9EB.v1, size=86, entryCompress=NONE, stateCompress=NONE}
01:14:28,980 AM [new-server-%d154625] [DEBUG] RaftStorageCompleter - new-server: 1 completion(s) pending
01:14:28,980 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - new-server: running 1 completion(s)
01:14:28,980 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - new-server: persist complete JournaledLogEntry{index=2, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}
01:14:28,980 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - new-server: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=2, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@3609bd05}
01:14:28,980 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - new-server: synchronized callbacks after 2.865 ms
[WARN] [07/12/2025 01:14:28.981] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/new-server135] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=new-server, initialSyncDone=true]
01:14:29,86 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): Commit index set to 2
01:14:29,86 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 2 (of expected 1)
01:14:29,86 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): 1, lastIndex(): 2
01:14:29,86 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - new-server (Follower): Setting last applied to 2
01:14:29,86 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - new-server: Moving last applied index from 1 to 2
01:14:29,86 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - new-server: Applying state for log index 2 data VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:29,117 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithNoExistingFollower ending
01:14:29,117 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower133]
01:14:29,128 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector134#53542146]
01:14:29,128 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server135]
01:14:29,129 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EnabledRaftStorage - new-server: terminating thread VirtualThread[#504,new-server-writer-47]/waiting
01:14:29,129 AM [new-server-writer-47] [DEBUG] JournalWriteTask - new-server: received 1 commands after 181.8 ms
01:14:29,129 AM [new-server-writer-47] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 34.51 μs
01:14:29,129 AM [new-server-writer-47] [DEBUG] JournalWriteTask - new-server: journal writer stopped
01:14:29,129 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - new-server: journal closed
01:14:29,129 AM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - new-server: journal closed
01:14:29,129 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:29,130 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:29,130 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader136]
01:14:29,130 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#505,leader-writer-48]/waiting
01:14:29,130 AM [leader-writer-48] [DEBUG] JournalWriteTask - leader: received 1 commands after 176.8 ms
01:14:29,130 AM [leader-writer-48] [DEBUG] JournalWriteTask - leader: completed 1 commands in 19.05 μs
01:14:29,130 AM [leader-writer-48] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:29,131 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:29,131 AM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - leader: journal closed
01:14:29,131 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:29,131 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:29,131 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector137]
01:14:29,135 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeToVotingWithNoLeaderAndForwardedToOtherNodeAfterElectionTimeout starting
[WARN] [07/12/2025 01:14:29.138] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/node1]: org.opendaylight.controller.cluster.common.actor.Monitor@15ec908a
01:14:29,139 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - node1: Starting recovery with journal batch size 1000
01:14:29,139 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node1: started executor
01:14:29,139 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node1: started executor
01:14:29,140 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - node1: metadata journal open: replayFrom=1 applyTo=0
01:14:29,140 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - node1: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:29,140 AM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - node1: journal open: applyTo=0
01:14:29,140 AM [node1-writer-49] [DEBUG] JournalWriteTask - node1: journal writer started
01:14:29,140 AM [node1-writer-49] [DEBUG] JournalWriteTask - node1: waiting to receive commands
01:14:29,142 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/TermInfo.properties does not exist
01:14:29,142 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/journal-v1-1.log
01:14:29,142 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/metadata-v1-1.log
01:14:29,142 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - node1: no eligible files found
01:14:29,142 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=1, votedFor=node1
01:14:29,143 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PekkoRecovery - node1: Received ReplicatedLogEntry for recovery: index: 0, size: 133
01:14:29,143 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=NON_VOTING]]
[WARN] [07/12/2025 01:14:29.143] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/node2]: org.opendaylight.controller.cluster.common.actor.Monitor@65ee92d3
01:14:29,143 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - node1: Recovery completed  - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1
01:14:29,143 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - node2: Starting recovery with journal batch size 1000
01:14:29,143 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node2: started executor
01:14:29,143 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - node2: started executor
01:14:29,144 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - node2: metadata journal open: replayFrom=1 applyTo=0
01:14:29,145 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - node2: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:29,145 AM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - node2: journal open: applyTo=0
01:14:29,145 AM [node2-writer-50] [DEBUG] JournalWriteTask - node2: journal writer started
01:14:29,145 AM [node2-writer-50] [DEBUG] JournalWriteTask - node2: waiting to receive commands
01:14:29,145 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=1, votedFor=node1
01:14:29,145 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - node1: Local TermInfo store seeded with TermInfo{term=1, votedFor=node1}
01:14:29,145 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - node1: taking snapshot to clear Pekko persistence to 2
01:14:29,145 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Recovery - node1: no applied entries in recovery log, re-snapshotting EntryInfo[index=-1, term=-1]
01:14:29,145 AM [test-pekko.actor.default-dispatcher-5] [INFO] Recovery - node1: Taking snapshot on entry with index -1
01:14:29,145 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - node1: support() called
01:14:29,145 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - node1: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/snapshot-000000006871B6F5-08B1D072.tmp
01:14:29,147 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/TermInfo.properties does not exist
01:14:29,147 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/journal-v1-1.log
01:14:29,147 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/metadata-v1-1.log
01:14:29,147 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: no eligible files found
01:14:29,147 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=1, votedFor=node1
01:14:29,147 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - node2: Received ReplicatedLogEntry for recovery: index: 0, size: 133
01:14:29,147 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - node2: Updated server config: isVoting: false, peers: [PeerInfo [id=node1, address=null, votingState=NON_VOTING]]
01:14:29,147 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - node2: Received ReplicatedLogEntry for recovery: index: 1, size: 1
01:14:29,147 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - node2: Received apply journal entries for recovery, applying to state: 0 to 1
01:14:29,147 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - node2: Moving last applied index from -1 to 1
01:14:29,148 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - node1: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/snapshot-000000006871B6F5-08B1D072.v1
01:14:29,148 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - node1: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/snapshot-000000006871B6F5-08B1D072.v1
01:14:29,148 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/TermInfo.properties
01:14:29,148 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/journal-v1-1.log
01:14:29,148 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/metadata-v1-1.log
01:14:29,148 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - node1: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:29.145870962Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/snapshot-000000006871B6F5-08B1D072.v1, size=380, entryCompress=NONE, stateCompress=NONE}
01:14:29,148 AM [test-pekko.actor.default-dispatcher-5] [INFO] Recovery - node1: Snapshot completed in 2.674 ms, resetting timer for the next recovery snapshot
01:14:29,148 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - node1: Pekko recovery completed and can restore from snapshot
01:14:29,148 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - node1: starting journal recovery
01:14:29,148 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - node1: Moving last applied index from -1 to -1
01:14:29,148 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - node1: empty journal: appending 1 entries
01:14:29,148 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - node2: Recovery completed in 40.62 μs - Switching actor to Follower - last log index = 1, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 2
01:14:29,148 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - node1: updated meta to JournalMeta[replayFrom=1, applyTo=0]
01:14:29,152 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=1, votedFor=node1
01:14:29,152 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - node2: Local TermInfo store seeded with TermInfo{term=1, votedFor=node1}
01:14:29,152 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - node2: taking snapshot to clear Pekko persistence to 4
01:14:29,152 AM [test-pekko.actor.default-dispatcher-12] [INFO] Recovery - node2: Taking snapshot on entry with index 1
01:14:29,152 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - node2: support() called
01:14:29,152 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/snapshot-000000006871B6F5-09139357.tmp
01:14:29,152 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] JournalRecovery - node1: journal recovery completedin 4.285 ms with journalIndex=1
01:14:29,153 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorVotingConfigSupport - node1: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[]], state: Idle
01:14:29,153 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState
01:14:29,153 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorVotingConfigSupport - node1: Sending local ElectionTimeout to start leader election
01:14:29,153 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=null, votingState=VOTING]]
01:14:29,153 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - node1: ignoring DeleteMessagesSuccess(2)
01:14:29,153 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/snapshot-000000006871B6F5-09139357.v1
01:14:29,154 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:29,154 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - node1 (Follower): Received TimeoutNow - switching to Candidate
01:14:29,154 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/snapshot-000000006871B6F5-09139357.v1
01:14:29,154 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - node1 (Candidate): Election: Candidate has following voting peers: [node2]
01:14:29,154 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/TermInfo.properties
01:14:29,154 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/journal-v1-1.log
01:14:29,154 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/metadata-v1-1.log
01:14:29,154 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=1, term=1], timestamp=2025-07-12T01:14:29.152277847Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/snapshot-000000006871B6F5-09139357.v1, size=237, entryCompress=NONE, stateCompress=NONE}
01:14:29,154 AM [test-pekko.actor.default-dispatcher-12] [INFO] Recovery - node2: Snapshot completed in 2.253 ms, resetting timer for the next recovery snapshot
01:14:29,154 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - node2: Pekko recovery completed and can restore from snapshot
01:14:29,154 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - node2: starting journal recovery
01:14:29,154 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - node2: Moving last applied index from -1 to 1
01:14:29,154 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - node2: empty journal: appending 0 entries
01:14:29,155 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - node2: updated meta to JournalMeta[replayFrom=1, applyTo=0]
01:14:29,155 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - node2: journal recovery completedin 652.6 μs with journalIndex=1
01:14:29,155 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - node2: ignoring DeleteMessagesSuccess(4)
01:14:29,155 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=2, votedFor=node1
01:14:29,155 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - node1 (Candidate): Starting new election term 2
01:14:29,156 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - node1 (Candidate): Sending RequestVote{term=2, candidateId=node1, lastLogIndex=0, lastLogTerm=1} to peer node2
01:14:29,156 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - node1 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
01:14:29,156 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - node2 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:29,156 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - node2 (Follower): Cluster state: []
01:14:29,156 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - node2 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=node1, lastLogIndex=0, lastLogTerm=1} with higher term appears reachable, updating term.
01:14:29,156 AM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - node2 (Follower): Term 2 in "RequestVote{term=2, candidateId=node1, lastLogIndex=0, lastLogTerm=1}" message is greater than follower's term 1 - updating term
01:14:29,158 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=2, votedFor=null
01:14:29,158 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - node2 (Follower): In requestVote: RequestVote{term=2, candidateId=node1, lastLogIndex=0, lastLogTerm=1} - currentTerm: 2, votedFor: null, lastIndex: 1, lastTerm: 1
01:14:29,158 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - node2 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=false}
01:14:29,158 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - node1 (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=false}, my term is 2
01:14:29,158 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - node1 (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=false}, current voteCount: 1
01:14:29,465 AM [test-pekko.actor.default-dispatcher-5] [WARN] RaftActorVotingConfigSupport - node1: Leader election timed out - cannot apply operation ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[]]
01:14:29,465 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=pekko://test/user/node2, votingState=NON_VOTING]]
01:14:29,465 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorVotingConfigSupport - node1: tryToForwardOperationToAnotherServer - servers already visited []
01:14:29,465 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorVotingConfigSupport - node1: Found server ActorSelection[Anchor(pekko://test/), Path(/user/node2)] to forward to
01:14:29,466 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorVotingConfigSupport - node2: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[node1]], state: Idle
01:14:29,466 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState
01:14:29,466 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorVotingConfigSupport - node2: Sending local ElectionTimeout to start leader election
01:14:29,466 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - node2: Updated server config: isVoting: true, peers: [PeerInfo [id=node1, address=null, votingState=VOTING]]
01:14:29,466 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - node2 (Follower): Received TimeoutNow - switching to Candidate
01:14:29,467 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - node2 (Candidate): Election: Candidate has following voting peers: [node1]
01:14:29,470 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=3, votedFor=node2
01:14:29,470 AM [test-pekko.actor.default-dispatcher-5] [INFO] Candidate - node2 (Candidate): Starting new election term 3
01:14:29,470 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Candidate - node2 (Candidate): Sending RequestVote{term=3, candidateId=node2, lastLogIndex=1, lastLogTerm=1} to peer node1
01:14:29,470 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActorBehavior - node2 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
01:14:29,470 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - node1 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:29,470 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - node1 (Follower): Cluster state: []
01:14:29,470 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - node1 (Follower): Candidate in requestVote:RequestVote{term=3, candidateId=node2, lastLogIndex=1, lastLogTerm=1} with higher term appears reachable, updating term.
01:14:29,470 AM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - node1 (Follower): Term 3 in "RequestVote{term=3, candidateId=node2, lastLogIndex=1, lastLogTerm=1}" message is greater than follower's term 2 - updating term
01:14:29,475 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=3, votedFor=null
01:14:29,475 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - node1 (Follower): In requestVote: RequestVote{term=3, candidateId=node2, lastLogIndex=1, lastLogTerm=1} - currentTerm: 3, votedFor: null, lastIndex: 0, lastTerm: 1
01:14:29,477 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=3, votedFor=node2
01:14:29,477 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - node1 (Follower): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
01:14:29,477 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - node2 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3
01:14:29,477 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Candidate - node2 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1
01:14:29,477 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - node2 (Leader): Election: Leader has following peers: [node1]
01:14:29,477 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - node2 (Leader): Checking sendAppendEntries for follower node1: active: false, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: 1
01:14:29,477 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActorBehavior - node2 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
01:14:29,477 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - node2: New leader node2 elected
01:14:29,477 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - node2: New server configuration : [ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]
01:14:29,477 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - node2: Persist data index=2 term=3 command=VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}
01:14:29,477 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - node1: Last sync leader does not match current leader node2, need to catch up to -1
01:14:29,477 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - node2: Append log entry and persist JournaledLogEntry{index=2, term=3, command=VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}, pending=true} 
01:14:29,477 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - node2 (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=613bf2e0-c81e-4976-9034-12578838b984}, logIndex: 2, isSendImmediate: true
01:14:29,477 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - node2 (Leader): Checking sendAppendEntries for follower node1: active: false, followerNextIndex: 1, leaderLastIndex: 2, leaderSnapShotIndex: 1
[WARN] [07/12/2025 01:14:29.477] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/node1] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=node1, initialSyncDone=false]
01:14:29,477 AM [node2-writer-50] [DEBUG] JournalWriteTask - node2: received 1 commands after 332.7 ms
01:14:29,477 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - node2: Returning OK for operation ChangeServersVotingStatus [serverVotingStatusMap={node1=true, node2=true}, serversVisited=[node1]]
01:14:29,477 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - node1: Lagging 0 entries behind leader node2 and reached -1 (of expected -1)
[WARN] [07/12/2025 01:14:29.478] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/node1] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=node1, initialSyncDone=true]
01:14:29,478 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - node2 (Leader): handleAppendEntriesReply - FollowerLogInformation for node1 updated: matchIndex: 0, nextIndex: 1
01:14:29,478 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - node2 (Leader): Checking sendAppendEntries for follower node1: active: true, followerNextIndex: 1, leaderLastIndex: 2, leaderSnapShotIndex: 1
01:14:29,478 AM [test-pekko.actor.default-dispatcher-12] [INFO] AbstractLeader - node2 (Leader): Initiating install snapshot to follower node1: follower nextIndex: 1, leader snapshotIndex: 1, leader lastIndex: 2, leader log size: 1
01:14:29,478 AM [test-pekko.actor.default-dispatcher-12] [INFO] SnapshotManager - node2: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=1, lastAppliedTerm=1, lastIndex=2, lastTerm=3, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] to install on node1
01:14:29,478 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SnapshotManager - node2: last applied journal index prior to capture: 0
01:14:29,478 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - node2: support() called
01:14:29,479 AM [node2-%d738079] [DEBUG] RaftStorageCompleter - node2: 1 completion(s) pending
01:14:29,479 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - node1: Lagging 0 entries behind leader node2 and reached -1 (of expected -1)
01:14:29,479 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - node2: running 1 completion(s)
01:14:29,479 AM [test-pekko.actor.default-dispatcher-12] [INFO] SnapshotManager - node2: Persising snapshot at EntryInfo[index=1, term=1]/EntryInfo[index=2, term=3]
01:14:29,479 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - node2: support() called
01:14:29,479 AM [test-pekko.actor.default-dispatcher-12] [INFO] SnapshotManager - node2: Removed in-memory snapshotted entries, adjusted snapshotIndex: 1 and term: 1
01:14:29,479 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - node2 (Leader): sendInstallSnapshot
01:14:29,479 AM [node2-%d738080] [DEBUG] RaftStorage - node2: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/snapshot-000000006871B6F5-1C90C83F.tmp
01:14:29,479 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] LeaderInstallSnapshotState - node2 (Leader): Snapshot 157 bytes, total chunks to send: 1
01:14:29,479 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] LeaderInstallSnapshotState - node2 (Leader): Next chunk: total length=157, offset=0, size=157, hashCode=1546036366
01:14:29,479 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - node2 (Leader): next snapshot chunk size for follower node1: 157
01:14:29,479 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - node2 (Leader): InstallSnapshot sent to follower Vector(user, node1), Chunk: 1/1
01:14:29,479 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - node1 (Follower): handleInstallSnapshot: InstallSnapshot{term=3, leaderId=node2, lastIncludedIndex=1, lastIncludedTerm=1, datasize=157, chunk=1/1, lastChunkHashCode=OptionalInt[-1], votingConfig=VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}}
01:14:29,479 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - node1: Lagging 2 entries behind leader node2 and reached -1 (of expected -1)
01:14:29,479 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotTracker - node1 (Follower): addChunk: chunkIndex=1, lastChunkIndex=0, collectedChunks.size=0, lastChunkHashCode=-1
01:14:29,479 AM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - node1 (Follower): Snapshot received from leader: node2
01:14:29,479 AM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - node1: Applying snapshot on follower: PlainSnapshotSource{io=MemoryStreamSource{size=157}}
01:14:29,479 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - node1: support() called
01:14:29,480 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - node1: Converted InstallSnapshot from leader: node2 to state
01:14:29,480 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - node1: last applied journal index prior to persisting applied snapshot: 0
01:14:29,480 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - node1: support() called
01:14:29,480 AM [node1-%d282763] [DEBUG] RaftStorage - node1: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/snapshot-000000006871B6F5-1C9F1371.tmp
01:14:29,481 AM [node2-writer-50] [DEBUG] RaftStorageCompleter - node2: 1 completion(s) pending
01:14:29,481 AM [node2-writer-50] [DEBUG] JournalWriteTask - node2: completed 1 commands in 3.494 ms
01:14:29,481 AM [node2-writer-50] [DEBUG] JournalWriteTask - node2: waiting to receive commands
01:14:29,481 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - node2: running 1 completion(s)
01:14:29,481 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - node2: persist complete JournaledLogEntry{index=2, term=3, command=VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}, pending=true}
01:14:29,482 AM [node2-%d738080] [DEBUG] RaftStorage - node2: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/snapshot-000000006871B6F5-1C90C83F.v1
01:14:29,482 AM [node1-%d282763] [DEBUG] RaftStorage - node1: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/snapshot-000000006871B6F5-1C9F1371.v1
01:14:29,482 AM [node2-%d738080] [DEBUG] RaftStorage - node2: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/snapshot-000000006871B6F5-09139357.v1
01:14:29,482 AM [node1-%d282763] [DEBUG] RaftStorage - node1: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/snapshot-000000006871B6F5-1C9F1371.v1
01:14:29,482 AM [node2-%d738080] [DEBUG] RaftStorage - node2: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/snapshot-000000006871B6F5-1C90C83F.v1
01:14:29,482 AM [node2-%d738080] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/TermInfo.properties
01:14:29,482 AM [node2-%d738080] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/journal-v1-1.log
01:14:29,482 AM [node2-%d738080] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/metadata-v1-1.log
01:14:29,482 AM [node1-%d282763] [DEBUG] RaftStorage - node1: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/snapshot-000000006871B6F5-08B1D072.v1
01:14:29,482 AM [node1-%d282763] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/TermInfo.properties
01:14:29,482 AM [node2-%d738080] [DEBUG] RaftStorage - node2: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=1, term=1], timestamp=2025-07-12T01:14:29.152277847Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/snapshot-000000006871B6F5-09139357.v1, size=237, entryCompress=NONE, stateCompress=NONE}
01:14:29,483 AM [node2-%d738080] [DEBUG] RaftStorage - node2: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=1, term=1], timestamp=2025-07-12T01:14:29.479250495Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node2/snapshot-000000006871B6F5-1C90C83F.v1, size=237, entryCompress=NONE, stateCompress=NONE}
01:14:29,483 AM [node1-%d282763] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/journal-v1-1.log
01:14:29,483 AM [node2-%d738080] [DEBUG] RaftStorageCompleter - node2: 1 completion(s) pending
01:14:29,483 AM [node1-%d282763] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/metadata-v1-1.log
01:14:29,483 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - node2: running 1 completion(s)
01:14:29,483 AM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - node2: snapshot is durable as of 2025-07-12T01:14:29.479250495Z
01:14:29,483 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - node2: Snapshot success, discarding journal entries up to 0
01:14:29,483 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorSnapshotMessageSupport - node2: SnapshotComplete received
01:14:29,483 AM [node1-%d282763] [DEBUG] RaftStorage - node1: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:29.145870962Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/snapshot-000000006871B6F5-08B1D072.v1, size=380, entryCompress=NONE, stateCompress=NONE}
01:14:29,483 AM [node2-writer-50] [DEBUG] JournalWriteTask - node2: received 1 commands after 1.764 ms
01:14:29,483 AM [node2-writer-50] [DEBUG] EntryJournalV1 - node2: first entry 1 already includes 1
01:14:29,483 AM [node1-%d282763] [DEBUG] RaftStorage - node1: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=1, term=1], timestamp=2025-07-12T01:14:29.480187249Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest16485210703923722973/node1/snapshot-000000006871B6F5-1C9F1371.v1, size=237, entryCompress=NONE, stateCompress=NONE}
01:14:29,483 AM [node2-writer-50] [DEBUG] RaftStorageCompleter - node2: 1 completion(s) pending
01:14:29,483 AM [node1-%d282763] [DEBUG] RaftStorageCompleter - node1: 1 completion(s) pending
01:14:29,483 AM [node2-writer-50] [DEBUG] JournalWriteTask - node2: completed 1 commands in 78.45 μs
01:14:29,483 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - node2: running 1 completion(s)
01:14:29,483 AM [node2-writer-50] [DEBUG] JournalWriteTask - node2: waiting to receive commands
01:14:29,483 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - node1: running 1 completion(s)
01:14:29,483 AM [test-pekko.actor.default-dispatcher-12] [INFO] SnapshotManager - node1: snapshot is durable as of 2025-07-12T01:14:29.480187249Z
01:14:29,483 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=pekko://test/user/node2, votingState=VOTING]]
01:14:29,483 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - node1: support() called
01:14:29,483 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - node1: applySnapshot called
01:14:29,483 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - node1 (Follower): handleInstallSnapshot returning: InstallSnapshotReply{term=3, followerId=node1, chunkIndex=1, success=true}
01:14:29,483 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SnapshotManager - node1: Snapshot success, discarding journal entries up to 0
01:14:29,483 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorSnapshotMessageSupport - node1: SnapshotComplete received
01:14:29,483 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - node2 (Leader): handleInstallSnapshotReply: InstallSnapshotReply{term=3, followerId=node1, chunkIndex=1, success=true}
01:14:29,483 AM [test-pekko.actor.default-dispatcher-15] [INFO] AbstractLeader - node2 (Leader): Snapshot successfully installed on follower node1 (last chunk 1) - matchIndex set to 1, nextIndex set to 2
01:14:29,483 AM [node1-writer-49] [DEBUG] JournalWriteTask - node1: received 1 commands after 343.0 ms
01:14:29,483 AM [node1-writer-49] [DEBUG] EntryJournalV1 - node1: first entry 1 already includes 1
01:14:29,483 AM [node1-writer-49] [DEBUG] RaftStorageCompleter - node1: 1 completion(s) pending
01:14:29,483 AM [node1-writer-49] [DEBUG] JournalWriteTask - node1: completed 1 commands in 83.59 μs
01:14:29,483 AM [node1-writer-49] [DEBUG] JournalWriteTask - node1: waiting to receive commands
01:14:29,484 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - node1: running 1 completion(s)
01:14:29,595 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - node2 (Leader): sendAppendEntries: 2 is present for follower node1
01:14:29,595 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - node2 (Leader): Sending AppendEntries to follower node1: AppendEntries{term=3, leaderId=node2, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=3, command=VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}, pending=false}]}
01:14:29,596 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - node1 (Follower): handleAppendEntries: AppendEntries{term=3, leaderId=node2, prevLogIndex=1, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=0, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=2, term=3, command=VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}, pending=false}]}
01:14:29,596 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - node1 (Follower): Number of entries to be appended = 1
01:14:29,596 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - node1 (Follower): After cleanup, lastIndex: 1, entries to be added from: 0
01:14:29,596 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - node1 (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}
01:14:29,596 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - node1: Append log entry and persist JournaledLogEntry{index=2, term=3, command=VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}, pending=false} 
01:14:29,596 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=pekko://test/user/node2, votingState=VOTING]]
01:14:29,596 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - node1 (Follower): Log size is now 1
01:14:29,596 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - node1 (Follower): handleAppendEntries returning : AppendEntriesReply{term=3, success=true, followerId=node1, logLastIndex=2, logLastTerm=3, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:29,596 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - node1: Lagging 0 entries behind leader node2 and reached 1 (of expected -1)
01:14:29,596 AM [node1-writer-49] [DEBUG] JournalWriteTask - node1: received 1 commands after 112.9 ms
01:14:29,596 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - node1: awaiting more completions to resolve 1 synchronized callback(s)
01:14:29,597 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - node2 (Leader): handleAppendEntriesReply - FollowerLogInformation for node1 updated: matchIndex: 2, nextIndex: 3
01:14:29,597 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - node2 (Leader): Applying to log - commitIndex: 2, lastAppliedIndex: 1
01:14:29,597 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - node2 (Leader): Setting last applied to 2
01:14:29,597 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - node2: Moving last applied index from 1 to 2
01:14:29,597 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - node2: Applying state for log index 2 data VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}
01:14:29,597 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - node2 (Leader): Checking sendAppendEntries for follower node1: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: 1
01:14:29,597 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActorVotingConfigSupport - node2: VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]} has been successfully replicated to a majority of followers
01:14:29,597 AM [node2-writer-50] [DEBUG] JournalWriteTask - node2: received 1 commands after 114.3 ms
01:14:29,598 AM [node2-writer-50] [DEBUG] EntryJournalV1 - node2: updated meta to JournalMeta[replayFrom=1, applyTo=1]
01:14:29,598 AM [node2-writer-50] [DEBUG] RaftStorageCompleter - node2: 1 completion(s) pending
01:14:29,598 AM [node2-writer-50] [DEBUG] JournalWriteTask - node2: completed 1 commands in 374.6 μs
01:14:29,598 AM [node2-writer-50] [DEBUG] JournalWriteTask - node2: waiting to receive commands
01:14:29,598 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - node2: running 1 completion(s)
01:14:29,598 AM [node1-writer-49] [DEBUG] RaftStorageCompleter - node1: 1 completion(s) pending
01:14:29,598 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - node1: running 1 completion(s)
01:14:29,598 AM [node1-writer-49] [DEBUG] JournalWriteTask - node1: completed 1 commands in 1.397 ms
01:14:29,598 AM [node1-writer-49] [DEBUG] JournalWriteTask - node1: waiting to receive commands
01:14:29,598 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - node1: persist complete JournaledLogEntry{index=2, term=3, command=VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}, pending=false}
01:14:29,598 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - node1: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=2, term=3, command=VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@5c2a270d}
01:14:29,598 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - node1: synchronized callbacks after 1.598 ms
01:14:29,598 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - node1 (Follower): Commit index set to 2
01:14:29,598 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - node1: Lagging 0 entries behind leader node2 and reached 2 (of expected -1)
01:14:29,598 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - node1 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 2, context.getLastApplied(): 1, lastIndex(): 2
01:14:29,598 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - node1 (Follower): Setting last applied to 2
01:14:29,599 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - node1: Moving last applied index from 1 to 2
01:14:29,599 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - node1: Applying state for log index 2 data VotingConfig{serverInfo=[ServerInfo[peerId=node1, isVoting=true], ServerInfo[peerId=node2, isVoting=true]]}
01:14:29,599 AM [node1-writer-49] [DEBUG] JournalWriteTask - node1: received 1 commands after 750.9 μs
01:14:29,599 AM [node1-writer-49] [DEBUG] EntryJournalV1 - node1: updated meta to JournalMeta[replayFrom=1, applyTo=1]
01:14:29,599 AM [node1-writer-49] [DEBUG] RaftStorageCompleter - node1: 1 completion(s) pending
01:14:29,599 AM [node1-writer-49] [DEBUG] JournalWriteTask - node1: completed 1 commands in 346.2 μs
01:14:29,599 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - node1: running 1 completion(s)
01:14:29,599 AM [node1-writer-49] [DEBUG] JournalWriteTask - node1: waiting to receive commands
01:14:29,715 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - node1: Lagging 0 entries behind leader node2 and reached 2 (of expected -1)
01:14:29,781 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeToVotingWithNoLeaderAndForwardedToOtherNodeAfterElectionTimeout ending
01:14:29,781 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower138]
01:14:29,792 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector139#797170741]
01:14:29,793 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/node1]
01:14:29,793 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EnabledRaftStorage - node1: terminating thread VirtualThread[#511,node1-writer-49]/waiting
01:14:29,793 AM [node1-writer-49] [DEBUG] JournalWriteTask - node1: received 1 commands after 194.1 ms
01:14:29,793 AM [node1-writer-49] [DEBUG] JournalWriteTask - node1: completed 1 commands in 39.46 μs
01:14:29,794 AM [node1-writer-49] [DEBUG] JournalWriteTask - node1: journal writer stopped
01:14:29,794 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - node1: journal closed
01:14:29,794 AM [test-pekko.actor.default-dispatcher-5] [INFO] EnabledRaftStorage - node1: journal closed
01:14:29,794 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - node1: stopped executor with 0 remaining tasks
01:14:29,794 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - node1: stopped executor with 0 remaining tasks
01:14:29,794 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector140#1746179822]
01:14:29,795 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/node2]
01:14:29,795 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EnabledRaftStorage - node2: terminating thread VirtualThread[#512,node2-writer-50]/waiting
01:14:29,795 AM [node2-writer-50] [DEBUG] JournalWriteTask - node2: received 1 commands after 197.2 ms
01:14:29,795 AM [node2-writer-50] [DEBUG] JournalWriteTask - node2: completed 1 commands in 18.78 μs
01:14:29,795 AM [node2-writer-50] [DEBUG] JournalWriteTask - node2: journal writer stopped
01:14:29,795 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - node2: journal closed
01:14:29,795 AM [test-pekko.actor.default-dispatcher-5] [INFO] EnabledRaftStorage - node2: journal closed
01:14:29,795 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - node2: stopped executor with 0 remaining tasks
01:14:29,795 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - node2: stopped executor with 0 remaining tasks
01:14:29,799 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithNoConsensusReached starting
[WARN] [07/12/2025 01:14:29.800] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server143]: org.opendaylight.controller.cluster.common.actor.Monitor@44c5227e
01:14:29,801 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000
01:14:29,801 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - new-server: started executor
01:14:29,801 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - new-server: started executor
01:14:29,802 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0
01:14:29,802 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:29,802 AM [test-pekko.actor.default-dispatcher-5] [INFO] EnabledRaftStorage - new-server: journal open: applyTo=0
01:14:29,802 AM [new-server-writer-51] [DEBUG] JournalWriteTask - new-server: journal writer started
01:14:29,802 AM [new-server-writer-51] [DEBUG] JournalWriteTask - new-server: waiting to receive commands
01:14:29,804 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/new-server/TermInfo.properties does not exist
01:14:29,804 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/new-server/journal-v1-1.log
01:14:29,804 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/new-server/metadata-v1-1.log
01:14:29,804 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - new-server: no eligible files found
01:14:29,804 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:29,806 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null
01:14:29,806 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0}
01:14:29,806 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot
01:14:29,806 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery
01:14:29,807 AM [test-pekko.actor.default-dispatcher-12] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
[WARN] [07/12/2025 01:14:29.808] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader144]: org.opendaylight.controller.cluster.common.actor.Monitor@6cf9f40
01:14:29,809 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:29,809 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:29,809 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader: started executor
01:14:29,809 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader: started executor
01:14:29,810 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:29,810 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:29,810 AM [test-pekko.actor.default-dispatcher-5] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:29,810 AM [leader-writer-52] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:29,810 AM [leader-writer-52] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:29,812 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/TermInfo.properties does not exist
01:14:29,812 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/journal-v1-1.log
01:14:29,812 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/metadata-v1-1.log
01:14:29,812 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: no eligible files found
01:14:29,812 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:29,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:29,816 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=}
01:14:29,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:29,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:29,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: []
01:14:29,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server143, votingMember=true], state: Idle
01:14:29,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server143, votingMember=true]
01:14:29,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
01:14:29,816 AM [test-pekko.actor.default-dispatcher-12] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server
01:14:29,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SnapshotManager - leader: last applied journal index prior to capture: 0
01:14:29,816 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - leader: support() called
01:14:29,817 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating capture snapshot for new server new-server
01:14:29,817 AM [leader-%d674760] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:29,817 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:29,817 AM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=-1, term=-1]
01:14:29,817 AM [test-pekko.actor.default-dispatcher-5] [INFO] MockRaftActor - leader: support() called
01:14:29,817 AM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1
01:14:29,817 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader (Leader): sendInstallSnapshot
01:14:29,817 AM [leader-%d674761] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/snapshot-000000006871B6F5-30BEF9D3.tmp
01:14:29,818 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Snapshot 157 bytes, total chunks to send: 1
01:14:29,818 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Next chunk: total length=157, offset=0, size=157, hashCode=1546036366
01:14:29,818 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader (Leader): next snapshot chunk size for follower new-server: 157
01:14:29,818 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader (Leader): InstallSnapshot sent to follower Vector(user, new-server143), Chunk: 1/1
01:14:29,818 AM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - new-server (Follower): Term 1 in "InstallSnapshot{term=1, leaderId=leader, lastIncludedIndex=-1, lastIncludedTerm=-1, datasize=157, chunk=1/1, lastChunkHashCode=OptionalInt[-1]}" message is greater than follower's term 0 - updating term
01:14:29,820 AM [leader-%d674761] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/snapshot-000000006871B6F5-30BEF9D3.v1
01:14:29,820 AM [leader-%d674761] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/snapshot-000000006871B6F5-30BEF9D3.v1
01:14:29,820 AM [leader-%d674761] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/TermInfo.properties
01:14:29,820 AM [leader-%d674761] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/journal-v1-1.log
01:14:29,820 AM [leader-%d674761] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/metadata-v1-1.log
01:14:29,821 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=1, votedFor=null
01:14:29,821 AM [leader-%d674761] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:29.817822163Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/snapshot-000000006871B6F5-30BEF9D3.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:29,821 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - new-server (Follower): handleInstallSnapshot: InstallSnapshot{term=1, leaderId=leader, lastIncludedIndex=-1, lastIncludedTerm=-1, datasize=157, chunk=1/1, lastChunkHashCode=OptionalInt[-1]}
01:14:29,821 AM [leader-%d674761] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:29,821 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to -1
01:14:29,821 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotTracker - new-server (Follower): addChunk: chunkIndex=1, lastChunkIndex=0, collectedChunks.size=0, lastChunkHashCode=-1
01:14:29,821 AM [test-pekko.actor.default-dispatcher-6] [INFO] Follower - new-server (Follower): Snapshot received from leader: leader
01:14:29,821 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:29,821 AM [test-pekko.actor.default-dispatcher-5] [INFO] SnapshotManager - leader: snapshot is durable as of 2025-07-12T01:14:29.817822163Z
01:14:29,821 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SnapshotManager - leader: Snapshot success, discarding journal entries up to 0
01:14:29,821 AM [test-pekko.actor.default-dispatcher-6] [INFO] SnapshotManager - new-server: Applying snapshot on follower: PlainSnapshotSource{io=MemoryStreamSource{size=157}}
01:14:29,821 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - new-server: support() called
01:14:29,821 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorSnapshotMessageSupport - leader: SnapshotComplete received
[WARN] [07/12/2025 01:14:29.821] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/new-server143] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=new-server, initialSyncDone=false]
01:14:29,822 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotManager - new-server: Converted InstallSnapshot from leader: leader to state
01:14:29,822 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotManager - new-server: last applied journal index prior to persisting applied snapshot: 0
01:14:29,822 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - new-server: support() called
01:14:29,822 AM [new-server-%d652596] [DEBUG] RaftStorage - new-server: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/new-server/snapshot-000000006871B6F5-3106BEB6.tmp
01:14:29,825 AM [new-server-%d652596] [DEBUG] RaftStorage - new-server: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/new-server/snapshot-000000006871B6F5-3106BEB6.v1
01:14:29,825 AM [new-server-%d652596] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/new-server/TermInfo.properties
01:14:29,825 AM [new-server-%d652596] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/new-server/snapshot-000000006871B6F5-3106BEB6.v1
01:14:29,825 AM [new-server-%d652596] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/new-server/journal-v1-1.log
01:14:29,825 AM [new-server-%d652596] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/new-server/metadata-v1-1.log
01:14:29,826 AM [new-server-%d652596] [DEBUG] RaftStorage - new-server: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:29.822525622Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/new-server/snapshot-000000006871B6F5-3106BEB6.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:29,826 AM [new-server-%d652596] [DEBUG] RaftStorageCompleter - new-server: 1 completion(s) pending
01:14:29,826 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - new-server: running 1 completion(s)
01:14:29,826 AM [test-pekko.actor.default-dispatcher-6] [INFO] SnapshotManager - new-server: snapshot is durable as of 2025-07-12T01:14:29.822525622Z
01:14:29,826 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - new-server: support() called
01:14:29,826 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - new-server: applySnapshot called
01:14:29,826 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - new-server (Follower): handleInstallSnapshot returning: InstallSnapshotReply{term=1, followerId=new-server, chunkIndex=1, success=true}
01:14:29,826 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotManager - new-server: Snapshot success, discarding journal entries up to 0
01:14:29,826 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorSnapshotMessageSupport - new-server: SnapshotComplete received
01:14:29,826 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): handleInstallSnapshotReply: InstallSnapshotReply{term=1, followerId=new-server, chunkIndex=1, success=true}
01:14:29,826 AM [test-pekko.actor.default-dispatcher-12] [INFO] AbstractLeader - leader (Leader): Snapshot successfully installed on follower new-server (last chunk 1) - matchIndex set to -1, nextIndex set to 0
01:14:29,826 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - Sent message UnInitializedFollowerSnapshotReply to self
01:14:29,863 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: onUnInitializedFollowerSnapshotReply: UnInitializedFollowerSnapshotReply [followerId=new-server]
01:14:29,863 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]
01:14:29,863 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: Persist data index=0 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:29,863 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:29,863 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=6d45fc13-f628-4a91-92e9-3da1ec501a37}, logIndex: 0, isSendImmediate: true
01:14:29,863 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:29,863 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:29,864 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower new-server
01:14:29,864 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:29,864 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server143, votingMember=true]
01:14:29,864 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server2, newServerAddress=, votingMember=false], state: Persisting
01:14:29,864 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: Server operation already in progress - queueing AddServer [newServerId=new-server2, newServerAddress=, votingMember=false]
01:14:29,864 AM [leader-%d674762] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/snapshot-000000006871B6F5-337B7FF1.tmp
01:14:29,866 AM [leader-%d674762] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/snapshot-000000006871B6F5-337B7FF1.v1
01:14:29,867 AM [leader-%d674762] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/snapshot-000000006871B6F5-30BEF9D3.v1
01:14:29,867 AM [leader-%d674762] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/snapshot-000000006871B6F5-337B7FF1.v1
01:14:29,867 AM [leader-%d674762] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/TermInfo.properties
01:14:29,867 AM [leader-%d674762] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/journal-v1-1.log
01:14:29,867 AM [leader-%d674762] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/metadata-v1-1.log
01:14:29,867 AM [leader-%d674762] [DEBUG] RaftStorage - leader: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:29.817822163Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/snapshot-000000006871B6F5-30BEF9D3.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:29,868 AM [leader-%d674762] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:29.863731697Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest11559192051846500029/leader/snapshot-000000006871B6F5-337B7FF1.v1, size=86, entryCompress=NONE, stateCompress=NONE}
01:14:29,868 AM [leader-%d674762] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:29,868 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:29,868 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}
01:14:29,935 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower new-server
01:14:30,55 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower new-server
01:14:30,55 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}]}
01:14:30,175 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower new-server
01:14:30,175 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}]}
01:14:30,295 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower new-server
01:14:30,295 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}]}
01:14:30,415 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower new-server
01:14:30,415 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}]}
01:14:30,535 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower new-server
01:14:30,535 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}]}
01:14:30,655 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower new-server
01:14:30,655 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}]}
01:14:30,775 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower new-server
01:14:30,775 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}]}
01:14:31,876 AM [test-pekko.actor.default-dispatcher-12] [WARN] RaftActorVotingConfigSupport - leader: Timeout occured while replicating the new server configuration for new-server
01:14:31,876 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: Returning PRIOR_REQUEST_CONSENSUS_TIMEOUT for operation AddServer [newServerId=new-server2, newServerAddress=, votingMember=false]
01:14:31,876 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server2, newServerAddress=, votingMember=false], state: Persisting
01:14:31,876 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: Returning PRIOR_REQUEST_CONSENSUS_TIMEOUT for operation AddServer [newServerId=new-server2, newServerAddress=, votingMember=false]
01:14:31,876 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithNoConsensusReached ending
01:14:31,877 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower141]
01:14:31,879 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector142#-1800419384]
01:14:31,880 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server143]
01:14:31,880 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EnabledRaftStorage - new-server: terminating thread VirtualThread[#518,new-server-writer-51]/waiting
01:14:31,880 AM [new-server-writer-51] [DEBUG] JournalWriteTask - new-server: received 1 commands after 2.078 s
01:14:31,880 AM [new-server-writer-51] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 44.51 μs
01:14:31,881 AM [new-server-writer-51] [DEBUG] JournalWriteTask - new-server: journal writer stopped
01:14:31,881 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - new-server: journal closed
01:14:31,881 AM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - new-server: journal closed
01:14:31,881 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:31,881 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:31,881 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader144]
01:14:31,882 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#519,leader-writer-52]/waiting
01:14:31,882 AM [leader-writer-52] [DEBUG] JournalWriteTask - leader: received 1 commands after 2.071 s
01:14:31,882 AM [leader-writer-52] [DEBUG] JournalWriteTask - leader: completed 1 commands in 17.63 μs
01:14:31,882 AM [leader-writer-52] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:31,882 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:31,882 AM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - leader: journal closed
01:14:31,882 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:31,882 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:31,882 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector145]
01:14:31,883 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-serverCollector146]
01:14:31,888 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerLeaderWithNoFollowers starting
[WARN] [07/12/2025 01:14:31.890] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader148]: org.opendaylight.controller.cluster.common.actor.Monitor@6c508704
01:14:31,891 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:31,891 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:31,891 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: started executor
01:14:31,891 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: started executor
01:14:31,892 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:31,893 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:31,893 AM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:31,893 AM [leader-writer-53] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:31,893 AM [leader-writer-53] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:31,895 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2917170878621007621/leader/TermInfo.properties does not exist
01:14:31,895 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2917170878621007621/leader/journal-v1-1.log
01:14:31,895 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2917170878621007621/leader/metadata-v1-1.log
01:14:31,895 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: no eligible files found
01:14:31,895 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:31,898 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:31,898 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=}
01:14:31,898 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:31,898 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:31,898 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: []
01:14:31,904 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: onRemoveServer: RemoveServer{serverId='leader'}, state: Idle
01:14:31,905 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerLeaderWithNoFollowers ending
01:14:31,905 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower147]
01:14:31,916 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader148]
01:14:31,916 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#524,leader-writer-53]/waiting
01:14:31,916 AM [leader-writer-53] [DEBUG] JournalWriteTask - leader: received 1 commands after 23.55 ms
01:14:31,917 AM [leader-writer-53] [DEBUG] JournalWriteTask - leader: completed 1 commands in 26.88 μs
01:14:31,917 AM [leader-writer-53] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:31,917 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:31,917 AM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - leader: journal closed
01:14:31,917 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:31,917 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:31,921 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithLeaderChangeBeforePriorSnapshotComplete starting
[WARN] [07/12/2025 01:14:31.922] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server151]: org.opendaylight.controller.cluster.common.actor.Monitor@1e2eb601
01:14:31,923 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000
01:14:31,924 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - new-server: started executor
01:14:31,924 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - new-server: started executor
01:14:31,924 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0
01:14:31,925 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:31,925 AM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - new-server: journal open: applyTo=0
01:14:31,925 AM [new-server-writer-54] [DEBUG] JournalWriteTask - new-server: journal writer started
01:14:31,925 AM [new-server-writer-54] [DEBUG] JournalWriteTask - new-server: waiting to receive commands
01:14:31,926 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1766268763267167313/new-server/TermInfo.properties does not exist
01:14:31,927 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1766268763267167313/new-server/journal-v1-1.log
01:14:31,927 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1766268763267167313/new-server/metadata-v1-1.log
01:14:31,927 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - new-server: no eligible files found
01:14:31,927 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:31,930 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null
01:14:31,930 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0}
01:14:31,930 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot
01:14:31,930 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery
01:14:31,931 AM [test-pekko.actor.default-dispatcher-12] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
[WARN] [07/12/2025 01:14:31.932] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader152]: org.opendaylight.controller.cluster.common.actor.Monitor@34aea49
01:14:31,933 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:31,934 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:31,934 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: started executor
01:14:31,934 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: started executor
01:14:31,935 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:31,935 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:31,935 AM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:31,936 AM [leader-writer-55] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:31,936 AM [leader-writer-55] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:31,939 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1766268763267167313/leader/TermInfo.properties does not exist
01:14:31,939 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1766268763267167313/leader/journal-v1-1.log
01:14:31,939 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1766268763267167313/leader/metadata-v1-1.log
01:14:31,939 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: no eligible files found
01:14:31,939 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:31,941 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:31,941 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=}
01:14:31,941 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:31,941 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:31,942 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: []
01:14:31,942 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: Take a snapshot of current state. lastReplicatedLog is null and replicatedToAllIndex is -1
01:14:31,942 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
01:14:31,942 AM [test-pekko.actor.default-dispatcher-12] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true]
01:14:31,942 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SnapshotManager - leader: captured snapshot at lastSequenceNumber: 0
01:14:31,942 AM [test-pekko.actor.default-dispatcher-12] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=-1, term=-1]
01:14:31,942 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - leader: support() called
01:14:31,943 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SnapshotManager - leader: user triggered or root overwrite snapshot encountered, trimming log up to last applied index -1
01:14:31,943 AM [test-pekko.actor.default-dispatcher-12] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1
01:14:31,943 AM [leader-%d725608] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1766268763267167313/leader/snapshot-000000006871B6F7-38382CE5.tmp
01:14:31,945 AM [leader-%d725608] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1766268763267167313/leader/snapshot-000000006871B6F7-38382CE5.v1
01:14:31,945 AM [leader-%d725608] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1766268763267167313/leader/snapshot-000000006871B6F7-38382CE5.v1
01:14:31,945 AM [leader-%d725608] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1766268763267167313/leader/TermInfo.properties
01:14:31,945 AM [leader-%d725608] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1766268763267167313/leader/journal-v1-1.log
01:14:31,945 AM [leader-%d725608] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1766268763267167313/leader/metadata-v1-1.log
01:14:31,945 AM [leader-%d725608] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:31.943205605Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest1766268763267167313/leader/snapshot-000000006871B6F7-38382CE5.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:31,945 AM [leader-%d725608] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:31,945 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:31,949 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server151, votingMember=true], state: Idle
01:14:31,949 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server151, votingMember=true]
01:14:31,949 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SnapshotManager - leader: captureToInstall should not be called in state PersistCapture[lastJournalIndex=0, request=CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true]]
01:14:31,949 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: Snapshot already in progress - waiting for completion
01:14:32,53 AM [main] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:32,53 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:32,53 AM [test-pekko.actor.default-dispatcher-12] [INFO] SnapshotManager - leader: snapshot is durable as of 2025-07-12T01:14:31.943205605Z
01:14:32,54 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SnapshotManager - leader: Snapshot success, discarding journal entries up to 0
01:14:32,54 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: onSnapshotComplete
01:14:32,54 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: No longer the leader
01:14:32,54 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorSnapshotMessageSupport - leader: SnapshotComplete received
01:14:32,54 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: handleInstallSnapshotTimeout for new server new-server
01:14:32,54 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - leader: Returning NO_LEADER for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server151, votingMember=true]
01:14:32,54 AM [test-pekko.actor.default-dispatcher-12] [WARN] RaftActorVotingConfigSupport - leader: Timeout occured for new server new-server while waiting for prior snapshot to complete
01:14:32,54 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithLeaderChangeBeforePriorSnapshotComplete ending
01:14:32,54 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower149]
01:14:32,66 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector150#1958581594]
01:14:32,66 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server151]
01:14:32,66 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EnabledRaftStorage - new-server: terminating thread VirtualThread[#525,new-server-writer-54]/waiting
01:14:32,67 AM [new-server-writer-54] [DEBUG] JournalWriteTask - new-server: received 1 commands after 141.4 ms
01:14:32,67 AM [new-server-writer-54] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 48.89 μs
01:14:32,67 AM [new-server-writer-54] [DEBUG] JournalWriteTask - new-server: journal writer stopped
01:14:32,69 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - new-server: journal closed
01:14:32,69 AM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - new-server: journal closed
01:14:32,69 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:32,69 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:32,69 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader152]
01:14:32,69 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#526,leader-writer-55]/waiting
01:14:32,69 AM [leader-writer-55] [DEBUG] JournalWriteTask - leader: received 1 commands after 133.9 ms
01:14:32,70 AM [leader-writer-55] [DEBUG] JournalWriteTask - leader: completed 1 commands in 21.55 μs
01:14:32,70 AM [leader-writer-55] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:32,70 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:32,70 AM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - leader: journal closed
01:14:32,70 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:32,70 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:32,73 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServersAsNonVoting starting
[WARN] [07/12/2025 01:14:32.075] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server155]: org.opendaylight.controller.cluster.common.actor.Monitor@6991b117
01:14:32,78 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000
01:14:32,78 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - new-server: started executor
01:14:32,78 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - new-server: started executor
01:14:32,79 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0
01:14:32,80 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:32,80 AM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - new-server: journal open: applyTo=0
01:14:32,80 AM [new-server-writer-56] [DEBUG] JournalWriteTask - new-server: journal writer started
01:14:32,80 AM [new-server-writer-56] [DEBUG] JournalWriteTask - new-server: waiting to receive commands
01:14:32,82 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/TermInfo.properties does not exist
01:14:32,83 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/journal-v1-1.log
01:14:32,83 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/metadata-v1-1.log
01:14:32,83 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - new-server: no eligible files found
01:14:32,83 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:32,88 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null
01:14:32,88 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0}
01:14:32,88 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot
01:14:32,88 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery
01:14:32,89 AM [test-pekko.actor.default-dispatcher-5] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
[WARN] [07/12/2025 01:14:32.090] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader156]: org.opendaylight.controller.cluster.common.actor.Monitor@6e944c9f
01:14:32,92 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:32,92 AM [test-pekko.actor.default-dispatcher-5] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:32,92 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader: started executor
01:14:32,92 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader: started executor
01:14:32,93 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:32,93 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:32,93 AM [test-pekko.actor.default-dispatcher-5] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:32,93 AM [leader-writer-57] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:32,93 AM [leader-writer-57] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:32,95 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/TermInfo.properties does not exist
01:14:32,95 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/journal-v1-1.log
01:14:32,96 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/metadata-v1-1.log
01:14:32,96 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorage - leader: no eligible files found
01:14:32,96 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:32,98 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:32,98 AM [test-pekko.actor.default-dispatcher-5] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=}
01:14:32,98 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:32,98 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:32,98 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: []
01:14:32,105 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server155, votingMember=false], state: Idle
01:14:32,105 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server155, votingMember=false]
01:14:32,105 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: New follower is non-voting - directly persisting new server configuration
01:14:32,105 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]
01:14:32,105 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: Persist data index=0 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
01:14:32,105 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:32,106 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=641d5ae3-3f9f-46cc-b587-f661457596c3}, logIndex: 0, isSendImmediate: true
01:14:32,106 AM [leader-%d629446] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/snapshot-000000006871B6F8-0652128D.tmp
01:14:32,106 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader (Leader): Setting last applied to 0
01:14:32,106 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader: Moving last applied index from -1 to 0
01:14:32,106 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
01:14:32,106 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:32,106 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server155, votingMember=false]
01:14:32,106 AM [test-pekko.actor.default-dispatcher-5] [INFO] Follower - new-server (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term
01:14:32,107 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorVotingConfigSupport - leader: VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]} has been successfully replicated to a majority of followers
01:14:32,108 AM [leader-%d629446] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/snapshot-000000006871B6F8-0652128D.v1
01:14:32,108 AM [leader-%d629446] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/snapshot-000000006871B6F8-0652128D.v1
01:14:32,108 AM [leader-%d629446] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/TermInfo.properties
01:14:32,108 AM [leader-%d629446] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/journal-v1-1.log
01:14:32,108 AM [leader-%d629446] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/metadata-v1-1.log
01:14:32,108 AM [leader-%d629446] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:32.106041997Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/snapshot-000000006871B6F8-0652128D.v1, size=86, entryCompress=NONE, stateCompress=NONE}
01:14:32,108 AM [leader-%d629446] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:32,109 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:32,109 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=1, votedFor=null
01:14:32,109 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}
01:14:32,109 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to -1
01:14:32,109 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: -1, nextIndex: 0
01:14:32,109 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:32,109 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower new-server
[WARN] [07/12/2025 01:14:32.109] [test-pekko.actor.default-dispatcher-5] [pekko://test/user/new-server155] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=new-server, initialSyncDone=false]
01:14:32,109 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}]}
01:14:32,109 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}]}
01:14:32,109 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): Number of entries to be appended = 1
01:14:32,109 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
01:14:32,109 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
01:14:32,109 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - new-server: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false} 
01:14:32,110 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] PeerInfos - new-server: Updated server config: isVoting: false, peers: [PeerInfo [id=leader, address=null, votingState=VOTING]]
01:14:32,110 AM [new-server-%d124631] [DEBUG] RaftStorage - new-server: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/snapshot-000000006871B6F8-068F7BA3.tmp
01:14:32,110 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): Log size is now 1
01:14:32,110 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): Commit index set to 0
01:14:32,110 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=new-server, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:32,110 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
01:14:32,110 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] Follower - new-server (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
01:14:32,110 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActorBehavior - new-server (Follower): Setting last applied to 0
01:14:32,110 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] AbstractReplicatedLog - new-server: Moving last applied index from -1 to 0
01:14:32,110 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: 0, nextIndex: 1
01:14:32,110 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftActor - new-server: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
01:14:32,110 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:32,110 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - new-server: awaiting more completions to resolve 1 synchronized callback(s)
01:14:32,112 AM [new-server-%d124631] [DEBUG] RaftStorage - new-server: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/snapshot-000000006871B6F8-068F7BA3.v1
01:14:32,112 AM [new-server-%d124631] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/snapshot-000000006871B6F8-068F7BA3.v1
01:14:32,112 AM [new-server-%d124631] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/TermInfo.properties
01:14:32,112 AM [new-server-%d124631] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/journal-v1-1.log
01:14:32,112 AM [new-server-%d124631] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/metadata-v1-1.log
01:14:32,112 AM [new-server-%d124631] [DEBUG] RaftStorage - new-server: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:32.110066595Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/snapshot-000000006871B6F8-068F7BA3.v1, size=86, entryCompress=NONE, stateCompress=NONE}
01:14:32,112 AM [new-server-%d124631] [DEBUG] RaftStorageCompleter - new-server: 1 completion(s) pending
01:14:32,112 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - new-server: running 1 completion(s)
01:14:32,112 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] ReplicatedLogImpl - new-server: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}
01:14:32,112 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - new-server: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@677d62da}
01:14:32,113 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] RaftStorageCompleter - new-server: synchronized callbacks after 2.405 ms
[WARN] [07/12/2025 01:14:32.113] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/new-server155] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=new-server, initialSyncDone=true]
01:14:32,225 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
01:14:32,346 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
01:14:32,466 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
01:14:32,585 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
01:14:32,661 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server2, newServerAddress=pekko://test/user/follower153, votingMember=false], state: Idle
01:14:32,661 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server2, newServerAddress=pekko://test/user/follower153, votingMember=false]
01:14:32,661 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: New follower is non-voting - directly persisting new server configuration
01:14:32,661 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]
01:14:32,661 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: Persist data index=1 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
01:14:32,661 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:32,662 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=06051ced-1462-40f4-890e-9ff982e48fe1}, logIndex: 1, isSendImmediate: true
01:14:32,662 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorBehavior - leader (Leader): Setting last applied to 1
01:14:32,662 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractReplicatedLog - leader: Moving last applied index from 0 to 1
01:14:32,662 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: Applying state for log index 1 data VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
01:14:32,662 AM [leader-%d629447] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/snapshot-000000006871B6F8-2776CA34.tmp
01:14:32,662 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
01:14:32,662 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 1 is present for follower new-server
01:14:32,662 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries{term=1, leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:32,662 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server2: active: false, followerNextIndex: 0, leaderLastIndex: 1, leaderSnapShotIndex: -1
01:14:32,663 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation AddServer [newServerId=new-server2, newServerAddress=pekko://test/user/follower153, votingMember=false]
01:14:32,663 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - new-server2: Last sync leader does not match current leader leader, need to catch up to -1
01:14:32,663 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - new-server (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:32,663 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - new-server (Follower): Number of entries to be appended = 1
01:14:32,663 AM [test-pekko.actor.default-dispatcher-15] [INFO] RaftActorVotingConfigSupport - leader: VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]} has been successfully replicated to a majority of followers
01:14:32,663 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - new-server (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
01:14:32,663 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - new-server (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
01:14:32,663 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - new-server: Append log entry and persist JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:32,663 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower new-server2
01:14:32,663 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server2: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}, JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:32,663 AM [new-server-%d124632] [DEBUG] RaftStorage - new-server: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/snapshot-000000006871B6F8-278D1E07.tmp
01:14:32,663 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PeerInfos - new-server: Updated server config: isVoting: false, peers: [PeerInfo [id=leader, address=null, votingState=VOTING], PeerInfo [id=new-server2, address=null, votingState=NON_VOTING]]
01:14:32,663 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - new-server (Follower): Log size is now 2
01:14:32,663 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - new-server (Follower): Commit index set to 1
01:14:32,663 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - new-server (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=new-server, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:32,664 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 1 (of expected -1)
01:14:32,664 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - new-server (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
01:14:32,664 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - new-server (Follower): Setting last applied to 1
01:14:32,664 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - new-server: Moving last applied index from 0 to 1
01:14:32,664 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - new-server: Applying state for log index 1 data VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
01:14:32,664 AM [test-pekko.actor.default-dispatcher-5] [ERROR] OneForOneStrategy - Cannot invoke "org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.getReplicatedToAllIndex()" because "currentBehavior" is null
java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.getReplicatedToAllIndex()" because "currentBehavior" is null
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.trimLog(SnapshotManager.java:663)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.performSnapshotWithoutCapture(RaftActorBehavior.java:438)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.Follower.handleAppendEntries(Follower.java:221)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.appendEntries(RaftActorBehavior.java:152)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.handleMessage(RaftActorBehavior.java:375)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.Follower.handleMessage(Follower.java:501)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ForwardMessageToBehaviorActor.onReceive(ForwardMessageToBehaviorActor.java:25)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.UntypedAbstractActor$$anonfun$receive$1.applyOrElse(AbstractActor.scala:341)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.AbstractActor.aroundReceive(AbstractActor.scala:229)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312)
	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188)
01:14:32,664 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: 1, nextIndex: 2
01:14:32,664 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServersAsNonVoting ending
01:14:32,664 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: -1
01:14:32,664 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower153]
01:14:32,664 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - new-server: awaiting more completions to resolve 1 synchronized callback(s)
01:14:32,664 AM [leader-%d629447] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/snapshot-000000006871B6F8-2776CA34.v1
01:14:32,665 AM [leader-%d629447] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/snapshot-000000006871B6F8-0652128D.v1
01:14:32,665 AM [leader-%d629447] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/snapshot-000000006871B6F8-2776CA34.v1
[ERROR] [07/12/2025 01:14:32.664] [test-pekko.actor.internal-dispatcher-4] [pekko://test/user/follower153] Cannot invoke "org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.getReplicatedToAllIndex()" because "currentBehavior" is null
java.lang.NullPointerException: Cannot invoke "org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.getReplicatedToAllIndex()" because "currentBehavior" is null
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.SnapshotManager.trimLog(SnapshotManager.java:663)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.performSnapshotWithoutCapture(RaftActorBehavior.java:438)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.Follower.handleAppendEntries(Follower.java:221)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.appendEntries(RaftActorBehavior.java:152)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.RaftActorBehavior.handleMessage(RaftActorBehavior.java:375)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.behaviors.Follower.handleMessage(Follower.java:501)
	at org.opendaylight.controller.cluster.raft@12.0.0-SNAPSHOT/org.opendaylight.controller.cluster.raft.ForwardMessageToBehaviorActor.onReceive(ForwardMessageToBehaviorActor.java:25)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.UntypedAbstractActor$$anonfun$receive$1.applyOrElse(AbstractActor.scala:341)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.AbstractActor.aroundReceive(AbstractActor.scala:229)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241)
	at org.opendaylight.controller.repackaged.pekko@12.0.0-SNAPSHOT/org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312)
	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188)

01:14:32,665 AM [leader-%d629447] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/TermInfo.properties
01:14:32,665 AM [leader-%d629447] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/journal-v1-1.log
01:14:32,665 AM [leader-%d629447] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/metadata-v1-1.log
01:14:32,665 AM [leader-%d629447] [DEBUG] RaftStorage - leader: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:32.106041997Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/snapshot-000000006871B6F8-0652128D.v1, size=86, entryCompress=NONE, stateCompress=NONE}
01:14:32,665 AM [leader-%d629447] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:32.662096436Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/leader/snapshot-000000006871B6F8-2776CA34.v1, size=100, entryCompress=NONE, stateCompress=NONE}
01:14:32,666 AM [leader-%d629447] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:32,666 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:32,666 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}
01:14:32,666 AM [new-server-%d124632] [DEBUG] RaftStorage - new-server: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/snapshot-000000006871B6F8-278D1E07.v1
01:14:32,666 AM [new-server-%d124632] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/snapshot-000000006871B6F8-068F7BA3.v1
01:14:32,666 AM [new-server-%d124632] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/TermInfo.properties
01:14:32,666 AM [new-server-%d124632] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/journal-v1-1.log
01:14:32,666 AM [new-server-%d124632] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/metadata-v1-1.log
01:14:32,667 AM [new-server-%d124632] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/snapshot-000000006871B6F8-278D1E07.v1
01:14:32,667 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector154#-849175357]
01:14:32,667 AM [new-server-%d124632] [DEBUG] RaftStorage - new-server: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:32.110066595Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/snapshot-000000006871B6F8-068F7BA3.v1, size=86, entryCompress=NONE, stateCompress=NONE}
01:14:32,667 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server155]
01:14:32,667 AM [new-server-%d124632] [DEBUG] RaftStorage - new-server: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:32.663559687Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest6492004877340727212/new-server/snapshot-000000006871B6F8-278D1E07.v1, size=100, entryCompress=NONE, stateCompress=NONE}
01:14:32,667 AM [new-server-%d124632] [DEBUG] RaftStorageCompleter - new-server: 1 completion(s) pending
01:14:32,667 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - new-server: running 1 completion(s)
01:14:32,667 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - new-server: persist complete JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}
01:14:32,667 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - new-server: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@68ffb77e}
01:14:32,667 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - new-server: synchronized callbacks after 2.845 ms
[WARN] [07/12/2025 01:14:32.668] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/new-serverCollector154] received dead letter from TestActor[pekko://test/user/new-server155]: ApplyState[identifier=null, entry=JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=false], ServerInfo[peerId=new-server2, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}]
01:14:32,668 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EnabledRaftStorage - new-server: terminating thread VirtualThread[#529,new-server-writer-56]/waiting
01:14:32,668 AM [new-server-writer-56] [DEBUG] JournalWriteTask - new-server: received 1 commands after 587.5 ms
01:14:32,668 AM [new-server-writer-56] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 30.22 μs
01:14:32,668 AM [new-server-writer-56] [DEBUG] JournalWriteTask - new-server: journal writer stopped
01:14:32,668 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - new-server: journal closed
01:14:32,668 AM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - new-server: journal closed
01:14:32,668 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:32,668 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:32,669 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader156]
01:14:32,669 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#530,leader-writer-57]/waiting
01:14:32,669 AM [leader-writer-57] [DEBUG] JournalWriteTask - leader: received 1 commands after 575.9 ms
01:14:32,669 AM [leader-writer-57] [DEBUG] JournalWriteTask - leader: completed 1 commands in 17.84 μs
01:14:32,669 AM [leader-writer-57] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:32,670 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:32,670 AM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - leader: journal closed
01:14:32,670 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:32,670 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:32,670 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector157]
[WARN] [07/12/2025 01:14:32.672] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/new-server155] received dead letter: ExecuteInSelfMessage[runnable=org.opendaylight.controller.cluster.raft.spi.RaftStorageCompleter$$Lambda/0x00000007c07c3d60@50a04a2a]
01:14:32,675 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithPriorSnapshotInProgress starting
[WARN] [07/12/2025 01:14:32.676] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server160]: org.opendaylight.controller.cluster.common.actor.Monitor@1e0f8cbb
01:14:32,678 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000
01:14:32,678 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: started executor
01:14:32,678 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: started executor
01:14:32,679 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0
01:14:32,679 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:32,679 AM [test-pekko.actor.default-dispatcher-16] [INFO] EnabledRaftStorage - new-server: journal open: applyTo=0
01:14:32,679 AM [new-server-writer-58] [DEBUG] JournalWriteTask - new-server: journal writer started
01:14:32,680 AM [new-server-writer-58] [DEBUG] JournalWriteTask - new-server: waiting to receive commands
01:14:32,681 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/TermInfo.properties does not exist
01:14:32,681 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/journal-v1-1.log
01:14:32,681 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/metadata-v1-1.log
01:14:32,681 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - new-server: no eligible files found
01:14:32,681 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:32,684 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null
01:14:32,684 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0}
01:14:32,684 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot
01:14:32,684 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery
[WARN] [07/12/2025 01:14:32.686] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader161]: org.opendaylight.controller.cluster.common.actor.Monitor@1dcc6165
01:14:32,686 AM [test-pekko.actor.default-dispatcher-6] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
01:14:32,686 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:32,687 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:32,687 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: started executor
01:14:32,687 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: started executor
01:14:32,687 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:32,688 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:32,688 AM [test-pekko.actor.default-dispatcher-16] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:32,688 AM [leader-writer-59] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:32,688 AM [leader-writer-59] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:32,689 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/TermInfo.properties does not exist
01:14:32,689 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/journal-v1-1.log
01:14:32,689 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/metadata-v1-1.log
01:14:32,689 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: no eligible files found
01:14:32,689 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:32,692 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:32,692 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=}
01:14:32,692 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:32,692 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:32,692 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: []
01:14:32,692 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: Take a snapshot of current state. lastReplicatedLog is null and replicatedToAllIndex is -1
01:14:32,692 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
01:14:32,692 AM [test-pekko.actor.default-dispatcher-6] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true]
01:14:32,692 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotManager - leader: captured snapshot at lastSequenceNumber: 0
01:14:32,692 AM [test-pekko.actor.default-dispatcher-6] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=-1, term=-1]
01:14:32,692 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader: support() called
01:14:32,693 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotManager - leader: user triggered or root overwrite snapshot encountered, trimming log up to last applied index -1
01:14:32,693 AM [test-pekko.actor.default-dispatcher-6] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1
01:14:32,693 AM [leader-%d949018] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/snapshot-000000006871B6F8-2951A835.tmp
01:14:32,695 AM [leader-%d949018] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/snapshot-000000006871B6F8-2951A835.v1
01:14:32,695 AM [leader-%d949018] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/snapshot-000000006871B6F8-2951A835.v1
01:14:32,695 AM [leader-%d949018] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/TermInfo.properties
01:14:32,695 AM [leader-%d949018] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/journal-v1-1.log
01:14:32,695 AM [leader-%d949018] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/metadata-v1-1.log
01:14:32,695 AM [leader-%d949018] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:32.693217333Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/snapshot-000000006871B6F8-2951A835.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:32,695 AM [leader-%d949018] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:32,696 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:32,802 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server160, votingMember=true], state: Idle
01:14:32,802 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server160, votingMember=true]
01:14:32,802 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotManager - leader: captureToInstall should not be called in state PersistCapture[lastJournalIndex=0, request=CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true]]
01:14:32,802 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: Snapshot already in progress - waiting for completion
01:14:32,802 AM [main] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:32,802 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:32,802 AM [test-pekko.actor.default-dispatcher-6] [INFO] SnapshotManager - leader: snapshot is durable as of 2025-07-12T01:14:32.693217333Z
01:14:32,802 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotManager - leader: Snapshot success, discarding journal entries up to 0
01:14:32,803 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: onSnapshotComplete
01:14:32,803 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
01:14:32,803 AM [test-pekko.actor.default-dispatcher-6] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server
01:14:32,803 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotManager - leader: last applied journal index prior to capture: 0
01:14:32,803 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader: support() called
01:14:32,803 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating capture snapshot for new server new-server
01:14:32,803 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorSnapshotMessageSupport - leader: SnapshotComplete received
01:14:32,804 AM [leader-%d949019] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:32,804 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:32,804 AM [test-pekko.actor.default-dispatcher-6] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=-1, term=-1]
01:14:32,804 AM [test-pekko.actor.default-dispatcher-6] [INFO] MockRaftActor - leader: support() called
01:14:32,804 AM [test-pekko.actor.default-dispatcher-6] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1
01:14:32,804 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): sendInstallSnapshot
01:14:32,804 AM [leader-%d949020] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/snapshot-000000006871B6F8-2FF3BB9D.tmp
01:14:32,804 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Snapshot 157 bytes, total chunks to send: 1
01:14:32,804 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Next chunk: total length=157, offset=0, size=157, hashCode=1546036366
01:14:32,804 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): next snapshot chunk size for follower new-server: 157
01:14:32,805 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): InstallSnapshot sent to follower Vector(user, new-server160), Chunk: 1/1
01:14:32,805 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - new-server (Follower): Term 1 in "InstallSnapshot{term=1, leaderId=leader, lastIncludedIndex=-1, lastIncludedTerm=-1, datasize=157, chunk=1/1, lastChunkHashCode=OptionalInt[-1]}" message is greater than follower's term 0 - updating term
01:14:32,807 AM [leader-%d949020] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/snapshot-000000006871B6F8-2FF3BB9D.v1
01:14:32,807 AM [leader-%d949020] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/snapshot-000000006871B6F8-2FF3BB9D.v1
01:14:32,807 AM [leader-%d949020] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/snapshot-000000006871B6F8-2951A835.v1
01:14:32,808 AM [leader-%d949020] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/TermInfo.properties
01:14:32,808 AM [leader-%d949020] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/journal-v1-1.log
01:14:32,808 AM [leader-%d949020] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/metadata-v1-1.log
01:14:32,808 AM [leader-%d949020] [DEBUG] RaftStorage - leader: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:32.693217333Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/snapshot-000000006871B6F8-2951A835.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:32,808 AM [leader-%d949020] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:32.804502429Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/snapshot-000000006871B6F8-2FF3BB9D.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:32,808 AM [leader-%d949020] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:32,808 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=1, votedFor=null
01:14:32,808 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:32,808 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - new-server (Follower): handleInstallSnapshot: InstallSnapshot{term=1, leaderId=leader, lastIncludedIndex=-1, lastIncludedTerm=-1, datasize=157, chunk=1/1, lastChunkHashCode=OptionalInt[-1]}
01:14:32,808 AM [test-pekko.actor.default-dispatcher-6] [INFO] SnapshotManager - leader: snapshot is durable as of 2025-07-12T01:14:32.804502429Z
01:14:32,808 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SnapshotManager - leader: Snapshot success, discarding journal entries up to 0
01:14:32,808 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to -1
01:14:32,808 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorSnapshotMessageSupport - leader: SnapshotComplete received
01:14:32,808 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotTracker - new-server (Follower): addChunk: chunkIndex=1, lastChunkIndex=0, collectedChunks.size=0, lastChunkHashCode=-1
01:14:32,808 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - new-server (Follower): Snapshot received from leader: leader
[WARN] [07/12/2025 01:14:32.809] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/new-server160] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=new-server, initialSyncDone=false]
01:14:32,809 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - new-server: Applying snapshot on follower: PlainSnapshotSource{io=MemoryStreamSource{size=157}}
01:14:32,809 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - new-server: support() called
01:14:32,810 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - new-server: Converted InstallSnapshot from leader: leader to state
01:14:32,810 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - new-server: last applied journal index prior to persisting applied snapshot: 0
01:14:32,810 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - new-server: support() called
01:14:32,810 AM [new-server-%d454036] [DEBUG] RaftStorage - new-server: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/snapshot-000000006871B6F8-3050B084.tmp
01:14:32,812 AM [new-server-%d454036] [DEBUG] RaftStorage - new-server: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/snapshot-000000006871B6F8-3050B084.v1
01:14:32,813 AM [new-server-%d454036] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/snapshot-000000006871B6F8-3050B084.v1
01:14:32,813 AM [new-server-%d454036] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/TermInfo.properties
01:14:32,813 AM [new-server-%d454036] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/journal-v1-1.log
01:14:32,813 AM [new-server-%d454036] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/metadata-v1-1.log
01:14:32,813 AM [new-server-%d454036] [DEBUG] RaftStorage - new-server: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:32.810594436Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/snapshot-000000006871B6F8-3050B084.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:32,813 AM [new-server-%d454036] [DEBUG] RaftStorageCompleter - new-server: 1 completion(s) pending
01:14:32,813 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - new-server: running 1 completion(s)
01:14:32,813 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - new-server: snapshot is durable as of 2025-07-12T01:14:32.810594436Z
01:14:32,813 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - new-server: support() called
01:14:32,813 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - new-server: applySnapshot called
01:14:32,813 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - new-server (Follower): handleInstallSnapshot returning: InstallSnapshotReply{term=1, followerId=new-server, chunkIndex=1, success=true}
01:14:32,814 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - new-server: Snapshot success, discarding journal entries up to 0
01:14:32,814 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - new-server: SnapshotComplete received
01:14:32,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): handleInstallSnapshotReply: InstallSnapshotReply{term=1, followerId=new-server, chunkIndex=1, success=true}
01:14:32,814 AM [test-pekko.actor.default-dispatcher-6] [INFO] AbstractLeader - leader (Leader): Snapshot successfully installed on follower new-server (last chunk 1) - matchIndex set to -1, nextIndex set to 0
01:14:32,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - Sent message UnInitializedFollowerSnapshotReply to self
01:14:32,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: onUnInitializedFollowerSnapshotReply: UnInitializedFollowerSnapshotReply [followerId=new-server]
01:14:32,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]
01:14:32,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: Persist data index=0 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:32,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:32,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=b1167709-cb3c-407d-b46c-6542f97fef52}, logIndex: 0, isSendImmediate: true
01:14:32,814 AM [leader-%d949021] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/snapshot-000000006871B6F8-308E97B3.tmp
01:14:32,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:32,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:32,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower new-server
01:14:32,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:32,814 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server160, votingMember=true]
01:14:32,815 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:32,815 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): Number of entries to be appended = 1
01:14:32,815 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
01:14:32,815 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:32,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - new-server: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:32,816 AM [new-server-%d454037] [DEBUG] RaftStorage - new-server: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/snapshot-000000006871B6F8-30A585DC.tmp
01:14:32,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - new-server: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=null, votingState=VOTING]]
01:14:32,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): Log size is now 1
01:14:32,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=new-server, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:32,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached -1 (of expected -1)
01:14:32,816 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - new-server: awaiting more completions to resolve 1 synchronized callback(s)
01:14:32,816 AM [leader-%d949021] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/snapshot-000000006871B6F8-308E97B3.v1
01:14:32,816 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: 0, nextIndex: 1
01:14:32,817 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:32,817 AM [leader-%d949021] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/snapshot-000000006871B6F8-2FF3BB9D.v1
01:14:32,817 AM [leader-%d949021] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/snapshot-000000006871B6F8-308E97B3.v1
01:14:32,817 AM [leader-%d949021] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/TermInfo.properties
01:14:32,817 AM [leader-%d949021] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/journal-v1-1.log
01:14:32,817 AM [leader-%d949021] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/metadata-v1-1.log
01:14:32,817 AM [leader-%d949021] [DEBUG] RaftStorage - leader: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:32.804502429Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/snapshot-000000006871B6F8-2FF3BB9D.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:32,817 AM [leader-%d949021] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:32.814651315Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/leader/snapshot-000000006871B6F8-308E97B3.v1, size=86, entryCompress=NONE, stateCompress=NONE}
01:14:32,817 AM [leader-%d949021] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:32,817 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:32,817 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}
01:14:32,817 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
01:14:32,818 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader (Leader): Setting last applied to 0
01:14:32,818 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader: Moving last applied index from -1 to 0
01:14:32,818 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:32,818 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorVotingConfigSupport - leader: VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]} has been successfully replicated to a majority of followers
01:14:32,818 AM [new-server-%d454037] [DEBUG] RaftStorage - new-server: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/snapshot-000000006871B6F8-30A585DC.v1
01:14:32,818 AM [new-server-%d454037] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/snapshot-000000006871B6F8-3050B084.v1
01:14:32,818 AM [new-server-%d454037] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/snapshot-000000006871B6F8-30A585DC.v1
01:14:32,818 AM [new-server-%d454037] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/TermInfo.properties
01:14:32,818 AM [new-server-%d454037] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/journal-v1-1.log
01:14:32,818 AM [new-server-%d454037] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/metadata-v1-1.log
01:14:32,819 AM [new-server-%d454037] [DEBUG] RaftStorage - new-server: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:32.810594436Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/snapshot-000000006871B6F8-3050B084.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:32,819 AM [new-server-%d454037] [DEBUG] RaftStorage - new-server: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:32.816154076Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9897225871749289563/new-server/snapshot-000000006871B6F8-30A585DC.v1, size=86, entryCompress=NONE, stateCompress=NONE}
01:14:32,819 AM [new-server-%d454037] [DEBUG] RaftStorageCompleter - new-server: 1 completion(s) pending
01:14:32,819 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - new-server: running 1 completion(s)
01:14:32,819 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - new-server: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}
01:14:32,819 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - new-server: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@1c47cb13}
01:14:32,819 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - new-server: synchronized callbacks after 2.559 ms
[WARN] [07/12/2025 01:14:32.819] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/new-server160] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=new-server, initialSyncDone=true]
01:14:32,865 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithPriorSnapshotInProgress ending
01:14:32,865 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower158]
01:14:32,877 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector159#951967481]
01:14:32,877 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server160]
01:14:32,878 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EnabledRaftStorage - new-server: terminating thread VirtualThread[#536,new-server-writer-58]/waiting
01:14:32,878 AM [new-server-writer-58] [DEBUG] JournalWriteTask - new-server: received 1 commands after 198.3 ms
01:14:32,878 AM [new-server-writer-58] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 37.21 μs
01:14:32,878 AM [new-server-writer-58] [DEBUG] JournalWriteTask - new-server: journal writer stopped
01:14:32,878 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - new-server: journal closed
01:14:32,878 AM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - new-server: journal closed
01:14:32,879 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:32,879 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:32,879 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader161]
01:14:32,879 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#537,leader-writer-59]/waiting
01:14:32,879 AM [leader-writer-59] [DEBUG] JournalWriteTask - leader: received 1 commands after 191.1 ms
01:14:32,879 AM [leader-writer-59] [DEBUG] JournalWriteTask - leader: completed 1 commands in 17.47 μs
01:14:32,879 AM [leader-writer-59] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:32,879 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:32,880 AM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - leader: journal closed
01:14:32,880 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:32,880 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:32,880 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector162]
01:14:32,883 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeLeaderToNonVotingInSingleNode starting
[WARN] [07/12/2025 01:14:32.885] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader164]: org.opendaylight.controller.cluster.common.actor.Monitor@45b6219b
01:14:32,886 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:32,886 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:32,886 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: started executor
01:14:32,887 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: started executor
01:14:32,887 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:32,888 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:32,888 AM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:32,888 AM [leader-writer-60] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:32,888 AM [leader-writer-60] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:32,890 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest17360821594305681572/leader/TermInfo.properties does not exist
01:14:32,890 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest17360821594305681572/leader/journal-v1-1.log
01:14:32,890 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest17360821594305681572/leader/metadata-v1-1.log
01:14:32,890 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: no eligible files found
01:14:32,890 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:32,893 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:32,893 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=}
01:14:32,893 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:32,893 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:32,894 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: []
01:14:32,899 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={leader=false}, serversVisited=[]], state: Idle
01:14:32,899 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState
01:14:32,900 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: Returning INVALID_REQUEST for operation ChangeServersVotingStatus [serverVotingStatusMap={leader=false}, serversVisited=[]]
01:14:32,900 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeLeaderToNonVotingInSingleNode ending
01:14:32,900 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower163]
01:14:32,911 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader164]
01:14:32,912 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#545,leader-writer-60]/waiting
01:14:32,913 AM [leader-writer-60] [DEBUG] JournalWriteTask - leader: received 1 commands after 24.31 ms
01:14:32,913 AM [leader-writer-60] [DEBUG] JournalWriteTask - leader: completed 1 commands in 29.37 μs
01:14:32,913 AM [leader-writer-60] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:32,913 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:32,913 AM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - leader: journal closed
01:14:32,913 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:32,913 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:32,916 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeLeaderToNonVoting starting
[WARN] [07/12/2025 01:14:32.917] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader168]: org.opendaylight.controller.cluster.common.actor.Monitor@6824a627
01:14:32,918 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:32,918 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:32,918 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: started executor
01:14:32,919 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - leader: started executor
01:14:32,920 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:32,921 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:32,921 AM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:32,921 AM [leader-writer-61] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:32,921 AM [leader-writer-61] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:32,923 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/leader/TermInfo.properties does not exist
01:14:32,924 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/leader/journal-v1-1.log
01:14:32,924 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/leader/metadata-v1-1.log
01:14:32,924 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: no eligible files found
01:14:32,924 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [07/12/2025 01:14:32.924] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower166]: org.opendaylight.controller.cluster.common.actor.Monitor@316cc7eb
01:14:32,925 AM [test-pekko.actor.default-dispatcher-12] [INFO] RaftActor - follower: Starting recovery with journal batch size 1000
01:14:32,926 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower: started executor
01:14:32,926 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower: started executor
01:14:32,926 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower: metadata journal open: replayFrom=1 applyTo=0
01:14:32,928 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - follower: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:32,928 AM [test-pekko.actor.default-dispatcher-12] [INFO] EnabledRaftStorage - follower: journal open: applyTo=0
01:14:32,928 AM [follower-writer-62] [DEBUG] JournalWriteTask - follower: journal writer started
01:14:32,928 AM [follower-writer-62] [DEBUG] JournalWriteTask - follower: waiting to receive commands
01:14:32,929 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:32,929 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=}
01:14:32,929 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:32,929 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:32,929 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [follower2, follower]
01:14:32,930 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower2: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:32,930 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:32,930 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower/TermInfo.properties does not exist
01:14:32,930 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower/journal-v1-1.log
01:14:32,930 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower/metadata-v1-1.log
01:14:32,930 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorage - follower: no eligible files found
01:14:32,930 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [07/12/2025 01:14:32.930] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower2167]: org.opendaylight.controller.cluster.common.actor.Monitor@53344f32
01:14:32,931 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - follower2: Starting recovery with journal batch size 1000
01:14:32,931 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower2: started executor
01:14:32,931 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower2: started executor
01:14:32,932 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower2: metadata journal open: replayFrom=1 applyTo=0
01:14:32,932 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=0, votedFor=null
01:14:32,932 AM [test-pekko.actor.default-dispatcher-15] [INFO] PekkoRecovery - follower: Local TermInfo store seeded with TermInfo{term=0}
01:14:32,932 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower: Pekko recovery completed and can restore from snapshot
01:14:32,932 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - follower: no journal: skipping journal recovery
01:14:32,933 AM [test-pekko.actor.default-dispatcher-15] [INFO] Follower - follower (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term
01:14:32,933 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower2: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:32,933 AM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - follower2: journal open: applyTo=0
01:14:32,933 AM [follower2-writer-63] [DEBUG] JournalWriteTask - follower2: journal writer started
01:14:32,933 AM [follower2-writer-63] [DEBUG] JournalWriteTask - follower2: waiting to receive commands
01:14:32,934 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower2/TermInfo.properties does not exist
01:14:32,934 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower2/journal-v1-1.log
01:14:32,934 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower2/metadata-v1-1.log
01:14:32,934 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - follower2: no eligible files found
01:14:32,934 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower2: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:32,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=1, votedFor=null
01:14:32,936 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower: Last sync leader does not match current leader leader, need to catch up to -1
01:14:32,936 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: -1, nextIndex: 0
[WARN] [07/12/2025 01:14:32.936] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower166] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower, initialSyncDone=false]
01:14:32,937 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:32,937 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower2: Set currentTerm=0, votedFor=null
01:14:32,937 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - follower2: Local TermInfo store seeded with TermInfo{term=0}
01:14:32,937 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower2: Pekko recovery completed and can restore from snapshot
01:14:32,937 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower2: no journal: skipping journal recovery
01:14:32,938 AM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower2 (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term
01:14:32,939 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower2: Set currentTerm=1, votedFor=null
01:14:32,940 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower2: Last sync leader does not match current leader leader, need to catch up to -1
01:14:32,940 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower2 updated: matchIndex: -1, nextIndex: 0
01:14:32,940 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/12/2025 01:14:32.940] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower2167] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower2, initialSyncDone=false]
01:14:32,943 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={leader=false}, serversVisited=[]], state: Idle
01:14:32,944 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState
01:14:32,944 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - leader: Updated server config: isVoting: false, peers: [PeerInfo [id=follower2, address=pekko://test/user/follower2167, votingState=VOTING], PeerInfo [id=follower, address=pekko://test/user/follower166, votingState=VOTING]]
01:14:32,944 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]
01:14:32,944 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActor - leader: Persist data index=0 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}
01:14:32,944 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}, pending=true} 
01:14:32,944 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=bc5d972c-1a97-4af1-b089-fa989933c27f}, logIndex: 0, isSendImmediate: true
01:14:32,944 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:32,944 AM [leader-%d970948] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/leader/snapshot-000000006871B6F8-384ACDCE.tmp
01:14:32,944 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:32,944 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower follower2
01:14:32,944 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower follower2: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}, pending=true}]}
01:14:32,944 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:32,944 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower follower
01:14:32,944 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower follower: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}, pending=true}]}
01:14:32,944 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation ChangeServersVotingStatus [serverVotingStatusMap={leader=false}, serversVisited=[]]
01:14:32,945 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}, pending=true}]}
01:14:32,945 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower (Follower): Number of entries to be appended = 1
01:14:32,945 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
01:14:32,945 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}
01:14:32,945 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}, pending=true} 
01:14:32,945 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] PeerInfos - follower: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=pekko://test/user/leader168, votingState=NON_VOTING], PeerInfo [id=follower2, address=pekko://test/user/follower2167, votingState=VOTING]]
01:14:32,945 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower (Follower): Log size is now 1
01:14:32,945 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] Follower - follower (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:32,945 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached -1 (of expected -1)
01:14:32,945 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - follower: awaiting more completions to resolve 1 synchronized callback(s)
01:14:32,945 AM [follower-%d881567] [DEBUG] RaftStorage - follower: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower/snapshot-000000006871B6F8-38587360.tmp
01:14:32,945 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower2 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}, pending=true}]}
01:14:32,945 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower2 (Follower): Number of entries to be appended = 1
01:14:32,945 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower2 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
01:14:32,945 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower2 (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}
01:14:32,945 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower2: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}, pending=true} 
01:14:32,946 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: 0, nextIndex: 1
01:14:32,946 AM [follower2-%d468600] [DEBUG] RaftStorage - follower2: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower2/snapshot-000000006871B6F8-38637C06.tmp
01:14:32,946 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:32,946 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - follower2: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=pekko://test/user/leader168, votingState=NON_VOTING], PeerInfo [id=follower, address=pekko://test/user/follower166, votingState=VOTING]]
01:14:32,946 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower2 (Follower): Log size is now 1
01:14:32,946 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower2 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower2, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:32,946 AM [leader-%d970948] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/leader/snapshot-000000006871B6F8-384ACDCE.v1
01:14:32,947 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower2: Lagging 0 entries behind leader leader and reached -1 (of expected -1)
01:14:32,947 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower2: awaiting more completions to resolve 1 synchronized callback(s)
01:14:32,947 AM [leader-%d970948] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/leader/snapshot-000000006871B6F8-384ACDCE.v1
01:14:32,947 AM [leader-%d970948] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/leader/TermInfo.properties
01:14:32,947 AM [leader-%d970948] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/leader/journal-v1-1.log
01:14:32,947 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower2 updated: matchIndex: 0, nextIndex: 1
01:14:32,947 AM [leader-%d970948] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/leader/metadata-v1-1.log
01:14:32,947 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:32,947 AM [leader-%d970948] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:32.944426446Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/leader/snapshot-000000006871B6F8-384ACDCE.v1, size=96, entryCompress=NONE, stateCompress=NONE}
01:14:32,947 AM [leader-%d970948] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:32,947 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:32,947 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}, pending=true}
01:14:32,947 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
01:14:32,947 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorBehavior - leader (Leader): Setting last applied to 0
01:14:32,947 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractReplicatedLog - leader: Moving last applied index from -1 to 0
01:14:32,947 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}
01:14:32,948 AM [follower-%d881567] [DEBUG] RaftStorage - follower: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower/snapshot-000000006871B6F8-38587360.v1
01:14:32,948 AM [follower-%d881567] [DEBUG] RaftStorage - follower: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower/snapshot-000000006871B6F8-38587360.v1
01:14:32,948 AM [follower-%d881567] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower/TermInfo.properties
01:14:32,948 AM [follower-%d881567] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower/journal-v1-1.log
01:14:32,948 AM [follower-%d881567] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower/metadata-v1-1.log
01:14:32,948 AM [follower-%d881567] [DEBUG] RaftStorage - follower: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:32.945320800Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower/snapshot-000000006871B6F8-38587360.v1, size=96, entryCompress=NONE, stateCompress=NONE}
01:14:32,948 AM [follower-%d881567] [DEBUG] RaftStorageCompleter - follower: 1 completion(s) pending
01:14:32,948 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - follower: running 1 completion(s)
01:14:32,948 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] ReplicatedLogImpl - follower: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}, pending=false}
01:14:32,948 AM [follower2-%d468600] [DEBUG] RaftStorage - follower2: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower2/snapshot-000000006871B6F8-38637C06.v1
01:14:32,948 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - follower: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@787b28d4}
01:14:32,948 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorVotingConfigSupport - leader: VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]} has been successfully replicated to a majority of followers
01:14:32,948 AM [test-pekko.actor.default-dispatcher-15] [DEBUG] RaftStorageCompleter - follower: synchronized callbacks after 3.466 ms
01:14:32,949 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorVotingConfigSupport - Leader changed to non-voting - trying leadership transfer
01:14:32,949 AM [follower2-%d468600] [DEBUG] RaftStorage - follower2: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower2/snapshot-000000006871B6F8-38637C06.v1
[WARN] [07/12/2025 01:14:32.949] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower166] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower, initialSyncDone=true]
01:14:32,949 AM [follower2-%d468600] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower2/TermInfo.properties
01:14:32,949 AM [follower2-%d468600] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower2/journal-v1-1.log
01:14:32,949 AM [follower2-%d468600] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower2/metadata-v1-1.log
01:14:32,949 AM [follower2-%d468600] [DEBUG] RaftStorage - follower2: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:32.946043910Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9982201313744087579/follower2/snapshot-000000006871B6F8-38637C06.v1, size=96, entryCompress=NONE, stateCompress=NONE}
01:14:32,949 AM [follower2-%d468600] [DEBUG] RaftStorageCompleter - follower2: 1 completion(s) pending
01:14:32,949 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - leader: Initiating leader transfer
01:14:32,950 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower2: running 1 completion(s)
01:14:32,950 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower2: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}, pending=false}
01:14:32,950 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower2: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@20b421c9}
01:14:32,950 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower2: synchronized callbacks after 3.455 ms
[WARN] [07/12/2025 01:14:32.950] [test-pekko.actor.default-dispatcher-15] [pekko://test/user/follower2167] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower2, initialSyncDone=true]
01:14:32,950 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower2: onLeaderTransitioning: LeaderTransitioning [leaderId=leader]
01:14:32,950 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower: onLeaderTransitioning: LeaderTransitioning [leaderId=leader]
01:14:32,952 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActorLeadershipTransferCohort - leader: pauseLeader successfully completed - doing transfer
01:14:32,952 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] Leader - leader (Leader): Attempting to transfer leadership
01:14:32,953 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:32,953 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:32,953 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower (Follower): Commit index set to 0
01:14:32,953 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower2 (Follower): Commit index set to 0
01:14:32,953 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
01:14:32,953 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
01:14:32,953 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower (Follower): Setting last applied to 0
01:14:32,953 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower2: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
01:14:32,953 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower: Moving last applied index from -1 to 0
01:14:32,953 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] Follower - follower2 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
01:14:32,953 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - follower2 (Follower): Setting last applied to 0
01:14:32,953 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}
01:14:32,953 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - follower2: Moving last applied index from -1 to 0
01:14:32,953 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower2: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=false]]}
01:14:32,953 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Leader - leader (Leader): tryToCompleteLeadershipTransfer: followerId: follower, matchIndex: 0, lastIndex: 0, isVoting: true
01:14:32,954 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Leader - leader (Leader): Follower's log matches - sending ElectionTimeout
01:14:32,954 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:32,954 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:32,954 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Leader - leader (Leader): Leader transfer complete
01:14:32,954 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorLeadershipTransferCohort - leader: leader transfer complete - waiting for new leader
01:14:32,954 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower2: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
01:14:32,954 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
01:14:32,954 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:32,954 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower (Follower): Received TimeoutNow - switching to Candidate
01:14:32,954 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - follower (Candidate): Election: Candidate has following voting peers: [follower2]
01:14:32,956 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=2, votedFor=follower
01:14:32,956 AM [test-pekko.actor.default-dispatcher-16] [INFO] Candidate - follower (Candidate): Starting new election term 2
01:14:32,956 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - follower (Candidate): Sending RequestVote{term=2, candidateId=follower, lastLogIndex=0, lastLogTerm=1} to peer follower2
01:14:32,956 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - follower (Follower) :- Switching from behavior Follower to Candidate, election term: 2
01:14:32,956 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower2 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:32,956 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower2 (Follower): Cluster state: []
01:14:32,956 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower2 (Follower): Candidate in requestVote:RequestVote{term=2, candidateId=follower, lastLogIndex=0, lastLogTerm=1} with higher term appears reachable, updating term.
01:14:32,956 AM [test-pekko.actor.default-dispatcher-12] [INFO] Follower - follower2 (Follower): Term 2 in "RequestVote{term=2, candidateId=follower, lastLogIndex=0, lastLogTerm=1}" message is greater than follower's term 1 - updating term
01:14:32,959 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower2: Set currentTerm=2, votedFor=null
01:14:32,959 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower2 (Follower): In requestVote: RequestVote{term=2, candidateId=follower, lastLogIndex=0, lastLogTerm=1} - currentTerm: 2, votedFor: null, lastIndex: 0, lastTerm: 1
01:14:32,961 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - follower2: Set currentTerm=2, votedFor=follower
01:14:32,961 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower2 (Follower): requestVote returning: RequestVoteReply{term=2, voteGranted=true}
01:14:32,961 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - follower (Candidate): RaftRPC message received RequestVoteReply{term=2, voteGranted=true}, my term is 2
01:14:32,961 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Candidate - follower (Candidate): handleRequestVoteReply: RequestVoteReply{term=2, voteGranted=true}, current voteCount: 1
01:14:32,961 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - follower (Leader): Election: Leader has following peers: [leader, follower2]
01:14:32,961 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - follower (Leader): Checking sendAppendEntries for follower leader: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:32,961 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - follower (Leader): Checking sendAppendEntries for follower follower2: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:32,961 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorBehavior - follower (Candidate) :- Switching from behavior Candidate to Leader, election term: 2
01:14:32,961 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower2: Last sync leader does not match current leader follower, need to catch up to -1
01:14:32,962 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - follower (Leader): handleAppendEntriesReply - FollowerLogInformation for follower2 updated: matchIndex: 0, nextIndex: 1
01:14:32,962 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - follower (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:32,962 AM [test-pekko.actor.default-dispatcher-7] [INFO] AbstractLeader - leader (Leader): Term 2 in "AppendEntries{term=2, leaderId=follower, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than leader's term 1 - switching to Follower
01:14:32,962 AM [test-pekko.actor.default-dispatcher-5] [DEBUG] SyncStatusTracker - follower2: Lagging 0 entries behind leader follower and reached 0 (of expected -1)
[WARN] [07/12/2025 01:14:32.962] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower2167] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower2, initialSyncDone=false]
[WARN] [07/12/2025 01:14:32.962] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower2167] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower2, initialSyncDone=true]
01:14:32,964 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=2, votedFor=null
01:14:32,964 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActorBehavior - leader (Leader) :- Switching from behavior Leader to Follower, election term: 2
01:14:33,476 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] SyncStatusTracker - follower2: Lagging 0 entries behind leader follower and reached 0 (of expected -1)
01:14:33,477 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - leader: Last sync leader does not match current leader follower, need to catch up to -1
01:14:33,477 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - follower (Leader): handleAppendEntriesReply - FollowerLogInformation for leader updated: matchIndex: 0, nextIndex: 1
01:14:33,477 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorLeadershipTransferCohort - leader: leader changed to follower
01:14:33,477 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - follower (Leader): Checking sendAppendEntries for follower leader: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:33,477 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorLeadershipTransferCohort - leader: Successfully transferred leadership to follower in 527.2 ms
01:14:33,477 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader: leader transfer succeeded after change to non-voting
[WARN] [07/12/2025 01:14:33.478] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/leader168] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=leader, initialSyncDone=false]
01:14:33,482 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - leader: Lagging 0 entries behind leader follower and reached 0 (of expected -1)
[WARN] [07/12/2025 01:14:33.482] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/leader168] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=leader, initialSyncDone=true]
01:14:33,498 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeLeaderToNonVoting ending
01:14:33,498 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower165]
01:14:33,509 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader168]
01:14:33,510 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#546,leader-writer-61]/waiting
01:14:33,510 AM [leader-writer-61] [DEBUG] JournalWriteTask - leader: received 1 commands after 589.1 ms
01:14:33,510 AM [leader-writer-61] [DEBUG] JournalWriteTask - leader: completed 1 commands in 28.74 μs
01:14:33,510 AM [leader-writer-61] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:33,511 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:33,511 AM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - leader: journal closed
01:14:33,511 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:33,511 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:33,511 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector169]
01:14:33,512 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector170#-1495613377]
01:14:33,512 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower166]
01:14:33,512 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EnabledRaftStorage - follower: terminating thread VirtualThread[#547,follower-writer-62]/waiting
01:14:33,512 AM [follower-writer-62] [DEBUG] JournalWriteTask - follower: received 1 commands after 583.9 ms
01:14:33,512 AM [follower-writer-62] [DEBUG] JournalWriteTask - follower: completed 1 commands in 17.82 μs
01:14:33,512 AM [follower-writer-62] [DEBUG] JournalWriteTask - follower: journal writer stopped
01:14:33,513 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower: journal closed
01:14:33,513 AM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - follower: journal closed
01:14:33,513 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks
01:14:33,513 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks
01:14:33,513 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector171#-1749270206]
01:14:33,513 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower2167]
01:14:33,513 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EnabledRaftStorage - follower2: terminating thread VirtualThread[#548,follower2-writer-63]/waiting
01:14:33,514 AM [follower2-writer-63] [DEBUG] JournalWriteTask - follower2: received 1 commands after 580.6 ms
01:14:33,514 AM [follower2-writer-63] [DEBUG] JournalWriteTask - follower2: completed 1 commands in 17.61 μs
01:14:33,514 AM [follower2-writer-63] [DEBUG] JournalWriteTask - follower2: journal writer stopped
01:14:33,514 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower2: journal closed
01:14:33,514 AM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - follower2: journal closed
01:14:33,514 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower2: stopped executor with 0 remaining tasks
01:14:33,514 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower2: stopped executor with 0 remaining tasks
01:14:33,517 AM [main] [INFO] RaftActorVotingConfigSupportTest - testOnApplyState starting
01:14:33,520 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:33,520 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: started executor
01:14:33,520 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: started executor
01:14:33,521 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:33,521 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:33,521 AM [test-pekko.actor.default-dispatcher-18] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:33,521 AM [leader-writer-64] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:33,521 AM [leader-writer-64] [DEBUG] JournalWriteTask - leader: waiting to receive commands
[WARN] [07/12/2025 01:14:33.521] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader173]: org.opendaylight.controller.cluster.common.actor.Monitor@12523916
01:14:33,522 AM [main] [INFO] RaftActorVotingConfigSupportTest - testOnApplyState ending
01:14:33,522 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower172]
01:14:33,523 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7487656482926890569/leader/TermInfo.properties does not exist
01:14:33,523 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7487656482926890569/leader/journal-v1-1.log
01:14:33,523 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7487656482926890569/leader/metadata-v1-1.log
01:14:33,523 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: no eligible files found
01:14:33,523 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:33,526 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=0, votedFor=null
01:14:33,526 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=0}
01:14:33,526 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:33,526 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:33,533 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader173]
01:14:33,533 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#554,leader-writer-64]/waiting
01:14:33,533 AM [leader-writer-64] [DEBUG] JournalWriteTask - leader: received 1 commands after 11.53 ms
01:14:33,533 AM [leader-writer-64] [DEBUG] JournalWriteTask - leader: completed 1 commands in 25.10 μs
01:14:33,533 AM [leader-writer-64] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:33,533 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:33,533 AM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - leader: journal closed
01:14:33,534 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:33,534 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:33,536 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServer starting
[WARN] [07/12/2025 01:14:33.537] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader177]: org.opendaylight.controller.cluster.common.actor.Monitor@90c6f4
01:14:33,538 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:33,538 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:33,538 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor
01:14:33,538 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - leader: started executor
01:14:33,539 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:33,540 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:33,540 AM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:33,540 AM [leader-writer-65] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:33,540 AM [leader-writer-65] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:33,541 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/leader/TermInfo.properties does not exist
01:14:33,541 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/leader/journal-v1-1.log
01:14:33,541 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/leader/metadata-v1-1.log
01:14:33,541 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: no eligible files found
01:14:33,541 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [07/12/2025 01:14:33.542] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower175]: org.opendaylight.controller.cluster.common.actor.Monitor@5ebf62fc
01:14:33,542 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - follower: Starting recovery with journal batch size 1000
01:14:33,543 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower: started executor
01:14:33,543 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower: started executor
01:14:33,543 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower: metadata journal open: replayFrom=1 applyTo=0
01:14:33,543 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:33,543 AM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - follower: journal open: applyTo=0
01:14:33,544 AM [follower-writer-66] [DEBUG] JournalWriteTask - follower: journal writer started
01:14:33,544 AM [follower-writer-66] [DEBUG] JournalWriteTask - follower: waiting to receive commands
01:14:33,544 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:33,544 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=}
01:14:33,544 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:33,544 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:33,544 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [follower2, follower, downNode]
01:14:33,544 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower2: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:33,544 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/12/2025 01:14:33.544] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower2176] received dead letter from TestActor[pekko://test/user/leader177]: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
01:14:33,544 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower downNode: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:33,545 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/follower/TermInfo.properties does not exist
[WARN] [07/12/2025 01:14:33.545] [test-pekko.actor.default-dispatcher-7] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader177]: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
01:14:33,545 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/follower/journal-v1-1.log
01:14:33,545 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/follower/metadata-v1-1.log
01:14:33,545 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower: no eligible files found
01:14:33,545 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [07/12/2025 01:14:33.545] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower2176]: org.opendaylight.controller.cluster.common.actor.Monitor@12e7090d
01:14:33,546 AM [test-pekko.actor.default-dispatcher-7] [INFO] RaftActor - follower2: Starting recovery with journal batch size 1000
01:14:33,546 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower2: started executor
01:14:33,546 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower2: started executor
01:14:33,546 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower2: metadata journal open: replayFrom=1 applyTo=0
01:14:33,547 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] EntryJournalV1 - follower2: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:33,547 AM [test-pekko.actor.default-dispatcher-7] [INFO] EnabledRaftStorage - follower2: journal open: applyTo=0
01:14:33,547 AM [follower2-writer-67] [DEBUG] JournalWriteTask - follower2: journal writer started
01:14:33,547 AM [follower2-writer-67] [DEBUG] JournalWriteTask - follower2: waiting to receive commands
01:14:33,548 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/follower2/TermInfo.properties does not exist
01:14:33,548 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/follower2/journal-v1-1.log
01:14:33,548 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/follower2/metadata-v1-1.log
01:14:33,548 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower2: no eligible files found
01:14:33,548 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower2: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:33,549 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=0, votedFor=null
01:14:33,549 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - follower: Local TermInfo store seeded with TermInfo{term=0}
01:14:33,549 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower: Pekko recovery completed and can restore from snapshot
01:14:33,549 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower: no journal: skipping journal recovery
01:14:33,550 AM [test-pekko.actor.default-dispatcher-18] [INFO] Follower - follower (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term
01:14:33,550 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - follower2: Set currentTerm=0, votedFor=null
01:14:33,550 AM [test-pekko.actor.default-dispatcher-6] [INFO] PekkoRecovery - follower2: Local TermInfo store seeded with TermInfo{term=0}
01:14:33,550 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower2: Pekko recovery completed and can restore from snapshot
01:14:33,550 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - follower2: no journal: skipping journal recovery
01:14:33,551 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: onRemoveServer: RemoveServer{serverId='follower'}, state: Idle
01:14:33,551 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=downNode, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]
01:14:33,551 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: Persist data index=0 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=downNode, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,551 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=downNode, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:33,551 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=1, votedFor=null
01:14:33,551 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower: Last sync leader does not match current leader leader, need to catch up to -1
[WARN] [07/12/2025 01:14:33.551] [test-pekko.actor.default-dispatcher-7] [pekko://test/user/follower175] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower, initialSyncDone=false]
01:14:33,552 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=0d5352f4-ca16-42a5-8891-6cf3f0105e1c}, logIndex: 0, isSendImmediate: true
01:14:33,552 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:33,552 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower2: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:33,552 AM [leader-%d902668] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/leader/snapshot-000000006871B6F9-20E5E38A.tmp
01:14:33,552 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower downNode: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:33,552 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation RemoveServer{serverId='follower'}
01:14:33,552 AM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - follower2 (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term
[WARN] [07/12/2025 01:14:33.552] [test-pekko.actor.default-dispatcher-18] [pekko://test/] unhandled message from TestActor[pekko://test/user/leader177]: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}
01:14:33,552 AM [test-pekko.actor.default-dispatcher-6] [ERROR] AbstractLeader - leader (Leader): handleAppendEntriesReply - unknown follower follower
01:14:33,554 AM [leader-%d902668] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/leader/snapshot-000000006871B6F9-20E5E38A.v1
01:14:33,554 AM [leader-%d902668] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/leader/snapshot-000000006871B6F9-20E5E38A.v1
01:14:33,554 AM [leader-%d902668] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/leader/TermInfo.properties
01:14:33,554 AM [leader-%d902668] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/leader/journal-v1-1.log
01:14:33,554 AM [leader-%d902668] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/leader/metadata-v1-1.log
01:14:33,554 AM [leader-%d902668] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.551936906Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/leader/snapshot-000000006871B6F9-20E5E38A.v1, size=96, entryCompress=NONE, stateCompress=NONE}
01:14:33,554 AM [leader-%d902668] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:33,554 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:33,554 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=downNode, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}
01:14:33,555 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower2: Set currentTerm=1, votedFor=null
01:14:33,555 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower2: Last sync leader does not match current leader leader, need to catch up to -1
01:14:33,555 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower2 updated: matchIndex: -1, nextIndex: 0
[WARN] [07/12/2025 01:14:33.555] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower2176] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower2, initialSyncDone=false]
01:14:33,555 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:33,555 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower follower2
01:14:33,555 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower follower2: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=downNode, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}]}
01:14:33,555 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower2 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=downNode, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}]}
01:14:33,555 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower2 (Follower): Number of entries to be appended = 1
01:14:33,555 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower2 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
01:14:33,555 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower2 (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=downNode, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,555 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower2: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=downNode, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false} 
01:14:33,555 AM [follower2-%d939879] [DEBUG] RaftStorage - follower2: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/follower2/snapshot-000000006871B6F9-211F5C7B.tmp
01:14:33,555 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PeerInfos - follower2: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=pekko://test/user/leader177, votingState=VOTING], PeerInfo [id=downNode, address=, votingState=VOTING]]
01:14:33,555 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower2 (Follower): Log size is now 1
01:14:33,555 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower2 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower2, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:33,555 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower2: Lagging 0 entries behind leader leader and reached -1 (of expected -1)
01:14:33,555 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - follower2: awaiting more completions to resolve 1 synchronized callback(s)
01:14:33,555 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower2 updated: matchIndex: 0, nextIndex: 1
01:14:33,556 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1
01:14:33,556 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader (Leader): Setting last applied to 0
01:14:33,556 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader: Moving last applied index from -1 to 0
01:14:33,556 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=downNode, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,556 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:33,556 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorVotingConfigSupport - leader: VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=downNode, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]} has been successfully replicated to a majority of followers
[WARN] [07/12/2025 01:14:33.556] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/follower175] unhandled message from TestActor[pekko://test/user/leader177]: ServerRemoved [serverId=follower]
01:14:33,557 AM [follower2-%d939879] [DEBUG] RaftStorage - follower2: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/follower2/snapshot-000000006871B6F9-211F5C7B.v1
01:14:33,557 AM [follower2-%d939879] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/follower2/TermInfo.properties
01:14:33,557 AM [follower2-%d939879] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/follower2/journal-v1-1.log
01:14:33,557 AM [follower2-%d939879] [DEBUG] RaftStorage - follower2: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/follower2/snapshot-000000006871B6F9-211F5C7B.v1
01:14:33,557 AM [follower2-%d939879] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/follower2/metadata-v1-1.log
01:14:33,557 AM [follower2-%d939879] [DEBUG] RaftStorage - follower2: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.555703419Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest7256622667822430679/follower2/snapshot-000000006871B6F9-211F5C7B.v1, size=96, entryCompress=NONE, stateCompress=NONE}
01:14:33,557 AM [follower2-%d939879] [DEBUG] RaftStorageCompleter - follower2: 1 completion(s) pending
01:14:33,557 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - follower2: running 1 completion(s)
01:14:33,557 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower2: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=downNode, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}
01:14:33,557 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - follower2: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=downNode, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@375e49e1}
01:14:33,557 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - follower2: synchronized callbacks after 1.624 ms
01:14:33,557 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower2 (Follower): Commit index set to 0
01:14:33,557 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower2: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
01:14:33,557 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower2 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
01:14:33,557 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower2 (Follower): Setting last applied to 0
01:14:33,557 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower2: Moving last applied index from -1 to 0
01:14:33,557 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower2: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=true], ServerInfo[peerId=downNode, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
[WARN] [07/12/2025 01:14:33.557] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower2176] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower2, initialSyncDone=true]
01:14:33,604 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServer ending
01:14:33,604 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower174]
01:14:33,605 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader177]
01:14:33,606 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#555,leader-writer-65]/waiting
01:14:33,606 AM [leader-writer-65] [DEBUG] JournalWriteTask - leader: received 1 commands after 66.12 ms
01:14:33,606 AM [leader-writer-65] [DEBUG] JournalWriteTask - leader: completed 1 commands in 43.31 μs
01:14:33,606 AM [leader-writer-65] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:33,607 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:33,607 AM [test-pekko.actor.default-dispatcher-18] [INFO] EnabledRaftStorage - leader: journal closed
01:14:33,607 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:33,607 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:33,607 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector178]
01:14:33,608 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector179#1696552642]
01:14:33,608 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower175]
01:14:33,608 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EnabledRaftStorage - follower: terminating thread VirtualThread[#556,follower-writer-66]/waiting
01:14:33,608 AM [follower-writer-66] [DEBUG] JournalWriteTask - follower: received 1 commands after 64.86 ms
01:14:33,609 AM [follower-writer-66] [DEBUG] JournalWriteTask - follower: completed 1 commands in 19.40 μs
01:14:33,609 AM [follower-writer-66] [DEBUG] JournalWriteTask - follower: journal writer stopped
01:14:33,609 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower: journal closed
01:14:33,609 AM [test-pekko.actor.default-dispatcher-18] [INFO] EnabledRaftStorage - follower: journal closed
01:14:33,609 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks
01:14:33,609 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks
01:14:33,609 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector180#-1221425319]
01:14:33,609 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower2176]
01:14:33,610 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EnabledRaftStorage - follower2: terminating thread VirtualThread[#557,follower2-writer-67]/waiting
01:14:33,610 AM [follower2-writer-67] [DEBUG] JournalWriteTask - follower2: received 1 commands after 62.61 ms
01:14:33,610 AM [follower2-writer-67] [DEBUG] JournalWriteTask - follower2: completed 1 commands in 17.61 μs
01:14:33,610 AM [follower2-writer-67] [DEBUG] JournalWriteTask - follower2: journal writer stopped
01:14:33,610 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower2: journal closed
01:14:33,610 AM [test-pekko.actor.default-dispatcher-18] [INFO] EnabledRaftStorage - follower2: journal closed
01:14:33,610 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower2: stopped executor with 0 remaining tasks
01:14:33,610 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower2: stopped executor with 0 remaining tasks
01:14:33,613 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithNoLeader starting
01:14:33,615 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000
01:14:33,616 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - new-server: started executor
01:14:33,616 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - new-server: started executor
01:14:33,617 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0
[WARN] [07/12/2025 01:14:33.616] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server183]: org.opendaylight.controller.cluster.common.actor.Monitor@54af463d
01:14:33,617 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:33,617 AM [test-pekko.actor.default-dispatcher-18] [INFO] EnabledRaftStorage - new-server: journal open: applyTo=0
01:14:33,617 AM [new-server-writer-68] [DEBUG] JournalWriteTask - new-server: journal writer started
01:14:33,617 AM [new-server-writer-68] [DEBUG] JournalWriteTask - new-server: waiting to receive commands
01:14:33,618 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8316276360429962038/new-server/TermInfo.properties does not exist
01:14:33,619 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8316276360429962038/new-server/journal-v1-1.log
01:14:33,619 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8316276360429962038/new-server/metadata-v1-1.log
01:14:33,619 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - new-server: no eligible files found
01:14:33,619 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:33,622 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null
01:14:33,622 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0}
01:14:33,622 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot
01:14:33,622 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery
01:14:33,622 AM [test-pekko.actor.default-dispatcher-18] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
[WARN] [07/12/2025 01:14:33.623] [test-pekko.actor.default-dispatcher-6] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader184]: org.opendaylight.controller.cluster.common.actor.Monitor@6270b16c
01:14:33,623 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:33,623 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: started executor
01:14:33,623 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: started executor
01:14:33,624 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:33,624 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:33,624 AM [test-pekko.actor.default-dispatcher-18] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:33,624 AM [leader-writer-69] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:33,624 AM [leader-writer-69] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:33,625 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8316276360429962038/leader/TermInfo.properties does not exist
01:14:33,626 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8316276360429962038/leader/journal-v1-1.log
01:14:33,626 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest8316276360429962038/leader/metadata-v1-1.log
01:14:33,626 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: no eligible files found
01:14:33,626 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:33,627 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=0, votedFor=null
01:14:33,627 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=0}
01:14:33,627 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:33,627 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:33,629 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server183, votingMember=true], state: Idle
01:14:33,629 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: No leader - returning NO_LEADER reply
01:14:33,629 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithNoLeader ending
01:14:33,629 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower181]
01:14:33,630 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector182#-1439546035]
01:14:33,630 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server183]
01:14:33,630 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EnabledRaftStorage - new-server: terminating thread VirtualThread[#560,new-server-writer-68]/waiting
01:14:33,630 AM [new-server-writer-68] [DEBUG] JournalWriteTask - new-server: received 1 commands after 13.09 ms
01:14:33,630 AM [new-server-writer-68] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 38.03 μs
01:14:33,630 AM [new-server-writer-68] [DEBUG] JournalWriteTask - new-server: journal writer stopped
01:14:33,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - new-server: journal closed
01:14:33,631 AM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - new-server: journal closed
01:14:33,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:33,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:33,631 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader184]
01:14:33,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#561,leader-writer-69]/waiting
01:14:33,631 AM [leader-writer-69] [DEBUG] JournalWriteTask - leader: received 1 commands after 6.714 ms
01:14:33,631 AM [leader-writer-69] [DEBUG] JournalWriteTask - leader: completed 1 commands in 17.02 μs
01:14:33,631 AM [leader-writer-69] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:33,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:33,631 AM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - leader: journal closed
01:14:33,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:33,631 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:33,634 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeServersVotingStatus starting
[WARN] [07/12/2025 01:14:33.635] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader188]: org.opendaylight.controller.cluster.common.actor.Monitor@500119a0
01:14:33,636 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:33,636 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:33,636 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: started executor
01:14:33,636 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - leader: started executor
01:14:33,637 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:33,637 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:33,637 AM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:33,637 AM [leader-writer-70] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:33,637 AM [leader-writer-70] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:33,638 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/TermInfo.properties does not exist
01:14:33,639 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/journal-v1-1.log
01:14:33,639 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/metadata-v1-1.log
01:14:33,639 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: no eligible files found
01:14:33,639 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
[WARN] [07/12/2025 01:14:33.639] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower186]: org.opendaylight.controller.cluster.common.actor.Monitor@8755cd4
01:14:33,639 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower: Starting recovery with journal batch size 1000
01:14:33,640 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower: started executor
01:14:33,640 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower: started executor
01:14:33,640 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower: metadata journal open: replayFrom=1 applyTo=0
01:14:33,640 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:33,640 AM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - follower: journal open: applyTo=0
01:14:33,640 AM [follower-writer-71] [DEBUG] JournalWriteTask - follower: journal writer started
01:14:33,640 AM [follower-writer-71] [DEBUG] JournalWriteTask - follower: waiting to receive commands
[WARN] [07/12/2025 01:14:33.641] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower2187]: org.opendaylight.controller.cluster.common.actor.Monitor@4f8cdeeb
01:14:33,641 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/TermInfo.properties does not exist
01:14:33,642 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/journal-v1-1.log
01:14:33,642 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/metadata-v1-1.log
01:14:33,642 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActor - follower2: Starting recovery with journal batch size 1000
01:14:33,642 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftStorage - follower: no eligible files found
01:14:33,642 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:33,642 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower2: started executor
01:14:33,642 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorage - follower2: started executor
01:14:33,642 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower2: metadata journal open: replayFrom=1 applyTo=0
01:14:33,643 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] EntryJournalV1 - follower2: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:33,643 AM [test-pekko.actor.default-dispatcher-6] [INFO] EnabledRaftStorage - follower2: journal open: applyTo=0
01:14:33,643 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:33,643 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=}
01:14:33,643 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:33,643 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:33,643 AM [follower2-writer-72] [DEBUG] JournalWriteTask - follower2: journal writer started
01:14:33,643 AM [follower2-writer-72] [DEBUG] JournalWriteTask - follower2: waiting to receive commands
01:14:33,643 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [follower2, follower]
01:14:33,643 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower2: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:33,643 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:33,644 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/TermInfo.properties does not exist
01:14:33,644 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/journal-v1-1.log
01:14:33,644 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/metadata-v1-1.log
01:14:33,644 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower2: no eligible files found
01:14:33,644 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower2: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:33,644 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=0, votedFor=null
01:14:33,644 AM [test-pekko.actor.default-dispatcher-7] [INFO] PekkoRecovery - follower: Local TermInfo store seeded with TermInfo{term=0}
01:14:33,644 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower: Pekko recovery completed and can restore from snapshot
01:14:33,644 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] RaftActor - follower: no journal: skipping journal recovery
01:14:33,644 AM [test-pekko.actor.default-dispatcher-7] [INFO] Follower - follower (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term
01:14:33,645 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={follower2=false, follower=false}, serversVisited=[]], state: Idle
01:14:33,645 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState
01:14:33,645 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] PeerInfos - leader: Updated server config: isVoting: true, peers: [PeerInfo [id=follower2, address=pekko://test/user/follower2187, votingState=NON_VOTING], PeerInfo [id=follower, address=pekko://test/user/follower186, votingState=NON_VOTING]]
01:14:33,645 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]
01:14:33,645 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: Persist data index=0 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,645 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:33,645 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=290d424d-ba2d-45ff-87fd-6df91b2aa3b4}, logIndex: 0, isSendImmediate: true
01:14:33,645 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorBehavior - leader (Leader): Setting last applied to 0
01:14:33,645 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractReplicatedLog - leader: Moving last applied index from -1 to 0
01:14:33,645 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActor - leader: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,645 AM [leader-%d870753] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/snapshot-000000006871B6F9-267AA67D.tmp
01:14:33,645 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower2: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:33,645 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: false, followerNextIndex: -1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:33,645 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation ChangeServersVotingStatus [serverVotingStatusMap={follower2=false, follower=false}, serversVisited=[]]
01:14:33,646 AM [test-pekko.actor.default-dispatcher-6] [INFO] RaftActorVotingConfigSupport - leader: VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]} has been successfully replicated to a majority of followers
01:14:33,646 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower2: Set currentTerm=0, votedFor=null
01:14:33,646 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower2: Local TermInfo store seeded with TermInfo{term=0}
01:14:33,646 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower2: Pekko recovery completed and can restore from snapshot
01:14:33,646 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower2: no journal: skipping journal recovery
01:14:33,647 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - follower2 (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term
01:14:33,647 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=1, votedFor=null
01:14:33,647 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower: Last sync leader does not match current leader leader, need to catch up to -1
01:14:33,647 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: -1, nextIndex: 0
01:14:33,647 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:33,647 AM [test-pekko.actor.default-dispatcher-7] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached -1 (of expected -1)
01:14:33,647 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower follower
01:14:33,647 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower follower: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
[WARN] [07/12/2025 01:14:33.648] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower186] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower, initialSyncDone=false]
[WARN] [07/12/2025 01:14:33.648] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/follower186] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower, initialSyncDone=true]
01:14:33,648 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:33,648 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower (Follower): Number of entries to be appended = 1
01:14:33,648 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
01:14:33,648 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,648 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:33,648 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - follower: Updated server config: isVoting: false, peers: [PeerInfo [id=leader, address=pekko://test/user/leader188, votingState=VOTING], PeerInfo [id=follower2, address=pekko://test/user/follower2187, votingState=NON_VOTING]]
01:14:33,648 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower (Follower): Log size is now 1
01:14:33,648 AM [follower-%d412992] [DEBUG] RaftStorage - follower: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/snapshot-000000006871B6F9-26A53130.tmp
01:14:33,648 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower (Follower): Commit index set to 0
01:14:33,648 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:33,648 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
01:14:33,648 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - follower (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
01:14:33,648 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - follower (Follower): Setting last applied to 0
01:14:33,648 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - follower: Moving last applied index from -1 to 0
01:14:33,648 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - follower: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,648 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - follower: awaiting more completions to resolve 1 synchronized callback(s)
01:14:33,648 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower follower
01:14:33,648 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: 0, nextIndex: 1
01:14:33,648 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:33,648 AM [leader-%d870753] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/snapshot-000000006871B6F9-267AA67D.v1
01:14:33,649 AM [leader-%d870753] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/snapshot-000000006871B6F9-267AA67D.v1
01:14:33,649 AM [leader-%d870753] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/TermInfo.properties
01:14:33,649 AM [leader-%d870753] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/journal-v1-1.log
01:14:33,649 AM [leader-%d870753] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/metadata-v1-1.log
01:14:33,649 AM [leader-%d870753] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.645572221Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/snapshot-000000006871B6F9-267AA67D.v1, size=96, entryCompress=NONE, stateCompress=NONE}
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower2: Set currentTerm=1, votedFor=null
01:14:33,650 AM [leader-%d870753] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower2: Last sync leader does not match current leader leader, need to catch up to -1
01:14:33,650 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:33,650 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}
01:14:33,650 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower2 updated: matchIndex: -1, nextIndex: 0
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower2: Lagging 0 entries behind leader leader and reached -1 (of expected -1)
01:14:33,650 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:33,650 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower follower2
01:14:33,650 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower follower2: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}]}
01:14:33,650 AM [test-pekko.actor.default-dispatcher-6] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 0 is present for follower follower2
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower2 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}]}
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower2 (Follower): Number of entries to be appended = 1
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower2 (Follower): After cleanup, lastIndex: -1, entries to be added from: 0
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower2 (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
[WARN] [07/12/2025 01:14:33.650] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower2187] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower2, initialSyncDone=false]
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower2: Append log entry and persist JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false} 
[WARN] [07/12/2025 01:14:33.650] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/follower2187] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower2, initialSyncDone=true]
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - follower2: Updated server config: isVoting: false, peers: [PeerInfo [id=leader, address=pekko://test/user/leader188, votingState=VOTING], PeerInfo [id=follower, address=pekko://test/user/follower186, votingState=NON_VOTING]]
01:14:33,650 AM [follower2-%d818672] [DEBUG] RaftStorage - follower2: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/snapshot-000000006871B6F9-26C6FF05.tmp
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower2 (Follower): Log size is now 1
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower2 (Follower): Commit index set to 0
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower2 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower2, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower2: Lagging 0 entries behind leader leader and reached 0 (of expected -1)
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower2 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 0
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower2 (Follower): Setting last applied to 0
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower2: Moving last applied index from -1 to 0
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower2: Applying state for log index 0 data VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,650 AM [follower-%d412992] [DEBUG] RaftStorage - follower: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/snapshot-000000006871B6F9-26A53130.v1
01:14:33,650 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower2: awaiting more completions to resolve 1 synchronized callback(s)
01:14:33,650 AM [follower-%d412992] [DEBUG] RaftStorage - follower: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/snapshot-000000006871B6F9-26A53130.v1
01:14:33,650 AM [follower-%d412992] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/TermInfo.properties
01:14:33,651 AM [follower-%d412992] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/journal-v1-1.log
01:14:33,651 AM [follower-%d412992] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/metadata-v1-1.log
01:14:33,651 AM [follower-%d412992] [DEBUG] RaftStorage - follower: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.648360240Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/snapshot-000000006871B6F9-26A53130.v1, size=96, entryCompress=NONE, stateCompress=NONE}
01:14:33,651 AM [follower-%d412992] [DEBUG] RaftStorageCompleter - follower: 1 completion(s) pending
01:14:33,651 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - follower: running 1 completion(s)
01:14:33,651 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - follower: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}
01:14:33,651 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - follower: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@10d1cead}
01:14:33,651 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower2 updated: matchIndex: 0, nextIndex: 1
01:14:33,651 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - follower: synchronized callbacks after 2.692 ms
01:14:33,651 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 1, leaderLastIndex: 0, leaderSnapShotIndex: -1
01:14:33,652 AM [follower2-%d818672] [DEBUG] RaftStorage - follower2: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/snapshot-000000006871B6F9-26C6FF05.v1
01:14:33,652 AM [follower2-%d818672] [DEBUG] RaftStorage - follower2: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/snapshot-000000006871B6F9-26C6FF05.v1
01:14:33,652 AM [follower2-%d818672] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/TermInfo.properties
01:14:33,652 AM [follower2-%d818672] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/journal-v1-1.log
01:14:33,652 AM [follower2-%d818672] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/metadata-v1-1.log
01:14:33,652 AM [follower2-%d818672] [DEBUG] RaftStorage - follower2: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.650575621Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/snapshot-000000006871B6F9-26C6FF05.v1, size=96, entryCompress=NONE, stateCompress=NONE}
01:14:33,652 AM [follower2-%d818672] [DEBUG] RaftStorageCompleter - follower2: 1 completion(s) pending
01:14:33,652 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower2: running 1 completion(s)
01:14:33,652 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower2: persist complete JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}
01:14:33,652 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower2: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=0, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=false], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@144c6775}
01:14:33,652 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower2: synchronized callbacks after 2.113 ms
01:14:33,698 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={follower=true}, serversVisited=[]], state: Idle
01:14:33,698 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState
01:14:33,698 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - leader: Updated server config: isVoting: true, peers: [PeerInfo [id=follower2, address=pekko://test/user/follower2187, votingState=NON_VOTING], PeerInfo [id=follower, address=pekko://test/user/follower186, votingState=VOTING]]
01:14:33,698 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]
01:14:33,698 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader: Persist data index=1 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,698 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:33,698 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=69592507-7d85-4e5c-a377-cf580149e4bf}, logIndex: 1, isSendImmediate: true
01:14:33,698 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - leader (Leader): Setting last applied to 1
01:14:33,698 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - leader: Moving last applied index from 0 to 1
01:14:33,698 AM [leader-%d870754] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/snapshot-000000006871B6F9-29A6D13E.tmp
01:14:33,698 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - leader: Applying state for log index 1 data VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,699 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
01:14:33,699 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 1 is present for follower follower2
01:14:33,699 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower follower2: AppendEntries{term=1, leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:33,699 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1
01:14:33,699 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 1 is present for follower follower
01:14:33,699 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower follower: AppendEntries{term=1, leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:33,699 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower2 (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:33,699 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower2 (Follower): Number of entries to be appended = 1
01:14:33,699 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation ChangeServersVotingStatus [serverVotingStatusMap={follower=true}, serversVisited=[]]
01:14:33,699 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower2 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
01:14:33,699 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower2 (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,699 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower2: Append log entry and persist JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:33,699 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorVotingConfigSupport - leader: VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]} has been successfully replicated to a majority of followers
01:14:33,699 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:33,700 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower (Follower): Number of entries to be appended = 1
01:14:33,700 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
01:14:33,700 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,700 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower: Append log entry and persist JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:33,700 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - follower: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=pekko://test/user/leader188, votingState=VOTING], PeerInfo [id=follower2, address=pekko://test/user/follower2187, votingState=NON_VOTING]]
01:14:33,700 AM [follower-%d412993] [DEBUG] RaftStorage - follower: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/snapshot-000000006871B6F9-29BBE09C.tmp
01:14:33,700 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower (Follower): Log size is now 2
01:14:33,700 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower (Follower): Commit index set to 1
01:14:33,700 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:33,700 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached 1 (of expected -1)
01:14:33,700 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
01:14:33,700 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - follower (Follower): Setting last applied to 1
01:14:33,700 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - follower: Moving last applied index from 0 to 1
01:14:33,700 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower: Applying state for log index 1 data VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,700 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower: awaiting more completions to resolve 1 synchronized callback(s)
01:14:33,700 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: 1, nextIndex: 2
01:14:33,700 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SnapshotManager - leader: fakeSnapshot purging log to 0 for term 1
01:14:33,701 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: 0
01:14:33,700 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PeerInfos - follower2: Updated server config: isVoting: false, peers: [PeerInfo [id=leader, address=pekko://test/user/leader188, votingState=VOTING], PeerInfo [id=follower, address=pekko://test/user/follower186, votingState=VOTING]]
01:14:33,701 AM [follower2-%d818673] [DEBUG] RaftStorage - follower2: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/snapshot-000000006871B6F9-29B5001D.tmp
01:14:33,701 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower2 (Follower): Log size is now 2
01:14:33,701 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower2 (Follower): Commit index set to 1
01:14:33,701 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower2 (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower2, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:33,701 AM [leader-%d870754] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/snapshot-000000006871B6F9-29A6D13E.v1
01:14:33,701 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower2 updated: matchIndex: 1, nextIndex: 2
01:14:33,701 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower2: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: 0
01:14:33,701 AM [leader-%d870754] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/snapshot-000000006871B6F9-267AA67D.v1
01:14:33,701 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower2: Lagging 0 entries behind leader leader and reached 1 (of expected -1)
01:14:33,701 AM [leader-%d870754] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/snapshot-000000006871B6F9-29A6D13E.v1
01:14:33,701 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower2 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
01:14:33,701 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower2 (Follower): Setting last applied to 1
01:14:33,701 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower2: Moving last applied index from 0 to 1
01:14:33,701 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - follower2: Applying state for log index 1 data VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,701 AM [leader-%d870754] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/TermInfo.properties
01:14:33,701 AM [leader-%d870754] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/journal-v1-1.log
01:14:33,701 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - follower2: awaiting more completions to resolve 1 synchronized callback(s)
01:14:33,701 AM [leader-%d870754] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/metadata-v1-1.log
01:14:33,702 AM [follower-%d412993] [DEBUG] RaftStorage - follower: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/snapshot-000000006871B6F9-29BBE09C.v1
01:14:33,702 AM [follower-%d412993] [DEBUG] RaftStorage - follower: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/snapshot-000000006871B6F9-26A53130.v1
01:14:33,702 AM [leader-%d870754] [DEBUG] RaftStorage - leader: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.645572221Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/snapshot-000000006871B6F9-267AA67D.v1, size=96, entryCompress=NONE, stateCompress=NONE}
01:14:33,703 AM [leader-%d870754] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.698798398Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/leader/snapshot-000000006871B6F9-29A6D13E.v1, size=96, entryCompress=NONE, stateCompress=NONE}
01:14:33,703 AM [follower2-%d818673] [DEBUG] RaftStorage - follower2: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/snapshot-000000006871B6F9-29B5001D.v1
01:14:33,703 AM [leader-%d870754] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:33,703 AM [follower2-%d818673] [DEBUG] RaftStorage - follower2: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/snapshot-000000006871B6F9-29B5001D.v1
01:14:33,703 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:33,703 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}
01:14:33,703 AM [follower2-%d818673] [DEBUG] RaftStorage - follower2: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/snapshot-000000006871B6F9-26C6FF05.v1
01:14:33,703 AM [follower2-%d818673] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/TermInfo.properties
01:14:33,703 AM [follower2-%d818673] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/journal-v1-1.log
01:14:33,703 AM [follower2-%d818673] [DEBUG] RaftStorage - follower2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/metadata-v1-1.log
01:14:33,703 AM [follower-%d412993] [DEBUG] RaftStorage - follower: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/snapshot-000000006871B6F9-29BBE09C.v1
01:14:33,703 AM [follower-%d412993] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/TermInfo.properties
01:14:33,703 AM [follower-%d412993] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/journal-v1-1.log
01:14:33,703 AM [follower2-%d818673] [DEBUG] RaftStorage - follower2: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.650575621Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/snapshot-000000006871B6F9-26C6FF05.v1, size=96, entryCompress=NONE, stateCompress=NONE}
01:14:33,703 AM [follower-%d412993] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/metadata-v1-1.log
01:14:33,703 AM [follower2-%d818673] [DEBUG] RaftStorage - follower2: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.699727901Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower2/snapshot-000000006871B6F9-29B5001D.v1, size=96, entryCompress=NONE, stateCompress=NONE}
01:14:33,704 AM [follower2-%d818673] [DEBUG] RaftStorageCompleter - follower2: 1 completion(s) pending
01:14:33,704 AM [follower-%d412993] [DEBUG] RaftStorage - follower: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.648360240Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/snapshot-000000006871B6F9-26A53130.v1, size=96, entryCompress=NONE, stateCompress=NONE}
01:14:33,704 AM [follower-%d412993] [DEBUG] RaftStorage - follower: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.700178588Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13293681815201945177/follower/snapshot-000000006871B6F9-29BBE09C.v1, size=96, entryCompress=NONE, stateCompress=NONE}
01:14:33,704 AM [follower-%d412993] [DEBUG] RaftStorageCompleter - follower: 1 completion(s) pending
01:14:33,704 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower: running 1 completion(s)
01:14:33,704 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower: persist complete JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}
01:14:33,704 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - follower2: running 1 completion(s)
01:14:33,704 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - follower2: persist complete JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}
01:14:33,704 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@7bc07ff1}
01:14:33,704 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - follower2: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=1, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower2, isVoting=false], ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@63258e2c}
01:14:33,704 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - follower: synchronized callbacks after 4.026 ms
01:14:33,704 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - follower2: synchronized callbacks after 2.739 ms
01:14:33,752 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeServersVotingStatus ending
01:14:33,752 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower185]
01:14:33,763 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader188]
01:14:33,763 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#562,leader-writer-70]/waiting
01:14:33,764 AM [leader-writer-70] [DEBUG] JournalWriteTask - leader: received 1 commands after 126.5 ms
01:14:33,764 AM [leader-writer-70] [DEBUG] JournalWriteTask - leader: completed 1 commands in 41.46 μs
01:14:33,764 AM [leader-writer-70] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:33,764 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:33,764 AM [test-pekko.actor.default-dispatcher-18] [INFO] EnabledRaftStorage - leader: journal closed
01:14:33,764 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:33,764 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:33,765 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector189]
01:14:33,765 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector190#-1511815669]
01:14:33,765 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower186]
01:14:33,765 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EnabledRaftStorage - follower: terminating thread VirtualThread[#563,follower-writer-71]/waiting
01:14:33,766 AM [follower-writer-71] [DEBUG] JournalWriteTask - follower: received 1 commands after 125.2 ms
01:14:33,766 AM [follower-writer-71] [DEBUG] JournalWriteTask - follower: completed 1 commands in 18.26 μs
01:14:33,766 AM [follower-writer-71] [DEBUG] JournalWriteTask - follower: journal writer stopped
01:14:33,766 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower: journal closed
01:14:33,766 AM [test-pekko.actor.default-dispatcher-18] [INFO] EnabledRaftStorage - follower: journal closed
01:14:33,766 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks
01:14:33,766 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks
01:14:33,766 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector191#740206212]
01:14:33,766 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower2187]
01:14:33,767 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EnabledRaftStorage - follower2: terminating thread VirtualThread[#564,follower2-writer-72]/waiting
01:14:33,767 AM [follower2-writer-72] [DEBUG] JournalWriteTask - follower2: received 1 commands after 123.8 ms
01:14:33,767 AM [follower2-writer-72] [DEBUG] JournalWriteTask - follower2: completed 1 commands in 10.47 μs
01:14:33,767 AM [follower2-writer-72] [DEBUG] JournalWriteTask - follower2: journal writer stopped
01:14:33,767 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - follower2: journal closed
01:14:33,767 AM [test-pekko.actor.default-dispatcher-18] [INFO] EnabledRaftStorage - follower2: journal closed
01:14:33,767 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower2: stopped executor with 0 remaining tasks
01:14:33,767 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - follower2: stopped executor with 0 remaining tasks
01:14:33,871 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithExistingFollower starting
[WARN] [07/12/2025 01:14:33.873] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server194]: org.opendaylight.controller.cluster.common.actor.Monitor@49af5112
01:14:33,874 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000
01:14:33,874 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - new-server: started executor
01:14:33,874 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - new-server: started executor
01:14:33,875 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0
01:14:33,876 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:33,876 AM [test-pekko.actor.default-dispatcher-18] [INFO] EnabledRaftStorage - new-server: journal open: applyTo=0
01:14:33,876 AM [new-server-writer-73] [DEBUG] JournalWriteTask - new-server: journal writer started
01:14:33,876 AM [new-server-writer-73] [DEBUG] JournalWriteTask - new-server: waiting to receive commands
01:14:33,878 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/TermInfo.properties does not exist
01:14:33,878 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/journal-v1-1.log
01:14:33,878 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/metadata-v1-1.log
01:14:33,878 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: no eligible files found
01:14:33,879 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:33,881 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null
01:14:33,881 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0}
01:14:33,881 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot
01:14:33,881 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery
01:14:33,882 AM [main] [DEBUG] AbstractReplicatedLog - follower: Moving last applied index from -1 to 2
01:14:33,882 AM [test-pekko.actor.default-dispatcher-16] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
01:14:33,883 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=leader
01:14:33,883 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:33,883 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: started executor
01:14:33,883 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: started executor
[WARN] [07/12/2025 01:14:33.883] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader195]: org.opendaylight.controller.cluster.common.actor.Monitor@67aa5358
01:14:33,883 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:33,884 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:33,884 AM [test-pekko.actor.default-dispatcher-18] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:33,884 AM [leader-writer-74] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:33,884 AM [leader-writer-74] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:33,886 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/TermInfo.properties does not exist
01:14:33,886 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/journal-v1-1.log
01:14:33,886 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/metadata-v1-1.log
01:14:33,886 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: no eligible files found
01:14:33,886 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:33,888 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=leader
01:14:33,888 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=leader}
01:14:33,888 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:33,888 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:33,889 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [follower]
01:14:33,889 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: false, followerNextIndex: 2, leaderLastIndex: 2, leaderSnapShotIndex: -1
01:14:33,889 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower: Last sync leader does not match current leader leader, need to catch up to -1
01:14:33,889 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: 2, nextIndex: 3
01:14:33,889 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - leader: fakeSnapshot purging log to 1 for term 1
01:14:33,889 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 3, leaderLastIndex: 2, leaderSnapShotIndex: 1
01:14:33,889 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached 2 (of expected -1)
01:14:33,889 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - follower: fakeSnapshot purging log to 1 for term 1
01:14:33,938 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server194, votingMember=true], state: Idle
01:14:33,938 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server194, votingMember=true]
01:14:33,938 AM [test-pekko.actor.default-dispatcher-18] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=2, lastAppliedTerm=1, lastIndex=2, lastTerm=1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] to install on new-server
01:14:33,938 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - leader: last applied journal index prior to capture: 3
01:14:33,938 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader: support() called
01:14:33,939 AM [leader-%d211609] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:33,939 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating capture snapshot for new server new-server
01:14:33,939 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:33,939 AM [test-pekko.actor.default-dispatcher-18] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=2, term=1]/EntryInfo[index=2, term=1]
01:14:33,939 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader: support() called
01:14:33,940 AM [leader-%d211610] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/snapshot-000000006871B6F9-3807BC1B.tmp
01:14:33,940 AM [test-pekko.actor.default-dispatcher-18] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: 1 and term: 1
01:14:33,940 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): sendInstallSnapshot
01:14:33,940 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Snapshot 157 bytes, total chunks to send: 1
01:14:33,940 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] LeaderInstallSnapshotState - leader (Leader): Next chunk: total length=157, offset=0, size=157, hashCode=1546036366
01:14:33,940 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): next snapshot chunk size for follower new-server: 157
01:14:33,941 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): InstallSnapshot sent to follower Vector(user, new-server194), Chunk: 1/1
01:14:33,941 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - new-server (Follower): Term 1 in "InstallSnapshot{term=1, leaderId=leader, lastIncludedIndex=2, lastIncludedTerm=1, datasize=157, chunk=1/1, lastChunkHashCode=OptionalInt[-1]}" message is greater than follower's term 0 - updating term
01:14:33,943 AM [leader-%d211610] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/snapshot-000000006871B6F9-3807BC1B.v1
01:14:33,943 AM [leader-%d211610] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/snapshot-000000006871B6F9-3807BC1B.v1
01:14:33,943 AM [leader-%d211610] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/TermInfo.properties
01:14:33,943 AM [leader-%d211610] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/journal-v1-1.log
01:14:33,943 AM [leader-%d211610] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/metadata-v1-1.log
01:14:33,943 AM [leader-%d211610] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.940031003Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/snapshot-000000006871B6F9-3807BC1B.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:33,944 AM [leader-%d211610] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:33,944 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=1, votedFor=null
01:14:33,944 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - new-server (Follower): handleInstallSnapshot: InstallSnapshot{term=1, leaderId=leader, lastIncludedIndex=2, lastIncludedTerm=1, datasize=157, chunk=1/1, lastChunkHashCode=OptionalInt[-1]}
01:14:33,944 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to 2
01:14:33,944 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotTracker - new-server (Follower): addChunk: chunkIndex=1, lastChunkIndex=0, collectedChunks.size=0, lastChunkHashCode=-1
01:14:33,944 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - new-server (Follower): Snapshot received from leader: leader
01:14:33,944 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:33,944 AM [test-pekko.actor.default-dispatcher-17] [INFO] SnapshotManager - leader: snapshot is durable as of 2025-07-12T01:14:33.940031003Z
01:14:33,944 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SnapshotManager - leader: Snapshot success, discarding journal entries up to 3
01:14:33,944 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorSnapshotMessageSupport - leader: SnapshotComplete received
[WARN] [07/12/2025 01:14:33.945] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/new-server194] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=new-server, initialSyncDone=false]
01:14:33,945 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - new-server: Applying snapshot on follower: PlainSnapshotSource{io=MemoryStreamSource{size=157}}
01:14:33,945 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - new-server: support() called
01:14:33,946 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - new-server: Converted InstallSnapshot from leader: leader to state
01:14:33,946 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - new-server: last applied journal index prior to persisting applied snapshot: 0
01:14:33,946 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - new-server: support() called
01:14:33,946 AM [new-server-%d387429] [DEBUG] RaftStorage - new-server: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/snapshot-000000006871B6F9-3869DF47.tmp
01:14:33,948 AM [new-server-%d387429] [DEBUG] RaftStorage - new-server: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/snapshot-000000006871B6F9-3869DF47.v1
01:14:33,949 AM [new-server-%d387429] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/snapshot-000000006871B6F9-3869DF47.v1
01:14:33,949 AM [new-server-%d387429] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/TermInfo.properties
01:14:33,949 AM [new-server-%d387429] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/journal-v1-1.log
01:14:33,949 AM [new-server-%d387429] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/metadata-v1-1.log
01:14:33,949 AM [new-server-%d387429] [DEBUG] RaftStorage - new-server: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.946462535Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/snapshot-000000006871B6F9-3869DF47.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:33,949 AM [new-server-%d387429] [DEBUG] RaftStorageCompleter - new-server: 1 completion(s) pending
01:14:33,949 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - new-server: running 1 completion(s)
01:14:33,949 AM [test-pekko.actor.default-dispatcher-16] [INFO] SnapshotManager - new-server: snapshot is durable as of 2025-07-12T01:14:33.946462535Z
01:14:33,949 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - new-server: support() called
01:14:33,949 AM [test-pekko.actor.default-dispatcher-16] [INFO] MockRaftActor - new-server: applySnapshot called
01:14:33,949 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - new-server (Follower): handleInstallSnapshot returning: InstallSnapshotReply{term=1, followerId=new-server, chunkIndex=1, success=true}
01:14:33,950 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SnapshotManager - new-server: Snapshot success, discarding journal entries up to 0
01:14:33,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): handleInstallSnapshotReply: InstallSnapshotReply{term=1, followerId=new-server, chunkIndex=1, success=true}
01:14:33,950 AM [test-pekko.actor.default-dispatcher-18] [INFO] AbstractLeader - leader (Leader): Snapshot successfully installed on follower new-server (last chunk 1) - matchIndex set to 2, nextIndex set to 3
01:14:33,950 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorSnapshotMessageSupport - new-server: SnapshotComplete received
01:14:33,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - Sent message UnInitializedFollowerSnapshotReply to self
01:14:33,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorVotingConfigSupport - leader: onUnInitializedFollowerSnapshotReply: UnInitializedFollowerSnapshotReply [followerId=new-server]
01:14:33,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorVotingConfigSupport - leader: New server configuration : [ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]
01:14:33,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader: Persist data index=3 term=1 command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader: Append log entry and persist JournaledLogEntry{index=3, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:33,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=a477e0b4-cc43-4249-81af-701f24b1b4c3}, logIndex: 3, isSendImmediate: true
01:14:33,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:33,950 AM [leader-%d211611] [DEBUG] RaftStorage - leader: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/snapshot-000000006871B6F9-38A6F8E7.tmp
01:14:33,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 3, leaderLastIndex: 3, leaderSnapShotIndex: 1
01:14:33,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 3 is present for follower follower
01:14:33,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower follower: AppendEntries{term=1, leaderId=leader, prevLogIndex=2, prevLogTerm=1, leaderCommit=2, replicatedToAllIndex=1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:33,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 3, leaderLastIndex: 3, leaderSnapShotIndex: 1
01:14:33,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): sendAppendEntries: 3 is present for follower new-server
01:14:33,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): Sending AppendEntries to follower new-server: AppendEntries{term=1, leaderId=leader, prevLogIndex=2, prevLogTerm=1, leaderCommit=2, replicatedToAllIndex=1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:33,950 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorVotingConfigSupport - leader: Returning OK for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server194, votingMember=true]
01:14:33,951 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader, prevLogIndex=2, prevLogTerm=1, leaderCommit=2, replicatedToAllIndex=1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:33,951 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): Number of entries to be appended = 1
01:14:33,951 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): After cleanup, lastIndex: 2, entries to be added from: 0
01:14:33,951 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,951 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - new-server: Append log entry and persist JournaledLogEntry{index=3, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:33,951 AM [new-server-%d387430] [DEBUG] RaftStorage - new-server: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/snapshot-000000006871B6F9-38B3883A.tmp
01:14:33,951 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - new-server: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=null, votingState=VOTING], PeerInfo [id=follower, address=null, votingState=VOTING]]
01:14:33,951 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): Log size is now 1
01:14:33,951 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=new-server, logLastIndex=3, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:33,951 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 2 (of expected 2)
01:14:33,951 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - new-server: awaiting more completions to resolve 1 synchronized callback(s)
01:14:33,951 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: 3, nextIndex: 4
01:14:33,951 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server: active: true, followerNextIndex: 4, leaderLastIndex: 3, leaderSnapShotIndex: 1
01:14:33,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower (Follower): handleAppendEntries: AppendEntries{term=1, leaderId=leader, prevLogIndex=2, prevLogTerm=1, leaderCommit=2, replicatedToAllIndex=1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=3, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}]}
01:14:33,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower (Follower): Number of entries to be appended = 1
01:14:33,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower (Follower): After cleanup, lastIndex: 2, entries to be added from: 0
01:14:33,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower: Append log entry and persist JournaledLogEntry{index=3, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true} 
01:14:33,951 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - test: 1 completion(s) pending
01:14:33,952 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - test: running 1 completion(s)
01:14:33,952 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - follower: persist complete JournaledLogEntry{index=3, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}
01:14:33,952 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - test: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=3, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@316c83af}
01:14:33,952 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PeerInfos - follower: Updated server config: isVoting: true, peers: [PeerInfo [id=leader, address=, votingState=VOTING], PeerInfo [id=new-server, address=null, votingState=VOTING]]
01:14:33,952 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower (Follower): Log size is now 2
01:14:33,952 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] Follower - follower (Follower): handleAppendEntries returning : AppendEntriesReply{term=1, success=true, followerId=follower, logLastIndex=3, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=0, raftVersion=5, recipientRaftVersion=5}
01:14:33,952 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached 2 (of expected -1)
01:14:33,952 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for follower updated: matchIndex: 3, nextIndex: 4
01:14:33,952 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: true, followerNextIndex: 4, leaderLastIndex: 3, leaderSnapShotIndex: 1
01:14:33,953 AM [leader-%d211611] [DEBUG] RaftStorage - leader: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/snapshot-000000006871B6F9-38A6F8E7.v1
01:14:33,953 AM [leader-%d211611] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/snapshot-000000006871B6F9-38A6F8E7.v1
01:14:33,953 AM [leader-%d211611] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/snapshot-000000006871B6F9-3807BC1B.v1
01:14:33,953 AM [leader-%d211611] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/TermInfo.properties
01:14:33,953 AM [leader-%d211611] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/journal-v1-1.log
01:14:33,953 AM [leader-%d211611] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/metadata-v1-1.log
01:14:33,953 AM [new-server-%d387430] [DEBUG] RaftStorage - new-server: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/snapshot-000000006871B6F9-38B3883A.v1
01:14:33,953 AM [leader-%d211611] [DEBUG] RaftStorage - leader: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.940031003Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/snapshot-000000006871B6F9-3807BC1B.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:33,953 AM [new-server-%d387430] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/snapshot-000000006871B6F9-3869DF47.v1
01:14:33,953 AM [leader-%d211611] [DEBUG] RaftStorage - leader: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.950466791Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/snapshot-000000006871B6F9-38A6F8E7.v1, size=97, entryCompress=NONE, stateCompress=NONE}
01:14:33,953 AM [leader-%d211611] [DEBUG] RaftStorageCompleter - leader: 1 completion(s) pending
01:14:33,953 AM [new-server-%d387430] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/snapshot-000000006871B6F9-38B3883A.v1
01:14:33,954 AM [new-server-%d387430] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/TermInfo.properties
01:14:33,953 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - leader: running 1 completion(s)
01:14:33,954 AM [new-server-%d387430] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/journal-v1-1.log
01:14:33,954 AM [new-server-%d387430] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/metadata-v1-1.log
01:14:33,954 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - leader: persist complete JournaledLogEntry{index=3, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=true}
01:14:33,954 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): Applying to log - commitIndex: 3, lastAppliedIndex: 2
01:14:33,954 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - leader (Leader): Setting last applied to 3
01:14:33,954 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader: Moving last applied index from 2 to 3
01:14:33,954 AM [new-server-%d387430] [DEBUG] RaftStorage - new-server: deleted snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.946462535Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/snapshot-000000006871B6F9-3869DF47.v1, size=64, entryCompress=NONE, stateCompress=NONE}
01:14:33,954 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader: Applying state for log index 3 data VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:33,954 AM [new-server-%d387430] [DEBUG] RaftStorage - new-server: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.951289914Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/snapshot-000000006871B6F9-38B3883A.v1, size=97, entryCompress=NONE, stateCompress=NONE}
01:14:33,954 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - leader: fakeSnapshot purging log to 2 for term 1
01:14:33,954 AM [new-server-%d387430] [DEBUG] RaftStorageCompleter - new-server: 1 completion(s) pending
01:14:33,954 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - new-server: running 1 completion(s)
01:14:33,954 AM [test-pekko.actor.default-dispatcher-18] [INFO] RaftActorVotingConfigSupport - leader: VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]} has been successfully replicated to a majority of followers
01:14:33,954 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] ReplicatedLogImpl - new-server: persist complete JournaledLogEntry{index=3, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}
01:14:33,954 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - new-server: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=3, term=1, command=VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@22dbc554}
01:14:33,954 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorageCompleter - new-server: synchronized callbacks after 2.798 ms
[WARN] [07/12/2025 01:14:33.954] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/new-server194] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=new-server, initialSyncDone=true]
01:14:34,125 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower (Follower): Commit index set to 3
01:14:34,125 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): Commit index set to 3
01:14:34,125 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - follower: Lagging 0 entries behind leader leader and reached 3 (of expected -1)
01:14:34,125 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - new-server: Lagging 0 entries behind leader leader and reached 3 (of expected 2)
01:14:34,125 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - follower (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 3, context.getLastApplied(): 2, lastIndex(): 3
01:14:34,125 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] Follower - new-server (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 3, context.getLastApplied(): 2, lastIndex(): 3
01:14:34,125 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - follower (Follower): Setting last applied to 3
01:14:34,125 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorBehavior - new-server (Follower): Setting last applied to 3
01:14:34,125 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - follower: Moving last applied index from 2 to 3
01:14:34,125 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - new-server: Moving last applied index from 2 to 3
01:14:34,125 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - new-server: Applying state for log index 3 data VotingConfig{serverInfo=[ServerInfo[peerId=follower, isVoting=true], ServerInfo[peerId=new-server, isVoting=true], ServerInfo[peerId=leader, isVoting=true]]}
01:14:34,125 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - follower: fakeSnapshot purging log to 2 for term 1
01:14:34,141 AM [main] [DEBUG] RaftStorage - leader: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/snapshot-000000006871B6F9-38A6F8E7.v1
01:14:34,141 AM [main] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/TermInfo.properties
01:14:34,141 AM [main] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/journal-v1-1.log
01:14:34,141 AM [main] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/metadata-v1-1.log
01:14:34,141 AM [main] [DEBUG] RaftStorage - leader: picked SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.950466791Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/leader/snapshot-000000006871B6F9-38A6F8E7.v1, size=97, entryCompress=NONE, stateCompress=NONE} as the latest file
01:14:34,142 AM [main] [DEBUG] RaftStorage - new-server: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/snapshot-000000006871B6F9-38B3883A.v1
01:14:34,142 AM [main] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/TermInfo.properties
01:14:34,142 AM [main] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/journal-v1-1.log
01:14:34,142 AM [main] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/metadata-v1-1.log
01:14:34,142 AM [main] [DEBUG] RaftStorage - new-server: picked SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:33.951289914Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest4117049289234157972/new-server/snapshot-000000006871B6F9-38B3883A.v1, size=97, entryCompress=NONE, stateCompress=NONE} as the latest file
01:14:34,142 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithExistingFollower ending
01:14:34,142 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower192]
01:14:34,153 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector193#1295376192]
01:14:34,154 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server194]
01:14:34,154 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EnabledRaftStorage - new-server: terminating thread VirtualThread[#571,new-server-writer-73]/waiting
01:14:34,154 AM [new-server-writer-73] [DEBUG] JournalWriteTask - new-server: received 1 commands after 278.1 ms
01:14:34,154 AM [new-server-writer-73] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 42.61 μs
01:14:34,154 AM [new-server-writer-73] [DEBUG] JournalWriteTask - new-server: journal writer stopped
01:14:34,155 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - new-server: journal closed
01:14:34,155 AM [test-pekko.actor.default-dispatcher-16] [INFO] EnabledRaftStorage - new-server: journal closed
01:14:34,155 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:34,155 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:34,155 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader195]
01:14:34,155 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#572,leader-writer-74]/waiting
01:14:34,155 AM [leader-writer-74] [DEBUG] JournalWriteTask - leader: received 1 commands after 271.5 ms
01:14:34,155 AM [leader-writer-74] [DEBUG] JournalWriteTask - leader: completed 1 commands in 16.52 μs
01:14:34,156 AM [leader-writer-74] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:34,156 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:34,156 AM [test-pekko.actor.default-dispatcher-16] [INFO] EnabledRaftStorage - leader: journal closed
01:14:34,156 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:34,156 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:34,156 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leaderCollector196]
01:14:34,160 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerForwardedToLeader starting
[WARN] [07/12/2025 01:14:34.162] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server199]: org.opendaylight.controller.cluster.common.actor.Monitor@63a965ce
01:14:34,163 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000
01:14:34,163 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: started executor
01:14:34,163 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: started executor
01:14:34,164 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0
01:14:34,165 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:34,165 AM [test-pekko.actor.default-dispatcher-16] [INFO] EnabledRaftStorage - new-server: journal open: applyTo=0
01:14:34,165 AM [new-server-writer-75] [DEBUG] JournalWriteTask - new-server: journal writer started
01:14:34,165 AM [new-server-writer-75] [DEBUG] JournalWriteTask - new-server: waiting to receive commands
01:14:34,166 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13064188100379458482/new-server/TermInfo.properties does not exist
01:14:34,166 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13064188100379458482/new-server/journal-v1-1.log
01:14:34,166 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13064188100379458482/new-server/metadata-v1-1.log
01:14:34,167 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - new-server: no eligible files found
01:14:34,167 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:34,169 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null
01:14:34,169 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0}
01:14:34,169 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot
01:14:34,169 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery
01:14:34,169 AM [test-pekko.actor.default-dispatcher-16] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
[WARN] [07/12/2025 01:14:34.170] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower201]: org.opendaylight.controller.cluster.common.actor.Monitor@4335fe4a
01:14:34,171 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - follower: Starting recovery with journal batch size 1000
01:14:34,171 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: started executor
01:14:34,171 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: started executor
01:14:34,171 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower: metadata journal open: replayFrom=1 applyTo=0
01:14:34,172 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:34,172 AM [test-pekko.actor.default-dispatcher-16] [INFO] EnabledRaftStorage - follower: journal open: applyTo=0
01:14:34,172 AM [follower-writer-76] [DEBUG] JournalWriteTask - follower: journal writer started
01:14:34,172 AM [follower-writer-76] [DEBUG] JournalWriteTask - follower: waiting to receive commands
01:14:34,173 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13064188100379458482/follower/TermInfo.properties does not exist
01:14:34,173 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13064188100379458482/follower/journal-v1-1.log
01:14:34,173 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest13064188100379458482/follower/metadata-v1-1.log
01:14:34,173 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: no eligible files found
01:14:34,173 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:34,175 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=0, votedFor=null
01:14:34,175 AM [test-pekko.actor.default-dispatcher-16] [INFO] PekkoRecovery - follower: Local TermInfo store seeded with TermInfo{term=0}
01:14:34,175 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower: Pekko recovery completed and can restore from snapshot
01:14:34,175 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower: no journal: skipping journal recovery
01:14:34,176 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=0, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term
01:14:34,178 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=1, votedFor=null
01:14:34,178 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower (Follower): The followers log is empty and the senders prevLogIndex is 0
01:14:34,178 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower (Follower): Follower is out-of-sync so sending negative reply: AppendEntriesReply{term=1, success=false, followerId=follower, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:34,178 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower: Last sync leader does not match current leader leader, need to catch up to -1
[WARN] [07/12/2025 01:14:34.179] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/follower201] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower, initialSyncDone=false]
01:14:34,187 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - follower: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server199, votingMember=true], state: Idle
01:14:34,187 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower: getLeaderAddress leaderId = leader peerAddress = pekko://test/user/leader200
01:14:34,187 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - follower: Not leader - forwarding to leader ActorSelection[Anchor(pekko://test/), Path(/user/leader200)]
01:14:34,237 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerForwardedToLeader ending
01:14:34,237 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower197]
01:14:34,249 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector198#1591387412]
01:14:34,249 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server199]
01:14:34,249 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EnabledRaftStorage - new-server: terminating thread VirtualThread[#578,new-server-writer-75]/waiting
01:14:34,250 AM [new-server-writer-75] [DEBUG] JournalWriteTask - new-server: received 1 commands after 84.69 ms
01:14:34,250 AM [new-server-writer-75] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 32.17 μs
01:14:34,250 AM [new-server-writer-75] [DEBUG] JournalWriteTask - new-server: journal writer stopped
01:14:34,250 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - new-server: journal closed
01:14:34,250 AM [test-pekko.actor.default-dispatcher-17] [INFO] EnabledRaftStorage - new-server: journal closed
01:14:34,250 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:34,250 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:34,250 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/leader200#-1818437903]
01:14:34,251 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower201]
01:14:34,251 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EnabledRaftStorage - follower: terminating thread VirtualThread[#579,follower-writer-76]/waiting
01:14:34,251 AM [follower-writer-76] [DEBUG] JournalWriteTask - follower: received 1 commands after 79.03 ms
01:14:34,251 AM [follower-writer-76] [DEBUG] JournalWriteTask - follower: completed 1 commands in 11.03 μs
01:14:34,251 AM [follower-writer-76] [DEBUG] JournalWriteTask - follower: journal writer stopped
01:14:34,251 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower: journal closed
01:14:34,251 AM [test-pekko.actor.default-dispatcher-17] [INFO] EnabledRaftStorage - follower: journal closed
01:14:34,251 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks
01:14:34,251 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks
01:14:34,255 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerForwardToLeader starting
[WARN] [07/12/2025 01:14:34.257] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/follower204]: org.opendaylight.controller.cluster.common.actor.Monitor@1dbca125
01:14:34,258 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - follower: Starting recovery with journal batch size 1000
01:14:34,258 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower: started executor
01:14:34,258 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower: started executor
01:14:34,258 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower: metadata journal open: replayFrom=1 applyTo=0
01:14:34,259 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - follower: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:34,259 AM [test-pekko.actor.default-dispatcher-17] [INFO] EnabledRaftStorage - follower: journal open: applyTo=0
01:14:34,259 AM [follower-writer-77] [DEBUG] JournalWriteTask - follower: journal writer started
01:14:34,259 AM [follower-writer-77] [DEBUG] JournalWriteTask - follower: waiting to receive commands
01:14:34,260 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18234807219826645474/follower/TermInfo.properties does not exist
01:14:34,260 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18234807219826645474/follower/journal-v1-1.log
01:14:34,260 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest18234807219826645474/follower/metadata-v1-1.log
01:14:34,260 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - follower: no eligible files found
01:14:34,260 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:34,263 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=0, votedFor=null
01:14:34,263 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - follower: Local TermInfo store seeded with TermInfo{term=0}
01:14:34,263 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower: Pekko recovery completed and can restore from snapshot
01:14:34,263 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - follower: no journal: skipping journal recovery
01:14:34,263 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader, prevLogIndex=0, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=0, recipientRaftVersion=5, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term
01:14:34,265 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - follower: Set currentTerm=1, votedFor=null
01:14:34,265 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower (Follower): The followers log is empty and the senders prevLogIndex is 0
01:14:34,265 AM [test-pekko.actor.default-dispatcher-17] [INFO] Follower - follower (Follower): Follower is out-of-sync so sending negative reply: AppendEntriesReply{term=1, success=false, followerId=follower, logLastIndex=-1, logLastTerm=-1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:34,265 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - follower: Last sync leader does not match current leader leader, need to catch up to -1
[WARN] [07/12/2025 01:14:34.265] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/follower204] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=follower, initialSyncDone=false]
01:14:34,274 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - follower: onRemoveServer: RemoveServer{serverId='follower'}, state: Idle
01:14:34,274 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - follower: getLeaderAddress leaderId = leader peerAddress = pekko://test/user/leader203
01:14:34,274 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - follower: Not leader - forwarding to leader ActorSelection[Anchor(pekko://test/), Path(/user/leader203)]
01:14:34,324 AM [main] [INFO] RaftActorVotingConfigSupportTest - testRemoveServerForwardToLeader ending
01:14:34,324 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower202]
01:14:34,335 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader203]
01:14:34,335 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower204]
01:14:34,336 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EnabledRaftStorage - follower: terminating thread VirtualThread[#580,follower-writer-77]/waiting
01:14:34,336 AM [follower-writer-77] [DEBUG] JournalWriteTask - follower: received 1 commands after 76.97 ms
01:14:34,336 AM [follower-writer-77] [DEBUG] JournalWriteTask - follower: completed 1 commands in 38.51 μs
01:14:34,336 AM [follower-writer-77] [DEBUG] JournalWriteTask - follower: journal writer stopped
01:14:34,336 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - follower: journal closed
01:14:34,336 AM [test-pekko.actor.default-dispatcher-16] [INFO] EnabledRaftStorage - follower: journal closed
01:14:34,337 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks
01:14:34,337 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - follower: stopped executor with 0 remaining tasks
01:14:34,339 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithExistingServer starting
[WARN] [07/12/2025 01:14:34.340] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader206]: org.opendaylight.controller.cluster.common.actor.Monitor@36b607a
01:14:34,341 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:34,341 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:34,342 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: started executor
01:14:34,342 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: started executor
01:14:34,342 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:34,343 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:34,343 AM [test-pekko.actor.default-dispatcher-16] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:34,343 AM [leader-writer-78] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:34,343 AM [leader-writer-78] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:34,345 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest12060070696729327424/leader/TermInfo.properties does not exist
01:14:34,345 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest12060070696729327424/leader/journal-v1-1.log
01:14:34,345 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest12060070696729327424/leader/metadata-v1-1.log
01:14:34,345 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: no eligible files found
01:14:34,345 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:34,348 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:34,348 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=}
01:14:34,348 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:34,348 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:34,349 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: [follower]
01:14:34,349 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower follower: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1
01:14:34,354 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=follower, newServerAddress=pekko://test/user/follower205, votingMember=true], state: Idle
01:14:34,354 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=follower, newServerAddress=pekko://test/user/follower205, votingMember=true]
01:14:34,355 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorVotingConfigSupport - leader: Returning ALREADY_EXISTS for operation AddServer [newServerId=follower, newServerAddress=pekko://test/user/follower205, votingMember=true]
01:14:34,355 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithExistingServer ending
01:14:34,355 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower205]
01:14:34,366 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader206]
01:14:34,366 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#581,leader-writer-78]/waiting
01:14:34,367 AM [leader-writer-78] [DEBUG] JournalWriteTask - leader: received 1 commands after 23.29 ms
01:14:34,367 AM [leader-writer-78] [DEBUG] JournalWriteTask - leader: completed 1 commands in 47.38 μs
01:14:34,367 AM [leader-writer-78] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:34,367 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:34,367 AM [test-pekko.actor.default-dispatcher-16] [INFO] EnabledRaftStorage - leader: journal closed
01:14:34,367 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:34,367 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:34,371 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeToVotingWithNoLeaderAndElectionTimeout starting
[WARN] [07/12/2025 01:14:34.373] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/node1]: org.opendaylight.controller.cluster.common.actor.Monitor@7bbac1e1
01:14:34,375 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - node1: Starting recovery with journal batch size 1000
01:14:34,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - node1: started executor
01:14:34,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - node1: started executor
01:14:34,375 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - node1: metadata journal open: replayFrom=1 applyTo=0
01:14:34,376 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - node1: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:34,376 AM [test-pekko.actor.default-dispatcher-16] [INFO] EnabledRaftStorage - node1: journal open: applyTo=0
01:14:34,376 AM [node1-writer-79] [DEBUG] JournalWriteTask - node1: journal writer started
01:14:34,376 AM [node1-writer-79] [DEBUG] JournalWriteTask - node1: waiting to receive commands
[WARN] [07/12/2025 01:14:34.378] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/node2]: org.opendaylight.controller.cluster.common.actor.Monitor@38a65e4
01:14:34,378 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node1/TermInfo.properties does not exist
01:14:34,378 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node1/journal-v1-1.log
01:14:34,378 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node1/metadata-v1-1.log
01:14:34,378 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: no eligible files found
01:14:34,378 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=1, votedFor=node1
01:14:34,378 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - node2: Starting recovery with journal batch size 1000
01:14:34,378 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PekkoRecovery - node1: Received ReplicatedLogEntry for recovery: index: 0, size: 133
01:14:34,378 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - node2: started executor
01:14:34,378 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PeerInfos - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=VOTING]]
01:14:34,378 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - node2: started executor
01:14:34,379 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - node1: Recovery completed  - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1
01:14:34,379 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - node2: metadata journal open: replayFrom=1 applyTo=0
01:14:34,379 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - node2: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:34,379 AM [test-pekko.actor.default-dispatcher-16] [INFO] EnabledRaftStorage - node2: journal open: applyTo=0
01:14:34,379 AM [node2-writer-80] [DEBUG] JournalWriteTask - node2: journal writer started
01:14:34,379 AM [node2-writer-80] [DEBUG] JournalWriteTask - node2: waiting to receive commands
01:14:34,381 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node2/TermInfo.properties does not exist
01:14:34,381 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node2/journal-v1-1.log
01:14:34,381 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node2/metadata-v1-1.log
01:14:34,381 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node2: no eligible files found
01:14:34,381 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=1, votedFor=node1
01:14:34,381 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - node2: Received ReplicatedLogEntry for recovery: index: 0, size: 133
01:14:34,381 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PeerInfos - node2: Updated server config: isVoting: true, peers: [PeerInfo [id=node1, address=null, votingState=NON_VOTING]]
01:14:34,381 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - node2: Recovery completed  - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1
01:14:34,384 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=1, votedFor=node1
01:14:34,384 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - node1: Local TermInfo store seeded with TermInfo{term=1, votedFor=node1}
01:14:34,384 AM [test-pekko.actor.default-dispatcher-17] [INFO] PekkoRecovery - node1: taking snapshot to clear Pekko persistence to 2
01:14:34,384 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Recovery - node1: no applied entries in recovery log, re-snapshotting EntryInfo[index=-1, term=-1]
01:14:34,384 AM [test-pekko.actor.default-dispatcher-17] [INFO] Recovery - node1: Taking snapshot on entry with index -1
01:14:34,384 AM [test-pekko.actor.default-dispatcher-17] [INFO] MockRaftActor - node1: support() called
01:14:34,384 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node1/snapshot-000000006871B6FA-16E846DA.tmp
01:14:34,385 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=1, votedFor=node1
01:14:34,385 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - node2: Local TermInfo store seeded with TermInfo{term=1, votedFor=node1}
01:14:34,385 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - node2: taking snapshot to clear Pekko persistence to 2
01:14:34,385 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Recovery - node2: no applied entries in recovery log, re-snapshotting EntryInfo[index=-1, term=-1]
01:14:34,385 AM [test-pekko.actor.default-dispatcher-18] [INFO] Recovery - node2: Taking snapshot on entry with index -1
01:14:34,385 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - node2: support() called
01:14:34,385 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node2: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node2/snapshot-000000006871B6FA-16F5A643.tmp
01:14:34,386 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node1/snapshot-000000006871B6FA-16E846DA.v1
01:14:34,386 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node1/snapshot-000000006871B6FA-16E846DA.v1
01:14:34,387 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node1/TermInfo.properties
01:14:34,387 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node1/journal-v1-1.log
01:14:34,387 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node1/metadata-v1-1.log
01:14:34,387 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:34.384321242Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node1/snapshot-000000006871B6FA-16E846DA.v1, size=380, entryCompress=NONE, stateCompress=NONE}
01:14:34,387 AM [test-pekko.actor.default-dispatcher-17] [INFO] Recovery - node1: Snapshot completed in 2.940 ms, resetting timer for the next recovery snapshot
01:14:34,387 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - node1: Pekko recovery completed and can restore from snapshot
01:14:34,387 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - node1: starting journal recovery
01:14:34,387 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractReplicatedLog - node1: Moving last applied index from -1 to -1
01:14:34,387 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - node1: empty journal: appending 1 entries
01:14:34,387 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node1: updated meta to JournalMeta[replayFrom=1, applyTo=0]
01:14:34,387 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node2: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node2/snapshot-000000006871B6FA-16F5A643.v1
01:14:34,387 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node2: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node2/snapshot-000000006871B6FA-16F5A643.v1
01:14:34,387 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node2/TermInfo.properties
01:14:34,387 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node2/journal-v1-1.log
01:14:34,387 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node2/metadata-v1-1.log
01:14:34,387 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node2: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=-1, term=-1], timestamp=2025-07-12T01:14:34.385197635Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest2372480579874058644/node2/snapshot-000000006871B6FA-16F5A643.v1, size=380, entryCompress=NONE, stateCompress=NONE}
01:14:34,388 AM [test-pekko.actor.default-dispatcher-18] [INFO] Recovery - node2: Snapshot completed in 2.907 ms, resetting timer for the next recovery snapshot
01:14:34,388 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - node2: Pekko recovery completed and can restore from snapshot
01:14:34,388 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - node2: starting journal recovery
01:14:34,388 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - node2: Moving last applied index from -1 to -1
01:14:34,388 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - node2: empty journal: appending 1 entries
01:14:34,389 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - node2: updated meta to JournalMeta[replayFrom=1, applyTo=0]
01:14:34,392 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] JournalRecovery - node1: journal recovery completedin 5.062 ms with journalIndex=1
01:14:34,392 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - node1: ignoring DeleteMessagesSuccess(2)
01:14:34,393 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - node1: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={node1=true}, serversVisited=[]], state: Idle
01:14:34,393 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState
01:14:34,393 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - node1: Sending local ElectionTimeout to start leader election
01:14:34,393 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PeerInfos - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=null, votingState=VOTING]]
01:14:34,393 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:34,393 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - node1 (Follower): Received TimeoutNow - switching to Candidate
01:14:34,393 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - node1 (Candidate): Election: Candidate has following voting peers: [node2]
01:14:34,393 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - node2: journal recovery completedin 5.380 ms with journalIndex=1
01:14:34,394 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - node2: ignoring DeleteMessagesSuccess(2)
01:14:34,395 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=2, votedFor=node1
01:14:34,395 AM [test-pekko.actor.default-dispatcher-17] [INFO] Candidate - node1 (Candidate): Starting new election term 2
01:14:34,395 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - node1 (Candidate): Sending RequestVote{term=2, candidateId=node1, lastLogIndex=0, lastLogTerm=1} to peer node2
01:14:34,395 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - node1 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
01:14:34,504 AM [test-pekko.actor.default-dispatcher-12] [WARN] RaftActorVotingConfigSupport - node1: Leader election timed out - cannot apply operation ChangeServersVotingStatus [serverVotingStatusMap={node1=true}, serversVisited=[]]
01:14:34,504 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=pekko://test/user/node2, votingState=VOTING]]
01:14:34,505 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - node1: tryToForwardOperationToAnotherServer - servers already visited []
01:14:34,505 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - node1: Returning NO_LEADER for operation ChangeServersVotingStatus [serverVotingStatusMap={node1=true}, serversVisited=[]]
01:14:34,505 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeToVotingWithNoLeaderAndElectionTimeout ending
01:14:34,505 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower207]
01:14:34,516 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector208#-1965649468]
01:14:34,517 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/node1]
01:14:34,517 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EnabledRaftStorage - node1: terminating thread VirtualThread[#582,node1-writer-79]/waiting
01:14:34,517 AM [node1-writer-79] [DEBUG] JournalWriteTask - node1: received 1 commands after 141.0 ms
01:14:34,517 AM [node1-writer-79] [DEBUG] JournalWriteTask - node1: completed 1 commands in 78.19 μs
01:14:34,517 AM [node1-writer-79] [DEBUG] JournalWriteTask - node1: journal writer stopped
01:14:34,518 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node1: journal closed
01:14:34,518 AM [test-pekko.actor.default-dispatcher-17] [INFO] EnabledRaftStorage - node1: journal closed
01:14:34,518 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: stopped executor with 0 remaining tasks
01:14:34,518 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: stopped executor with 0 remaining tasks
01:14:34,518 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector209#1464343565]
01:14:34,518 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/node2]
01:14:34,519 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EnabledRaftStorage - node2: terminating thread VirtualThread[#583,node2-writer-80]/waiting
01:14:34,519 AM [node2-writer-80] [DEBUG] JournalWriteTask - node2: received 1 commands after 139.5 ms
01:14:34,519 AM [node2-writer-80] [DEBUG] JournalWriteTask - node2: completed 1 commands in 19.34 μs
01:14:34,519 AM [node2-writer-80] [DEBUG] JournalWriteTask - node2: journal writer stopped
01:14:34,519 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node2: journal closed
01:14:34,519 AM [test-pekko.actor.default-dispatcher-17] [INFO] EnabledRaftStorage - node2: journal closed
01:14:34,519 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: stopped executor with 0 remaining tasks
01:14:34,519 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: stopped executor with 0 remaining tasks
01:14:34,522 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeToVotingWithNoLeader starting
[WARN] [07/12/2025 01:14:34.524] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/node1]: org.opendaylight.controller.cluster.common.actor.Monitor@6a183d7a
01:14:34,525 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - node1: Starting recovery with journal batch size 1000
01:14:34,525 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: started executor
01:14:34,525 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: started executor
01:14:34,526 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node1: metadata journal open: replayFrom=1 applyTo=0
01:14:34,527 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node1: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:34,527 AM [test-pekko.actor.default-dispatcher-17] [INFO] EnabledRaftStorage - node1: journal open: applyTo=0
01:14:34,527 AM [node1-writer-81] [DEBUG] JournalWriteTask - node1: journal writer started
01:14:34,527 AM [node1-writer-81] [DEBUG] JournalWriteTask - node1: waiting to receive commands
[WARN] [07/12/2025 01:14:34.528] [test-pekko.actor.default-dispatcher-12] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/node2]: org.opendaylight.controller.cluster.common.actor.Monitor@73dfeedb
01:14:34,529 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node1/TermInfo.properties does not exist
01:14:34,529 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - node2: Starting recovery with journal batch size 1000
01:14:34,529 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: started executor
01:14:34,529 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node1/journal-v1-1.log
01:14:34,529 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node1/metadata-v1-1.log
01:14:34,529 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: started executor
01:14:34,529 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node1: no eligible files found
01:14:34,529 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=1, votedFor=downNode1
01:14:34,529 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - node1: Received ReplicatedLogEntry for recovery: index: 0, size: 163
01:14:34,529 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PeerInfos - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=NON_VOTING], PeerInfo [id=downNode2, address=null, votingState=VOTING], PeerInfo [id=downNode1, address=null, votingState=VOTING]]
01:14:34,529 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PekkoRecovery - node1: Received apply journal entries for recovery, applying to state: 0 to 0
01:14:34,529 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - node1: Moving last applied index from -1 to 0
01:14:34,529 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node2: metadata journal open: replayFrom=1 applyTo=0
01:14:34,530 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - node1: Recovery completed in 85.92 μs - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1
01:14:34,530 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node2: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:34,530 AM [test-pekko.actor.default-dispatcher-17] [INFO] EnabledRaftStorage - node2: journal open: applyTo=0
01:14:34,530 AM [node2-writer-82] [DEBUG] JournalWriteTask - node2: journal writer started
01:14:34,530 AM [node2-writer-82] [DEBUG] JournalWriteTask - node2: waiting to receive commands
01:14:34,531 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node2/TermInfo.properties does not exist
01:14:34,531 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node2/journal-v1-1.log
01:14:34,531 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node2/metadata-v1-1.log
01:14:34,531 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: no eligible files found
01:14:34,531 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=1, votedFor=downNode2
01:14:34,532 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - node2: Received ReplicatedLogEntry for recovery: index: 0, size: 163
01:14:34,532 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - node2: Updated server config: isVoting: false, peers: [PeerInfo [id=downNode2, address=null, votingState=VOTING], PeerInfo [id=downNode1, address=null, votingState=VOTING], PeerInfo [id=node1, address=null, votingState=NON_VOTING]]
01:14:34,532 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PekkoRecovery - node2: Received apply journal entries for recovery, applying to state: 0 to 0
01:14:34,532 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - node2: Moving last applied index from -1 to 0
01:14:34,532 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - node2: Recovery completed in 60.87 μs - Switching actor to Follower - last log index = 0, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 1
01:14:34,532 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=1, votedFor=downNode1
01:14:34,532 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - node1: Local TermInfo store seeded with TermInfo{term=1, votedFor=downNode1}
01:14:34,532 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - node1: taking snapshot to clear Pekko persistence to 3
01:14:34,532 AM [test-pekko.actor.default-dispatcher-18] [INFO] Recovery - node1: Taking snapshot on entry with index 0
01:14:34,533 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - node1: support() called
01:14:34,533 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node1: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node1/snapshot-000000006871B6FA-1FC581AC.tmp
01:14:34,536 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=1, votedFor=downNode2
01:14:34,536 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - node2: Local TermInfo store seeded with TermInfo{term=1, votedFor=downNode2}
01:14:34,536 AM [test-pekko.actor.default-dispatcher-12] [INFO] PekkoRecovery - node2: taking snapshot to clear Pekko persistence to 3
01:14:34,536 AM [test-pekko.actor.default-dispatcher-12] [INFO] Recovery - node2: Taking snapshot on entry with index 0
01:14:34,536 AM [test-pekko.actor.default-dispatcher-12] [INFO] MockRaftActor - node2: support() called
01:14:34,536 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: starting snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node2/snapshot-000000006871B6FA-1FFA8D01.tmp
01:14:34,537 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node1: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node1/snapshot-000000006871B6FA-1FC581AC.v1
01:14:34,537 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node1: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node1/snapshot-000000006871B6FA-1FC581AC.v1
01:14:34,537 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node1/TermInfo.properties
01:14:34,537 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node1/journal-v1-1.log
01:14:34,537 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node1: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node1/metadata-v1-1.log
01:14:34,537 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - node1: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=0, term=1], timestamp=2025-07-12T01:14:34.533037484Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node1/snapshot-000000006871B6FA-1FC581AC.v1, size=261, entryCompress=NONE, stateCompress=NONE}
01:14:34,537 AM [test-pekko.actor.default-dispatcher-18] [INFO] Recovery - node1: Snapshot completed in 4.875 ms, resetting timer for the next recovery snapshot
01:14:34,537 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - node1: Pekko recovery completed and can restore from snapshot
01:14:34,537 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - node1: starting journal recovery
01:14:34,537 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - node1: Moving last applied index from -1 to 0
01:14:34,538 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - node1: empty journal: appending 0 entries
01:14:34,538 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: finished snapshot writeout to /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node2/snapshot-000000006871B6FA-1FFA8D01.v1
01:14:34,538 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] EntryJournalV1 - node1: updated meta to JournalMeta[replayFrom=1, applyTo=0]
01:14:34,538 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node2/TermInfo.properties
01:14:34,538 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node2/journal-v1-1.log
01:14:34,538 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node2/metadata-v1-1.log
01:14:34,538 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: selected SNAPSHOT_V1 to handle file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node2/snapshot-000000006871B6FA-1FFA8D01.v1
01:14:34,538 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] JournalRecovery - node1: journal recovery completedin 398.8 μs with journalIndex=1
01:14:34,538 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftStorage - node2: retaining snapshot SnapshotFileV1{lastIncluded=EntryInfo[index=0, term=1], timestamp=2025-07-12T01:14:34.536513793Z, file=/tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9415992990819737030/node2/snapshot-000000006871B6FA-1FFA8D01.v1, size=261, entryCompress=NONE, stateCompress=NONE}
01:14:34,538 AM [test-pekko.actor.default-dispatcher-12] [INFO] Recovery - node2: Snapshot completed in 2.131 ms, resetting timer for the next recovery snapshot
01:14:34,538 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - node2: Pekko recovery completed and can restore from snapshot
01:14:34,538 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - node2: starting journal recovery
01:14:34,538 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] AbstractReplicatedLog - node2: Moving last applied index from -1 to 0
01:14:34,538 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - node2: empty journal: appending 0 entries
01:14:34,538 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] EntryJournalV1 - node2: updated meta to JournalMeta[replayFrom=1, applyTo=0]
01:14:34,538 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] JournalRecovery - node2: journal recovery completedin 250.1 μs with journalIndex=1
01:14:34,538 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - node1: ignoring DeleteMessagesSuccess(3)
01:14:34,539 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActor - node2: ignoring DeleteMessagesSuccess(3)
01:14:34,549 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - node1: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={downNode2=false, node2=true, downNode1=false, node1=true}, serversVisited=[]], state: Idle
01:14:34,549 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState
01:14:34,550 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - node1: Sending local ElectionTimeout to start leader election
01:14:34,550 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PeerInfos - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=null, votingState=VOTING], PeerInfo [id=downNode2, address=null, votingState=NON_VOTING], PeerInfo [id=downNode1, address=null, votingState=NON_VOTING]]
01:14:34,550 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] DefaultConfigParamsImpl - No custom RaftPolicy specified. Using DefaultRaftPolicy
01:14:34,550 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - node1 (Follower): Received TimeoutNow - switching to Candidate
01:14:34,550 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - node1 (Candidate): Election: Candidate has following voting peers: [node2]
01:14:34,552 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=2, votedFor=node1
01:14:34,552 AM [test-pekko.actor.default-dispatcher-17] [INFO] Candidate - node1 (Candidate): Starting new election term 2
01:14:34,552 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - node1 (Follower) :- Switching from behavior Follower to Candidate, election term: 2
01:14:35,65 AM [test-pekko.actor.default-dispatcher-12] [WARN] RaftActorVotingConfigSupport - node1: Leader election timed out - cannot apply operation ChangeServersVotingStatus [serverVotingStatusMap={downNode2=false, node2=true, downNode1=false, node1=true}, serversVisited=[]]
01:14:35,66 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] PeerInfos - node1: Updated server config: isVoting: false, peers: [PeerInfo [id=node2, address=null, votingState=NON_VOTING], PeerInfo [id=downNode2, address=null, votingState=VOTING], PeerInfo [id=downNode1, address=null, votingState=VOTING]]
01:14:35,66 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - node1: tryToForwardOperationToAnotherServer - servers already visited []
01:14:35,66 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] RaftActorVotingConfigSupport - node1: Returning NO_LEADER for operation ChangeServersVotingStatus [serverVotingStatusMap={downNode2=false, node2=true, downNode1=false, node1=true}, serversVisited=[]]
01:14:35,68 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] SyncStatusTracker - node1: Last sync leader does not match current leader downNode1, need to catch up to 0
[WARN] [07/12/2025 01:14:35.068] [test-pekko.actor.default-dispatcher-18] [pekko://test/deadLetters] received dead letter from TestActor[pekko://test/user/node1]: AppendEntriesReply{term=2, success=true, followerId=node1, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
[WARN] [07/12/2025 01:14:35.068] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/node1] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=node1, initialSyncDone=false]
01:14:35,625 AM [main] [INFO] PeerInfos - node1: Peer address for peer node2 set to pekko://test/user/node2
01:14:35,625 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - node1: onChangeServersVotingStatus: ChangeServersVotingStatus [serverVotingStatusMap={downNode2=false, node2=true, downNode1=false, node1=true}, serversVisited=[]], state: Idle
01:14:35,625 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - Initiating ChangeServersVotingStatusState
01:14:35,625 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - node1: Sending local ElectionTimeout to start leader election
01:14:35,626 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PeerInfos - node1: Updated server config: isVoting: true, peers: [PeerInfo [id=node2, address=pekko://test/user/node2, votingState=VOTING], PeerInfo [id=downNode2, address=null, votingState=NON_VOTING], PeerInfo [id=downNode1, address=null, votingState=NON_VOTING]]
01:14:35,626 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Follower - node1 (Follower): Received TimeoutNow - switching to Candidate
01:14:35,626 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - node1 (Candidate): Election: Candidate has following voting peers: [node2]
01:14:35,629 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] PropertiesTermInfoStore - node1: Set currentTerm=3, votedFor=node1
01:14:35,629 AM [test-pekko.actor.default-dispatcher-17] [INFO] Candidate - node1 (Candidate): Starting new election term 3
01:14:35,629 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - node1 (Candidate): Sending RequestVote{term=3, candidateId=node1, lastLogIndex=0, lastLogTerm=1} to peer node2
01:14:35,629 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - node1 (Follower) :- Switching from behavior Follower to Candidate, election term: 3
01:14:35,629 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - node2 (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term.
01:14:35,629 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - node2 (Follower): Cluster state: []
01:14:35,629 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - node2 (Follower): Candidate in requestVote:RequestVote{term=3, candidateId=node1, lastLogIndex=0, lastLogTerm=1} with higher term appears reachable, updating term.
01:14:35,629 AM [test-pekko.actor.default-dispatcher-18] [INFO] Follower - node2 (Follower): Term 3 in "RequestVote{term=3, candidateId=node1, lastLogIndex=0, lastLogTerm=1}" message is greater than follower's term 1 - updating term
01:14:35,632 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=3, votedFor=null
01:14:35,632 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - node2 (Follower): In requestVote: RequestVote{term=3, candidateId=node1, lastLogIndex=0, lastLogTerm=1} - currentTerm: 3, votedFor: null, lastIndex: 0, lastTerm: 1
01:14:35,635 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - node2: Set currentTerm=3, votedFor=node1
01:14:35,635 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - node2 (Follower): requestVote returning: RequestVoteReply{term=3, voteGranted=true}
01:14:35,635 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - node1 (Candidate): RaftRPC message received RequestVoteReply{term=3, voteGranted=true}, my term is 3
01:14:35,635 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] Candidate - node1 (Candidate): handleRequestVoteReply: RequestVoteReply{term=3, voteGranted=true}, current voteCount: 1
01:14:35,636 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - node1 (Leader): Election: Leader has following peers: [node2, downNode2, downNode1]
01:14:35,636 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - node1 (Leader): Checking sendAppendEntries for follower node2: active: false, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: 0
01:14:35,636 AM [test-pekko.actor.default-dispatcher-12] [DEBUG] SyncStatusTracker - node2: Last sync leader does not match current leader node1, need to catch up to -1
01:14:35,636 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActorBehavior - node1 (Candidate) :- Switching from behavior Candidate to Leader, election term: 3
01:14:35,636 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - node1: New leader node1 elected
01:14:35,636 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - node1: New server configuration : [ServerInfo[peerId=node2, isVoting=true], ServerInfo[peerId=downNode2, isVoting=false], ServerInfo[peerId=downNode1, isVoting=false], ServerInfo[peerId=node1, isVoting=true]]
[WARN] [07/12/2025 01:14:35.636] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/node2] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=node2, initialSyncDone=false]
01:14:35,636 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActor - node1: Persist data index=1 term=3 command=VotingConfig{serverInfo=[ServerInfo[peerId=node2, isVoting=true], ServerInfo[peerId=downNode2, isVoting=false], ServerInfo[peerId=downNode1, isVoting=false], ServerInfo[peerId=node1, isVoting=true]]}
01:14:35,636 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] ReplicatedLogImpl - node1: Append log entry and persist JournaledLogEntry{index=1, term=3, command=VotingConfig{serverInfo=[ServerInfo[peerId=node2, isVoting=true], ServerInfo[peerId=downNode2, isVoting=false], ServerInfo[peerId=downNode1, isVoting=false], ServerInfo[peerId=node1, isVoting=true]]}, pending=true} 
01:14:35,637 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - node1 (Leader): Replicate message: identifier: ServerOperationContextIdentifier{value=4c147f2f-00a8-43f4-adb7-055ab48a540c}, logIndex: 1, isSendImmediate: true
01:14:35,637 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - node1 (Leader): Checking sendAppendEntries for follower node2: active: false, followerNextIndex: 0, leaderLastIndex: 1, leaderSnapShotIndex: 0
01:14:35,637 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - node1: Returning OK for operation ChangeServersVotingStatus [serverVotingStatusMap={downNode2=false, node2=true, downNode1=false, node1=true}, serversVisited=[]]
01:14:35,637 AM [node1-writer-81] [DEBUG] JournalWriteTask - node1: received 1 commands after 1.110 s
01:14:35,637 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - node1 (Leader): handleAppendEntriesReply - FollowerLogInformation for node2 updated: matchIndex: 0, nextIndex: 1
01:14:35,637 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - node1 (Leader): Checking sendAppendEntries for follower node2: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: 0
01:14:35,637 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - node1 (Leader): sendAppendEntries: 1 is present for follower node2
01:14:35,637 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] AbstractLeader - node1 (Leader): Sending AppendEntries to follower node2: AppendEntries{term=3, leaderId=node1, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=3, command=VotingConfig{serverInfo=[ServerInfo[peerId=node2, isVoting=true], ServerInfo[peerId=downNode2, isVoting=false], ServerInfo[peerId=downNode1, isVoting=false], ServerInfo[peerId=node1, isVoting=true]]}, pending=true}]}
01:14:35,638 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - node2: Lagging -1 entries behind leader node1 and reached 0 (of expected -1)
01:14:35,638 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - node2 (Follower): handleAppendEntries: AppendEntries{term=3, leaderId=node1, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=5, leaderRaftVersion=5, entries==[JournaledLogEntry{index=1, term=3, command=VotingConfig{serverInfo=[ServerInfo[peerId=node2, isVoting=true], ServerInfo[peerId=downNode2, isVoting=false], ServerInfo[peerId=downNode1, isVoting=false], ServerInfo[peerId=node1, isVoting=true]]}, pending=true}]}
01:14:35,638 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - node2 (Follower): Number of entries to be appended = 1
01:14:35,638 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - node2 (Follower): After cleanup, lastIndex: 0, entries to be added from: 0
01:14:35,638 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - node1 (Leader): sendAppendEntries: 1 is present for follower node2
01:14:35,638 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - node2 (Follower): Append entry to log VotingConfig{serverInfo=[ServerInfo[peerId=node2, isVoting=true], ServerInfo[peerId=downNode2, isVoting=false], ServerInfo[peerId=downNode1, isVoting=false], ServerInfo[peerId=node1, isVoting=true]]}
01:14:35,638 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - node2: Append log entry and persist JournaledLogEntry{index=1, term=3, command=VotingConfig{serverInfo=[ServerInfo[peerId=node2, isVoting=true], ServerInfo[peerId=downNode2, isVoting=false], ServerInfo[peerId=downNode1, isVoting=false], ServerInfo[peerId=node1, isVoting=true]]}, pending=true} 
01:14:35,638 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PeerInfos - node2: Updated server config: isVoting: true, peers: [PeerInfo [id=downNode2, address=null, votingState=NON_VOTING], PeerInfo [id=downNode1, address=null, votingState=NON_VOTING], PeerInfo [id=node1, address=null, votingState=VOTING]]
01:14:35,638 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - node2 (Follower): Log size is now 1
01:14:35,638 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - node2 (Follower): handleAppendEntries returning : AppendEntriesReply{term=3, success=true, followerId=node2, logLastIndex=1, logLastTerm=3, forceInstallSnapshot=false, needsLeaderAddress=true, payloadVersion=5, raftVersion=5, recipientRaftVersion=5}
01:14:35,638 AM [node2-writer-82] [DEBUG] JournalWriteTask - node2: received 1 commands after 1.109 s
01:14:35,639 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - node2: Lagging 0 entries behind leader node1 and reached 0 (of expected -1)
01:14:35,639 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - node2: awaiting more completions to resolve 1 synchronized callback(s)
01:14:35,639 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - node1 (Leader): handleAppendEntriesReply - FollowerLogInformation for node2 updated: matchIndex: 1, nextIndex: 2
01:14:35,639 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - node1 (Leader): Checking sendAppendEntries for follower node2: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: 0
01:14:35,642 AM [node1-writer-81] [DEBUG] RaftStorageCompleter - node1: 1 completion(s) pending
01:14:35,642 AM [node1-writer-81] [DEBUG] JournalWriteTask - node1: completed 1 commands in 5.305 ms
01:14:35,642 AM [node1-writer-81] [DEBUG] JournalWriteTask - node1: waiting to receive commands
01:14:35,642 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - node1: running 1 completion(s)
01:14:35,642 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] ReplicatedLogImpl - node1: persist complete JournaledLogEntry{index=1, term=3, command=VotingConfig{serverInfo=[ServerInfo[peerId=node2, isVoting=true], ServerInfo[peerId=downNode2, isVoting=false], ServerInfo[peerId=downNode1, isVoting=false], ServerInfo[peerId=node1, isVoting=true]]}, pending=true}
01:14:35,643 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractLeader - node1 (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0
01:14:35,643 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActorBehavior - node1 (Leader): Setting last applied to 1
01:14:35,643 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] AbstractReplicatedLog - node1: Moving last applied index from 0 to 1
01:14:35,643 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftActor - node1: Applying state for log index 1 data VotingConfig{serverInfo=[ServerInfo[peerId=node2, isVoting=true], ServerInfo[peerId=downNode2, isVoting=false], ServerInfo[peerId=downNode1, isVoting=false], ServerInfo[peerId=node1, isVoting=true]]}
01:14:35,643 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActorVotingConfigSupport - node1: VotingConfig{serverInfo=[ServerInfo[peerId=node2, isVoting=true], ServerInfo[peerId=downNode2, isVoting=false], ServerInfo[peerId=downNode1, isVoting=false], ServerInfo[peerId=node1, isVoting=true]]} has been successfully replicated to a majority of followers
01:14:35,643 AM [node1-writer-81] [DEBUG] JournalWriteTask - node1: received 1 commands after 565.0 μs
01:14:35,643 AM [node1-writer-81] [DEBUG] EntryJournalV1 - node1: updated meta to JournalMeta[replayFrom=1, applyTo=1]
01:14:35,643 AM [node1-writer-81] [DEBUG] RaftStorageCompleter - node1: 1 completion(s) pending
01:14:35,643 AM [node1-writer-81] [DEBUG] JournalWriteTask - node1: completed 1 commands in 292.3 μs
01:14:35,643 AM [node1-writer-81] [DEBUG] JournalWriteTask - node1: waiting to receive commands
01:14:35,643 AM [node2-writer-82] [DEBUG] RaftStorageCompleter - node2: 1 completion(s) pending
01:14:35,643 AM [node2-writer-82] [DEBUG] JournalWriteTask - node2: completed 1 commands in 4.774 ms
01:14:35,643 AM [node2-writer-82] [DEBUG] JournalWriteTask - node2: waiting to receive commands
01:14:35,643 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - node2: running 1 completion(s)
01:14:35,643 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorageCompleter - node1: running 1 completion(s)
01:14:35,643 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] ReplicatedLogImpl - node2: persist complete JournaledLogEntry{index=1, term=3, command=VotingConfig{serverInfo=[ServerInfo[peerId=node2, isVoting=true], ServerInfo[peerId=downNode2, isVoting=false], ServerInfo[peerId=downNode1, isVoting=false], ServerInfo[peerId=node1, isVoting=true]]}, pending=false}
01:14:35,644 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - node2: completed synchronized callback AppendReceivedCallback{entry=JournaledLogEntry{index=1, term=3, command=VotingConfig{serverInfo=[ServerInfo[peerId=node2, isVoting=true], ServerInfo[peerId=downNode2, isVoting=false], ServerInfo[peerId=downNode1, isVoting=false], ServerInfo[peerId=node1, isVoting=true]]}, pending=false}, callback=org.opendaylight.controller.cluster.raft.behaviors.Follower$$Lambda/0x00000007c0896ae8@160f4c39}
01:14:35,644 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorageCompleter - node2: synchronized callbacks after 4.984 ms
[WARN] [07/12/2025 01:14:35.644] [test-pekko.actor.default-dispatcher-16] [pekko://test/user/node2] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=node2, initialSyncDone=true]
01:14:35,755 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - node2 (Follower): Commit index set to 1
01:14:35,755 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SyncStatusTracker - node2: Lagging 0 entries behind leader node1 and reached 1 (of expected -1)
01:14:35,755 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] Follower - node2 (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1
01:14:35,756 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorBehavior - node2 (Follower): Setting last applied to 1
01:14:35,756 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - node2: Moving last applied index from 0 to 1
01:14:35,756 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - node2: Applying state for log index 1 data VotingConfig{serverInfo=[ServerInfo[peerId=node2, isVoting=true], ServerInfo[peerId=downNode2, isVoting=false], ServerInfo[peerId=downNode1, isVoting=false], ServerInfo[peerId=node1, isVoting=true]]}
01:14:35,756 AM [node2-writer-82] [DEBUG] JournalWriteTask - node2: received 1 commands after 112.4 ms
01:14:35,756 AM [node2-writer-82] [DEBUG] EntryJournalV1 - node2: updated meta to JournalMeta[replayFrom=1, applyTo=1]
01:14:35,756 AM [node2-writer-82] [DEBUG] RaftStorageCompleter - node2: 1 completion(s) pending
01:14:35,756 AM [node2-writer-82] [DEBUG] JournalWriteTask - node2: completed 1 commands in 362.2 μs
01:14:35,756 AM [node2-writer-82] [DEBUG] JournalWriteTask - node2: waiting to receive commands
01:14:35,756 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorageCompleter - node2: running 1 completion(s)
01:14:35,841 AM [main] [INFO] RaftActorVotingConfigSupportTest - testChangeToVotingWithNoLeader ending
01:14:35,841 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower210]
01:14:35,852 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector211#1257053636]
01:14:35,852 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/node1]
01:14:35,852 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EnabledRaftStorage - node1: terminating thread VirtualThread[#584,node1-writer-81]/waiting
01:14:35,853 AM [node1-writer-81] [DEBUG] JournalWriteTask - node1: received 1 commands after 209.4 ms
01:14:35,853 AM [node1-writer-81] [DEBUG] JournalWriteTask - node1: completed 1 commands in 31.31 μs
01:14:35,853 AM [node1-writer-81] [DEBUG] JournalWriteTask - node1: journal writer stopped
01:14:35,853 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node1: journal closed
01:14:35,853 AM [test-pekko.actor.default-dispatcher-17] [INFO] EnabledRaftStorage - node1: journal closed
01:14:35,853 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: stopped executor with 0 remaining tasks
01:14:35,853 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node1: stopped executor with 0 remaining tasks
01:14:35,853 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/collector212#-558655335]
01:14:35,854 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/node2]
01:14:35,854 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EnabledRaftStorage - node2: terminating thread VirtualThread[#585,node2-writer-82]/waiting
01:14:35,854 AM [node2-writer-82] [DEBUG] JournalWriteTask - node2: received 1 commands after 97.84 ms
01:14:35,854 AM [node2-writer-82] [DEBUG] JournalWriteTask - node2: completed 1 commands in 18.02 μs
01:14:35,854 AM [node2-writer-82] [DEBUG] JournalWriteTask - node2: journal writer stopped
01:14:35,854 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - node2: journal closed
01:14:35,854 AM [test-pekko.actor.default-dispatcher-17] [INFO] EnabledRaftStorage - node2: journal closed
01:14:35,855 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: stopped executor with 0 remaining tasks
01:14:35,855 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - node2: stopped executor with 0 remaining tasks
01:14:35,857 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithPriorSnapshotCompleteTimeout starting
[WARN] [07/12/2025 01:14:35.859] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/new-server215]: org.opendaylight.controller.cluster.common.actor.Monitor@2049e150
01:14:35,860 AM [test-pekko.actor.default-dispatcher-17] [INFO] RaftActor - new-server: Starting recovery with journal batch size 1000
01:14:35,860 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - new-server: started executor
01:14:35,860 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - new-server: started executor
01:14:35,861 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - new-server: metadata journal open: replayFrom=1 applyTo=0
01:14:35,861 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - new-server: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:35,861 AM [test-pekko.actor.default-dispatcher-17] [INFO] EnabledRaftStorage - new-server: journal open: applyTo=0
01:14:35,861 AM [new-server-writer-83] [DEBUG] JournalWriteTask - new-server: journal writer started
01:14:35,861 AM [new-server-writer-83] [DEBUG] JournalWriteTask - new-server: waiting to receive commands
01:14:35,863 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9093885615312771444/new-server/TermInfo.properties does not exist
01:14:35,863 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9093885615312771444/new-server/journal-v1-1.log
01:14:35,863 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - new-server: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9093885615312771444/new-server/metadata-v1-1.log
01:14:35,863 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - new-server: no eligible files found
01:14:35,863 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - new-server: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:35,866 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=0, votedFor=null
01:14:35,866 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - new-server: Local TermInfo store seeded with TermInfo{term=0}
01:14:35,866 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - new-server: Pekko recovery completed and can restore from snapshot
01:14:35,866 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - new-server: no journal: skipping journal recovery
01:14:35,866 AM [test-pekko.actor.default-dispatcher-18] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
[WARN] [07/12/2025 01:14:35.867] [test-pekko.actor.default-dispatcher-18] [pekko://test/user/termination-monitor] received dead letter from TestActor[pekko://test/user/leader216]: org.opendaylight.controller.cluster.common.actor.Monitor@6e04a38d
01:14:35,867 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:35,868 AM [test-pekko.actor.default-dispatcher-16] [INFO] RaftActor - leader: Starting recovery with journal batch size 1000
01:14:35,868 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: started executor
01:14:35,868 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] RaftStorage - leader: started executor
01:14:35,868 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader: metadata journal open: replayFrom=1 applyTo=0
01:14:35,869 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] EntryJournalV1 - leader: journal open: firstIndex=1 lastIndex=0 replayFrom=1 fileEntries=0
01:14:35,869 AM [test-pekko.actor.default-dispatcher-16] [INFO] EnabledRaftStorage - leader: journal open: applyTo=0
01:14:35,869 AM [leader-writer-84] [DEBUG] JournalWriteTask - leader: journal writer started
01:14:35,869 AM [leader-writer-84] [DEBUG] JournalWriteTask - leader: waiting to receive commands
01:14:35,871 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9093885615312771444/leader/TermInfo.properties does not exist
01:14:35,871 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9093885615312771444/leader/journal-v1-1.log
01:14:35,871 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: skipping unrecognized file /tmp/org.opendaylight.controller.cluster.raft.RaftActorVotingConfigSupportTest9093885615312771444/leader/metadata-v1-1.log
01:14:35,871 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftStorage - leader: no eligible files found
01:14:35,871 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:14:35,874 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] PropertiesTermInfoStore - leader: Set currentTerm=1, votedFor=
01:14:35,874 AM [test-pekko.actor.default-dispatcher-18] [INFO] PekkoRecovery - leader: Local TermInfo store seeded with TermInfo{term=1, votedFor=}
01:14:35,874 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader: Pekko recovery completed and can restore from snapshot
01:14:35,874 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader: no journal: skipping journal recovery
01:14:35,874 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): Election: Leader has following peers: []
01:14:35,874 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActor - leader: Take a snapshot of current state. lastReplicatedLog is null and replicatedToAllIndex is -1
01:14:35,874 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractReplicatedLog - leader: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
01:14:35,874 AM [test-pekko.actor.default-dispatcher-18] [INFO] SnapshotManager - leader: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true]
01:14:35,874 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - leader: captured snapshot at lastSequenceNumber: 0
01:14:35,874 AM [test-pekko.actor.default-dispatcher-18] [INFO] SnapshotManager - leader: Persising snapshot at EntryInfo[index=-1, term=-1]/EntryInfo[index=-1, term=-1]
01:14:35,875 AM [test-pekko.actor.default-dispatcher-18] [INFO] MockRaftActor - leader: support() called
01:14:35,875 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - leader: user triggered or root overwrite snapshot encountered, trimming log up to last applied index -1
01:14:35,875 AM [test-pekko.actor.default-dispatcher-18] [INFO] SnapshotManager - leader: Removed in-memory snapshotted entries, adjusted snapshotIndex: -1 and term: -1
01:14:35,881 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorVotingConfigSupport - leader: onAddServer: AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server215, votingMember=true], state: Idle
01:14:35,882 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorVotingConfigSupport - leader: Initiating AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server215, votingMember=true]
01:14:35,882 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] SnapshotManager - leader: captureToInstall should not be called in state PersistCapture[lastJournalIndex=0, request=CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true]]
01:14:35,882 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] RaftActorVotingConfigSupport - leader: Snapshot already in progress - waiting for completion
01:14:35,995 AM [test-pekko.actor.default-dispatcher-16] [INFO] Follower - new-server (Follower): Term 1 in "AppendEntries{term=1, leaderId=leader, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=5, recipientRaftVersion=4, leaderRaftVersion=5, entries==[]}" message is greater than follower's term 0 - updating term
01:14:35,999 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] PropertiesTermInfoStore - new-server: Set currentTerm=1, votedFor=null
01:14:35,999 AM [test-pekko.actor.default-dispatcher-16] [DEBUG] SyncStatusTracker - new-server: Last sync leader does not match current leader leader, need to catch up to -1
01:14:35,999 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): handleAppendEntriesReply - FollowerLogInformation for new-server updated: matchIndex: -1, nextIndex: 0
01:14:35,999 AM [test-pekko.actor.default-dispatcher-18] [DEBUG] AbstractLeader - leader (Leader): Checking sendAppendEntries for follower new-server: active: false, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1
[WARN] [07/12/2025 01:14:35.999] [test-pekko.actor.default-dispatcher-17] [pekko://test/user/new-server215] unhandled message from Actor[pekko://test/deadLetters]: FollowerInitialSyncUpStatus[memberId=new-server, initialSyncDone=false]
01:14:36,95 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: handleInstallSnapshotTimeout for new server new-server
01:14:36,95 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftActorVotingConfigSupport - leader: Returning TIMEOUT for operation AddServer [newServerId=new-server, newServerAddress=pekko://test/user/new-server215, votingMember=true]
01:14:36,96 AM [test-pekko.actor.default-dispatcher-17] [WARN] RaftActorVotingConfigSupport - leader: Timeout occured for new server new-server while waiting for prior snapshot to complete
01:14:36,96 AM [main] [INFO] RaftActorVotingConfigSupportTest - testAddServerWithPriorSnapshotCompleteTimeout ending
01:14:36,97 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/follower213]
01:14:36,108 AM [main] [INFO] TestActorFactory - Killing actor Actor[pekko://test/user/new-serverCollector214#-621850877]
01:14:36,108 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/new-server215]
01:14:36,108 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EnabledRaftStorage - new-server: terminating thread VirtualThread[#588,new-server-writer-83]/waiting
01:14:36,109 AM [new-server-writer-83] [DEBUG] JournalWriteTask - new-server: received 1 commands after 247.2 ms
01:14:36,109 AM [new-server-writer-83] [DEBUG] JournalWriteTask - new-server: completed 1 commands in 46.34 μs
01:14:36,109 AM [new-server-writer-83] [DEBUG] JournalWriteTask - new-server: journal writer stopped
01:14:36,109 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - new-server: journal closed
01:14:36,109 AM [test-pekko.actor.default-dispatcher-17] [INFO] EnabledRaftStorage - new-server: journal closed
01:14:36,109 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:36,109 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - new-server: stopped executor with 0 remaining tasks
01:14:36,109 AM [main] [INFO] TestActorFactory - Killing actor TestActor[pekko://test/user/leader216]
01:14:36,110 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EnabledRaftStorage - leader: terminating thread VirtualThread[#589,leader-writer-84]/waiting
01:14:36,110 AM [leader-writer-84] [DEBUG] JournalWriteTask - leader: received 1 commands after 240.7 ms
01:14:36,110 AM [leader-writer-84] [DEBUG] JournalWriteTask - leader: completed 1 commands in 19.25 μs
01:14:36,110 AM [leader-writer-84] [DEBUG] JournalWriteTask - leader: journal writer stopped
01:14:36,110 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] EntryJournalV1 - leader: journal closed
01:14:36,110 AM [test-pekko.actor.default-dispatcher-17] [INFO] EnabledRaftStorage - leader: journal closed
01:14:36,110 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:36,110 AM [test-pekko.actor.default-dispatcher-17] [DEBUG] RaftStorage - leader: stopped executor with 0 remaining tasks
01:14:36,112 AM [test-pekko.actor.default-dispatcher-18] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
[INFO] [07/12/2025 01:14:36.112] [main] [CoordinatedShutdown(pekko://test)] Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
[WARN] [07/12/2025 01:14:36.113] [test-pekko.actor.default-dispatcher-17] [pekko://test/system/cluster/core/daemon] unhandled message from Actor[pekko://test/deadLetters]: Leave(pekko://test@10.30.170.124:17355)
[INFO] [07/12/2025 01:14:36.114] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.124:17355] - Exiting completed
[INFO] [07/12/2025 01:14:36.114] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.124:17355] - Shutting down...
[INFO] [07/12/2025 01:14:36.114] [test-pekko.actor.internal-dispatcher-3] [Cluster(pekko://test)] Cluster Node [pekko://test@10.30.170.124:17355] - Successfully shut down
01:14:36,115 AM [test-pekko.actor.default-dispatcher-17] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.124:17355] - Exiting completed
01:14:36,115 AM [test-pekko.actor.default-dispatcher-17] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.124:17355] - Shutting down...
01:14:36,115 AM [test-pekko.actor.default-dispatcher-17] [INFO] Cluster - Cluster Node [pekko://test@10.30.170.124:17355] - Successfully shut down
[INFO] [07/12/2025 01:14:36.116] [test-pekko.remote.default-remote-dispatcher-8] [pekko://test@10.30.170.124:17355/system/remoting-terminator] Shutting down remote daemon.
[INFO] [07/12/2025 01:14:36.116] [test-pekko.remote.default-remote-dispatcher-8] [pekko://test@10.30.170.124:17355/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports.
01:14:36,116 AM [test-pekko.actor.default-dispatcher-18] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
01:14:36,116 AM [test-pekko.actor.default-dispatcher-18] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
01:14:36,118 AM [test-pekko.actor.default-dispatcher-17] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[INFO] [07/12/2025 01:14:36.118] [test-pekko.remote.default-remote-dispatcher-8] [pekko://test@10.30.170.124:17355/system/remoting-terminator] Remoting shut down.